2024-09-22T08:06:58.936 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T08:06:58.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:06:59.055 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043 branch: wip-skoduri-cloud-restore description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7915043' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-cloud-restore ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 8852379c050c686f4605f33f0129009b2029ca9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8852379c050c686f4605f33f0129009b2029ca9d rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-cloud-restore sha1: 8852379c050c686f4605f33f0129009b2029ca9d owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 8852379c050c686f4605f33f0129009b2029ca9d sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-cloud-restore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8852379c050c686f4605f33f0129009b2029ca9d targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBqZTeK8XsKizjuHExm58Y+CUCxfxv4AeYdpfAkBcCpsFZ7p6BYyA/s6NKaOOD5Y9KXZ1O9irVtMClKrZ420BY= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbOC1WmNcg12H8hW7ZcfY4IUU9ax2ar00OMmlthTNpBvuCmuUqC74EBMrakuq0yp2SNI6bR3HRO2NCss4023a8= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-22_06:37:27 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T08:06:59.055 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa; will attempt to use it 2024-09-22T08:06:59.056 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa/tasks 2024-09-22T08:06:59.056 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T08:06:59.058 INFO:teuthology.task.internal:Checking packages... 2024-09-22T08:06:59.079 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8852379c050c686f4605f33f0129009b2029ca9d' 2024-09-22T08:06:59.090 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T08:06:59.094 INFO:teuthology.packaging:ref: None 2024-09-22T08:06:59.094 INFO:teuthology.packaging:tag: None 2024-09-22T08:06:59.094 INFO:teuthology.packaging:branch: wip-skoduri-cloud-restore 2024-09-22T08:06:59.094 INFO:teuthology.packaging:sha1: 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:06:59.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-cloud-restore 2024-09-22T08:06:59.244 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5106.g8852379c 2024-09-22T08:06:59.245 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T08:06:59.252 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T08:06:59.252 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T08:06:59.257 INFO:teuthology.task.internal:Saving configuration 2024-09-22T08:06:59.281 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T08:06:59.288 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T08:06:59.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:01:59.392261', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBqZTeK8XsKizjuHExm58Y+CUCxfxv4AeYdpfAkBcCpsFZ7p6BYyA/s6NKaOOD5Y9KXZ1O9irVtMClKrZ420BY='} 2024-09-22T08:06:59.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:01:59.393976', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbOC1WmNcg12H8hW7ZcfY4IUU9ax2ar00OMmlthTNpBvuCmuUqC74EBMrakuq0yp2SNI6bR3HRO2NCss4023a8='} 2024-09-22T08:06:59.337 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T08:06:59.344 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T08:06:59.345 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T08:06:59.345 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T08:06:59.406 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59d2fdf640>, signals=[15]) 2024-09-22T08:06:59.406 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T08:06:59.414 INFO:teuthology.task.internal:Opening connections... 2024-09-22T08:06:59.414 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:06:59.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:06:59.506 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:06:59.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:06:59.580 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T08:06:59.587 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-22T08:06:59.606 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-22T08:06:59.606 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:06:59.663 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:06:59.664 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:06:59.664 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-22T08:06:59.689 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-22T08:06:59.707 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-22T08:06:59.708 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:06:59.765 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:06:59.766 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:06:59.766 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:06:59.766 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:06:59.766 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:06:59.766 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-22T08:06:59.789 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T08:06:59.805 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T08:06:59.809 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T08:06:59.809 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:06:59.812 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:06:59.828 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T08:06:59.842 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T08:06:59.843 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:06:59.870 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:06:59.906 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T08:06:59.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T08:06:59.971 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-22T08:06:59.971 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-22T08:06:59.971 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:06:59.972 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:06:59.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:06:59.988 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-22T08:06:59.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:06:59.989 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-22T08:07:00.045 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:07:00.045 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-503.el9.x86_64 2024-09-22T08:07:00.045 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-09-22T08:07:00.048 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:07:00.048 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-22T08:07:00.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-22T08:07:04.267 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-22T08:07:04.925 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-22T08:07:06.784 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-22T08:07:09.268 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-22T08:07:11.043 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-22T08:07:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-22T08:07:13.607 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-22T08:07:13.652 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-22T08:07:15.136 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-22T08:07:16.082 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-22T08:07:18.963 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T08:07:20.869 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:07:20.869 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:07:20.948 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-22T08:07:20.958 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-22T08:07:20.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:07:20.960 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-22T08:07:20.960 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-22T08:07:20.960 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-22T08:07:21.274 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 123 kB/s | 36 kB 00:00 2024-09-22T08:07:21.487 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-22T08:07:23.335 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:07:23.335 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:07:23.429 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-22T08:07:23.436 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-22T08:07:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-09-22T08:07:23.437 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:07:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 79 M 2024-09-22T08:07:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 126 M 2024-09-22T08:07:23.437 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-22T08:07:23.489 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-22T08:07:23.564 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 452 kB/s | 36 kB 00:00 2024-09-22T08:07:23.973 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-22T08:07:24.372 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-22T08:07:24.515 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.8 MB/s | 29 MB 00:03 2024-09-22T08:07:24.515 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:07:24.515 INFO:teuthology.orchestra.run.smithi078.stdout:Total 22 MB/s | 79 MB 00:03 2024-09-22T08:07:25.064 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-22T08:07:25.193 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-22T08:07:25.465 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:01 2024-09-22T08:07:25.465 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:07:25.465 INFO:teuthology.orchestra.run.smithi171.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-22T08:07:25.563 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-22T08:07:25.563 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-22T08:07:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-22T08:07:26.499 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-22T08:07:26.499 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-22T08:07:26.540 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-22T08:07:26.540 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-22T08:07:27.465 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-22T08:07:27.465 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-22T08:07:28.966 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-22T08:07:29.681 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:07:29.758 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:07:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-22T08:07:30.553 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:07:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:07:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:07:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:07:33.419 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:07:33.542 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:07:37.449 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:07:37.487 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:07:38.373 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:07:38.409 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:07:42.350 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:07:43.272 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:20.525 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:20.565 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:20.953 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:20.953 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:08:20.953 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:08:20.953 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:08:21.712 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:21.764 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:21.835 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:21.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:08:21.835 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:08:21.836 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-22T08:08:22.131 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:22.132 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:08:22.132 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:08:22.132 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:08:22.182 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:08:22.262 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:22.262 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:08:22.262 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:08:22.262 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:08:22.263 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:08:22.263 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T08:08:22.263 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:08:22.263 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:08:22.321 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:22.322 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:08:22.322 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-22T08:08:22.353 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:08:22.354 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:08:22.355 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:08:22.356 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:08:22.356 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:08:22.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.020 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:08:23.021 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-22T08:08:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-22T08:08:23.369 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:08:23.449 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.449 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:08:23.450 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:08:23.450 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:08:23.450 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:08:23.450 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-22T08:08:23.450 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:08:23.450 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:08:23.508 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:08:23.509 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:08:23.509 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-09-22T08:08:23.548 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 82.el9 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8274670 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-09-22T08:08:23.549 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:08:23.550 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:08:23.551 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:08:23.551 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:08:23.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:08:24.237 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-09-22T08:08:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:08:24.364 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-22T08:08:24.366 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-22T08:08:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.frgRSpF6xB 2024-09-22T08:08:24.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.frgRSpF6xB 2024-09-22T08:08:24.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.frgRSpF6xB 2024-09-22T08:08:24.593 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.frgRSpF6xB is 6KB 2024-09-22T08:08:24.614 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.frgRSpF6xB 2024-09-22T08:08:24.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:08:24.692 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:08:24.692 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:08:24.692 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:08:24.692 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:08:24.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:08:24.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-22T08:08:25.545 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:08:25.581 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-09-22T08:08:25.584 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-22T08:08:25.599 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.UCddnAF95n 2024-09-22T08:08:25.599 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UCddnAF95n 2024-09-22T08:08:25.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.UCddnAF95n 2024-09-22T08:08:25.802 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.UCddnAF95n is 6KB 2024-09-22T08:08:25.849 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.UCddnAF95n 2024-09-22T08:08:25.864 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:08:25.928 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:08:25.928 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:08:25.928 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:08:25.928 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:08:25.929 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:08:26.091 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-09-22T08:08:54.882 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T08:08:54.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:08:54.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:08:56.095 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-22T08:08:56.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:08:56.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:09:13.199 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-22T08:09:14.479 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-22T08:09:22.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:09:22.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:09:23.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:09:23.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:09:25.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-22T08:09:26.542 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-22T08:09:37.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:09:37.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:09:38.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:09:38.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:09:56.977 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-22T08:10:09.014 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-22T08:10:09.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:10:09.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:10:09.435 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-22T08:10:09.449 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:10:09.450 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:10:09.450 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:10:09.450 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:10:10.451 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T08:10:10.451 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:10:10.538 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-22T08:10:10.562 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:11.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:10:11.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:10:12.295 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-22T08:10:12.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:10:12.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:10:12.667 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-22T08:10:12.681 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:10:12.681 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:10:12.681 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:10:12.681 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:10:13.682 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-22T08:10:13.683 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:10:13.788 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-09-22T08:10:13.807 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:13.807 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T08:10:13.819 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T08:10:13.820 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:10:13.822 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:10:13.836 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T08:10:13.842 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T08:10:13.859 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T08:10:13.859 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:10:13.878 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:10:13.904 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T08:10:13.909 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T08:10:13.910 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:10:13.942 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:10:13.975 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:10:13.981 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:10:13.985 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:10:13.991 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:10:13.993 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T08:10:13.999 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T08:10:13.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:10:14.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:10:14.059 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T08:10:14.067 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T08:10:14.067 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:10:14.100 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:10:14.115 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:10:14.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:10:14.248 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:10:14.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:10:14.370 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:10:14.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:10:14.435 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:10:14.477 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:10:14.521 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:10:14.596 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:10:14.636 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:10:14.636 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:10:14.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-22T08:10:14.700 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-22T08:10:14.745 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:10:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:10:15.263 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T08:10:15.270 INFO:teuthology.task.internal:Starting timer... 2024-09-22T08:10:15.270 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T08:10:15.279 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T08:10:15.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-22T08:10:15.334 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-22T08:10:15.336 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-09-22T08:10:15.399 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-09-22T08:10:15.401 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T08:10:15.401 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-22T08:10:15.422 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-22T08:10:15.422 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-09-22T08:10:15.445 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-09-22T08:10:15.446 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-09-22T08:10:15.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:10:15.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:10:15.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:10:15.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:10:15.513 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T08:10:15.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:10:15.561 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:10:15.636 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T08:10:15.644 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T08:10:15.647 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T08:10:15.752 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T08:10:15.762 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T08:10:15.762 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T08:13:58.103 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-22T08:13:58.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:13:58.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:13:58.183 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-22T08:13:58.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-22T08:13:58.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:13:58.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:13:58.343 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-22T08:13:58.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-22T08:13:58.418 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T08:13:58.427 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T08:13:58.427 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:13:58.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:13:58.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:13:58.430 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:13:58.458 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:13:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:13:58.487 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:13:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-22T08:13:58.501 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:13:58.508 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-22T08:13:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:13:58.526 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-09-22T08:13:58.536 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:13:58.537 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-09-22T08:13:58.551 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:13:58.565 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:13:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.597 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.621 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:13:58.624 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:13:58.625 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-22T08:13:58.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:13:58.626 INFO:teuthology.run_tasks:Running task install... 2024-09-22T08:13:58.633 DEBUG:teuthology.task.install:project ceph 2024-09-22T08:13:58.634 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}} 2024-09-22T08:13:58.634 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'} 2024-09-22T08:13:58.634 INFO:teuthology.task.install:Using flavor: default 2024-09-22T08:13:58.639 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T08:13:58.639 INFO:teuthology.task.install:extra packages: [] 2024-09-22T08:13:58.639 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:13:58.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:13:58.641 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:13:58.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:13:58.789 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:13:58.789 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:13:58.792 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:13:58.792 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:13:58.896 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:13:58.897 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:13:58.897 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:13:58.917 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:13:58.918 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:13:58.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:13:58.923 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:13:58.923 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:13:58.943 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:13:58.944 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:13:58.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:13:59.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:13:59.066 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:13:59.085 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:13:59.130 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-09-22T08:13:59.132 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-09-22T08:13:59.149 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-22T08:13:59.150 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-22T08:13:59.368 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-09-22T08:13:59.389 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-22T08:13:59.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:13:59.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:13:59.945 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-22T08:13:59.982 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-22T08:14:00.245 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-22T08:14:00.283 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-22T08:14:00.504 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-22T08:14:01.022 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-22T08:14:02.975 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 742 B/s | 1.9 kB 00:02 2024-09-22T08:14:03.416 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-22T08:14:10.392 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-22T08:14:11.897 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 20 MB 00:09 2024-09-22T08:14:16.643 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-22T08:14:17.548 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-22T08:14:18.402 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-22T08:14:19.149 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-22T08:14:19.372 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-22T08:14:19.921 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-22T08:14:24.804 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-22T08:14:25.311 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T08:14:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:14:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:14:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================== 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================== 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:14:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:14:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:14:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:14:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:14:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:14:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:14:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:14:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:14:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:14:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:14:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:14:27.111 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:14:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:14:27.113 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:14:27.114 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:14:27.115 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:14:27.116 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:14:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:14:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:14:27.119 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:14:27.120 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================================== 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout:Install 284 Packages 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 2 Packages 2024-09-22T08:14:27.121 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:14:27.122 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 322 M 2024-09-22T08:14:27.122 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-22T08:14:27.523 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:14:27.524 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:14:27.572 INFO:teuthology.orchestra.run.smithi078.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-22T08:14:27.616 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:14:27.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:14:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:14:27.657 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:14:27.658 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:14:27.659 INFO:teuthology.orchestra.run.smithi171.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:14:27.660 INFO:teuthology.orchestra.run.smithi171.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:14:27.661 INFO:teuthology.orchestra.run.smithi171.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:14:27.662 INFO:teuthology.orchestra.run.smithi171.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:14:27.663 INFO:teuthology.orchestra.run.smithi171.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:14:27.664 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:14:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:14:27.666 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:14:27.667 INFO:teuthology.orchestra.run.smithi171.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:14:27.668 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:14:27.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:14:27.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:14:27.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:14:27.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:14:27.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:14:27.674 INFO:teuthology.orchestra.run.smithi171.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-09-22T08:14:27.675 INFO:teuthology.orchestra.run.smithi171.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:14:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:Install 284 Packages 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 2 Packages 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 322 M 2024-09-22T08:14:27.677 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-22T08:14:27.839 INFO:teuthology.orchestra.run.smithi078.stdout:(2/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 3.3 MB/s | 900 kB 00:00 2024-09-22T08:14:27.931 INFO:teuthology.orchestra.run.smithi078.stdout:(3/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-22T08:14:27.956 INFO:teuthology.orchestra.run.smithi078.stdout:(4/286): ceph-immutable-object-cache-19.3.0-510 1.2 MB/s | 145 kB 00:00 2024-09-22T08:14:28.031 INFO:teuthology.orchestra.run.smithi078.stdout:(5/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 24 MB/s | 2.4 MB 00:00 2024-09-22T08:14:28.198 INFO:teuthology.orchestra.run.smithi078.stdout:(6/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-22T08:14:28.290 INFO:teuthology.orchestra.run.smithi078.stdout:(7/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-22T08:14:28.554 INFO:teuthology.orchestra.run.smithi171.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-09-22T08:14:28.633 INFO:teuthology.orchestra.run.smithi078.stdout:(8/286): ceph-common-19.3.0-5106.g8852379c.el9. 18 MB/s | 22 MB 00:01 2024-09-22T08:14:28.683 INFO:teuthology.orchestra.run.smithi078.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 507 kB/s | 25 kB 00:00 2024-09-22T08:14:28.955 INFO:teuthology.orchestra.run.smithi171.stdout:(2/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 9.4 MB/s | 5.5 MB 00:00 2024-09-22T08:14:28.991 INFO:teuthology.orchestra.run.smithi078.stdout:(10/286): ceph-radosgw-19.3.0-5106.g8852379c.el 16 MB/s | 11 MB 00:00 2024-09-22T08:14:28.996 INFO:teuthology.orchestra.run.smithi171.stdout:(3/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 2.0 MB/s | 900 kB 00:00 2024-09-22T08:14:29.022 INFO:teuthology.orchestra.run.smithi171.stdout:(4/286): ceph-immutable-object-cache-19.3.0-510 2.1 MB/s | 145 kB 00:00 2024-09-22T08:14:29.049 INFO:teuthology.orchestra.run.smithi078.stdout:(11/286): libcephfs-devel-19.3.0-5106.g8852379c 547 kB/s | 32 kB 00:00 2024-09-22T08:14:29.158 INFO:teuthology.orchestra.run.smithi078.stdout:(12/286): libcephfs2-19.3.0-5106.g8852379c.el9. 6.8 MB/s | 755 kB 00:00 2024-09-22T08:14:29.164 INFO:teuthology.orchestra.run.smithi171.stdout:(5/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-22T08:14:29.217 INFO:teuthology.orchestra.run.smithi078.stdout:(13/286): libcephsqlite-19.3.0-5106.g8852379c.e 2.7 MB/s | 161 kB 00:00 2024-09-22T08:14:29.300 INFO:teuthology.orchestra.run.smithi078.stdout:(14/286): librados-devel-19.3.0-5106.g8852379c. 1.5 MB/s | 127 kB 00:00 2024-09-22T08:14:29.409 INFO:teuthology.orchestra.run.smithi078.stdout:(15/286): libradosstriper1-19.3.0-5106.g8852379 4.6 MB/s | 508 kB 00:00 2024-09-22T08:14:29.447 INFO:teuthology.orchestra.run.smithi171.stdout:(6/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-22T08:14:29.909 INFO:teuthology.orchestra.run.smithi078.stdout:(16/286): ceph-osd-19.3.0-5106.g8852379c.el9.x8 10 MB/s | 17 MB 00:01 2024-09-22T08:14:29.993 INFO:teuthology.orchestra.run.smithi078.stdout:(17/286): librgw2-19.3.0-5106.g8852379c.el9.x86 9.4 MB/s | 5.5 MB 00:00 2024-09-22T08:14:30.018 INFO:teuthology.orchestra.run.smithi078.stdout:(18/286): python3-ceph-argparse-19.3.0-5106.g88 414 kB/s | 45 kB 00:00 2024-09-22T08:14:30.023 INFO:teuthology.orchestra.run.smithi171.stdout:(7/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-09-22T08:14:30.044 INFO:teuthology.orchestra.run.smithi078.stdout:(19/286): python3-ceph-common-19.3.0-5106.g8852 2.9 MB/s | 148 kB 00:00 2024-09-22T08:14:30.094 INFO:teuthology.orchestra.run.smithi078.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 2.1 MB/s | 162 kB 00:00 2024-09-22T08:14:30.119 INFO:teuthology.orchestra.run.smithi078.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 4.2 MB/s | 320 kB 00:00 2024-09-22T08:14:30.153 INFO:teuthology.orchestra.run.smithi078.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 5.1 MB/s | 307 kB 00:00 2024-09-22T08:14:30.178 INFO:teuthology.orchestra.run.smithi078.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.7 MB/s | 99 kB 00:00 2024-09-22T08:14:30.204 INFO:teuthology.orchestra.run.smithi078.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-22T08:14:30.232 INFO:teuthology.orchestra.run.smithi171.stdout:(8/286): ceph-osd-19.3.0-5106.g8852379c.el9.x86 22 MB/s | 17 MB 00:00 2024-09-22T08:14:30.254 INFO:teuthology.orchestra.run.smithi078.stdout:(25/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-22T08:14:30.290 INFO:teuthology.orchestra.run.smithi171.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 432 kB/s | 25 kB 00:00 2024-09-22T08:14:30.312 INFO:teuthology.orchestra.run.smithi078.stdout:(26/286): ceph-grafana-dashboards-19.3.0-5106.g 587 kB/s | 34 kB 00:00 2024-09-22T08:14:30.371 INFO:teuthology.orchestra.run.smithi078.stdout:(27/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 17 MB/s | 3.2 MB 00:00 2024-09-22T08:14:30.396 INFO:teuthology.orchestra.run.smithi078.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 1.8 MB/s | 154 kB 00:00 2024-09-22T08:14:31.389 INFO:teuthology.orchestra.run.smithi078.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 7.5 MB/s | 7.4 MB 00:00 2024-09-22T08:14:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5106.g88 2.6 MB/s | 292 kB 00:00 2024-09-22T08:14:31.697 INFO:teuthology.orchestra.run.smithi078.stdout:(31/286): ceph-mgr-dashboard-19.3.0-5106.g88523 11 MB/s | 14 MB 00:01 2024-09-22T08:14:31.723 INFO:teuthology.orchestra.run.smithi078.stdout:(32/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 219 kB/s | 49 kB 00:00 2024-09-22T08:14:31.773 INFO:teuthology.orchestra.run.smithi078.stdout:(33/286): ceph-prometheus-alerts-19.3.0-5106.g8 219 kB/s | 16 kB 00:00 2024-09-22T08:14:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:(34/286): ceph-volume-19.3.0-5106.g8852379c.el9 3.3 MB/s | 285 kB 00:00 2024-09-22T08:14:31.873 INFO:teuthology.orchestra.run.smithi078.stdout:(35/286): cephadm-19.3.0-5106.g8852379c.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-22T08:14:32.224 INFO:teuthology.orchestra.run.smithi171.stdout:(10/286): ceph-common-19.3.0-5106.g8852379c.el9 5.6 MB/s | 22 MB 00:03 2024-09-22T08:14:32.257 INFO:teuthology.orchestra.run.smithi078.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 221 kB/s | 85 kB 00:00 2024-09-22T08:14:32.374 INFO:teuthology.orchestra.run.smithi078.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 591 kB/s | 335 kB 00:00 2024-09-22T08:14:32.399 INFO:teuthology.orchestra.run.smithi078.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 348 kB/s | 49 kB 00:00 2024-09-22T08:14:32.666 INFO:teuthology.orchestra.run.smithi171.stdout:(11/286): ceph-test-19.3.0-5106.g8852379c.el9.x 19 MB/s | 46 MB 00:02 2024-09-22T08:14:32.691 INFO:teuthology.orchestra.run.smithi171.stdout:(12/286): libcephfs-devel-19.3.0-5106.g8852379c 68 kB/s | 32 kB 00:00 2024-09-22T08:14:32.750 INFO:teuthology.orchestra.run.smithi171.stdout:(13/286): libcephfs2-19.3.0-5106.g8852379c.el9. 8.8 MB/s | 755 kB 00:00 2024-09-22T08:14:32.775 INFO:teuthology.orchestra.run.smithi171.stdout:(14/286): libcephsqlite-19.3.0-5106.g8852379c.e 1.9 MB/s | 161 kB 00:00 2024-09-22T08:14:32.809 INFO:teuthology.orchestra.run.smithi171.stdout:(15/286): librados-devel-19.3.0-5106.g8852379c. 2.1 MB/s | 127 kB 00:00 2024-09-22T08:14:32.833 INFO:teuthology.orchestra.run.smithi078.stdout:(39/286): ceph-test-19.3.0-5106.g8852379c.el9.x 11 MB/s | 46 MB 00:04 2024-09-22T08:14:32.858 INFO:teuthology.orchestra.run.smithi078.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-22T08:14:32.868 INFO:teuthology.orchestra.run.smithi171.stdout:(16/286): libradosstriper1-19.3.0-5106.g8852379 5.4 MB/s | 508 kB 00:00 2024-09-22T08:14:32.883 INFO:teuthology.orchestra.run.smithi078.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 514 kB/s | 262 kB 00:00 2024-09-22T08:14:32.935 INFO:teuthology.orchestra.run.smithi171.stdout:(17/286): python3-ceph-argparse-19.3.0-5106.g88 679 kB/s | 45 kB 00:00 2024-09-22T08:14:32.967 INFO:teuthology.orchestra.run.smithi078.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 248 kB/s | 27 kB 00:00 2024-09-22T08:14:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-22T08:14:33.027 INFO:teuthology.orchestra.run.smithi171.stdout:(18/286): librgw2-19.3.0-5106.g8852379c.el9.x86 25 MB/s | 5.5 MB 00:00 2024-09-22T08:14:33.052 INFO:teuthology.orchestra.run.smithi171.stdout:(19/286): python3-ceph-common-19.3.0-5106.g8852 1.2 MB/s | 148 kB 00:00 2024-09-22T08:14:33.078 INFO:teuthology.orchestra.run.smithi171.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 3.1 MB/s | 162 kB 00:00 2024-09-22T08:14:33.103 INFO:teuthology.orchestra.run.smithi171.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 6.2 MB/s | 320 kB 00:00 2024-09-22T08:14:33.128 INFO:teuthology.orchestra.run.smithi171.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 6.0 MB/s | 307 kB 00:00 2024-09-22T08:14:33.154 INFO:teuthology.orchestra.run.smithi171.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.9 MB/s | 99 kB 00:00 2024-09-22T08:14:33.168 INFO:teuthology.orchestra.run.smithi078.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 469 kB/s | 94 kB 00:00 2024-09-22T08:14:33.179 INFO:teuthology.orchestra.run.smithi171.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 1.6 MB/s | 85 kB 00:00 2024-09-22T08:14:33.193 INFO:teuthology.orchestra.run.smithi078.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-22T08:14:33.238 INFO:teuthology.orchestra.run.smithi171.stdout:(25/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-22T08:14:33.280 INFO:teuthology.orchestra.run.smithi171.stdout:(26/286): ceph-grafana-dashboards-19.3.0-5106.g 824 kB/s | 34 kB 00:00 2024-09-22T08:14:33.310 INFO:teuthology.orchestra.run.smithi078.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-22T08:14:33.330 INFO:teuthology.orchestra.run.smithi171.stdout:(27/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 3.0 MB/s | 154 kB 00:00 2024-09-22T08:14:33.406 INFO:teuthology.orchestra.run.smithi171.stdout:(28/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 13 MB/s | 3.2 MB 00:00 2024-09-22T08:14:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:(47/286): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-22T08:14:33.544 INFO:teuthology.orchestra.run.smithi078.stdout:(48/286): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-22T08:14:33.569 INFO:teuthology.orchestra.run.smithi078.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 881 kB/s | 125 kB 00:00 2024-09-22T08:14:33.595 INFO:teuthology.orchestra.run.smithi078.stdout:(50/286): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-22T08:14:33.662 INFO:teuthology.orchestra.run.smithi078.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-22T08:14:33.807 INFO:teuthology.orchestra.run.smithi171.stdout:(29/286): ceph-mgr-dashboard-19.3.0-5106.g88523 30 MB/s | 14 MB 00:00 2024-09-22T08:14:33.854 INFO:teuthology.orchestra.run.smithi078.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-22T08:14:33.856 INFO:teuthology.orchestra.run.smithi171.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5106.g88 5.7 MB/s | 292 kB 00:00 2024-09-22T08:14:33.912 INFO:teuthology.orchestra.run.smithi078.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.0 MB/s | 523 kB 00:00 2024-09-22T08:14:33.937 INFO:teuthology.orchestra.run.smithi078.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 849 kB/s | 71 kB 00:00 2024-09-22T08:14:33.971 INFO:teuthology.orchestra.run.smithi078.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 5.1 MB/s | 302 kB 00:00 2024-09-22T08:14:33.974 INFO:teuthology.orchestra.run.smithi171.stdout:(31/286): ceph-radosgw-19.3.0-5106.g8852379c.el 2.8 MB/s | 11 MB 00:03 2024-09-22T08:14:33.996 INFO:teuthology.orchestra.run.smithi078.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-22T08:14:33.999 INFO:teuthology.orchestra.run.smithi171.stdout:(32/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 347 kB/s | 49 kB 00:00 2024-09-22T08:14:34.024 INFO:teuthology.orchestra.run.smithi171.stdout:(33/286): ceph-prometheus-alerts-19.3.0-5106.g8 329 kB/s | 16 kB 00:00 2024-09-22T08:14:34.046 INFO:teuthology.orchestra.run.smithi078.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 559 kB 00:00 2024-09-22T08:14:34.050 INFO:teuthology.orchestra.run.smithi171.stdout:(34/286): ceph-volume-19.3.0-5106.g8852379c.el9 5.5 MB/s | 285 kB 00:00 2024-09-22T08:14:34.072 INFO:teuthology.orchestra.run.smithi078.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-22T08:14:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-22T08:14:34.131 INFO:teuthology.orchestra.run.smithi078.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 398 kB/s | 23 kB 00:00 2024-09-22T08:14:34.164 INFO:teuthology.orchestra.run.smithi078.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-22T08:14:34.175 INFO:teuthology.orchestra.run.smithi171.stdout:(35/286): ceph-mgr-diskprediction-local-19.3.0- 9.6 MB/s | 7.4 MB 00:00 2024-09-22T08:14:34.190 INFO:teuthology.orchestra.run.smithi078.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 253 kB/s | 15 kB 00:00 2024-09-22T08:14:34.223 INFO:teuthology.orchestra.run.smithi078.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-22T08:14:34.234 INFO:teuthology.orchestra.run.smithi171.stdout:(36/286): cephadm-19.3.0-5106.g8852379c.el9.noa 3.7 MB/s | 784 kB 00:00 2024-09-22T08:14:34.249 INFO:teuthology.orchestra.run.smithi078.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 910 kB/s | 53 kB 00:00 2024-09-22T08:14:34.309 INFO:teuthology.orchestra.run.smithi171.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 635 kB/s | 85 kB 00:00 2024-09-22T08:14:34.335 INFO:teuthology.orchestra.run.smithi171.stdout:(38/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.1 MB/s | 335 kB 00:00 2024-09-22T08:14:34.360 INFO:teuthology.orchestra.run.smithi171.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 393 kB/s | 49 kB 00:00 2024-09-22T08:14:34.383 INFO:teuthology.orchestra.run.smithi078.stdout:(65/286): adwaita-icon-theme-40.1.1-3.el9.noarc 15 MB/s | 12 MB 00:00 2024-09-22T08:14:34.385 INFO:teuthology.orchestra.run.smithi171.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-22T08:14:34.408 INFO:teuthology.orchestra.run.smithi078.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 385 kB/s | 61 kB 00:00 2024-09-22T08:14:34.428 INFO:teuthology.orchestra.run.smithi171.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.2 MB/s | 262 kB 00:00 2024-09-22T08:14:34.433 INFO:teuthology.orchestra.run.smithi078.stdout:(67/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.1 MB/s | 229 kB 00:00 2024-09-22T08:14:34.453 INFO:teuthology.orchestra.run.smithi171.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 401 kB/s | 27 kB 00:00 2024-09-22T08:14:34.466 INFO:teuthology.orchestra.run.smithi078.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 337 kB/s | 28 kB 00:00 2024-09-22T08:14:34.487 INFO:teuthology.orchestra.run.smithi171.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-22T08:14:34.492 INFO:teuthology.orchestra.run.smithi078.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.3 MB/s | 113 kB 00:00 2024-09-22T08:14:34.512 INFO:teuthology.orchestra.run.smithi171.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-22T08:14:34.525 INFO:teuthology.orchestra.run.smithi078.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 5.6 MB/s | 525 kB 00:00 2024-09-22T08:14:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:(45/286): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-22T08:14:34.567 INFO:teuthology.orchestra.run.smithi078.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 9.5 MB/s | 980 kB 00:00 2024-09-22T08:14:34.571 INFO:teuthology.orchestra.run.smithi171.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2024-09-22T08:14:34.593 INFO:teuthology.orchestra.run.smithi078.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.6 MB/s | 781 kB 00:00 2024-09-22T08:14:34.621 INFO:teuthology.orchestra.run.smithi171.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-22T08:14:34.627 INFO:teuthology.orchestra.run.smithi078.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-22T08:14:34.647 INFO:teuthology.orchestra.run.smithi171.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-22T08:14:34.652 INFO:teuthology.orchestra.run.smithi078.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-22T08:14:34.672 INFO:teuthology.orchestra.run.smithi171.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-22T08:14:34.685 INFO:teuthology.orchestra.run.smithi078.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 370 kB/s | 22 kB 00:00 2024-09-22T08:14:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:(50/286): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-22T08:14:34.711 INFO:teuthology.orchestra.run.smithi078.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-22T08:14:34.761 INFO:teuthology.orchestra.run.smithi078.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-09-22T08:14:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-09-22T08:14:34.786 INFO:teuthology.orchestra.run.smithi078.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-22T08:14:34.812 INFO:teuthology.orchestra.run.smithi078.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-22T08:14:34.837 INFO:teuthology.orchestra.run.smithi078.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-22T08:14:34.896 INFO:teuthology.orchestra.run.smithi078.stdout:(81/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-22T08:14:34.921 INFO:teuthology.orchestra.run.smithi078.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-22T08:14:34.946 INFO:teuthology.orchestra.run.smithi078.stdout:(83/286): geoclue2-2.6.0-7.el9.x86_64.rpm 928 kB/s | 124 kB 00:00 2024-09-22T08:14:34.980 INFO:teuthology.orchestra.run.smithi078.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 5.5 MB/s | 473 kB 00:00 2024-09-22T08:14:34.990 INFO:teuthology.orchestra.run.smithi171.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.0 MB/s | 650 kB 00:00 2024-09-22T08:14:35.013 INFO:teuthology.orchestra.run.smithi078.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 510 kB/s | 34 kB 00:00 2024-09-22T08:14:35.038 INFO:teuthology.orchestra.run.smithi078.stdout:(86/286): graphene-1.10.6-2.el9.x86_64.rpm 548 kB/s | 64 kB 00:00 2024-09-22T08:14:35.049 INFO:teuthology.orchestra.run.smithi171.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-22T08:14:35.074 INFO:teuthology.orchestra.run.smithi171.stdout:(54/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.7 MB/s | 523 kB 00:00 2024-09-22T08:14:35.116 INFO:teuthology.orchestra.run.smithi171.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 4.4 MB/s | 302 kB 00:00 2024-09-22T08:14:35.184 INFO:teuthology.orchestra.run.smithi171.stdout:(56/286): apache-commons-lang3-3.12.0-6.el9.noa 8.2 MB/s | 559 kB 00:00 2024-09-22T08:14:35.209 INFO:teuthology.orchestra.run.smithi171.stdout:(57/286): apache-commons-io-2.8.0-8.el9.noarch. 2.1 MB/s | 283 kB 00:00 2024-09-22T08:14:35.234 INFO:teuthology.orchestra.run.smithi171.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-22T08:14:35.241 INFO:teuthology.orchestra.run.smithi078.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 5.5 MB/s | 1.4 MB 00:00 2024-09-22T08:14:35.268 INFO:teuthology.orchestra.run.smithi171.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-22T08:14:35.273 INFO:teuthology.orchestra.run.smithi078.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 141 kB/s | 33 kB 00:00 2024-09-22T08:14:35.285 INFO:teuthology.orchestra.run.smithi171.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 461 kB/s | 23 kB 00:00 2024-09-22T08:14:35.323 INFO:teuthology.orchestra.run.smithi078.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 7.2 MB/s | 2.2 MB 00:00 2024-09-22T08:14:35.344 INFO:teuthology.orchestra.run.smithi171.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-22T08:14:35.369 INFO:teuthology.orchestra.run.smithi171.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 178 kB/s | 15 kB 00:00 2024-09-22T08:14:35.423 INFO:teuthology.orchestra.run.smithi078.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 27 MB/s | 4.9 MB 00:00 2024-09-22T08:14:35.448 INFO:teuthology.orchestra.run.smithi078.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 1.7 MB/s | 219 kB 00:00 2024-09-22T08:14:35.495 INFO:teuthology.orchestra.run.smithi171.stdout:(63/286): adwaita-icon-theme-40.1.1-3.el9.noarc 15 MB/s | 12 MB 00:00 2024-09-22T08:14:35.507 INFO:teuthology.orchestra.run.smithi078.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 9.9 MB/s | 2.3 MB 00:00 2024-09-22T08:14:35.520 INFO:teuthology.orchestra.run.smithi171.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 355 kB/s | 53 kB 00:00 2024-09-22T08:14:35.545 INFO:teuthology.orchestra.run.smithi171.stdout:(65/286): boost-program-options-1.75.0-8.el9.x8 532 kB/s | 107 kB 00:00 2024-09-22T08:14:35.549 INFO:teuthology.orchestra.run.smithi078.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 6.1 MB/s | 632 kB 00:00 2024-09-22T08:14:35.571 INFO:teuthology.orchestra.run.smithi171.stdout:(66/286): colord-libs-1.4.5-4.el9.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-09-22T08:14:35.574 INFO:teuthology.orchestra.run.smithi078.stdout:(94/286): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-22T08:14:35.596 INFO:teuthology.orchestra.run.smithi171.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 806 kB/s | 61 kB 00:00 2024-09-22T08:14:35.608 INFO:teuthology.orchestra.run.smithi078.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 769 kB/s | 45 kB 00:00 2024-09-22T08:14:35.621 INFO:teuthology.orchestra.run.smithi171.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 373 kB/s | 28 kB 00:00 2024-09-22T08:14:35.642 INFO:teuthology.orchestra.run.smithi078.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-22T08:14:35.655 INFO:teuthology.orchestra.run.smithi171.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.3 MB/s | 113 kB 00:00 2024-09-22T08:14:35.667 INFO:teuthology.orchestra.run.smithi078.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.9 MB/s | 413 kB 00:00 2024-09-22T08:14:35.734 INFO:teuthology.orchestra.run.smithi078.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-22T08:14:35.739 INFO:teuthology.orchestra.run.smithi171.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 8.2 MB/s | 980 kB 00:00 2024-09-22T08:14:35.764 INFO:teuthology.orchestra.run.smithi171.stdout:(71/286): exempi-2.6.0-0.2.20211007gite23c213.e 3.1 MB/s | 525 kB 00:00 2024-09-22T08:14:35.801 INFO:teuthology.orchestra.run.smithi078.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 21 MB/s | 3.3 MB 00:00 2024-09-22T08:14:35.806 INFO:teuthology.orchestra.run.smithi171.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 5.1 MB/s | 781 kB 00:00 2024-09-22T08:14:35.818 INFO:teuthology.orchestra.run.smithi078.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 156 kB/s | 13 kB 00:00 2024-09-22T08:14:35.831 INFO:teuthology.orchestra.run.smithi171.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-09-22T08:14:35.843 INFO:teuthology.orchestra.run.smithi078.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.2 MB/s | 53 kB 00:00 2024-09-22T08:14:35.857 INFO:teuthology.orchestra.run.smithi171.stdout:(74/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-22T08:14:35.860 INFO:teuthology.orchestra.run.smithi078.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 572 kB/s | 24 kB 00:00 2024-09-22T08:14:35.899 INFO:teuthology.orchestra.run.smithi171.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-22T08:14:35.910 INFO:teuthology.orchestra.run.smithi078.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-22T08:14:35.924 INFO:teuthology.orchestra.run.smithi171.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.1 MB/s | 73 kB 00:00 2024-09-22T08:14:35.927 INFO:teuthology.orchestra.run.smithi078.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 530 kB/s | 35 kB 00:00 2024-09-22T08:14:35.966 INFO:teuthology.orchestra.run.smithi171.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2024-09-22T08:14:35.969 INFO:teuthology.orchestra.run.smithi078.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-22T08:14:35.992 INFO:teuthology.orchestra.run.smithi171.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 353 kB/s | 33 kB 00:00 2024-09-22T08:14:35.994 INFO:teuthology.orchestra.run.smithi078.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 166 kB/s | 11 kB 00:00 2024-09-22T08:14:36.017 INFO:teuthology.orchestra.run.smithi171.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 359 kB/s | 18 kB 00:00 2024-09-22T08:14:36.020 INFO:teuthology.orchestra.run.smithi078.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-22T08:14:36.051 INFO:teuthology.orchestra.run.smithi171.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-22T08:14:36.053 INFO:teuthology.orchestra.run.smithi078.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 524 kB/s | 31 kB 00:00 2024-09-22T08:14:36.076 INFO:teuthology.orchestra.run.smithi171.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-22T08:14:36.079 INFO:teuthology.orchestra.run.smithi078.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 389 kB/s | 23 kB 00:00 2024-09-22T08:14:36.102 INFO:teuthology.orchestra.run.smithi171.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 962 kB/s | 49 kB 00:00 2024-09-22T08:14:36.112 INFO:teuthology.orchestra.run.smithi078.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 338 kB/s | 20 kB 00:00 2024-09-22T08:14:36.136 INFO:teuthology.orchestra.run.smithi171.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 7.9 MB/s | 473 kB 00:00 2024-09-22T08:14:36.137 INFO:teuthology.orchestra.run.smithi078.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 677 kB/s | 40 kB 00:00 2024-09-22T08:14:36.163 INFO:teuthology.orchestra.run.smithi078.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-22T08:14:36.186 INFO:teuthology.orchestra.run.smithi171.stdout:(84/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-22T08:14:36.196 INFO:teuthology.orchestra.run.smithi078.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 485 kB/s | 28 kB 00:00 2024-09-22T08:14:36.211 INFO:teuthology.orchestra.run.smithi171.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 590 kB/s | 64 kB 00:00 2024-09-22T08:14:36.222 INFO:teuthology.orchestra.run.smithi078.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 368 kB/s | 21 kB 00:00 2024-09-22T08:14:36.228 INFO:teuthology.orchestra.run.smithi171.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 368 kB/s | 34 kB 00:00 2024-09-22T08:14:36.247 INFO:teuthology.orchestra.run.smithi078.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-22T08:14:36.273 INFO:teuthology.orchestra.run.smithi078.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-22T08:14:36.279 INFO:teuthology.orchestra.run.smithi171.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 662 kB/s | 33 kB 00:00 2024-09-22T08:14:36.297 INFO:teuthology.orchestra.run.smithi078.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 606 kB/s | 30 kB 00:00 2024-09-22T08:14:36.312 INFO:teuthology.orchestra.run.smithi171.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-22T08:14:36.331 INFO:teuthology.orchestra.run.smithi078.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-22T08:14:36.357 INFO:teuthology.orchestra.run.smithi078.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 542 kB/s | 32 kB 00:00 2024-09-22T08:14:36.399 INFO:teuthology.orchestra.run.smithi078.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.3 MB/s | 161 kB 00:00 2024-09-22T08:14:36.424 INFO:teuthology.orchestra.run.smithi078.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-22T08:14:36.479 INFO:teuthology.orchestra.run.smithi171.stdout:(89/286): guava-30.1-6.el9.noarch.rpm 14 MB/s | 2.3 MB 00:00 2024-09-22T08:14:36.482 INFO:teuthology.orchestra.run.smithi078.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 435 kB 00:00 2024-09-22T08:14:36.508 INFO:teuthology.orchestra.run.smithi078.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 370 kB/s | 31 kB 00:00 2024-09-22T08:14:36.530 INFO:teuthology.orchestra.run.smithi171.stdout:(90/286): gstreamer1-plugins-base-1.22.1-2.el9. 7.1 MB/s | 2.2 MB 00:00 2024-09-22T08:14:36.533 INFO:teuthology.orchestra.run.smithi078.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-22T08:14:36.558 INFO:teuthology.orchestra.run.smithi078.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-22T08:14:36.597 INFO:teuthology.orchestra.run.smithi171.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-22T08:14:36.631 INFO:teuthology.orchestra.run.smithi171.stdout:(92/286): hicolor-icon-theme-0.17-13.el9.noarch 1.4 MB/s | 219 kB 00:00 2024-09-22T08:14:36.656 INFO:teuthology.orchestra.run.smithi171.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 5.1 MB/s | 657 kB 00:00 2024-09-22T08:14:36.689 INFO:teuthology.orchestra.run.smithi171.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 6.7 MB/s | 632 kB 00:00 2024-09-22T08:14:36.715 INFO:teuthology.orchestra.run.smithi171.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 769 kB/s | 45 kB 00:00 2024-09-22T08:14:36.748 INFO:teuthology.orchestra.run.smithi171.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-22T08:14:36.799 INFO:teuthology.orchestra.run.smithi171.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.8 MB/s | 413 kB 00:00 2024-09-22T08:14:36.866 INFO:teuthology.orchestra.run.smithi171.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-22T08:14:36.917 INFO:teuthology.orchestra.run.smithi171.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-22T08:14:36.948 INFO:teuthology.orchestra.run.smithi078.stdout:(126/286): java-11-openjdk-headless-11.0.20.1.1 30 MB/s | 39 MB 00:01 2024-09-22T08:14:36.967 INFO:teuthology.orchestra.run.smithi171.stdout:(100/286): java-11-openjdk-devel-11.0.20.1.1-2. 15 MB/s | 3.3 MB 00:00 2024-09-22T08:14:36.975 INFO:teuthology.orchestra.run.smithi078.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 83 kB/s | 37 kB 00:00 2024-09-22T08:14:36.984 INFO:teuthology.orchestra.run.smithi171.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 788 kB/s | 53 kB 00:00 2024-09-22T08:14:37.009 INFO:teuthology.orchestra.run.smithi078.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 316 kB/s | 142 kB 00:00 2024-09-22T08:14:37.010 INFO:teuthology.orchestra.run.smithi171.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 572 kB/s | 24 kB 00:00 2024-09-22T08:14:37.034 INFO:teuthology.orchestra.run.smithi078.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-22T08:14:37.051 INFO:teuthology.orchestra.run.smithi171.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-22T08:14:37.076 INFO:teuthology.orchestra.run.smithi078.stdout:(130/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-09-22T08:14:37.077 INFO:teuthology.orchestra.run.smithi171.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 530 kB/s | 35 kB 00:00 2024-09-22T08:14:37.102 INFO:teuthology.orchestra.run.smithi078.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 615 kB/s | 41 kB 00:00 2024-09-22T08:14:37.110 INFO:teuthology.orchestra.run.smithi171.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-22T08:14:37.127 INFO:teuthology.orchestra.run.smithi078.stdout:(132/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 522 kB/s | 61 kB 00:00 2024-09-22T08:14:37.136 INFO:teuthology.orchestra.run.smithi171.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-22T08:14:37.162 INFO:teuthology.orchestra.run.smithi078.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-22T08:14:37.162 INFO:teuthology.orchestra.run.smithi171.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 479 kB/s | 24 kB 00:00 2024-09-22T08:14:37.186 INFO:teuthology.orchestra.run.smithi078.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 521 kB/s | 44 kB 00:00 2024-09-22T08:14:37.186 INFO:teuthology.orchestra.run.smithi171.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 610 kB/s | 31 kB 00:00 2024-09-22T08:14:37.211 INFO:teuthology.orchestra.run.smithi078.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 400 kB/s | 34 kB 00:00 2024-09-22T08:14:37.220 INFO:teuthology.orchestra.run.smithi171.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 389 kB/s | 23 kB 00:00 2024-09-22T08:14:37.236 INFO:teuthology.orchestra.run.smithi078.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-22T08:14:37.245 INFO:teuthology.orchestra.run.smithi171.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 336 kB/s | 20 kB 00:00 2024-09-22T08:14:37.270 INFO:teuthology.orchestra.run.smithi078.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-09-22T08:14:37.279 INFO:teuthology.orchestra.run.smithi171.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 677 kB/s | 40 kB 00:00 2024-09-22T08:14:37.303 INFO:teuthology.orchestra.run.smithi078.stdout:(138/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-22T08:14:37.304 INFO:teuthology.orchestra.run.smithi171.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 256 kB/s | 15 kB 00:00 2024-09-22T08:14:37.329 INFO:teuthology.orchestra.run.smithi078.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-22T08:14:37.330 INFO:teuthology.orchestra.run.smithi171.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-22T08:14:37.363 INFO:teuthology.orchestra.run.smithi078.stdout:(140/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-22T08:14:37.365 INFO:teuthology.orchestra.run.smithi171.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 365 kB/s | 21 kB 00:00 2024-09-22T08:14:37.388 INFO:teuthology.orchestra.run.smithi078.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-22T08:14:37.389 INFO:teuthology.orchestra.run.smithi171.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 324 kB/s | 19 kB 00:00 2024-09-22T08:14:37.413 INFO:teuthology.orchestra.run.smithi078.stdout:(142/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.8 MB/s | 206 kB 00:00 2024-09-22T08:14:37.422 INFO:teuthology.orchestra.run.smithi171.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 320 kB/s | 19 kB 00:00 2024-09-22T08:14:37.438 INFO:teuthology.orchestra.run.smithi078.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-22T08:14:37.448 INFO:teuthology.orchestra.run.smithi171.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 519 kB/s | 30 kB 00:00 2024-09-22T08:14:37.464 INFO:teuthology.orchestra.run.smithi078.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 471 kB/s | 36 kB 00:00 2024-09-22T08:14:37.473 INFO:teuthology.orchestra.run.smithi171.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-22T08:14:37.497 INFO:teuthology.orchestra.run.smithi078.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 3.8 MB/s | 324 kB 00:00 2024-09-22T08:14:37.499 INFO:teuthology.orchestra.run.smithi171.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 631 kB/s | 32 kB 00:00 2024-09-22T08:14:37.523 INFO:teuthology.orchestra.run.smithi078.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-22T08:14:37.532 INFO:teuthology.orchestra.run.smithi171.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-22T08:14:37.548 INFO:teuthology.orchestra.run.smithi078.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.2 MB/s | 193 kB 00:00 2024-09-22T08:14:37.565 INFO:teuthology.orchestra.run.smithi078.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 496 kB/s | 33 kB 00:00 2024-09-22T08:14:37.566 INFO:teuthology.orchestra.run.smithi171.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-22T08:14:37.582 INFO:teuthology.orchestra.run.smithi078.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 330 kB/s | 19 kB 00:00 2024-09-22T08:14:37.600 INFO:teuthology.orchestra.run.smithi171.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 6.3 MB/s | 435 kB 00:00 2024-09-22T08:14:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 218 kB/s | 13 kB 00:00 2024-09-22T08:14:37.626 INFO:teuthology.orchestra.run.smithi171.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 525 kB/s | 31 kB 00:00 2024-09-22T08:14:37.632 INFO:teuthology.orchestra.run.smithi078.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 623 kB/s | 42 kB 00:00 2024-09-22T08:14:37.651 INFO:teuthology.orchestra.run.smithi171.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-22T08:14:37.667 INFO:teuthology.orchestra.run.smithi078.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-22T08:14:37.677 INFO:teuthology.orchestra.run.smithi171.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-22T08:14:37.684 INFO:teuthology.orchestra.run.smithi078.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 248 kB/s | 13 kB 00:00 2024-09-22T08:14:37.702 INFO:teuthology.orchestra.run.smithi171.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 731 kB/s | 37 kB 00:00 2024-09-22T08:14:37.709 INFO:teuthology.orchestra.run.smithi078.stdout:(154/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.3 MB/s | 133 kB 00:00 2024-09-22T08:14:37.726 INFO:teuthology.orchestra.run.smithi078.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 610 kB/s | 36 kB 00:00 2024-09-22T08:14:37.727 INFO:teuthology.orchestra.run.smithi171.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-22T08:14:37.751 INFO:teuthology.orchestra.run.smithi078.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-22T08:14:37.769 INFO:teuthology.orchestra.run.smithi171.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 3.7 MB/s | 256 kB 00:00 2024-09-22T08:14:37.776 INFO:teuthology.orchestra.run.smithi078.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-22T08:14:37.795 INFO:teuthology.orchestra.run.smithi171.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-09-22T08:14:37.801 INFO:teuthology.orchestra.run.smithi078.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-22T08:14:37.812 INFO:teuthology.orchestra.run.smithi171.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-22T08:14:37.827 INFO:teuthology.orchestra.run.smithi078.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 234 kB/s | 18 kB 00:00 2024-09-22T08:14:37.837 INFO:teuthology.orchestra.run.smithi171.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 980 kB/s | 41 kB 00:00 2024-09-22T08:14:37.852 INFO:teuthology.orchestra.run.smithi078.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 179 kB/s | 9.0 kB 00:00 2024-09-22T08:14:37.871 INFO:teuthology.orchestra.run.smithi171.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-22T08:14:37.888 INFO:teuthology.orchestra.run.smithi171.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-22T08:14:37.919 INFO:teuthology.orchestra.run.smithi078.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 10 MB/s | 1.5 MB 00:00 2024-09-22T08:14:37.921 INFO:teuthology.orchestra.run.smithi171.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 666 kB/s | 34 kB 00:00 2024-09-22T08:14:37.944 INFO:teuthology.orchestra.run.smithi078.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 1.6 MB/s | 151 kB 00:00 2024-09-22T08:14:37.947 INFO:teuthology.orchestra.run.smithi171.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-22T08:14:37.972 INFO:teuthology.orchestra.run.smithi171.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-22T08:14:37.978 INFO:teuthology.orchestra.run.smithi078.stdout:(163/286): maven-resolver-1.6.1-10.el9.noarch.r 3.3 MB/s | 517 kB 00:00 2024-09-22T08:14:38.003 INFO:teuthology.orchestra.run.smithi078.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-22T08:14:38.023 INFO:teuthology.orchestra.run.smithi171.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-22T08:14:38.037 INFO:teuthology.orchestra.run.smithi078.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 192 kB/s | 11 kB 00:00 2024-09-22T08:14:38.057 INFO:teuthology.orchestra.run.smithi171.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-22T08:14:38.062 INFO:teuthology.orchestra.run.smithi078.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-22T08:14:38.090 INFO:teuthology.orchestra.run.smithi171.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-22T08:14:38.096 INFO:teuthology.orchestra.run.smithi078.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-22T08:14:38.116 INFO:teuthology.orchestra.run.smithi171.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-22T08:14:38.121 INFO:teuthology.orchestra.run.smithi078.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 620 kB/s | 36 kB 00:00 2024-09-22T08:14:38.146 INFO:teuthology.orchestra.run.smithi078.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 916 kB/s | 46 kB 00:00 2024-09-22T08:14:38.149 INFO:teuthology.orchestra.run.smithi171.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-22T08:14:38.172 INFO:teuthology.orchestra.run.smithi078.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2024-09-22T08:14:38.175 INFO:teuthology.orchestra.run.smithi171.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-22T08:14:38.200 INFO:teuthology.orchestra.run.smithi171.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 710 kB/s | 36 kB 00:00 2024-09-22T08:14:38.259 INFO:teuthology.orchestra.run.smithi171.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 3.8 MB/s | 324 kB 00:00 2024-09-22T08:14:38.264 INFO:teuthology.orchestra.run.smithi078.stdout:(171/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 27 MB/s | 8.8 MB 00:00 2024-09-22T08:14:38.284 INFO:teuthology.orchestra.run.smithi171.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-22T08:14:38.289 INFO:teuthology.orchestra.run.smithi078.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-22T08:14:38.318 INFO:teuthology.orchestra.run.smithi171.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-22T08:14:38.322 INFO:teuthology.orchestra.run.smithi078.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-22T08:14:38.344 INFO:teuthology.orchestra.run.smithi171.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 566 kB/s | 33 kB 00:00 2024-09-22T08:14:38.348 INFO:teuthology.orchestra.run.smithi078.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-22T08:14:38.381 INFO:teuthology.orchestra.run.smithi078.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-22T08:14:38.386 INFO:teuthology.orchestra.run.smithi171.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 290 kB/s | 19 kB 00:00 2024-09-22T08:14:38.411 INFO:teuthology.orchestra.run.smithi171.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 192 kB/s | 13 kB 00:00 2024-09-22T08:14:38.415 INFO:teuthology.orchestra.run.smithi078.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 7.7 MB/s | 531 kB 00:00 2024-09-22T08:14:38.436 INFO:teuthology.orchestra.run.smithi171.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 828 kB/s | 42 kB 00:00 2024-09-22T08:14:38.449 INFO:teuthology.orchestra.run.smithi078.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-22T08:14:38.470 INFO:teuthology.orchestra.run.smithi171.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-22T08:14:38.474 INFO:teuthology.orchestra.run.smithi078.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-22T08:14:38.495 INFO:teuthology.orchestra.run.smithi171.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-22T08:14:38.521 INFO:teuthology.orchestra.run.smithi171.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 250 kB/s | 13 kB 00:00 2024-09-22T08:14:38.541 INFO:teuthology.orchestra.run.smithi078.stdout:(179/286): openblas-openmp-0.3.26-2.el9.x86_64. 13 MB/s | 4.9 MB 00:00 2024-09-22T08:14:38.546 INFO:teuthology.orchestra.run.smithi171.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 712 kB/s | 36 kB 00:00 2024-09-22T08:14:38.566 INFO:teuthology.orchestra.run.smithi078.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 107 kB 00:00 2024-09-22T08:14:38.588 INFO:teuthology.orchestra.run.smithi171.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-22T08:14:38.600 INFO:teuthology.orchestra.run.smithi078.stdout:(181/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.6 MB/s | 246 kB 00:00 2024-09-22T08:14:38.614 INFO:teuthology.orchestra.run.smithi171.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-22T08:14:38.617 INFO:teuthology.orchestra.run.smithi078.stdout:(182/286): pipewire-jack-audio-connection-kit-1 183 kB/s | 9.1 kB 00:00 2024-09-22T08:14:38.642 INFO:teuthology.orchestra.run.smithi078.stdout:(183/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 569 kB/s | 57 kB 00:00 2024-09-22T08:14:38.664 INFO:teuthology.orchestra.run.smithi171.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-22T08:14:38.667 INFO:teuthology.orchestra.run.smithi078.stdout:(184/286): pipewire-jack-audio-connection-kit-l 2.0 MB/s | 135 kB 00:00 2024-09-22T08:14:38.681 INFO:teuthology.orchestra.run.smithi171.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 264 kB/s | 18 kB 00:00 2024-09-22T08:14:38.701 INFO:teuthology.orchestra.run.smithi078.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-22T08:14:38.743 INFO:teuthology.orchestra.run.smithi078.stdout:(186/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 15 MB/s | 1.9 MB 00:00 2024-09-22T08:14:38.748 INFO:teuthology.orchestra.run.smithi171.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 18 MB/s | 1.5 MB 00:00 2024-09-22T08:14:38.760 INFO:teuthology.orchestra.run.smithi078.stdout:(187/286): plexus-cipher-1.7-27.el9.noarch.rpm 280 kB/s | 26 kB 00:00 2024-09-22T08:14:38.777 INFO:teuthology.orchestra.run.smithi078.stdout:(188/286): plexus-classworlds-2.6.0-11.el9.noar 794 kB/s | 60 kB 00:00 2024-09-22T08:14:38.780 INFO:teuthology.orchestra.run.smithi171.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 91 kB/s | 9.0 kB 00:00 2024-09-22T08:14:38.794 INFO:teuthology.orchestra.run.smithi078.stdout:(189/286): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-22T08:14:38.814 INFO:teuthology.orchestra.run.smithi171.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 7.7 MB/s | 517 kB 00:00 2024-09-22T08:14:38.819 INFO:teuthology.orchestra.run.smithi078.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-22T08:14:38.836 INFO:teuthology.orchestra.run.smithi078.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 574 kB/s | 34 kB 00:00 2024-09-22T08:14:38.839 INFO:teuthology.orchestra.run.smithi171.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-22T08:14:38.861 INFO:teuthology.orchestra.run.smithi078.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-22T08:14:38.881 INFO:teuthology.orchestra.run.smithi171.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.6 MB/s | 112 kB 00:00 2024-09-22T08:14:38.895 INFO:teuthology.orchestra.run.smithi078.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-22T08:14:38.920 INFO:teuthology.orchestra.run.smithi078.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-22T08:14:38.923 INFO:teuthology.orchestra.run.smithi171.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 270 kB/s | 11 kB 00:00 2024-09-22T08:14:38.962 INFO:teuthology.orchestra.run.smithi078.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 15 MB/s | 1.9 MB 00:00 2024-09-22T08:14:38.988 INFO:teuthology.orchestra.run.smithi078.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-22T08:14:38.990 INFO:teuthology.orchestra.run.smithi171.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-22T08:14:39.021 INFO:teuthology.orchestra.run.smithi078.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-22T08:14:39.055 INFO:teuthology.orchestra.run.smithi078.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-22T08:14:39.082 INFO:teuthology.orchestra.run.smithi171.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-22T08:14:39.097 INFO:teuthology.orchestra.run.smithi078.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.2 MB/s | 245 kB 00:00 2024-09-22T08:14:39.130 INFO:teuthology.orchestra.run.smithi078.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 3.2 MB/s | 248 kB 00:00 2024-09-22T08:14:39.149 INFO:teuthology.orchestra.run.smithi171.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 543 kB/s | 36 kB 00:00 2024-09-22T08:14:39.155 INFO:teuthology.orchestra.run.smithi078.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 438 kB/s | 26 kB 00:00 2024-09-22T08:14:39.181 INFO:teuthology.orchestra.run.smithi078.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 383 kB/s | 19 kB 00:00 2024-09-22T08:14:39.256 INFO:teuthology.orchestra.run.smithi078.stdout:(203/286): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-22T08:14:39.281 INFO:teuthology.orchestra.run.smithi078.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 346 kB/s | 35 kB 00:00 2024-09-22T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:(205/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-22T08:14:39.333 INFO:teuthology.orchestra.run.smithi171.stdout:(168/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 18 MB/s | 8.8 MB 00:00 2024-09-22T08:14:39.357 INFO:teuthology.orchestra.run.smithi078.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.2 MB/s | 250 kB 00:00 2024-09-22T08:14:39.358 INFO:teuthology.orchestra.run.smithi171.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 220 kB/s | 46 kB 00:00 2024-09-22T08:14:39.382 INFO:teuthology.orchestra.run.smithi078.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.2 MB/s | 222 kB 00:00 2024-09-22T08:14:39.384 INFO:teuthology.orchestra.run.smithi171.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 646 kB/s | 32 kB 00:00 2024-09-22T08:14:39.407 INFO:teuthology.orchestra.run.smithi078.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-22T08:14:39.409 INFO:teuthology.orchestra.run.smithi171.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 762 kB/s | 38 kB 00:00 2024-09-22T08:14:39.433 INFO:teuthology.orchestra.run.smithi078.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 841 kB/s | 42 kB 00:00 2024-09-22T08:14:39.468 INFO:teuthology.orchestra.run.smithi171.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-22T08:14:39.508 INFO:teuthology.orchestra.run.smithi078.stdout:(210/286): python3-numpy-1.20.1-5.el9.x86_64.rp 20 MB/s | 5.1 MB 00:00 2024-09-22T08:14:39.527 INFO:teuthology.orchestra.run.smithi171.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2024-09-22T08:14:39.533 INFO:teuthology.orchestra.run.smithi078.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.5 MB/s | 159 kB 00:00 2024-09-22T08:14:39.559 INFO:teuthology.orchestra.run.smithi078.stdout:(212/286): python3-protobuf-3.14.0-13.el9.noarc 1.7 MB/s | 269 kB 00:00 2024-09-22T08:14:39.584 INFO:teuthology.orchestra.run.smithi078.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-09-22T08:14:39.610 INFO:teuthology.orchestra.run.smithi078.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-22T08:14:39.610 INFO:teuthology.orchestra.run.smithi171.stdout:(174/286): openblas-openmp-0.3.26-2.el9.x86_64. 22 MB/s | 4.9 MB 00:00 2024-09-22T08:14:39.634 INFO:teuthology.orchestra.run.smithi078.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 713 kB/s | 54 kB 00:00 2024-09-22T08:14:39.636 INFO:teuthology.orchestra.run.smithi171.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.6 MB/s | 183 kB 00:00 2024-09-22T08:14:39.677 INFO:teuthology.orchestra.run.smithi078.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-22T08:14:39.687 INFO:teuthology.orchestra.run.smithi171.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 6.9 MB/s | 531 kB 00:00 2024-09-22T08:14:39.701 INFO:teuthology.orchestra.run.smithi078.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-22T08:14:39.712 INFO:teuthology.orchestra.run.smithi171.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 979 kB/s | 74 kB 00:00 2024-09-22T08:14:39.727 INFO:teuthology.orchestra.run.smithi078.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-22T08:14:39.745 INFO:teuthology.orchestra.run.smithi171.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-22T08:14:39.752 INFO:teuthology.orchestra.run.smithi078.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-22T08:14:39.777 INFO:teuthology.orchestra.run.smithi078.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-22T08:14:39.779 INFO:teuthology.orchestra.run.smithi171.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 3.6 MB/s | 246 kB 00:00 2024-09-22T08:14:39.805 INFO:teuthology.orchestra.run.smithi171.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-22T08:14:39.811 INFO:teuthology.orchestra.run.smithi078.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 510 kB 00:00 2024-09-22T08:14:39.830 INFO:teuthology.orchestra.run.smithi171.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-22T08:14:39.836 INFO:teuthology.orchestra.run.smithi078.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 69 kB 00:00 2024-09-22T08:14:39.870 INFO:teuthology.orchestra.run.smithi078.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-22T08:14:39.895 INFO:teuthology.orchestra.run.smithi078.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-22T08:14:39.918 INFO:teuthology.orchestra.run.smithi171.stdout:(182/286): pipewire-jack-audio-connection-kit-1 81 kB/s | 9.1 kB 00:00 2024-09-22T08:14:39.929 INFO:teuthology.orchestra.run.smithi078.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.6 MB/s | 152 kB 00:00 2024-09-22T08:14:39.948 INFO:teuthology.orchestra.run.smithi171.stdout:(183/286): pipewire-jack-audio-connection-kit-l 1.1 MB/s | 135 kB 00:00 2024-09-22T08:14:39.954 INFO:teuthology.orchestra.run.smithi078.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.2 MB/s | 555 kB 00:00 2024-09-22T08:14:40.006 INFO:teuthology.orchestra.run.smithi171.stdout:(184/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-22T08:14:40.057 INFO:teuthology.orchestra.run.smithi171.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-09-22T08:14:40.082 INFO:teuthology.orchestra.run.smithi171.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 343 kB/s | 26 kB 00:00 2024-09-22T08:14:40.108 INFO:teuthology.orchestra.run.smithi171.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-22T08:14:40.122 INFO:teuthology.orchestra.run.smithi078.stdout:(227/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-22T08:14:40.133 INFO:teuthology.orchestra.run.smithi171.stdout:(188/286): plexus-containers-component-annotati 364 kB/s | 18 kB 00:00 2024-09-22T08:14:40.138 INFO:teuthology.orchestra.run.smithi078.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 289 kB/s | 53 kB 00:00 2024-09-22T08:14:40.158 INFO:teuthology.orchestra.run.smithi171.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 80 kB 00:00 2024-09-22T08:14:40.180 INFO:teuthology.orchestra.run.smithi078.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.7 MB/s | 944 kB 00:00 2024-09-22T08:14:40.184 INFO:teuthology.orchestra.run.smithi171.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 666 kB/s | 34 kB 00:00 2024-09-22T08:14:40.205 INFO:teuthology.orchestra.run.smithi078.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 173 kB 00:00 2024-09-22T08:14:40.217 INFO:teuthology.orchestra.run.smithi171.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 254 kB 00:00 2024-09-22T08:14:40.231 INFO:teuthology.orchestra.run.smithi078.stdout:(231/286): tzdata-java-2024a-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-22T08:14:40.256 INFO:teuthology.orchestra.run.smithi078.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-22T08:14:40.268 INFO:teuthology.orchestra.run.smithi171.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-22T08:14:40.281 INFO:teuthology.orchestra.run.smithi078.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-22T08:14:40.324 INFO:teuthology.orchestra.run.smithi078.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.8 MB/s | 358 kB 00:00 2024-09-22T08:14:40.327 INFO:teuthology.orchestra.run.smithi171.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.6 MB/s | 152 kB 00:00 2024-09-22T08:14:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 460 kB/s | 42 kB 00:00 2024-09-22T08:14:40.374 INFO:teuthology.orchestra.run.smithi078.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.1 MB/s | 385 kB 00:00 2024-09-22T08:14:40.385 INFO:teuthology.orchestra.run.smithi171.stdout:(194/286): poppler-data-0.4.9-9.el9.noarch.rpm 11 MB/s | 1.9 MB 00:00 2024-09-22T08:14:40.399 INFO:teuthology.orchestra.run.smithi078.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-22T08:14:40.428 INFO:teuthology.orchestra.run.smithi171.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-22T08:14:40.453 INFO:teuthology.orchestra.run.smithi171.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-22T08:14:40.466 INFO:teuthology.orchestra.run.smithi078.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 7.2 MB/s | 859 kB 00:00 2024-09-22T08:14:40.492 INFO:teuthology.orchestra.run.smithi078.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 543 kB/s | 64 kB 00:00 2024-09-22T08:14:40.495 INFO:teuthology.orchestra.run.smithi171.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.9 MB/s | 679 kB 00:00 2024-09-22T08:14:40.517 INFO:teuthology.orchestra.run.smithi078.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.2 MB/s | 505 kB 00:00 2024-09-22T08:14:40.562 INFO:teuthology.orchestra.run.smithi171.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-22T08:14:40.575 INFO:teuthology.orchestra.run.smithi078.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-22T08:14:40.601 INFO:teuthology.orchestra.run.smithi078.stdout:(242/286): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-22T08:14:40.621 INFO:teuthology.orchestra.run.smithi171.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-22T08:14:40.634 INFO:teuthology.orchestra.run.smithi078.stdout:(243/286): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-22T08:14:40.660 INFO:teuthology.orchestra.run.smithi078.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-22T08:14:40.663 INFO:teuthology.orchestra.run.smithi171.stdout:(200/286): python3-jsonpatch-1.21-16.el9.noarch 613 kB/s | 26 kB 00:00 2024-09-22T08:14:40.685 INFO:teuthology.orchestra.run.smithi078.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-22T08:14:40.747 INFO:teuthology.orchestra.run.smithi171.stdout:(201/286): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-22T08:14:40.772 INFO:teuthology.orchestra.run.smithi171.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 176 kB/s | 19 kB 00:00 2024-09-22T08:14:40.785 INFO:teuthology.orchestra.run.smithi078.stdout:(246/286): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-22T08:14:40.810 INFO:teuthology.orchestra.run.smithi078.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-09-22T08:14:40.861 INFO:teuthology.orchestra.run.smithi078.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-22T08:14:40.894 INFO:teuthology.orchestra.run.smithi078.stdout:(249/286): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-09-22T08:14:40.969 INFO:teuthology.orchestra.run.smithi078.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 839 kB 00:00 2024-09-22T08:14:41.003 INFO:teuthology.orchestra.run.smithi078.stdout:(251/286): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-22T08:14:41.029 INFO:teuthology.orchestra.run.smithi078.stdout:(252/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 740 kB/s | 43 kB 00:00 2024-09-22T08:14:41.054 INFO:teuthology.orchestra.run.smithi078.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-22T08:14:41.079 INFO:teuthology.orchestra.run.smithi078.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-22T08:14:41.105 INFO:teuthology.orchestra.run.smithi078.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-22T08:14:41.131 INFO:teuthology.orchestra.run.smithi171.stdout:(203/286): java-11-openjdk-headless-11.0.20.1.1 9.0 MB/s | 39 MB 00:04 2024-09-22T08:14:41.146 INFO:teuthology.orchestra.run.smithi078.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-22T08:14:41.156 INFO:teuthology.orchestra.run.smithi171.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 90 kB/s | 35 kB 00:00 2024-09-22T08:14:41.172 INFO:teuthology.orchestra.run.smithi078.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-22T08:14:41.190 INFO:teuthology.orchestra.run.smithi171.stdout:(205/286): python3-mako-1.1.4-6.el9.noarch.rpm 389 kB/s | 172 kB 00:00 2024-09-22T08:14:41.197 INFO:teuthology.orchestra.run.smithi078.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-22T08:14:41.215 INFO:teuthology.orchestra.run.smithi171.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-22T08:14:41.222 INFO:teuthology.orchestra.run.smithi078.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-22T08:14:41.249 INFO:teuthology.orchestra.run.smithi171.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-22T08:14:41.274 INFO:teuthology.orchestra.run.smithi171.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-22T08:14:41.289 INFO:teuthology.orchestra.run.smithi078.stdout:(260/286): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-22T08:14:41.299 INFO:teuthology.orchestra.run.smithi171.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 839 kB/s | 42 kB 00:00 2024-09-22T08:14:41.306 INFO:teuthology.orchestra.run.smithi078.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-22T08:14:41.323 INFO:teuthology.orchestra.run.smithi078.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-22T08:14:41.340 INFO:teuthology.orchestra.run.smithi078.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-22T08:14:41.342 INFO:teuthology.orchestra.run.smithi171.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 3.9 MB/s | 269 kB 00:00 2024-09-22T08:14:41.357 INFO:teuthology.orchestra.run.smithi078.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-22T08:14:41.367 INFO:teuthology.orchestra.run.smithi171.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.3 MB/s | 159 kB 00:00 2024-09-22T08:14:41.374 INFO:teuthology.orchestra.run.smithi078.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-22T08:14:41.399 INFO:teuthology.orchestra.run.smithi078.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:14:41.409 INFO:teuthology.orchestra.run.smithi171.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 4.1 MB/s | 279 kB 00:00 2024-09-22T08:14:41.424 INFO:teuthology.orchestra.run.smithi078.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-22T08:14:41.434 INFO:teuthology.orchestra.run.smithi171.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-09-22T08:14:41.458 INFO:teuthology.orchestra.run.smithi078.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-22T08:14:41.460 INFO:teuthology.orchestra.run.smithi171.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-22T08:14:41.492 INFO:teuthology.orchestra.run.smithi078.stdout:(269/286): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-22T08:14:41.510 INFO:teuthology.orchestra.run.smithi171.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-22T08:14:41.517 INFO:teuthology.orchestra.run.smithi078.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-22T08:14:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-22T08:14:41.569 INFO:teuthology.orchestra.run.smithi171.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-22T08:14:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-22T08:14:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-22T08:14:41.628 INFO:teuthology.orchestra.run.smithi171.stdout:(217/286): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-22T08:14:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-22T08:14:41.660 INFO:teuthology.orchestra.run.smithi078.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-22T08:14:41.686 INFO:teuthology.orchestra.run.smithi078.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-22T08:14:41.704 INFO:teuthology.orchestra.run.smithi171.stdout:(218/286): python3-numpy-1.20.1-5.el9.x86_64.rp 8.9 MB/s | 5.1 MB 00:00 2024-09-22T08:14:41.729 INFO:teuthology.orchestra.run.smithi171.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-09-22T08:14:41.744 INFO:teuthology.orchestra.run.smithi078.stdout:(277/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-22T08:14:41.754 INFO:teuthology.orchestra.run.smithi171.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-22T08:14:41.769 INFO:teuthology.orchestra.run.smithi078.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-09-22T08:14:41.795 INFO:teuthology.orchestra.run.smithi078.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-22T08:14:41.796 INFO:teuthology.orchestra.run.smithi171.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.4 MB/s | 510 kB 00:00 2024-09-22T08:14:41.820 INFO:teuthology.orchestra.run.smithi078.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-22T08:14:41.821 INFO:teuthology.orchestra.run.smithi171.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-22T08:14:41.845 INFO:teuthology.orchestra.run.smithi078.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-22T08:14:41.871 INFO:teuthology.orchestra.run.smithi078.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-22T08:14:41.872 INFO:teuthology.orchestra.run.smithi171.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-22T08:14:41.896 INFO:teuthology.orchestra.run.smithi078.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-22T08:14:41.897 INFO:teuthology.orchestra.run.smithi171.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 4.9 MB/s | 383 kB 00:00 2024-09-22T08:14:41.931 INFO:teuthology.orchestra.run.smithi171.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-22T08:14:41.946 INFO:teuthology.orchestra.run.smithi078.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:14:41.990 INFO:teuthology.orchestra.run.smithi171.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 5.9 MB/s | 555 kB 00:00 2024-09-22T08:14:42.139 INFO:teuthology.orchestra.run.smithi078.stdout:(285/286): librados2-19.3.0-5106.g8852379c.el9. 13 MB/s | 3.5 MB 00:00 2024-09-22T08:14:42.148 INFO:teuthology.orchestra.run.smithi171.stdout:(227/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-22T08:14:42.165 INFO:teuthology.orchestra.run.smithi171.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 303 kB/s | 53 kB 00:00 2024-09-22T08:14:42.197 INFO:teuthology.orchestra.run.smithi078.stdout:(286/286): librbd1-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-22T08:14:42.199 INFO:teuthology.orchestra.run.smithi171.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.4 MB/s | 944 kB 00:00 2024-09-22T08:14:42.203 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:14:42.203 INFO:teuthology.orchestra.run.smithi078.stdout:Total 21 MB/s | 322 MB 00:15 2024-09-22T08:14:42.224 INFO:teuthology.orchestra.run.smithi171.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-22T08:14:42.250 INFO:teuthology.orchestra.run.smithi171.stdout:(231/286): tzdata-java-2024a-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-22T08:14:42.275 INFO:teuthology.orchestra.run.smithi171.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 3.9 MB/s | 306 kB 00:00 2024-09-22T08:14:42.301 INFO:teuthology.orchestra.run.smithi171.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-22T08:14:42.326 INFO:teuthology.orchestra.run.smithi171.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 4.6 MB/s | 358 kB 00:00 2024-09-22T08:14:42.343 INFO:teuthology.orchestra.run.smithi171.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 630 kB/s | 42 kB 00:00 2024-09-22T08:14:42.369 INFO:teuthology.orchestra.run.smithi171.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.6 MB/s | 385 kB 00:00 2024-09-22T08:14:42.394 INFO:teuthology.orchestra.run.smithi171.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.9 MB/s | 134 kB 00:00 2024-09-22T08:14:42.436 INFO:teuthology.orchestra.run.smithi171.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 9.1 MB/s | 859 kB 00:00 2024-09-22T08:14:42.461 INFO:teuthology.orchestra.run.smithi171.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 688 kB/s | 64 kB 00:00 2024-09-22T08:14:42.495 INFO:teuthology.orchestra.run.smithi171.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.9 MB/s | 505 kB 00:00 2024-09-22T08:14:42.546 INFO:teuthology.orchestra.run.smithi171.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-22T08:14:42.579 INFO:teuthology.orchestra.run.smithi171.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-22T08:14:42.604 INFO:teuthology.orchestra.run.smithi171.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-22T08:14:42.730 INFO:teuthology.orchestra.run.smithi171.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-22T08:14:42.772 INFO:teuthology.orchestra.run.smithi171.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 945 kB/s | 26 kB 00:00 2024-09-22T08:14:42.797 INFO:teuthology.orchestra.run.smithi171.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-22T08:14:42.831 INFO:teuthology.orchestra.run.smithi171.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-22T08:14:42.856 INFO:teuthology.orchestra.run.smithi171.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-09-22T08:14:42.890 INFO:teuthology.orchestra.run.smithi171.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-22T08:14:42.924 INFO:teuthology.orchestra.run.smithi171.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-22T08:14:42.949 INFO:teuthology.orchestra.run.smithi171.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-22T08:14:42.974 INFO:teuthology.orchestra.run.smithi171.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-22T08:14:43.000 INFO:teuthology.orchestra.run.smithi171.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-22T08:14:43.025 INFO:teuthology.orchestra.run.smithi171.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-22T08:14:43.059 INFO:teuthology.orchestra.run.smithi171.stdout:(255/286): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-22T08:14:43.084 INFO:teuthology.orchestra.run.smithi171.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-22T08:14:43.110 INFO:teuthology.orchestra.run.smithi171.stdout:(257/286): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-22T08:14:43.160 INFO:teuthology.orchestra.run.smithi171.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-22T08:14:43.202 INFO:teuthology.orchestra.run.smithi171.stdout:(259/286): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-09-22T08:14:43.228 INFO:teuthology.orchestra.run.smithi171.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-09-22T08:14:43.253 INFO:teuthology.orchestra.run.smithi171.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 349 kB/s | 18 kB 00:00 2024-09-22T08:14:43.279 INFO:teuthology.orchestra.run.smithi171.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 458 kB/s | 23 kB 00:00 2024-09-22T08:14:43.296 INFO:teuthology.orchestra.run.smithi171.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 462 kB/s | 19 kB 00:00 2024-09-22T08:14:43.312 INFO:teuthology.orchestra.run.smithi171.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-22T08:14:43.338 INFO:teuthology.orchestra.run.smithi171.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-22T08:14:43.363 INFO:teuthology.orchestra.run.smithi171.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:14:43.380 INFO:teuthology.orchestra.run.smithi171.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-22T08:14:43.406 INFO:teuthology.orchestra.run.smithi171.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-22T08:14:43.431 INFO:teuthology.orchestra.run.smithi171.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-22T08:14:43.473 INFO:teuthology.orchestra.run.smithi171.stdout:(270/286): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-22T08:14:43.515 INFO:teuthology.orchestra.run.smithi171.stdout:(271/286): protobuf-compiler-3.14.0-13.el9.x86_ 819 kB/s | 863 kB 00:01 2024-09-22T08:14:43.541 INFO:teuthology.orchestra.run.smithi171.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-09-22T08:14:43.574 INFO:teuthology.orchestra.run.smithi171.stdout:(273/286): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2024-09-22T08:14:43.600 INFO:teuthology.orchestra.run.smithi171.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-22T08:14:43.625 INFO:teuthology.orchestra.run.smithi171.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 736 kB/s | 36 kB 00:00 2024-09-22T08:14:43.651 INFO:teuthology.orchestra.run.smithi171.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-22T08:14:43.684 INFO:teuthology.orchestra.run.smithi171.stdout:(277/286): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-22T08:14:43.710 INFO:teuthology.orchestra.run.smithi171.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-22T08:14:43.743 INFO:teuthology.orchestra.run.smithi171.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-22T08:14:43.769 INFO:teuthology.orchestra.run.smithi171.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-22T08:14:43.795 INFO:teuthology.orchestra.run.smithi171.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-22T08:14:43.819 INFO:teuthology.orchestra.run.smithi171.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-22T08:14:43.845 INFO:teuthology.orchestra.run.smithi171.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-22T08:14:43.895 INFO:teuthology.orchestra.run.smithi171.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:14:44.071 INFO:teuthology.orchestra.run.smithi171.stdout:(285/286): librbd1-19.3.0-5106.g8852379c.el9.x8 14 MB/s | 3.2 MB 00:00 2024-09-22T08:14:44.396 INFO:teuthology.orchestra.run.smithi171.stdout:(286/286): librados2-19.3.0-5106.g8852379c.el9. 6.0 MB/s | 3.5 MB 00:00 2024-09-22T08:14:44.403 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:14:44.403 INFO:teuthology.orchestra.run.smithi171.stdout:Total 19 MB/s | 322 MB 00:16 2024-09-22T08:14:45.419 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-22T08:14:45.603 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-22T08:14:45.604 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-22T08:14:47.422 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-22T08:14:47.608 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-22T08:14:47.608 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-22T08:14:48.798 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-22T08:14:48.798 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-22T08:14:50.920 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-22T08:14:50.921 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-22T08:14:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:14:59.029 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:14:59.190 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-22T08:14:59.269 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:14:59.302 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:14:59.378 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:14:59.431 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:14:59.487 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:14:59.528 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:14:59.612 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:14:59.850 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:15:00.213 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:15:00.330 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:15:00.463 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:15:00.497 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:15:00.580 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:15:00.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:15:00.658 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:15:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:15:00.712 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:15:00.738 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:15:00.779 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:15:00.812 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:15:00.838 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:15:00.866 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:15:01.036 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:15:01.167 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:15:01.171 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:15:01.200 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:15:01.237 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:15:01.265 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:15:01.341 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:15:01.379 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:15:01.408 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:15:01.470 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:15:01.495 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:15:01.497 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-22T08:15:01.517 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:15:01.549 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:15:01.578 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:15:01.622 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:15:01.700 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:15:01.754 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:15:01.758 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:15:01.793 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:15:01.820 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:15:01.871 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:15:01.896 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:15:01.905 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:15:01.940 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:15:01.942 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:15:01.976 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:15:02.050 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:15:02.102 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:15:02.142 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:15:02.185 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:15:02.218 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:15:02.245 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:15:02.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:15:02.292 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:15:02.295 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:15:02.324 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:15:02.357 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:15:02.382 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:15:02.415 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:15:02.426 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:15:02.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:15:02.525 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:15:02.538 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:15:02.575 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:15:02.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:15:02.620 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:15:02.649 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:15:02.663 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:15:02.679 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:15:02.699 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:15:02.718 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:15:02.740 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:15:02.748 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:15:02.773 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:15:02.799 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:15:02.830 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:15:02.857 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:15:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:15:02.898 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:15:02.910 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:15:02.933 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:15:02.952 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:15:02.970 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:15:03.029 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:15:03.132 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:15:03.179 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:15:03.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:15:03.285 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:15:03.334 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:15:03.371 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:15:03.415 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:15:03.525 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:15:03.550 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:15:03.612 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:15:03.637 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:15:03.669 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:15:03.692 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:15:03.764 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:15:03.843 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:15:03.847 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:15:03.871 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:15:03.877 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:15:03.940 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:15:03.977 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:15:03.995 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:15:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:15:04.025 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:15:04.042 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:15:04.061 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:15:04.113 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:15:04.143 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:15:04.153 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:15:04.186 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:15:04.204 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:15:04.222 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:15:04.245 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:15:04.260 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:15:04.288 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:15:04.292 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:15:04.313 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:15:04.325 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:15:04.340 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:15:04.365 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:15:04.366 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:15:04.397 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:15:04.425 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:15:04.428 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:15:04.460 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:15:04.469 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:15:04.496 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:15:04.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:15:04.544 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:15:04.592 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:15:04.597 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:15:04.661 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:15:04.670 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:15:04.719 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:15:04.743 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:15:04.750 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:15:04.782 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:15:04.803 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:15:04.818 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:15:04.845 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:15:04.865 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:15:04.896 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:15:04.910 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:15:04.961 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:15:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:15:05.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:15:05.066 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:15:05.100 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:15:05.108 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:15:05.145 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:15:05.185 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:15:05.187 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:15:05.292 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:15:05.329 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:15:05.330 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:15:05.369 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:15:05.402 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:15:05.404 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:15:05.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:15:05.520 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:15:05.648 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:15:05.690 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:15:05.901 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:15:05.941 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:15:05.948 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:15:05.980 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:15:06.010 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:15:06.034 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:15:06.052 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:15:06.071 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:15:06.080 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:15:06.093 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:15:06.094 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:15:06.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:06.140 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:15:06.186 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:15:06.222 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:15:06.252 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:15:06.285 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:15:06.323 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:15:06.358 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:15:06.367 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:15:06.388 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:15:06.420 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:15:06.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:15:06.453 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:15:06.461 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:15:06.478 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:15:06.494 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:15:06.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:15:06.526 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:15:06.576 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:15:06.635 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:15:06.671 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:15:06.707 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:15:06.801 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:15:06.874 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:15:06.924 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:06.947 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:15:06.967 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:06.982 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:06.982 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:15:06.982 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:06.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:15:07.022 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:15:07.031 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:15:07.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:15:07.069 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:15:07.099 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:15:07.114 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:15:07.141 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:15:07.157 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:15:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:15:07.263 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:15:07.297 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:15:07.305 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:15:07.334 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:15:07.345 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:15:07.375 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:15:07.449 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:15:07.481 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:15:07.496 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:15:07.519 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:15:07.559 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:15:07.592 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:15:07.625 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:15:07.720 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:15:07.855 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:15:08.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:15:08.099 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:15:08.148 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:15:08.180 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:15:08.209 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:15:08.233 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:15:08.259 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:15:08.285 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:15:08.288 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:15:08.301 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:15:08.301 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:15:08.302 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:08.318 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:15:08.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:15:08.476 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:15:08.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:15:08.580 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:15:08.638 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:15:08.663 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:15:08.667 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:15:08.688 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:15:08.709 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:15:08.715 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:15:08.762 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:15:09.133 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:09.162 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:09.176 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:15:09.176 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:15:09.176 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:09.219 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:15:09.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:15:09.263 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:15:09.287 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:15:09.329 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:15:09.349 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:15:09.363 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:15:09.387 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:15:09.438 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:15:09.463 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:15:09.479 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:15:09.519 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:15:09.569 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:15:09.662 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:15:09.673 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:15:09.693 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:15:09.736 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:15:09.777 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:15:10.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:15:10.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:15:10.526 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:15:10.560 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:15:10.575 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:15:10.665 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:15:10.703 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:15:10.893 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:15:10.951 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:15:11.000 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:15:11.511 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:15:11.577 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:15:11.614 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:15:11.649 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:15:11.682 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:15:11.866 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:15:11.875 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:15:11.888 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:15:11.958 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:15:11.971 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:15:12.021 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:15:12.056 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:15:12.085 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:15:12.138 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:15:12.150 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:15:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:15:12.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:12.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:15:12.242 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:15:12.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:15:12.589 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:15:12.634 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:15:12.660 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:15:12.734 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:15:12.766 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:15:12.774 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:15:12.798 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:15:12.827 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:15:12.890 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:15:12.927 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:15:12.952 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:15:12.990 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:15:13.016 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:15:13.309 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:15:13.353 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:15:13.388 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:15:13.414 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:15:13.440 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:15:13.464 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:15:13.489 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:15:13.517 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:15:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:15:13.600 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:15:13.639 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:15:13.686 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:15:13.713 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:15:14.045 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:15:14.122 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:15:14.176 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:15:14.182 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:15:14.216 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:15:14.243 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:15:14.273 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:15:14.285 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:15:14.285 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:15:14.285 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:14.306 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:15:14.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:15:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:15:14.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:15:14.394 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:15:14.398 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:15:14.423 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:15:14.493 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:15:14.539 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:15:14.562 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:15:14.583 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:15:14.609 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:15:14.635 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:15:14.669 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:15:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:15:14.719 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:15:14.770 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:15:14.852 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:15:14.885 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:15:14.918 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:15:14.981 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:15:15.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:15:15.073 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:15:15.098 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:15:15.142 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:15:15.180 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:15:15.431 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:15:15.473 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:15:15.503 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:15:15.528 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:15:15.554 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:15:15.579 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:15:15.604 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:15:15.633 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:15:15.669 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:15:15.787 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:15:16.050 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:15:16.202 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:15:16.245 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:15:16.709 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:15:16.843 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:15:16.910 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:15:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:15:16.963 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:15:17.032 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:15:17.072 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:15:17.096 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:15:17.115 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:15:17.142 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:15:17.169 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:15:17.205 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:15:17.224 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:15:26.222 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:15:26.265 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:15:26.293 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:15:26.333 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:15:26.367 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:15:26.404 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:15:26.911 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:15:26.942 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:15:27.014 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:15:27.044 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:15:28.879 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:15:28.921 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:15:28.949 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:15:28.989 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:15:29.015 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:15:29.052 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:15:29.457 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:29.510 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:29.594 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:15:29.633 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:15:29.722 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:15:29.752 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:15:30.068 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:30.105 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:15:30.204 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:15:30.205 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:15:30.205 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:15:30.205 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:30.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:15:32.109 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:32.146 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:32.699 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:15:32.733 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:15:32.822 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:15:32.823 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:15:32.823 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:15:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:32.851 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-22T08:15:39.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:39.738 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:15:39.754 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:15:39.754 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:39.754 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:15:39.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:41.214 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:15:41.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:41.464 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:15:41.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:41.931 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:15:41.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:42.057 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-09-22T08:15:42.244 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:42.415 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:15:42.431 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:15:42.431 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:42.431 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:15:42.431 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:43.899 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:15:43.926 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:15:43.926 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:43.926 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:15:43.926 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:15:43.926 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:15:43.927 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:44.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:15:44.181 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:15:44.182 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:44.182 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:15:44.182 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:15:44.182 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:15:44.182 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:44.625 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:15:44.649 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:15:44.649 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:44.649 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:15:44.649 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:15:44.650 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:15:44.650 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:44.752 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:15:44.911 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:15:45.250 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:15:45.307 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:15:45.369 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:15:45.556 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:15:45.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:15:45.688 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:15:45.778 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:15:45.952 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:15:46.000 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:15:46.881 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:15:46.934 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:15:47.299 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:15:47.363 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:15:47.396 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:15:47.424 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:15:47.459 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:15:47.496 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:15:47.523 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:15:47.549 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:15:47.575 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:15:47.599 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:15:47.619 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:15:47.626 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:15:47.651 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:15:47.678 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:15:47.708 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:15:47.726 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:15:47.736 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:15:47.771 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:15:47.784 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:15:47.807 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:15:47.838 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:15:47.854 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:15:47.872 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:15:47.907 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:15:47.943 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:15:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:15:48.024 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:15:48.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:15:48.068 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:15:48.095 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:15:48.100 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:15:48.124 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:15:48.174 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:15:48.176 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:15:48.217 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:15:48.247 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:15:48.302 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:15:48.411 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:15:48.456 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:15:48.470 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:15:48.501 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:15:48.503 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:15:48.530 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:15:48.557 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:15:48.589 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:15:48.717 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:15:48.780 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:15:48.847 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:15:48.877 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:15:48.985 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:15:49.025 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:15:49.039 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:15:49.070 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:15:49.092 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:15:49.368 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:15:49.432 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:15:49.531 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:49.562 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:49.579 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:49.579 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:15:49.579 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:49.783 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:15:49.815 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:15:49.825 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:15:49.856 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:15:49.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:15:49.886 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:15:49.919 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:15:49.923 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:15:49.956 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:15:49.959 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:15:49.983 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:15:49.984 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:15:50.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:15:50.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:15:50.059 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:15:50.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:15:50.102 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:15:50.129 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:15:50.160 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:15:50.188 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:15:50.223 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:15:50.259 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:15:50.289 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:15:50.332 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:15:50.348 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:50.366 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:15:50.379 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:50.395 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:15:50.396 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:50.433 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:15:50.476 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:15:50.520 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:15:50.552 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:15:50.575 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:15:50.628 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:15:50.669 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:15:50.699 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:15:50.728 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:15:50.754 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:15:50.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:15:50.947 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:15:50.954 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:15:50.981 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:15:51.016 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:15:51.041 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:15:51.049 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:15:51.087 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:15:51.115 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:15:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:15:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:15:51.312 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:15:51.333 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:15:51.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:15:51.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:15:51.403 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:15:51.425 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:15:51.454 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:15:51.480 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:15:51.521 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:15:51.525 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:15:51.548 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:15:51.549 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:15:51.560 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:15:51.578 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:15:51.590 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:15:51.601 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:15:51.611 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:15:51.641 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:15:52.015 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:52.047 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:52.064 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:15:52.064 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:15:52.064 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:52.120 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:15:52.164 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:15:52.197 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:15:52.264 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:15:52.288 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:15:52.298 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:15:52.368 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:15:52.405 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:15:52.441 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:15:52.466 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:15:52.852 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:52.879 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:52.895 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:15:53.435 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:15:53.516 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:15:53.553 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:15:53.582 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:15:53.780 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:15:53.844 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:15:53.878 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:15:53.900 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:15:53.929 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:15:53.992 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:15:54.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:15:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:15:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:15:54.089 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:15:54.116 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:15:54.570 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:15:54.596 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:15:54.638 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:15:54.705 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:15:54.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:15:55.505 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:15:55.811 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:15:56.774 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:15:56.811 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:15:56.928 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:15:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:15:57.130 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:15:57.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:57.205 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:15:57.217 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:15:57.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:15:57.268 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:15:57.317 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:15:57.340 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:15:57.357 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:15:57.357 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:15:57.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:57.932 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:15:57.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:15:58.325 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:15:58.348 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:15:58.348 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:58.348 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:15:58.348 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:15:58.348 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:15:58.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:58.392 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:15:58.415 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:15:58.415 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:58.415 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:15:58.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:58.743 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:15:58.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:15:58.944 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:15:58.976 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:15:59.092 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:15:59.255 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:15:59.315 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:15:59.339 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:15:59.388 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:15:59.399 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:15:59.422 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:15:59.451 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:15:59.500 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:15:59.523 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:15:59.539 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:15:59.539 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:15:59.539 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:00.550 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:16:00.576 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:16:00.576 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:16:00.576 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:16:00.576 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:16:00.577 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:16:00.577 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:00.618 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:16:00.641 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:16:00.641 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:16:00.641 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:16:00.641 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:00.961 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:16:00.986 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:16:03.140 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:16:03.171 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:16:03.276 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:16:03.356 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:16:03.387 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:16:03.388 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:16:03.480 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:16:03.480 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:03.594 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:16:03.600 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:16:03.610 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:16:03.621 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:16:03.621 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:16:03.621 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:16:03.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:03.681 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:16:03.750 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:16:05.282 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:16:05.323 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:16:05.354 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:16:05.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:16:05.514 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:16:05.545 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:16:05.545 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:16:05.638 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:16:05.638 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:05.737 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:05.752 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:16:05.759 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:16:05.768 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:16:05.778 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:16:05.778 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:16:05.778 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:16:05.778 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:05.833 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:16:05.902 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:16:14.117 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:14.117 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:16:14.117 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:16:14.117 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:16:14.117 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:16:14.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:16:14.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:16:14.141 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:16:14.142 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:16:14.143 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:16:14.144 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:16:14.145 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:16:14.146 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:16:14.147 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:16:14.148 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:16:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:16:14.150 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:16:14.151 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:16:14.152 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:16:14.153 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:16:14.154 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:16:14.155 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:16:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:16:14.157 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:16:14.158 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:16:14.159 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:16:16.014 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:16.014 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:16:16.014 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:16:16.015 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:16:16.016 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:16:16.017 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:16:16.018 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:16:16.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:16:16.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:16:16.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:16:16.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:16:16.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:16:16.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:16:16.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:16:16.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:16:16.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:16:16.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:16:16.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:16:16.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:16:16.031 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:16:16.032 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:16:16.033 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:16:16.034 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:16:17.544 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.545 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.546 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:16:17.547 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:16:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:16:17.549 INFO:teuthology.orchestra.run.smithi078.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:16:17.550 INFO:teuthology.orchestra.run.smithi078.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:16:17.551 INFO:teuthology.orchestra.run.smithi078.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:16:17.552 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:16:17.553 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:16:17.554 INFO:teuthology.orchestra.run.smithi078.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:16:17.555 INFO:teuthology.orchestra.run.smithi078.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:16:17.556 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:16:17.557 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:16:17.558 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:16:17.559 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.560 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.561 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:16:17.562 INFO:teuthology.orchestra.run.smithi078.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:17.563 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-22T08:16:17.954 DEBUG:teuthology.parallel:result is None 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:16:19.399 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.400 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.401 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:16:19.402 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:16:19.403 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:16:19.404 INFO:teuthology.orchestra.run.smithi171.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:16:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:16:19.406 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:16:19.407 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:16:19.408 INFO:teuthology.orchestra.run.smithi171.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:16:19.409 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:16:19.410 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.411 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:16:19.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:16:19.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:16:19.414 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:16:19.415 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:16:19.416 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:16:19.417 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:16:19.418 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:16:19.419 INFO:teuthology.orchestra.run.smithi171.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:16:19.419 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:19.419 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-22T08:16:19.846 DEBUG:teuthology.parallel:result is None 2024-09-22T08:16:19.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:16:19.997 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:16:20.084 INFO:teuthology.orchestra.run.smithi078.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:16:20.084 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:16:20.085 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:16:20.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:16:20.239 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:16:20.309 INFO:teuthology.orchestra.run.smithi171.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:16:20.310 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:16:20.310 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:16:20.312 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T08:16:20.312 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:20.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:16:20.359 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:20.359 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:16:20.400 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T08:16:20.400 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:20.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:16:20.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:16:20.523 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:20.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:16:20.563 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:16:20.641 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T08:16:20.641 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:20.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:16:20.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:16:20.760 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:20.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:16:20.798 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:16:20.876 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T08:16:20.877 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:20.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:16:20.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:16:20.995 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:20.995 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:16:21.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:16:21.110 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T08:16:21.195 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T08:16:21.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-09-22T08:16:21.198 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-09-22T08:16:21.235 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T08:16:21.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:16:21.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:16:21.315 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T08:16:21.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:16:21.356 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:16:21.405 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T08:16:21.406 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T08:16:21.406 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043', 'branch': 'wip-skoduri-cloud-restore', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7915043', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-cloud-restore'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-cloud-restore', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-cloud-restore', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBqZTeK8XsKizjuHExm58Y+CUCxfxv4AeYdpfAkBcCpsFZ7p6BYyA/s6NKaOOD5Y9KXZ1O9irVtMClKrZ420BY=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbOC1WmNcg12H8hW7ZcfY4IUU9ax2ar00OMmlthTNpBvuCmuUqC74EBMrakuq0yp2SNI6bR3HRO2NCss4023a8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-22_06:37:27', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T08:16:21.406 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:16:21.434 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:16:21.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:16:21.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:16:21.544 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:21.545 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:16:21.608 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:16:21.608 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-22 08:16:04.850543108 +0000 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-22 08:13:37.355220906 +0000 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-22 08:13:37.355220906 +0000 2024-09-22T08:16:21.678 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-22 08:13:37.355220906 +0000 2024-09-22T08:16:21.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:16:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-22T08:16:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-22T08:16:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000227732 s, 2.2 MB/s 2024-09-22T08:16:21.755 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:16:21.825 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-22T08:16:21.894 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-22 08:16:04.851543094 +0000 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-22 08:13:37.693215872 +0000 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-22 08:13:37.693215872 +0000 2024-09-22T08:16:21.895 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-22 08:13:37.693215872 +0000 2024-09-22T08:16:21.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:16:21.970 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-22T08:16:21.970 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-22T08:16:21.970 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000197518 s, 2.6 MB/s 2024-09-22T08:16:21.972 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:16:22.041 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-22T08:16:22.109 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-22 08:16:04.852543078 +0000 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-22 08:13:38.012211120 +0000 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-22 08:13:38.012211120 +0000 2024-09-22T08:16:22.110 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-22 08:13:38.012211120 +0000 2024-09-22T08:16:22.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:16:22.185 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-22T08:16:22.185 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-22T08:16:22.185 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000211543 s, 2.4 MB/s 2024-09-22T08:16:22.187 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:16:22.255 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-22T08:16:22.324 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-22 08:16:04.852543078 +0000 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-22 08:13:38.336206295 +0000 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-22 08:13:38.336206295 +0000 2024-09-22T08:16:22.325 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-22 08:13:38.336206295 +0000 2024-09-22T08:16:22.325 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:16:22.402 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-22T08:16:22.402 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-22T08:16:22.402 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000242779 s, 2.1 MB/s 2024-09-22T08:16:22.403 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:16:22.472 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:22.473 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:22.473 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:16:22.508 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:16:22.508 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-22 08:16:07.060565822 +0000 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-22 08:13:37.365093390 +0000 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-22 08:13:37.365093390 +0000 2024-09-22T08:16:22.580 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-22 08:13:37.365093390 +0000 2024-09-22T08:16:22.581 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:16:22.659 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-22T08:16:22.660 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-22T08:16:22.660 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000214552 s, 2.4 MB/s 2024-09-22T08:16:22.661 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:16:22.733 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-22 08:16:07.060565822 +0000 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-22 08:13:37.690087033 +0000 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-22 08:13:37.690087033 +0000 2024-09-22T08:16:22.803 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-22 08:13:37.690087033 +0000 2024-09-22T08:16:22.804 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:16:22.880 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-22T08:16:22.880 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-22T08:16:22.880 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000193136 s, 2.7 MB/s 2024-09-22T08:16:22.881 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:16:22.950 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-22 08:16:07.061565802 +0000 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-22 08:13:38.036080265 +0000 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-22 08:13:38.036080265 +0000 2024-09-22T08:16:23.019 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-22 08:13:38.036080265 +0000 2024-09-22T08:16:23.019 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:16:23.096 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-22T08:16:23.096 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-22T08:16:23.096 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000215319 s, 2.4 MB/s 2024-09-22T08:16:23.097 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:16:23.167 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-22 08:16:07.061565802 +0000 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-22 08:13:38.357073986 +0000 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-22 08:13:38.357073986 +0000 2024-09-22T08:16:23.236 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-22 08:13:38.357073986 +0000 2024-09-22T08:16:23.237 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:16:23.313 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-22T08:16:23.313 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-22T08:16:23.313 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000216909 s, 2.4 MB/s 2024-09-22T08:16:23.314 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:16:23.383 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:23.384 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:16:23.384 INFO:tasks.ceph:Generating config... 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-22T08:16:23.385 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-22T08:16:23.386 INFO:tasks.ceph:[client] setuser = ceph 2024-09-22T08:16:23.386 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-22T08:16:23.386 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-22T08:16:23.386 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-22T08:16:23.387 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-22T08:16:23.387 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T08:16:23.387 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T08:16:23.387 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T08:16:23.388 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T08:16:23.389 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T08:16:23.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T08:16:23.455 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T08:16:23.458 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T08:16:23.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:16:23.555 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]'), ('mon.b', '172.21.15.171')] 2024-09-22T08:16:23.555 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-22T08:16:23.556 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:23.556 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:16:23.624 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --add b 172.21.15.171 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:23.724 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:16:23.724 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:16:23.724 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:23.724 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:16:23.725 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-22T08:16:23.726 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:16:23.754 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8... 2024-09-22T08:16:23.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:16:23.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-09-22T08:16:23.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-09-22T08:16:23.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171" 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 5000 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: osd heartbeat grace = 40 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:16:23.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-09-22T08:16:23.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-09-22T08:16:23.856 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug objclass = 20 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:16:23.857 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: osd fast shutdown = False 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: osd shutdown pgref assert = True 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.858 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:16:23.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd crush smoke test = False 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = True 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-09-22T08:16:23.860 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: debug rgw = 20 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: debug rgw notification = 20 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw bucket counters cache = True 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt require ssl = False 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw d3n l1 local datacache enabled = True 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw max chunk size = 4194304 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw obj stripe size = 6291456 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw s3 auth use sts = True 2024-09-22T08:16:23.861 INFO:teuthology.orchestra.run.smithi078.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout: rgw torrent flag = True 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout: rgw user counters cache = True 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout: setgroup = ceph 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout: setuser = ceph 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-09-22T08:16:23.862 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.863 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:16:23.864 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-22T08:16:23.865 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171" 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon client directed command retry = 5 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: ms inject socket failures = 5000 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd heartbeat grace = 40 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-22T08:16:23.866 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:16:23.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-22T08:16:23.868 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug objclass = 20 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd fast shutdown = False 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd shutdown pgref assert = True 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.869 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-22T08:16:23.870 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:16:23.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd crush smoke test = False 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = True 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw = 20 2024-09-22T08:16:23.872 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw notification = 20 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw bucket counters cache = True 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt require ssl = False 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 local datacache enabled = True 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw max chunk size = 4194304 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw obj stripe size = 6291456 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw s3 auth use sts = True 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:16:23.873 INFO:teuthology.orchestra.run.smithi171.stdout: rgw torrent flag = True 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout: rgw user counters cache = True 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout: setgroup = ceph 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout: setuser = ceph 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-22T08:16:23.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-22T08:16:23.875 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T08:16:23.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T08:16:23.943 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T08:16:23.943 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:23.943 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T08:16:23.972 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:23.972 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T08:16:24.040 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:16:24.041 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:24.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:16:24.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:16:24.128 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:24.128 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:24.196 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:16:24.197 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:24.197 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:16:24.197 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:16:24.246 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:24.246 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:24.315 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T08:16:24.315 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T08:16:24.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:16:24.383 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:16:24.467 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:16:24.470 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T08:16:24.470 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T08:16:24.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T08:16:24.526 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T08:16:24.539 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T08:16:24.593 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T08:16:24.606 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T08:16:24.606 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:16:24.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T08:16:24.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:24.645 INFO:tasks.ceph:role: osd.0 2024-09-22T08:16:24.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:16:24.645 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:16:24.731 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:24.731 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:24.731 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:24.731 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:24.732 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:25.234 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-22T08:16:25.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-22T08:16:25.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T08:16:25.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T08:16:25.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T08:16:25.399 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:25.400 INFO:tasks.ceph:role: osd.1 2024-09-22T08:16:25.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:16:25.400 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:25.961 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-22T08:16:25.963 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-22T08:16:25.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T08:16:26.054 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T08:16:26.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T08:16:26.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:26.180 INFO:tasks.ceph:role: osd.2 2024-09-22T08:16:26.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:16:26.181 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:16:26.269 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:26.269 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:26.269 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:26.269 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:26.270 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:26.746 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-22T08:16:26.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-22T08:16:26.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-22T08:16:26.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T08:16:26.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T08:16:26.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:26.933 INFO:tasks.ceph:role: osd.3 2024-09-22T08:16:26.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:16:26.934 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:27.520 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-22T08:16:27.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-22T08:16:27.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-22T08:16:27.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T08:16:27.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:27.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:27.724+0000 7fc086b51640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T08:16:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:27.730+0000 7fc086b51640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T08:16:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:27.730+0000 7fc086b51640 -1 bdev(0x564838ca7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:27.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:27.730+0000 7fc086b51640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T08:16:30.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T08:16:30.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:30.997+0000 7f7ba6c18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T08:16:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:30.997+0000 7f7ba6c18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T08:16:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:30.997+0000 7f7ba6c18640 -1 bdev(0x55d10d1d9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:30.997+0000 7f7ba6c18640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T08:16:34.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T08:16:34.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:34.270+0000 7f9cf5cd4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T08:16:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:34.270+0000 7f9cf5cd4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T08:16:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:34.270+0000 7f9cf5cd4640 -1 bdev(0x55b6bd34b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:34.270+0000 7f9cf5cd4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T08:16:37.215 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T08:16:37.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:37.330+0000 7feb86c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T08:16:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:37.330+0000 7feb86c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T08:16:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:37.330+0000 7feb86c11640 -1 bdev(0x559420c69800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:16:37.331+0000 7feb86c11640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T08:16:40.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T08:16:40.529 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-22T08:16:40.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:40.576 INFO:tasks.ceph:role: osd.4 2024-09-22T08:16:40.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:16:40.576 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:16:40.625 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:40.625 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:40.626 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:41.132 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-22T08:16:41.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-22T08:16:41.135 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-22T08:16:41.226 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-22T08:16:41.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-22T08:16:41.360 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:41.360 INFO:tasks.ceph:role: osd.5 2024-09-22T08:16:41.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:16:41.361 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:16:41.453 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:41.453 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:41.453 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:41.453 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:41.453 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:41.454 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:41.454 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:41.454 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:41.454 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:41.454 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:41.906 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-22T08:16:41.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-22T08:16:41.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-22T08:16:41.970 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-22T08:16:42.012 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-22T08:16:42.091 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:42.091 INFO:tasks.ceph:role: osd.6 2024-09-22T08:16:42.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:16:42.092 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:16:42.176 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:42.176 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:42.177 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:42.652 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-22T08:16:42.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-22T08:16:42.654 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-22T08:16:42.748 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-22T08:16:42.791 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-22T08:16:42.870 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:16:42.870 INFO:tasks.ceph:role: osd.7 2024-09-22T08:16:42.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:16:42.870 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:16:42.957 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:16:43.452 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-22T08:16:43.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-22T08:16:43.455 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-22T08:16:43.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-22T08:16:43.588 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:43.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:43.684+0000 7f475b54d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-22T08:16:43.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:43.684+0000 7f475b54d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-22T08:16:43.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:43.684+0000 7f475b54d640 -1 bdev(0x561168ebb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:43.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:43.684+0000 7f475b54d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-22T08:16:46.847 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-22T08:16:46.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:46.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:46.995+0000 7efc723a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-22T08:16:46.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:46.995+0000 7efc723a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-22T08:16:46.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:46.995+0000 7efc723a4640 -1 bdev(0x555d395e7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:46.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:46.996+0000 7efc723a4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-22T08:16:50.166 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-22T08:16:50.211 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:50.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:50.272+0000 7f9316616640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-22T08:16:50.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:50.272+0000 7f9316616640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-22T08:16:50.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:50.273+0000 7f9316616640 -1 bdev(0x556091c7d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:50.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:50.273+0000 7f9316616640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-22T08:16:53.434 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-22T08:16:53.473 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:53.573 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:53.572+0000 7fdf2fd25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-22T08:16:53.573 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:53.572+0000 7fdf2fd25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-22T08:16:53.573 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:53.572+0000 7fdf2fd25640 -1 bdev(0x560b2912b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-22T08:16:53.573 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-22T08:16:53.572+0000 7fdf2fd25640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-22T08:16:56.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-22T08:16:56.533 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T08:16:56.534 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:56.534 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-22T08:16:56.580 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:56.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T08:16:56.675 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:56.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T08:16:56.766 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:56.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T08:16:56.854 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:56.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T08:16:56.944 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:56.945 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T08:16:56.997 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:56.998 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-22T08:16:57.083 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:57.084 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-22T08:16:57.167 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:57.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-22T08:16:57.249 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:57.249 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-22T08:16:57.330 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:16:57.330 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T08:16:57.363 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:16:57.363 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T08:16:57.403 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T08:16:57.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:16:57.408 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBY0u9mOE63FhAAKbOFQm1QWOLLxuKjJ+jjMA== 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBb0u9mDRA+KxAAxOPA1ySXDOoQjnrcnuJb0w== 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-09-22T08:16:57.448 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBe0u9mQ0qBOxAAUj7HlPWG+A78cfH2/5gIEQ== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBi0u9m9Z8oEBAAp931v+PJYC4w6D8vBVu/Lw== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBl0u9mJr/CExAAVUuXlOJnNIiK9b7R3ypeUg== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBY0u9mHY7nGxAATG7WZi6HfHH85Oc5eMLObA== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBr0u9mg8vYKBAARstVEV5M7ecMPwXx+X2w9A== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBu0u9meHplOxAAqYo+ngahUlmj9oPHOolprg== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBy0u9mgBNPEBAA7UlJbnzRLLJRmdhUp0k4KA== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB10u9mFbgqIhAA0OKZCXggxsKdKZwmbNcx4Q== 2024-09-22T08:16:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-22T08:16:57.450 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBY0u9m+whpHxAA+JlcD5rBHPuJvQyogwxMwA== 2024-09-22T08:16:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2024-09-22T08:16:57.450 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBY0u9mjgVqIxAAeS8Fe8jZ33y+lFIEiUCbGg== 2024-09-22T08:16:57.481 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-09-22T08:16:57.481 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBY0u9mOE63FhAAKbOFQm1QWOLLxuKjJ+jjMA== 2024-09-22T08:16:57.481 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBb0u9mDRA+KxAAxOPA1ySXDOoQjnrcnuJb0w== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBe0u9mQ0qBOxAAUj7HlPWG+A78cfH2/5gIEQ== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBi0u9m9Z8oEBAAp931v+PJYC4w6D8vBVu/Lw== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBl0u9mJr/CExAAVUuXlOJnNIiK9b7R3ypeUg== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBY0u9mHY7nGxAATG7WZi6HfHH85Oc5eMLObA== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBr0u9mg8vYKBAARstVEV5M7ecMPwXx+X2w9A== 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-09-22T08:16:57.482 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBu0u9meHplOxAAqYo+ngahUlmj9oPHOolprg== 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBy0u9mgBNPEBAA7UlJbnzRLLJRmdhUp0k4KA== 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB10u9mFbgqIhAA0OKZCXggxsKdKZwmbNcx4Q== 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBY0u9m+whpHxAA+JlcD5rBHPuJvQyogwxMwA== 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-09-22T08:16:57.483 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBY0u9mjgVqIxAAeS8Fe8jZ33y+lFIEiUCbGg== 2024-09-22T08:16:57.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:16:57.495 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:16:57.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.593 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.660 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.727 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:16:57.860 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:16:57.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.926 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:57.992 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:58.056 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:58.059 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:58.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:58.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:16:58.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:16:58.193 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:16:58.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:16:58.262 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:16:58.329 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T08:16:58.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T08:16:58.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:16:58.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T08:16:58.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-22T08:16:58.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:16:58.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-22T08:16:58.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-22T08:16:58.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:16:58.889 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-22T08:16:58.927 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:58.930 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:16:58.995 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T08:16:58.996 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T08:16:58.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T08:16:58.999 INFO:tasks.ceph.mon.a:Started 2024-09-22T08:16:58.999 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-22T08:16:58.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-22T08:16:59.001 INFO:tasks.ceph.mon.c:Started 2024-09-22T08:16:59.001 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-22T08:16:59.001 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-22T08:16:59.038 INFO:tasks.ceph.mon.b:Started 2024-09-22T08:16:59.038 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T08:16:59.038 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-22T08:16:59.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-22T08:16:59.040 INFO:tasks.ceph.mgr.y:Started 2024-09-22T08:16:59.041 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T08:16:59.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T08:16:59.042 INFO:tasks.ceph.mgr.x:Started 2024-09-22T08:16:59.043 DEBUG:tasks.ceph:set 0 configs 2024-09-22T08:16:59.043 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T08:16:59.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T08:17:05.231 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-22T08:17:05.242 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T08:17:05.242 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T08:17:05.242 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:17:05.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T08:17:05.281 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:17:05.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T08:17:05.360 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:17:05.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T08:17:05.439 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:17:05.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T08:17:05.518 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:17:05.518 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-22T08:17:05.558 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:17:05.558 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-22T08:17:05.637 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:17:05.637 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-22T08:17:05.717 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-22T08:17:05.718 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-22T08:17:05.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 75c980d6-b21d-4979-af3a-698d775e8476 0 2024-09-22T08:17:06.033 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-09-22T08:17:06.044 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 150179c9-39f6-4fbf-bf9f-9addaf887ea7 1 2024-09-22T08:17:06.242 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-22T08:17:06.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2e18cce0-0331-4aa9-94b2-d4e666438542 2 2024-09-22T08:17:06.452 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-09-22T08:17:06.463 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ef1fcc1f-90fb-4115-94ca-1aa88f9e0385 3 2024-09-22T08:17:06.658 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-09-22T08:17:06.669 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new b79fbab0-55ef-4583-997c-89d7bac6c38b 4 2024-09-22T08:17:06.867 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-09-22T08:17:06.879 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 90c93999-3519-4548-8d11-ba9fc05593ce 5 2024-09-22T08:17:07.075 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-09-22T08:17:07.087 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 02f18f4d-b281-436b-a28f-c8262ecb719d 6 2024-09-22T08:17:07.285 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-09-22T08:17:07.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0a5b9fda-9fa6-4f69-92d5-8c29b339fd35 7 2024-09-22T08:17:07.492 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-09-22T08:17:07.503 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T08:17:07.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T08:17:07.505 INFO:tasks.ceph.osd.0:Started 2024-09-22T08:17:07.505 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T08:17:07.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T08:17:07.507 INFO:tasks.ceph.osd.1:Started 2024-09-22T08:17:07.507 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T08:17:07.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T08:17:07.509 INFO:tasks.ceph.osd.2:Started 2024-09-22T08:17:07.509 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T08:17:07.510 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T08:17:07.512 INFO:tasks.ceph.osd.3:Started 2024-09-22T08:17:07.512 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-22T08:17:07.512 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-22T08:17:07.514 INFO:tasks.ceph.osd.4:Started 2024-09-22T08:17:07.514 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-22T08:17:07.514 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-22T08:17:07.516 INFO:tasks.ceph.osd.5:Started 2024-09-22T08:17:07.516 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-22T08:17:07.517 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-22T08:17:07.518 INFO:tasks.ceph.osd.6:Started 2024-09-22T08:17:07.519 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-22T08:17:07.519 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-22T08:17:07.521 INFO:tasks.ceph.osd.7:Started 2024-09-22T08:17:07.521 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:07.738 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:07.738 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:07.489855+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:07.749 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T08:17:07.749 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T08:17:08.554 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:08.735 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-22T08:17:08.735 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:07.489855+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:08.744 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T08:17:08.799 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-22T08:17:08.798+0000 7f4415f27640 -1 Falling back to public interface 2024-09-22T08:17:08.827 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-22T08:17:08.826+0000 7f2e799b9640 -1 Falling back to public interface 2024-09-22T08:17:08.970 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-22T08:17:08.969+0000 7fbd5a42c640 -1 Falling back to public interface 2024-09-22T08:17:08.997 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-22T08:17:08.996+0000 7f2f0d9fd640 -1 Falling back to public interface 2024-09-22T08:17:09.010 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-22T08:17:09.009+0000 7fba78c0d640 -1 Falling back to public interface 2024-09-22T08:17:09.018 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-22T08:17:09.017+0000 7fb722d4b640 -1 Falling back to public interface 2024-09-22T08:17:09.029 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-22T08:17:09.028+0000 7fa6d7817640 -1 Falling back to public interface 2024-09-22T08:17:09.235 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-22T08:17:09.234+0000 7f07d33b2640 -1 Falling back to public interface 2024-09-22T08:17:09.600 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-22T08:17:09.599+0000 7f8b9fb25640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-22T08:17:09.602 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-22T08:17:09.601+0000 7f8b9fb25640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-22T08:17:12.604 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-22T08:17:12.603+0000 7f4415f27640 -1 osd.4 0 log_to_monitors true 2024-09-22T08:17:12.621 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-22T08:17:12.620+0000 7f2e799b9640 -1 osd.7 0 log_to_monitors true 2024-09-22T08:17:12.801 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-22T08:17:12.800+0000 7fa6d7817640 -1 osd.6 0 log_to_monitors true 2024-09-22T08:17:12.835 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-22T08:17:12.834+0000 7f2f0d9fd640 -1 osd.1 0 log_to_monitors true 2024-09-22T08:17:12.972 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-22T08:17:12.971+0000 7fbd5a42c640 -1 osd.0 0 log_to_monitors true 2024-09-22T08:17:13.014 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-22T08:17:13.012+0000 7fb722d4b640 -1 osd.5 0 log_to_monitors true 2024-09-22T08:17:13.027 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-22T08:17:13.025+0000 7f07d33b2640 -1 osd.3 0 log_to_monitors true 2024-09-22T08:17:13.085 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-22T08:17:13.084+0000 7fba78c0d640 -1 osd.2 0 log_to_monitors true 2024-09-22T08:17:15.090 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-22T08:17:15.089+0000 7f2e7594d640 -1 osd.7 0 waiting for initial osdmap 2024-09-22T08:17:15.118 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-22T08:17:15.117+0000 7f4411ebb640 -1 osd.4 0 waiting for initial osdmap 2024-09-22T08:17:15.213 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-22T08:17:15.212+0000 7f2e6d76c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:15.245 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-22T08:17:15.244+0000 7f4409cda640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:15.550 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:15.899 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-22T08:17:15.899+0000 7fa6d3208640 -1 osd.6 0 waiting for initial osdmap 2024-09-22T08:17:15.908 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-22T08:17:15.908+0000 7fa6cb027640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:15.909 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-22T08:17:15.909 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":13,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:14.662956+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:15.921 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T08:17:15.954 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-22T08:17:15.953+0000 7fb71ecdf640 -1 osd.5 0 waiting for initial osdmap 2024-09-22T08:17:15.963 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-22T08:17:15.963+0000 7fb716afe640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:16.734 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-22T08:17:16.733+0000 7f07cf346640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T08:17:16.750 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-22T08:17:16.750+0000 7f07c7165640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:16.768 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-22T08:17:16.768+0000 7fbd563c0640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T08:17:16.776 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-22T08:17:16.775+0000 7f2f09991640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T08:17:16.779 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-22T08:17:16.779+0000 7fbd4e1df640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:16.793 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-22T08:17:16.793+0000 7f2f017b0640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:16.840 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-22T08:17:16.839+0000 7fba74650640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T08:17:16.861 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-22T08:17:16.861+0000 7fba6c46f640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:17:22.726 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:23.030 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-22T08:17:23.030 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":17,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:19.186467+0000","last_up_change":"2024-09-22T08:17:17.179098+0000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:17:16.610776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6803","nonce":670624169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6805","nonce":670624169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6809","nonce":670624169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6807","nonce":670624169}]},"public_addr":"172.21.15.78:6803/670624169","cluster_addr":"172.21.15.78:6805/670624169","heartbeat_back_addr":"172.21.15.78:6809/670624169","heartbeat_front_addr":"172.21.15.78:6807/670624169","state":["exists","up"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6811","nonce":3985180551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6813","nonce":3985180551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6817","nonce":3985180551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6815","nonce":3985180551}]},"public_addr":"172.21.15.78:6811/3985180551","cluster_addr":"172.21.15.78:6813/3985180551","heartbeat_back_addr":"172.21.15.78:6817/3985180551","heartbeat_front_addr":"172.21.15.78:6815/3985180551","state":["exists","up"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6819","nonce":3367866564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6821","nonce":3367866564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6825","nonce":3367866564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6823","nonce":3367866564}]},"public_addr":"172.21.15.78:6819/3367866564","cluster_addr":"172.21.15.78:6821/3367866564","heartbeat_back_addr":"172.21.15.78:6825/3367866564","heartbeat_front_addr":"172.21.15.78:6823/3367866564","state":["exists","up"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6827","nonce":1196772508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6829","nonce":1196772508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6833","nonce":1196772508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6831","nonce":1196772508}]},"public_addr":"172.21.15.78:6827/1196772508","cluster_addr":"172.21.15.78:6829/1196772508","heartbeat_back_addr":"172.21.15.78:6833/1196772508","heartbeat_front_addr":"172.21.15.78:6831/1196772508","state":["exists","up"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6801","nonce":1364473755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6803","nonce":1364473755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6807","nonce":1364473755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6805","nonce":1364473755}]},"public_addr":"172.21.15.171:6801/1364473755","cluster_addr":"172.21.15.171:6803/1364473755","heartbeat_back_addr":"172.21.15.171:6807/1364473755","heartbeat_front_addr":"172.21.15.171:6805/1364473755","state":["exists","up"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6817","nonce":959803971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6819","nonce":959803971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6823","nonce":959803971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6821","nonce":959803971}]},"public_addr":"172.21.15.171:6817/959803971","cluster_addr":"172.21.15.171:6819/959803971","heartbeat_back_addr":"172.21.15.171:6823/959803971","heartbeat_front_addr":"172.21.15.171:6821/959803971","state":["exists","up"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6825","nonce":2960376290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6827","nonce":2960376290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6831","nonce":2960376290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6829","nonce":2960376290}]},"public_addr":"172.21.15.171:6825/2960376290","cluster_addr":"172.21.15.171:6827/2960376290","heartbeat_back_addr":"172.21.15.171:6831/2960376290","heartbeat_front_addr":"172.21.15.171:6829/2960376290","state":["exists","up"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6809","nonce":3588151379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6811","nonce":3588151379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6815","nonce":3588151379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6813","nonce":3588151379}]},"public_addr":"172.21.15.171:6809/3588151379","cluster_addr":"172.21.15.171:6811/3588151379","heartbeat_back_addr":"172.21.15.171:6815/3588151379","heartbeat_front_addr":"172.21.15.171:6813/3588151379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.992913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.834461+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.092051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.070162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.623614+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.969541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.792169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.662319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:23.041 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-22T08:17:23.041 INFO:tasks.ceph:Creating RBD pool 2024-09-22T08:17:23.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T08:17:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2024-09-22T08:17:24.223 DEBUG:teuthology.orchestra.run.smithi078:> rbd --cluster ceph pool init rbd 2024-09-22T08:17:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:27.243 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T08:17:27.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T08:17:27.244 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T08:17:27.553 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:27.566 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":9,"timestamp":"2024-09-22T08:17:16.841023+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5345.783363"}]}] 2024-09-22T08:17:27.566 INFO:tasks.ceph_manager:config epoch is 9 2024-09-22T08:17:27.566 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T08:17:27.566 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T08:17:27.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T08:17:27.916 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:27.927 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1312258676},{"type":"v1","addr":"172.21.15.78:6801","nonce":1312258676}]},"active_addr":"172.21.15.78:6801/1312258676","active_change":"2024-09-22T08:17:08.589063+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1083643155}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2367531407}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1155034358}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2658661078}]}]} 2024-09-22T08:17:27.930 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T08:17:27.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T08:17:27.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:28.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:28.235 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:27.226224+0000","last_up_change":"2024-09-22T08:17:17.179098+0000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:17:16.610776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:17:23.342577+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6803","nonce":670624169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6805","nonce":670624169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6809","nonce":670624169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6807","nonce":670624169}]},"public_addr":"172.21.15.78:6803/670624169","cluster_addr":"172.21.15.78:6805/670624169","heartbeat_back_addr":"172.21.15.78:6809/670624169","heartbeat_front_addr":"172.21.15.78:6807/670624169","state":["exists","up"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6811","nonce":3985180551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6813","nonce":3985180551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6817","nonce":3985180551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6815","nonce":3985180551}]},"public_addr":"172.21.15.78:6811/3985180551","cluster_addr":"172.21.15.78:6813/3985180551","heartbeat_back_addr":"172.21.15.78:6817/3985180551","heartbeat_front_addr":"172.21.15.78:6815/3985180551","state":["exists","up"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6819","nonce":3367866564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6821","nonce":3367866564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6825","nonce":3367866564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6823","nonce":3367866564}]},"public_addr":"172.21.15.78:6819/3367866564","cluster_addr":"172.21.15.78:6821/3367866564","heartbeat_back_addr":"172.21.15.78:6825/3367866564","heartbeat_front_addr":"172.21.15.78:6823/3367866564","state":["exists","up"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6827","nonce":1196772508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6829","nonce":1196772508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6833","nonce":1196772508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6831","nonce":1196772508}]},"public_addr":"172.21.15.78:6827/1196772508","cluster_addr":"172.21.15.78:6829/1196772508","heartbeat_back_addr":"172.21.15.78:6833/1196772508","heartbeat_front_addr":"172.21.15.78:6831/1196772508","state":["exists","up"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6801","nonce":1364473755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6803","nonce":1364473755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6807","nonce":1364473755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6805","nonce":1364473755}]},"public_addr":"172.21.15.171:6801/1364473755","cluster_addr":"172.21.15.171:6803/1364473755","heartbeat_back_addr":"172.21.15.171:6807/1364473755","heartbeat_front_addr":"172.21.15.171:6805/1364473755","state":["exists","up"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6817","nonce":959803971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6819","nonce":959803971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6823","nonce":959803971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6821","nonce":959803971}]},"public_addr":"172.21.15.171:6817/959803971","cluster_addr":"172.21.15.171:6819/959803971","heartbeat_back_addr":"172.21.15.171:6823/959803971","heartbeat_front_addr":"172.21.15.171:6821/959803971","state":["exists","up"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6825","nonce":2960376290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6827","nonce":2960376290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6831","nonce":2960376290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6829","nonce":2960376290}]},"public_addr":"172.21.15.171:6825/2960376290","cluster_addr":"172.21.15.171:6827/2960376290","heartbeat_back_addr":"172.21.15.171:6831/2960376290","heartbeat_front_addr":"172.21.15.171:6829/2960376290","state":["exists","up"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6809","nonce":3588151379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6811","nonce":3588151379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6815","nonce":3588151379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6813","nonce":3588151379}]},"public_addr":"172.21.15.171:6809/3588151379","cluster_addr":"172.21.15.171:6811/3588151379","heartbeat_back_addr":"172.21.15.171:6815/3588151379","heartbeat_front_addr":"172.21.15.171:6813/3588151379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.992913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.834461+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.092051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.070162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.623614+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.969541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.792169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.662319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:28.248 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T08:17:28.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:17:28.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:28.547 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:17:27.226224+0000","last_up_change":"2024-09-22T08:17:17.179098+0000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:17:16.610776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:17:23.342577+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6803","nonce":670624169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6805","nonce":670624169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6809","nonce":670624169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6807","nonce":670624169}]},"public_addr":"172.21.15.78:6803/670624169","cluster_addr":"172.21.15.78:6805/670624169","heartbeat_back_addr":"172.21.15.78:6809/670624169","heartbeat_front_addr":"172.21.15.78:6807/670624169","state":["exists","up"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6811","nonce":3985180551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6813","nonce":3985180551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6817","nonce":3985180551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6815","nonce":3985180551}]},"public_addr":"172.21.15.78:6811/3985180551","cluster_addr":"172.21.15.78:6813/3985180551","heartbeat_back_addr":"172.21.15.78:6817/3985180551","heartbeat_front_addr":"172.21.15.78:6815/3985180551","state":["exists","up"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6819","nonce":3367866564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6821","nonce":3367866564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6825","nonce":3367866564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6823","nonce":3367866564}]},"public_addr":"172.21.15.78:6819/3367866564","cluster_addr":"172.21.15.78:6821/3367866564","heartbeat_back_addr":"172.21.15.78:6825/3367866564","heartbeat_front_addr":"172.21.15.78:6823/3367866564","state":["exists","up"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6827","nonce":1196772508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6829","nonce":1196772508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6833","nonce":1196772508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6831","nonce":1196772508}]},"public_addr":"172.21.15.78:6827/1196772508","cluster_addr":"172.21.15.78:6829/1196772508","heartbeat_back_addr":"172.21.15.78:6833/1196772508","heartbeat_front_addr":"172.21.15.78:6831/1196772508","state":["exists","up"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6801","nonce":1364473755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6803","nonce":1364473755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6807","nonce":1364473755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6805","nonce":1364473755}]},"public_addr":"172.21.15.171:6801/1364473755","cluster_addr":"172.21.15.171:6803/1364473755","heartbeat_back_addr":"172.21.15.171:6807/1364473755","heartbeat_front_addr":"172.21.15.171:6805/1364473755","state":["exists","up"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6817","nonce":959803971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6819","nonce":959803971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6823","nonce":959803971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6821","nonce":959803971}]},"public_addr":"172.21.15.171:6817/959803971","cluster_addr":"172.21.15.171:6819/959803971","heartbeat_back_addr":"172.21.15.171:6823/959803971","heartbeat_front_addr":"172.21.15.171:6821/959803971","state":["exists","up"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6825","nonce":2960376290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6827","nonce":2960376290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6831","nonce":2960376290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6829","nonce":2960376290}]},"public_addr":"172.21.15.171:6825/2960376290","cluster_addr":"172.21.15.171:6827/2960376290","heartbeat_back_addr":"172.21.15.171:6831/2960376290","heartbeat_front_addr":"172.21.15.171:6829/2960376290","state":["exists","up"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6809","nonce":3588151379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6811","nonce":3588151379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6815","nonce":3588151379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6813","nonce":3588151379}]},"public_addr":"172.21.15.171:6809/3588151379","cluster_addr":"172.21.15.171:6811/3588151379","heartbeat_back_addr":"172.21.15.171:6815/3588151379","heartbeat_front_addr":"172.21.15.171:6813/3588151379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.992913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.834461+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.092051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.070162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.623614+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.969541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.792169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.662319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:17:28.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T08:17:28.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T08:17:28.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T08:17:28.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T08:17:28.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-22T08:17:28.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-22T08:17:28.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-22T08:17:28.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-22T08:17:28.820 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:28.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:17:28.821 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:28.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:17:28.823 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:28.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:17:28.826 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-22T08:17:28.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:17:28.828 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:28.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:17:28.828 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:28.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:17:28.829 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-22T08:17:28.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:17:28.830 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:28.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:17:29.411 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:29.429 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:29.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-09-22T08:17:29.446 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-22T08:17:29.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.2 2024-09-22T08:17:29.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2024-09-22T08:17:29.479 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:29.487 INFO:teuthology.orchestra.run.smithi078.stdout:60129542148 2024-09-22T08:17:29.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-22T08:17:29.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-22T08:17:29.507 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:29.512 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:60129542148 2024-09-22T08:17:29.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-09-22T08:17:29.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-22T08:17:29.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-22T08:17:30.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:17:30.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:17:30.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:17:30.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:17:30.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:17:30.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:17:30.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:17:30.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:17:30.998 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:31.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-09-22T08:17:31.064 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:31.068 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:31.072 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-22T08:17:31.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.2 2024-09-22T08:17:31.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-22T08:17:31.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2024-09-22T08:17:31.132 INFO:teuthology.orchestra.run.smithi078.stdout:60129542148 2024-09-22T08:17:31.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-22T08:17:31.153 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:31.154 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:31.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-09-22T08:17:31.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-22T08:17:31.169 INFO:teuthology.orchestra.run.smithi078.stdout:60129542148 2024-09-22T08:17:31.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-22T08:17:32.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:17:32.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:17:32.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:17:32.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:17:32.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:17:32.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:17:32.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:17:32.182 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:17:32.557 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:32.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-22T08:17:32.577 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.645 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-22T08:17:32.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-22T08:17:32.659 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.691 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:32.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-22T08:17:32.707 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.743 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-22T08:17:32.743 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:32.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.3 2024-09-22T08:17:32.757 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-22T08:17:32.762 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.774 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-22T08:17:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-22T08:17:32.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-22T08:17:32.787 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-22T08:17:32.799 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.818 INFO:teuthology.orchestra.run.smithi078.stdout:60129542149 2024-09-22T08:17:32.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-22T08:17:32.830 DEBUG:teuthology.parallel:result is None 2024-09-22T08:17:32.830 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:17:32.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:17:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T08:17:33.180 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T08:17:32.597240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219044,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755676,"statfs":{"total":773094113280,"available":772869812224,"internally_reserved":0,"allocated":2854912,"data_stored":1738790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.377762"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236812+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T08:17:27.236812+0000","last_peered":"2024-09-22T08:17:27.236812+0000","last_clean":"2024-09-22T08:17:27.236812+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T08:17:27.236812+0000","last_undegraded":"2024-09-22T08:17:27.236812+0000","last_fullsized":"2024-09-22T08:17:27.236812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.237505+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T08:17:27.237505+0000","last_peered":"2024-09-22T08:17:27.237505+0000","last_clean":"2024-09-22T08:17:27.237505+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T08:17:27.237505+0000","last_undegraded":"2024-09-22T08:17:27.237505+0000","last_fullsized":"2024-09-22T08:17:27.237505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236535+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T08:17:27.236535+0000","last_peered":"2024-09-22T08:17:27.236535+0000","last_clean":"2024-09-22T08:17:27.236535+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T08:17:27.236535+0000","last_undegraded":"2024-09-22T08:17:27.236535+0000","last_fullsized":"2024-09-22T08:17:27.236535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.969596+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T08:17:27.969596+0000","last_peered":"2024-09-22T08:17:27.969596+0000","last_clean":"2024-09-22T08:17:27.969596+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T08:17:27.969596+0000","last_undegraded":"2024-09-22T08:17:27.969596+0000","last_fullsized":"2024-09-22T08:17:27.969596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.238487+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T08:17:27.238487+0000","last_peered":"2024-09-22T08:17:27.238487+0000","last_clean":"2024-09-22T08:17:27.238487+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T08:17:27.238487+0000","last_undegraded":"2024-09-22T08:17:27.238487+0000","last_fullsized":"2024-09-22T08:17:27.238487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.825826+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T08:17:27.825826+0000","last_peered":"2024-09-22T08:17:27.825826+0000","last_clean":"2024-09-22T08:17:27.825826+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T08:17:27.825826+0000","last_undegraded":"2024-09-22T08:17:27.825826+0000","last_fullsized":"2024-09-22T08:17:27.825826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.237005+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T08:17:27.237005+0000","last_peered":"2024-09-22T08:17:27.237005+0000","last_clean":"2024-09-22T08:17:27.237005+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T08:17:27.237005+0000","last_undegraded":"2024-09-22T08:17:27.237005+0000","last_fullsized":"2024-09-22T08:17:27.237005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236270+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T08:17:27.236270+0000","last_peered":"2024-09-22T08:17:27.236270+0000","last_clean":"2024-09-22T08:17:27.236270+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T08:17:27.236270+0000","last_undegraded":"2024-09-22T08:17:27.236270+0000","last_fullsized":"2024-09-22T08:17:27.236270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.939376+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T08:17:27.939376+0000","last_peered":"2024-09-22T08:17:27.939376+0000","last_clean":"2024-09-22T08:17:27.939376+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T08:17:27.939376+0000","last_undegraded":"2024-09-22T08:17:27.939376+0000","last_fullsized":"2024-09-22T08:17:27.939376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":64649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:17:33.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:17:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:33.485 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T08:17:33.497 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T08:17:32.597240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219044,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755676,"statfs":{"total":773094113280,"available":772869812224,"internally_reserved":0,"allocated":2854912,"data_stored":1738790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.377762"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236812+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T08:17:27.236812+0000","last_peered":"2024-09-22T08:17:27.236812+0000","last_clean":"2024-09-22T08:17:27.236812+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T08:17:27.236812+0000","last_undegraded":"2024-09-22T08:17:27.236812+0000","last_fullsized":"2024-09-22T08:17:27.236812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.237505+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T08:17:27.237505+0000","last_peered":"2024-09-22T08:17:27.237505+0000","last_clean":"2024-09-22T08:17:27.237505+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T08:17:27.237505+0000","last_undegraded":"2024-09-22T08:17:27.237505+0000","last_fullsized":"2024-09-22T08:17:27.237505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236535+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T08:17:27.236535+0000","last_peered":"2024-09-22T08:17:27.236535+0000","last_clean":"2024-09-22T08:17:27.236535+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T08:17:27.236535+0000","last_undegraded":"2024-09-22T08:17:27.236535+0000","last_fullsized":"2024-09-22T08:17:27.236535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.969596+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T08:17:27.969596+0000","last_peered":"2024-09-22T08:17:27.969596+0000","last_clean":"2024-09-22T08:17:27.969596+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T08:17:27.969596+0000","last_undegraded":"2024-09-22T08:17:27.969596+0000","last_fullsized":"2024-09-22T08:17:27.969596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.238487+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T08:17:27.238487+0000","last_peered":"2024-09-22T08:17:27.238487+0000","last_clean":"2024-09-22T08:17:27.238487+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T08:17:27.238487+0000","last_undegraded":"2024-09-22T08:17:27.238487+0000","last_fullsized":"2024-09-22T08:17:27.238487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.825826+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T08:17:27.825826+0000","last_peered":"2024-09-22T08:17:27.825826+0000","last_clean":"2024-09-22T08:17:27.825826+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T08:17:27.825826+0000","last_undegraded":"2024-09-22T08:17:27.825826+0000","last_fullsized":"2024-09-22T08:17:27.825826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.237005+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T08:17:27.237005+0000","last_peered":"2024-09-22T08:17:27.237005+0000","last_clean":"2024-09-22T08:17:27.237005+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T08:17:27.237005+0000","last_undegraded":"2024-09-22T08:17:27.237005+0000","last_fullsized":"2024-09-22T08:17:27.237005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.236270+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T08:17:27.236270+0000","last_peered":"2024-09-22T08:17:27.236270+0000","last_clean":"2024-09-22T08:17:27.236270+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T08:17:27.236270+0000","last_undegraded":"2024-09-22T08:17:27.236270+0000","last_fullsized":"2024-09-22T08:17:27.236270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:17:27.939376+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T08:17:27.939376+0000","last_peered":"2024-09-22T08:17:27.939376+0000","last_clean":"2024-09-22T08:17:27.939376+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T08:17:27.939376+0000","last_undegraded":"2024-09-22T08:17:27.939376+0000","last_fullsized":"2024-09-22T08:17:27.939376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":196608,"data_stored":64649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:17:33.498 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:17:33.498 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T08:17:33.498 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T08:17:33.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T08:17:33.831 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:17:33.831 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T08:17:33.843 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T08:17:33.843 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-22T08:17:33.853 INFO:teuthology.run_tasks:Running task rgw... 2024-09-22T08:17:33.864 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-22T08:17:33.864 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-22T08:17:33.865 INFO:tasks.rgw:Creating data pools 2024-09-22T08:17:33.865 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-22T08:17:33.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-22T08:17:35.119 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-22T08:17:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'default.rgw.buckets.data' created 2024-09-22T08:17:37.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-22T08:17:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-22T08:17:38.326 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-22T08:17:39.296 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'default.rgw.buckets.index' created 2024-09-22T08:17:39.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-22T08:17:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-22T08:17:40.330 DEBUG:tasks.rgw:Pools created 2024-09-22T08:17:40.330 INFO:tasks.rgw:Configuring compression type = random 2024-09-22T08:17:40.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:17:40.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:17:40.331 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:17:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.345+0000 7f13885a3640 0 -- 172.21.15.78:0/2661243464 >> [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] conn(0x7f1264077480 msgr2=0x7f1264079940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:17:42.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.349+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.350+0000 7f13885a3640 0 -- 172.21.15.78:0/4221253415 >> [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] conn(0x7f124c077570 msgr2=0x7f124c079a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 realm 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:42.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.351+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.352+0000 7f138aab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:42.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.352+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.353+0000 7f138aab9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:17:42.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.353+0000 7f138aab9800 20 searching for the correct realm 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:17:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:17:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.364+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.365+0000 7f138aab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.365+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 20 zone default found 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 4 Realm: () 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 20 zonegroup default 2024-09-22T08:17:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.368+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:42.369+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:44.337+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:44.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:44.337+0000 7f138aab9800 20 rados->read ofs=0 len=0 2024-09-22T08:17:44.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:44.340+0000 7f138aab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:44.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:44.340+0000 7f138aab9800 20 started sync module instance, tier type = 2024-09-22T08:17:44.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:44.340+0000 7f138aab9800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:17:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=0 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=1 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=2 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=3 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=4 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=5 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.370+0000 7f138aab9800 20 add_watcher() i=6 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 add_watcher() i=7 2024-09-22T08:17:46.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 2 all 8 watchers are set, enabling cache 2024-09-22T08:17:46.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-22T08:17:46.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-22T08:17:46.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.371+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-22T08:17:46.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.372+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-22T08:17:46.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-22T08:17:46.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.373+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-22T08:17:46.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-22T08:17:46.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.374+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.375+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-22T08:17:46.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-22T08:17:46.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.376+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.377+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.378+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-22T08:17:46.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-22T08:17:46.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.379+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-22T08:17:46.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.380+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-22T08:17:46.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.381+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-22T08:17:46.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.382+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.383+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-22T08:17:46.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.384+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-22T08:17:46.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-22T08:17:46.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.385+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.386+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-22T08:17:46.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.387+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-22T08:17:46.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.388+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.389+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.390+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.391+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-22T08:17:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-22T08:17:46.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-22T08:17:46.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-22T08:17:46.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.392+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-22T08:17:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-22T08:17:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-22T08:17:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.393+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.394+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-22T08:17:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.395+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.396+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-22T08:17:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.397+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.398+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-22T08:17:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.399+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-22T08:17:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.400+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-22T08:17:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.401+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.402+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-22T08:17:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.403+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-22T08:17:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-22T08:17:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-22T08:17:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.404+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-22T08:17:46.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.406+0000 7f138aab9800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:17:46.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.410+0000 7f123afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:46.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.410+0000 7f138aab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:46.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:46.410+0000 7f138aab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.360+0000 7f138aab9800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-22T08:17:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.360+0000 7f138aab9800 5 note: GC not initialized 2024-09-22T08:17:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.360+0000 7f1239fdb640 20 reqs_thread_entry: start 2024-09-22T08:17:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.361+0000 7f138aab9800 20 init_complete bucket index max shards: 11 2024-09-22T08:17:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.361+0000 7f138aab9800 20 Filter name: none 2024-09-22T08:17:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.361+0000 7f119b7fe640 20 reqs_thread_entry: start 2024-09-22T08:17:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.393+0000 7f123afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.396+0000 7f138aab9800 20 remove_watcher() i=0 2024-09-22T08:17:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.396+0000 7f138aab9800 2 removed watcher, disabling cache 2024-09-22T08:17:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.397+0000 7f138aab9800 20 remove_watcher() i=1 2024-09-22T08:17:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.399+0000 7f138aab9800 20 remove_watcher() i=2 2024-09-22T08:17:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.400+0000 7f138aab9800 20 remove_watcher() i=3 2024-09-22T08:17:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.403+0000 7f138aab9800 20 remove_watcher() i=4 2024-09-22T08:17:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.405+0000 7f138aab9800 20 remove_watcher() i=5 2024-09-22T08:17:49.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.407+0000 7f138aab9800 20 remove_watcher() i=6 2024-09-22T08:17:49.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.410+0000 7f138aab9800 20 remove_watcher() i=7 2024-09-22T08:17:49.429 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-22T08:17:49.429 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:17:49.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:17:49.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:17:49.429 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-22T08:17:49.495 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:49.495 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:49.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.519+0000 7f6a8a92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:49.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.519+0000 7f6a8a92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:49.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.522+0000 7f6948fe1640 20 reqs_thread_entry: start 2024-09-22T08:17:49.541 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:17:49.541 DEBUG:tasks.util.rgw: json result: {'id': 'bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:17:49.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:17:49.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:17:49.541 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:17:49.597 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:49.597 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.628+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 realm 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.630+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.631+0000 7f4f49328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.631+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.632+0000 7f4f49328800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-22T08:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.632+0000 7f4f49328800 20 searching for the correct realm 2024-09-22T08:17:49.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.634+0000 7f4f4584c640 0 -- 172.21.15.78:0/2607756841 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f4f3c084c20 msgr2=0x7f4f3c061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:17:49.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.839+0000 7f4f4484a640 0 -- 172.21.15.78:0/2607756841 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f4f4009c040 msgr2=0x7f4f40073820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:17:49.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:17:49.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.845+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:17:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 zone default found 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 4 Realm: () 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 zonegroup default 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.846+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.847+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.847+0000 7f4f49328800 20 rados->read ofs=0 len=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.847+0000 7f4f49328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.847+0000 7f4f49328800 20 started sync module instance, tier type = 2024-09-22T08:17:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.847+0000 7f4f49328800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:17:49.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.865+0000 7f4f49328800 20 add_watcher() i=0 2024-09-22T08:17:49.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.865+0000 7f4f49328800 20 add_watcher() i=1 2024-09-22T08:17:49.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.865+0000 7f4f49328800 20 add_watcher() i=2 2024-09-22T08:17:49.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.865+0000 7f4f49328800 20 add_watcher() i=3 2024-09-22T08:17:49.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.866+0000 7f4f49328800 20 add_watcher() i=4 2024-09-22T08:17:49.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.866+0000 7f4f49328800 20 add_watcher() i=5 2024-09-22T08:17:49.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.866+0000 7f4f49328800 20 add_watcher() i=6 2024-09-22T08:17:49.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.867+0000 7f4f49328800 20 add_watcher() i=7 2024-09-22T08:17:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.867+0000 7f4f49328800 2 all 8 watchers are set, enabling cache 2024-09-22T08:17:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4dfbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4f49328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4f49328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4f49328800 5 note: GC not initialized 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4dfafe5640 20 reqs_thread_entry: start 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.869+0000 7f4f49328800 20 init_complete bucket index max shards: 11 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.870+0000 7f4f49328800 20 Filter name: none 2024-09-22T08:17:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.870+0000 7f4df8fe1640 20 reqs_thread_entry: start 2024-09-22T08:17:49.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.880+0000 7f4dfbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:49.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.882+0000 7f4f49328800 20 remove_watcher() i=0 2024-09-22T08:17:49.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.882+0000 7f4f49328800 2 removed watcher, disabling cache 2024-09-22T08:17:49.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.884+0000 7f4f49328800 20 remove_watcher() i=1 2024-09-22T08:17:49.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.885+0000 7f4f49328800 20 remove_watcher() i=2 2024-09-22T08:17:49.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.886+0000 7f4f49328800 20 remove_watcher() i=3 2024-09-22T08:17:49.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.887+0000 7f4f49328800 20 remove_watcher() i=4 2024-09-22T08:17:49.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.888+0000 7f4f49328800 20 remove_watcher() i=5 2024-09-22T08:17:49.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.889+0000 7f4f49328800 20 remove_watcher() i=6 2024-09-22T08:17:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.890+0000 7f4f49328800 20 remove_watcher() i=7 2024-09-22T08:17:49.902 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-22T08:17:49.903 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:17:49.903 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-22T08:17:49.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-22T08:17:49.903 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-22T08:17:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.989+0000 7fad09440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.989+0000 7fad09440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:49.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:49.993+0000 7fabc97e2640 20 reqs_thread_entry: start 2024-09-22T08:17:50.010 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:17:50.011 DEBUG:tasks.util.rgw: json result: {'id': 'bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:17:50.011 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-22T08:17:50.011 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p /tmp/rgw_datacache 2024-09-22T08:17:50.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-22T08:17:50.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:17:50.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:17:50.118 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:17:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.246+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 realm 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.248+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.249+0000 7f1f2ba87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.249+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.250+0000 7f1f2ba87800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-22T08:17:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.250+0000 7f1f2ba87800 20 searching for the correct realm 2024-09-22T08:17:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.251+0000 7f1f28d77640 0 -- 172.21.15.78:0/478092538 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f1f1c018070 msgr2=0x7f1f1c060420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:17:50.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.456+0000 7f1f29578640 0 -- 172.21.15.78:0/478092538 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55ac43b3d660 msgr2=0x55ac43b3fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:17:50.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:17:50.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.462+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:17:50.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 zone default found 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 4 Realm: () 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:17:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 zonegroup default 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.463+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.464+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.464+0000 7f1f2ba87800 20 rados->read ofs=0 len=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.464+0000 7f1f2ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.464+0000 7f1f2ba87800 20 started sync module instance, tier type = 2024-09-22T08:17:50.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.464+0000 7f1f2ba87800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:17:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=0 2024-09-22T08:17:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=1 2024-09-22T08:17:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=2 2024-09-22T08:17:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=3 2024-09-22T08:17:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=4 2024-09-22T08:17:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=5 2024-09-22T08:17:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.477+0000 7f1f2ba87800 20 add_watcher() i=6 2024-09-22T08:17:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.478+0000 7f1f2ba87800 20 add_watcher() i=7 2024-09-22T08:17:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.478+0000 7f1f2ba87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:17:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1ddffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1f2ba87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1f2ba87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1f2ba87800 5 note: GC not initialized 2024-09-22T08:17:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1ddefe5640 20 reqs_thread_entry: start 2024-09-22T08:17:50.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1f2ba87800 20 init_complete bucket index max shards: 11 2024-09-22T08:17:50.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1f2ba87800 20 Filter name: none 2024-09-22T08:17:50.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.481+0000 7f1ddcfe1640 20 reqs_thread_entry: start 2024-09-22T08:17:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.491+0000 7f1ddffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:17:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.493+0000 7f1f2ba87800 20 remove_watcher() i=0 2024-09-22T08:17:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.493+0000 7f1f2ba87800 2 removed watcher, disabling cache 2024-09-22T08:17:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.494+0000 7f1f2ba87800 20 remove_watcher() i=1 2024-09-22T08:17:50.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.495+0000 7f1f2ba87800 20 remove_watcher() i=2 2024-09-22T08:17:50.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.496+0000 7f1f2ba87800 20 remove_watcher() i=3 2024-09-22T08:17:50.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.497+0000 7f1f2ba87800 20 remove_watcher() i=4 2024-09-22T08:17:50.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.498+0000 7f1f2ba87800 20 remove_watcher() i=5 2024-09-22T08:17:50.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.500+0000 7f1f2ba87800 20 remove_watcher() i=6 2024-09-22T08:17:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.501+0000 7f1f2ba87800 20 remove_watcher() i=7 2024-09-22T08:17:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-22T08:17:50.513 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:17:50.513 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-22T08:17:50.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:17:50.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:17:50.513 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-22T08:17:50.575 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:50.575 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:50.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.597+0000 7fab0972e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:50.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.597+0000 7fab0972e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:50.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.601+0000 7fa9437fe640 20 reqs_thread_entry: start 2024-09-22T08:17:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-22T08:17:50.618 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-22T08:17:50.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:17:50.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:17:50.618 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-22T08:17:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:50.684 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:50.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.708+0000 7f5e9311f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:50.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.708+0000 7f5e9311f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:50.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.712+0000 7f5d4cff9640 20 reqs_thread_entry: start 2024-09-22T08:17:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:17:50.730 DEBUG:tasks.util.rgw: json result: {'id': 'bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:17:50.730 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-22T08:17:50.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:17:50.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:17:50.730 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-22T08:17:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.814+0000 7feb99d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.814+0000 7feb99d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.818+0000 7fe9cbfff640 20 reqs_thread_entry: start 2024-09-22T08:17:50.834 INFO:teuthology.orchestra.run.smithi078.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-22T08:17:50.834 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-22T08:17:50.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:17:50.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:17:50.835 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-22T08:17:50.899 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:17:50.899 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:17:50.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.922+0000 7f0405126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:17:50.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.922+0000 7f0405126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:17:50.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:17:50.926+0000 7f0246ffd640 20 reqs_thread_entry: start 2024-09-22T08:17:50.943 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:17:50.944 DEBUG:tasks.util.rgw: json result: {'id': 'bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:17:50.944 INFO:tasks.rgw:Starting rgw... 2024-09-22T08:17:50.944 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-22T08:17:50.944 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-22T08:17:50.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo echo -n http://smithi078.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-22T08:17:50.983 INFO:teuthology.orchestra.run.smithi078.stdout:http://smithi078.front.sepia.ceph.com:80 2024-09-22T08:17:50.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-22T08:17:51.060 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-22T08:17:51.060 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-22T08:17:51.061 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-22T08:17:51.103 INFO:tasks.rgw.client.0:Started 2024-09-22T08:17:51.103 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:17:51.103 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:17:51.163 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:17:51.163 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:17:51.164 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:17:51.164 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:17:51.164 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:17:52.165 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:17:52.197 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:17:52.198 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:17:52.198 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:17:52.198 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:17:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:17:54.199 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:17:54.233 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:17:54.233 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:17:54.233 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:17:54.233 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:17:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:17:58.234 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:17:58.267 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:17:58.267 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:17:58.268 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:17:58.268 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:17:58.268 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:18:06.268 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:18:06.301 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:18:06.302 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:18:06.302 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:18:06.303 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:18:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:18:22.304 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-22T08:18:22.342 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:18:22.342 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:18:22.650 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 607 0 --:--:-- --:--:-- --:--:-- 609 2024-09-22T08:18:22.651 INFO:teuthology.orchestra.run.smithi078.stdout:anonymous 2024-09-22T08:18:22.651 INFO:teuthology.run_tasks:Running task tox... 2024-09-22T08:18:22.661 INFO:tasks.tox:Deploying tox from pip... 2024-09-22T08:18:22.661 DEBUG:teuthology.orchestra.run.smithi078:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-22T08:18:25.047 DEBUG:teuthology.orchestra.run.smithi078:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-22T08:18:25.567 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting tox==3.15.0 2024-09-22T08:18:25.615 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-22T08:18:25.746 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting py<2,>=1.4.17 2024-09-22T08:18:25.760 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-22T08:18:25.862 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting six<2,>=1.14.0 2024-09-22T08:18:25.875 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:18:26.148 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-22T08:18:26.164 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-22T08:18:26.372 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting toml>=0.9.4 2024-09-22T08:18:26.386 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-22T08:18:26.499 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting filelock<4,>=3.0.0 2024-09-22T08:18:26.513 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-22T08:18:26.652 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting packaging>=14 2024-09-22T08:18:26.666 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-22T08:18:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting pluggy<1,>=0.12.0 2024-09-22T08:18:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-22T08:18:26.918 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-22T08:18:26.932 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-22T08:18:27.059 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting distlib<1,>=0.3.7 2024-09-22T08:18:27.072 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-22T08:18:27.415 INFO:teuthology.orchestra.run.smithi078.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-22T08:18:28.202 INFO:teuthology.orchestra.run.smithi078.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-22T08:18:28.392 INFO:teuthology.orchestra.run.smithi078.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-22T08:18:28.392 INFO:teuthology.orchestra.run.smithi078.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-22T08:18:28.454 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:18:28.474 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:18:28.474 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:18:28.475 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:18:28.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:18:28.504 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:18:28.504 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:18:28.573 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:18:28.573 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:18:28.642 INFO:tasks.workunit:timeout=3h 2024-09-22T08:18:28.642 INFO:tasks.workunit:cleanup=True 2024-09-22T08:18:28.642 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:18:28.710 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:19:28.656 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:19:28.657 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:19:28.661 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:19:28.753 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:19:28.755 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:19:28.756 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:19:29.391 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:19:29.461 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:19:29.501 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:19:29.503 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:19:29.503 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:19:29.541 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:19:29.545 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:19:29.545 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:19:29.573 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-22T08:19:29.574 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-22T08:19:29.575 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-22T08:19:29.647 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-22T08:19:29.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:19:29.647 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:19:31.991 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-22T08:19:31.992 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:19:31.992 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:19:31.993 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-22T08:19:32.214 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:19:32.395 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-22T08:19:32.457 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:19:32.861 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-22T08:19:32.861 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-22T08:19:32.862 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:19:33.010 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:19:33.015 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:19:33.743 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-22T08:19:33.988 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install configobj 2024-09-22T08:19:34.366 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting configobj 2024-09-22T08:19:34.407 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading configobj-5.0.9.tar.gz (101 kB) 2024-09-22T08:19:34.501 INFO:tasks.workunit.client.0.smithi078.stdout: Installing build dependencies: started 2024-09-22T08:19:36.088 INFO:tasks.workunit.client.0.smithi078.stdout: Installing build dependencies: finished with status 'done' 2024-09-22T08:19:36.089 INFO:tasks.workunit.client.0.smithi078.stdout: Getting requirements to build wheel: started 2024-09-22T08:19:36.235 INFO:tasks.workunit.client.0.smithi078.stdout: Getting requirements to build wheel: finished with status 'done' 2024-09-22T08:19:36.236 INFO:tasks.workunit.client.0.smithi078.stdout: Preparing metadata (pyproject.toml): started 2024-09-22T08:19:36.395 INFO:tasks.workunit.client.0.smithi078.stdout: Preparing metadata (pyproject.toml): finished with status 'done' 2024-09-22T08:19:36.397 INFO:tasks.workunit.client.0.smithi078.stdout:Building wheels for collected packages: configobj 2024-09-22T08:19:36.398 INFO:tasks.workunit.client.0.smithi078.stdout: Building wheel for configobj (pyproject.toml): started 2024-09-22T08:19:36.580 INFO:tasks.workunit.client.0.smithi078.stdout: Building wheel for configobj (pyproject.toml): finished with status 'done' 2024-09-22T08:19:36.581 INFO:tasks.workunit.client.0.smithi078.stdout: Created wheel for configobj: filename=configobj-5.0.9-py2.py3-none-any.whl size=35614 sha256=f754df2c499e749b225bd26e3a947414aca409009cc8c0149cf1885ee5a4cbb3 2024-09-22T08:19:36.581 INFO:tasks.workunit.client.0.smithi078.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/7c/17/c0/b8a544b593480f94de0701e251b8f291c2fe5d893d9c0d937f 2024-09-22T08:19:36.583 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully built configobj 2024-09-22T08:19:36.589 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: configobj 2024-09-22T08:19:36.660 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed configobj-5.0.9 2024-09-22T08:19:36.723 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-22T08:19:36.751 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-22T08:19:36.751 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-22T08:19:36.752 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:36.752 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-22T08:19:36.753 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:19:36.753 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-22T08:19:36.835 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:36.835 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 46537/valgrind \ntcp6 0 0 :::80 :::* LISTEN 46537/valgrind \n' 2024-09-22T08:19:36.835 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:radosgw port: 80 2024-09-22T08:19:36.836 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-22T08:19:36.836 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-22T08:19:36.859 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:36.859 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'' 2024-09-22T08:19:36.859 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-22T08:19:37.018 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:37.018 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-22T08:19:36.966974Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-22T08:19:36.966945Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-22T08:19:37.018 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:Creating s3cmd config... 2024-09-22T08:19:37.018 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:proto for s3cmd config is http 2024-09-22T08:19:37.019 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:s3cmd config written 2024-09-22T08:19:37.019 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-22T08:19:37.550 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:37.551 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-22T08:19:37.551 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-22T08:19:39.157 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:39.157 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 1.4 seconds, 5.10 MB/s) [1 of 1]\n" 2024-09-22T08:19:39.157 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-22T08:19:39.634 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.2 seconds, 29.32 MB/s)\n" 2024-09-22T08:19:39.635 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-22T08:19:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "46f843cd04da95fcbcf0ff1f5e0bf785",\n "tag": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16257636943916591886",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".XyZ_S1klvOT9_9gkZh2X7FbICy-7IuT_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "bucket_id": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "bucket_id": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".XyZ_S1klvOT9_9gkZh2X7FbICy-7IuT_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340376,\n "stripe_size": 1048920,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "bucket_id": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".XyZ_S1klvOT9_9gkZh2X7FbICy-7IuT_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-22T08:19:39.059232Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16257636943916591886",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726993176/ctime:1726993176/gid:1333/gname:ubuntu/md5:46f843cd04da95fcbcf0ff1f5e0bf785/mode:33188/mtime:1726993176/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-22T08:19:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:Cached object name is: .XyZ_S1klvOT9_9gkZh2X7FbICy-7IuT_ 2024-09-22T08:19:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-22T08:19:39.977 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:command succeeded 2024-09-22T08:19:39.977 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:b'0\n' 2024-09-22T08:19:39.977 INFO:tasks.workunit.client.0.smithi078.stderr:DEBUG:root:Check cache dir content: 0 2024-09-22T08:19:39.977 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-22T08:19:39.978 INFO:tasks.workunit.client.0.smithi078.stderr:INFO:root:Completed Datacache tests 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:19:39.982 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-22T08:19:39.983 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-22T08:19:39.984 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-22T08:19:39.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:19:39.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:19:40.064 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-22T08:19:40.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:19:40.376 DEBUG:teuthology.parallel:result is None 2024-09-22T08:19:40.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:19:40.414 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:19:40.414 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:19:40.491 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:19:40.491 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:19:40.500 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:19:40.500 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:19:40.501 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:19:40.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:19:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:19:40.561 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:19:40.630 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:19:40.630 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:19:40.698 INFO:tasks.workunit:timeout=3h 2024-09-22T08:19:40.698 INFO:tasks.workunit:cleanup=True 2024-09-22T08:19:40.699 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:19:40.768 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:20:40.512 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:20:40.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.512 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:20:40.512 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:20:40.512 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:40.513 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:20:40.517 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:20:40.585 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:20:40.587 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:20:40.587 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:20:40.637 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:20:40.686 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:20:40.725 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:20:40.727 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:20:40.727 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:20:40.765 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:20:40.768 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:20:40.768 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:20:40.837 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-22T08:20:40.838 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-22T08:20:40.839 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:20:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:20:40.911 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:20:40.911 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:20:43.255 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:20:43.256 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-22T08:20:43.480 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:20:43.664 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-22T08:20:43.670 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:20:43.714 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-22T08:20:43.714 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-22T08:20:43.714 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:20:43.869 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:20:43.874 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:20:44.615 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-22T08:20:44.663 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-22T08:20:45.497 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-22T08:20:45.551 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:20:46.229 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:20:46.243 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:20:46.353 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:20:46.366 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:20:46.458 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:20:46.472 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:20:46.569 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:20:46.583 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:20:46.705 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:20:46.719 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:20:47.018 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:20:47.032 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:20:47.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:20:47.178 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:20:47.398 INFO:tasks.workunit.client.0.smithi078.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.6/12.6 MB 59.4 MB/s eta 0:00:00 2024-09-22T08:20:47.412 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:20:47.469 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:20:47.536 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:20:47.604 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:20:47.663 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:20:47.791 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:20:48.788 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:20:48.905 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-22T08:20:49.034 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-22T08:20:49.069 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:49.069 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:49.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.105+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.107+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.107+0000 7fd01e736800 20 realm 2024-09-22T08:20:49.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.107+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.108+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.108+0000 7fd01e736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.108+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.108+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.108+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.109+0000 7fd01e736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:49.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.109+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.110+0000 7fd01e736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:49.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.110+0000 7fd01e736800 20 searching for the correct realm 2024-09-22T08:20:49.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.112+0000 7fd01acb8640 0 -- 172.21.15.78:0/1337854499 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd010064b80 msgr2=0x7fd010099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:49.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.316+0000 7fd019cb6640 0 -- 172.21.15.78:0/1337854499 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd0140a1040 msgr2=0x7fd0140095e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.321+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:49.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:49.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 zone default found 2024-09-22T08:20:49.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 4 Realm: () 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 zonegroup default 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.322+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 started sync module instance, tier type = 2024-09-22T08:20:49.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.323+0000 7fd01e736800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=0 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=1 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=2 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=3 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=4 2024-09-22T08:20:49.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.337+0000 7fd01e736800 20 add_watcher() i=5 2024-09-22T08:20:49.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.340+0000 7fd01e736800 20 add_watcher() i=6 2024-09-22T08:20:49.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.340+0000 7fd01e736800 20 add_watcher() i=7 2024-09-22T08:20:49.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.340+0000 7fd01e736800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fced0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fd01e736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fd01e736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fd01e736800 5 note: GC not initialized 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fce4b7fe640 20 reqs_thread_entry: start 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fd01e736800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fd01e736800 20 Filter name: none 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.342+0000 7fce497fa640 20 reqs_thread_entry: start 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-22T08:20:49.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 20 rados->read ofs=0 len=0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:20:49.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.343+0000 7fd01e736800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fd01e736800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fd01e736800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fd01e736800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fcefdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724545 cookie 94248958613232 notifier 4631 bl.length()=593 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fcefdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:20:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.344+0000 7fcefdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:20:49.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fd01e736800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:20:49.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fd01e736800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:20:49.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fd01e736800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-22T08:20:49.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fcefdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94248958606752 notifier 4631 bl.length()=186 2024-09-22T08:20:49.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fcefdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:20:49.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.348+0000 7fcefdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:20:49.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.350+0000 7fced0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:49.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.353+0000 7fd01e736800 20 remove_watcher() i=0 2024-09-22T08:20:49.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.353+0000 7fd01e736800 2 removed watcher, disabling cache 2024-09-22T08:20:49.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.354+0000 7fd01e736800 20 remove_watcher() i=1 2024-09-22T08:20:49.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.355+0000 7fd01e736800 20 remove_watcher() i=2 2024-09-22T08:20:49.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.356+0000 7fd01e736800 20 remove_watcher() i=3 2024-09-22T08:20:49.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.357+0000 7fd01e736800 20 remove_watcher() i=4 2024-09-22T08:20:49.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.359+0000 7fd01e736800 20 remove_watcher() i=5 2024-09-22T08:20:49.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.360+0000 7fd01e736800 20 remove_watcher() i=6 2024-09-22T08:20:49.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:49.361+0000 7fd01e736800 20 remove_watcher() i=7 2024-09-22T08:20:50.318 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: recalculated bucket check stats are correct 2024-09-22T08:20:50.319 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:50.320 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:20:50.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:50.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:50.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.387+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.389+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.389+0000 7f826c53e800 20 realm 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.389+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.390+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.391+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:50.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.391+0000 7f826c53e800 20 searching for the correct realm 2024-09-22T08:20:50.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.394+0000 7f8268a87640 0 -- 172.21.15.78:0/3832691157 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f825c03d060 msgr2=0x7f825c068250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.397+0000 7f8267a85640 0 -- 172.21.15.78:0/3832691157 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f8260083020 msgr2=0x7f8260009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:50.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:50.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.401+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 zone default found 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 4 Realm: () 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 zonegroup default 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.402+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.403+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.403+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.403+0000 7f826c53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.403+0000 7f826c53e800 20 started sync module instance, tier type = 2024-09-22T08:20:50.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.403+0000 7f826c53e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=0 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=1 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=2 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=3 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=4 2024-09-22T08:20:50.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=5 2024-09-22T08:20:50.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.424+0000 7f826c53e800 20 add_watcher() i=6 2024-09-22T08:20:50.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.428+0000 7f826c53e800 20 add_watcher() i=7 2024-09-22T08:20:50.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.428+0000 7f826c53e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:50.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.429+0000 7f811efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.429+0000 7f826c53e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.429+0000 7f826c53e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.429+0000 7f826c53e800 5 note: GC not initialized 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f811dfdb640 20 reqs_thread_entry: start 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 20 Filter name: none 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f808f7fe640 20 reqs_thread_entry: start 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.430+0000 7f826c53e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.431+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.432+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:50.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.432+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:50.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.433+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:50.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.434+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:50.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.434+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:50.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.435+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:50.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.436+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:50.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.436+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:50.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.437+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:50.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.437+0000 7f826c53e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:50.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.446+0000 7f811efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.448+0000 7f826c53e800 20 remove_watcher() i=0 2024-09-22T08:20:50.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.448+0000 7f826c53e800 2 removed watcher, disabling cache 2024-09-22T08:20:50.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.449+0000 7f826c53e800 20 remove_watcher() i=1 2024-09-22T08:20:50.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.451+0000 7f826c53e800 20 remove_watcher() i=2 2024-09-22T08:20:50.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.452+0000 7f826c53e800 20 remove_watcher() i=3 2024-09-22T08:20:50.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.455+0000 7f826c53e800 20 remove_watcher() i=4 2024-09-22T08:20:50.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.456+0000 7f826c53e800 20 remove_watcher() i=5 2024-09-22T08:20:50.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.459+0000 7f826c53e800 20 remove_watcher() i=6 2024-09-22T08:20:50.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.462+0000 7f826c53e800 20 remove_watcher() i=7 2024-09-22T08:20:50.475 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:20:50.504 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:50.504 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:50.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.541+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 realm 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.543+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.544+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.544+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.545+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:50.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.545+0000 7f36f2525800 20 searching for the correct realm 2024-09-22T08:20:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.547+0000 7f36ee934640 0 -- 172.21.15.78:0/4137568 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f36e0090020 msgr2=0x7f36e0090760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.751+0000 7f36ed932640 0 -- 172.21.15.78:0/4137568 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f36e8004040 msgr2=0x7f36e8068990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:50.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.756+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 zone default found 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 4 Realm: () 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 zonegroup default 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.757+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.758+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.758+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.758+0000 7f36f2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.758+0000 7f36f2525800 20 started sync module instance, tier type = 2024-09-22T08:20:50.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.758+0000 7f36f2525800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=0 2024-09-22T08:20:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=1 2024-09-22T08:20:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=2 2024-09-22T08:20:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=3 2024-09-22T08:20:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=4 2024-09-22T08:20:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.774+0000 7f36f2525800 20 add_watcher() i=5 2024-09-22T08:20:50.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.777+0000 7f36f2525800 20 add_watcher() i=6 2024-09-22T08:20:50.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.780+0000 7f36f2525800 20 add_watcher() i=7 2024-09-22T08:20:50.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.780+0000 7f36f2525800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:50.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.781+0000 7f35a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.781+0000 7f36f2525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.781+0000 7f36f2525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.781+0000 7f36f2525800 5 note: GC not initialized 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.782+0000 7f351f7fe640 20 reqs_thread_entry: start 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.782+0000 7f36f2525800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.782+0000 7f36f2525800 20 Filter name: none 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.782+0000 7f351d7fa640 20 reqs_thread_entry: start 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.782+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.783+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:50.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.783+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.783+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:50.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.783+0000 7f36f2525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:50.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.783+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.784+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:50.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.784+0000 7f36f2525800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.784+0000 7f36f2525800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:50.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.784+0000 7f36f2525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:50.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.786+0000 7f35a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.788+0000 7f36f2525800 20 remove_watcher() i=0 2024-09-22T08:20:50.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.788+0000 7f36f2525800 2 removed watcher, disabling cache 2024-09-22T08:20:50.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.789+0000 7f36f2525800 20 remove_watcher() i=1 2024-09-22T08:20:50.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.790+0000 7f36f2525800 20 remove_watcher() i=2 2024-09-22T08:20:50.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.791+0000 7f36f2525800 20 remove_watcher() i=3 2024-09-22T08:20:50.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.792+0000 7f36f2525800 20 remove_watcher() i=4 2024-09-22T08:20:50.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.793+0000 7f36f2525800 20 remove_watcher() i=5 2024-09-22T08:20:50.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.794+0000 7f36f2525800 20 remove_watcher() i=6 2024-09-22T08:20:50.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.798+0000 7f36f2525800 20 remove_watcher() i=7 2024-09-22T08:20:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 86, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-22T08:20:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-22T08:20:50.809 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:50.810 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:20:50.842 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:50.842 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:50.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.879+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.880+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.880+0000 7fc79bf46800 20 realm 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.880+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.881+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.882+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:50.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.882+0000 7fc79bf46800 20 searching for the correct realm 2024-09-22T08:20:50.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.884+0000 7fc791236640 0 -- 172.21.15.78:0/561927187 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fc78c061f60 msgr2=0x7fc78c066190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.887+0000 7fc791236640 0 -- 172.21.15.78:0/561927187 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55931a9a99f0 msgr2=0x55931a9abde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.892+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 zone default found 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 4 Realm: () 2024-09-22T08:20:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 zonegroup default 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.893+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.894+0000 7fc79bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.894+0000 7fc79bf46800 20 started sync module instance, tier type = 2024-09-22T08:20:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.894+0000 7fc79bf46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:50.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=0 2024-09-22T08:20:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=1 2024-09-22T08:20:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=2 2024-09-22T08:20:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=3 2024-09-22T08:20:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=4 2024-09-22T08:20:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.908+0000 7fc79bf46800 20 add_watcher() i=5 2024-09-22T08:20:50.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.911+0000 7fc79bf46800 20 add_watcher() i=6 2024-09-22T08:20:50.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.913+0000 7fc79bf46800 20 add_watcher() i=7 2024-09-22T08:20:50.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.913+0000 7fc79bf46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:50.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.914+0000 7fc64ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 5 note: GC not initialized 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc64efe5640 20 reqs_thread_entry: start 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 20 Filter name: none 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc64cfe1640 20 reqs_thread_entry: start 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:50.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.915+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:50.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.916+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.917+0000 7fc79bf46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:20:50.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.917+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.917+0000 7fc79bf46800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.917+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:20:50.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.918+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:50.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.919+0000 7fc79bf46800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:20:50.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.919+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:50.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.919+0000 7fc79bf46800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:20:50.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.919+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:50.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:20:50.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:50.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:20:50.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:50.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:20:50.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.920+0000 7fc79bf46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:50.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.921+0000 7fc79bf46800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:20:50.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.921+0000 7fc79bf46800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:20:50.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.922+0000 7fc64ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:50.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.924+0000 7fc79bf46800 20 remove_watcher() i=0 2024-09-22T08:20:50.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.924+0000 7fc79bf46800 2 removed watcher, disabling cache 2024-09-22T08:20:50.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.925+0000 7fc79bf46800 20 remove_watcher() i=1 2024-09-22T08:20:50.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.926+0000 7fc79bf46800 20 remove_watcher() i=2 2024-09-22T08:20:50.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.927+0000 7fc79bf46800 20 remove_watcher() i=3 2024-09-22T08:20:50.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.928+0000 7fc79bf46800 20 remove_watcher() i=4 2024-09-22T08:20:50.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.929+0000 7fc79bf46800 20 remove_watcher() i=5 2024-09-22T08:20:50.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.930+0000 7fc79bf46800 20 remove_watcher() i=6 2024-09-22T08:20:50.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:50.931+0000 7fc79bf46800 20 remove_watcher() i=7 2024-09-22T08:20:50.944 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:20:51.358 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:20:52.855 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:20:52.856 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:20:52.888 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:52.888 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:52.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.925+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:52.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:52.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 realm 2024-09-22T08:20:52.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:52.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:52.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:52.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:52.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:52.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.927+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:52.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.928+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:52.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.928+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:52.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.929+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:52.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.929+0000 7f340121d800 20 searching for the correct realm 2024-09-22T08:20:52.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:52.931+0000 7f33fd1ec640 0 -- 172.21.15.78:0/3504680607 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f33e4071070 msgr2=0x7f33e4048740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:53.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.136+0000 7f33fc1ea640 0 -- 172.21.15.78:0/3504680607 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f33ec0720b0 msgr2=0x7f33ec06c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:53.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.142+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 zone default found 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 4 Realm: () 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 zonegroup default 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.143+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.144+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.144+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.144+0000 7f340121d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.144+0000 7f340121d800 20 started sync module instance, tier type = 2024-09-22T08:20:53.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.144+0000 7f340121d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:53.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=0 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=1 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=2 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=3 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=4 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=5 2024-09-22T08:20:53.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.161+0000 7f340121d800 20 add_watcher() i=6 2024-09-22T08:20:53.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.163+0000 7f340121d800 20 add_watcher() i=7 2024-09-22T08:20:53.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.163+0000 7f340121d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:53.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.165+0000 7f32b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.165+0000 7f340121d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.165+0000 7f340121d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.165+0000 7f340121d800 5 note: GC not initialized 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f32b1fe3640 20 reqs_thread_entry: start 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f340121d800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f340121d800 20 Filter name: none 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f32237fe640 20 reqs_thread_entry: start 2024-09-22T08:20:53.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.166+0000 7f340121d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.167+0000 7f340121d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.167+0000 7f340121d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.167+0000 7f340121d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.167+0000 7f340121d800 20 INFO: main: starting shard=0 2024-09-22T08:20:53.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.167+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 INFO: main: starting shard=1 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 INFO: main: starting shard=2 2024-09-22T08:20:53.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.168+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:53.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.169+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.169+0000 7f340121d800 20 INFO: main: starting shard=3 2024-09-22T08:20:53.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.169+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:53.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 INFO: main: starting shard=4 2024-09-22T08:20:53.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:53.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 INFO: main: starting shard=5 2024-09-22T08:20:53.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.170+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 INFO: main: starting shard=6 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 INFO: main: starting shard=7 2024-09-22T08:20:53.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.171+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:53.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.172+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.172+0000 7f340121d800 20 INFO: main: starting shard=8 2024-09-22T08:20:53.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.172+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:53.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.172+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:20:53.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.173+0000 7f340121d800 20 INFO: main: starting shard=9 2024-09-22T08:20:53.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.173+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:53.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.173+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.173+0000 7f340121d800 20 INFO: main: starting shard=10 2024-09-22T08:20:53.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.173+0000 7f340121d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:53.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.174+0000 7f340121d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.174+0000 7f340121d800 20 INFO: main: done 2024-09-22T08:20:53.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.175+0000 7f32b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:53.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.177+0000 7f340121d800 20 remove_watcher() i=0 2024-09-22T08:20:53.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.177+0000 7f340121d800 2 removed watcher, disabling cache 2024-09-22T08:20:53.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.178+0000 7f340121d800 20 remove_watcher() i=1 2024-09-22T08:20:53.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.179+0000 7f340121d800 20 remove_watcher() i=2 2024-09-22T08:20:53.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.180+0000 7f340121d800 20 remove_watcher() i=3 2024-09-22T08:20:53.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.182+0000 7f340121d800 20 remove_watcher() i=4 2024-09-22T08:20:53.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.183+0000 7f340121d800 20 remove_watcher() i=5 2024-09-22T08:20:53.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.186+0000 7f340121d800 20 remove_watcher() i=6 2024-09-22T08:20:53.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.189+0000 7f340121d800 20 remove_watcher() i=7 2024-09-22T08:20:53.339 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:20:53.340 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:20:53.371 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:53.371 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:53.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.407+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 realm 2024-09-22T08:20:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:53.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.409+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.410+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:53.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.410+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.411+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:53.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.411+0000 7f92bcb25800 20 searching for the correct realm 2024-09-22T08:20:53.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.413+0000 7f92b8f34640 0 -- 172.21.15.78:0/2260750534 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f92a008c030 msgr2=0x7f92a008c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:53.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.618+0000 7f92affff640 0 -- 172.21.15.78:0/2260750534 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f92b0091040 msgr2=0x7f92b00333b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:53.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:53.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.623+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:53.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 zone default found 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 4 Realm: () 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 zonegroup default 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.624+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.625+0000 7f92bcb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.625+0000 7f92bcb25800 20 started sync module instance, tier type = 2024-09-22T08:20:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.625+0000 7f92bcb25800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=0 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=1 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=2 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=3 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=4 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=5 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.640+0000 7f92bcb25800 20 add_watcher() i=6 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.641+0000 7f92bcb25800 20 add_watcher() i=7 2024-09-22T08:20:53.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.641+0000 7f92bcb25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.642+0000 7f916e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 5 note: GC not initialized 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f916d7e2640 20 reqs_thread_entry: start 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 20 Filter name: none 2024-09-22T08:20:53.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f90deffd640 20 reqs_thread_entry: start 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.643+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 INFO: main: starting shard=0 2024-09-22T08:20:53.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.644+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 INFO: main: starting shard=1 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 INFO: main: starting shard=2 2024-09-22T08:20:53.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.645+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:53.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.646+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.646+0000 7f92bcb25800 20 INFO: main: starting shard=3 2024-09-22T08:20:53.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.646+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:53.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 INFO: main: starting shard=4 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 INFO: main: starting shard=5 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.647+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:53.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:20:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 INFO: main: starting shard=6 2024-09-22T08:20:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 INFO: main: starting shard=7 2024-09-22T08:20:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.648+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 INFO: main: starting shard=8 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 INFO: main: starting shard=9 2024-09-22T08:20:53.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.649+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:53.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.650+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.650+0000 7f92bcb25800 20 INFO: main: starting shard=10 2024-09-22T08:20:53.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.650+0000 7f92bcb25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:53.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.650+0000 7f92bcb25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:53.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.650+0000 7f92bcb25800 20 INFO: main: done 2024-09-22T08:20:53.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.651+0000 7f916e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:53.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.654+0000 7f92bcb25800 20 remove_watcher() i=0 2024-09-22T08:20:53.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.654+0000 7f92bcb25800 2 removed watcher, disabling cache 2024-09-22T08:20:53.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.655+0000 7f92bcb25800 20 remove_watcher() i=1 2024-09-22T08:20:53.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.657+0000 7f92bcb25800 20 remove_watcher() i=2 2024-09-22T08:20:53.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.659+0000 7f92bcb25800 20 remove_watcher() i=3 2024-09-22T08:20:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.662+0000 7f92bcb25800 20 remove_watcher() i=4 2024-09-22T08:20:53.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.663+0000 7f92bcb25800 20 remove_watcher() i=5 2024-09-22T08:20:53.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.664+0000 7f92bcb25800 20 remove_watcher() i=6 2024-09-22T08:20:53.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.665+0000 7f92bcb25800 20 remove_watcher() i=7 2024-09-22T08:20:53.818 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:20:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:20:53.849 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:53.849 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:53.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.885+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 20 realm 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:53.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.887+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.888+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:53.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.888+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.888+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:53.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.888+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:53.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.889+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:53.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:53.889+0000 7f099bb26800 20 searching for the correct realm 2024-09-22T08:20:54.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.092+0000 7f0997fda640 0 -- 172.21.15.78:0/2430287999 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f09800c8c20 msgr2=0x7f09800967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:20:54.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.297+0000 7f098efd8640 0 -- 172.21.15.78:0/2430287999 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f0990043040 msgr2=0x7f0990044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:54.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:54.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:54.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:54.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:54.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.302+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 zone default found 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 4 Realm: () 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 zonegroup default 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.303+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 started sync module instance, tier type = 2024-09-22T08:20:54.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.304+0000 7f099bb26800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=0 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=1 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=2 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=3 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=4 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=5 2024-09-22T08:20:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.318+0000 7f099bb26800 20 add_watcher() i=6 2024-09-22T08:20:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.319+0000 7f099bb26800 20 add_watcher() i=7 2024-09-22T08:20:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.320+0000 7f099bb26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.321+0000 7f084dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 5 note: GC not initialized 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f084cfe1640 20 reqs_thread_entry: start 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 20 Filter name: none 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f07c67fc640 20 reqs_thread_entry: start 2024-09-22T08:20:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.322+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 INFO: main: starting shard=0 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.323+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 INFO: main: starting shard=1 2024-09-22T08:20:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 INFO: main: starting shard=2 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.324+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: starting shard=3 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: starting shard=4 2024-09-22T08:20:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:54.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 INFO: main: starting shard=5 2024-09-22T08:20:54.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.325+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:54.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.326+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.326+0000 7f099bb26800 20 INFO: main: starting shard=6 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.326+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 INFO: main: starting shard=7 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:54.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 INFO: main: starting shard=8 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.327+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 INFO: main: starting shard=9 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 INFO: main: starting shard=10 2024-09-22T08:20:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.328+0000 7f099bb26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:54.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.329+0000 7f099bb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.329+0000 7f099bb26800 20 INFO: main: done 2024-09-22T08:20:54.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.330+0000 7f084dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:54.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.332+0000 7f099bb26800 20 remove_watcher() i=0 2024-09-22T08:20:54.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.332+0000 7f099bb26800 2 removed watcher, disabling cache 2024-09-22T08:20:54.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.333+0000 7f099bb26800 20 remove_watcher() i=1 2024-09-22T08:20:54.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.334+0000 7f099bb26800 20 remove_watcher() i=2 2024-09-22T08:20:54.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.335+0000 7f099bb26800 20 remove_watcher() i=3 2024-09-22T08:20:54.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.336+0000 7f099bb26800 20 remove_watcher() i=4 2024-09-22T08:20:54.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.337+0000 7f099bb26800 20 remove_watcher() i=5 2024-09-22T08:20:54.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.339+0000 7f099bb26800 20 remove_watcher() i=6 2024-09-22T08:20:54.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.342+0000 7f099bb26800 20 remove_watcher() i=7 2024-09-22T08:20:54.463 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:20:54.464 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:20:54.494 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:54.494 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:54.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.530+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 realm 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.532+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.533+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:54.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.533+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.534+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:54.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.534+0000 7f18c1c0e800 20 searching for the correct realm 2024-09-22T08:20:54.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.536+0000 7f18bda5a640 0 -- 172.21.15.78:0/1533189844 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f18a807d070 msgr2=0x7f18a8061910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:54.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.540+0000 7f18b4a58640 0 -- 172.21.15.78:0/1533189844 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f18b800e040 msgr2=0x7f18b808b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:54.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:54.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.544+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 zone default found 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 4 Realm: () 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 zonegroup default 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.545+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.546+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.546+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.546+0000 7f18c1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.546+0000 7f18c1c0e800 20 started sync module instance, tier type = 2024-09-22T08:20:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.546+0000 7f18c1c0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=0 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=1 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=2 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=3 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=4 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=5 2024-09-22T08:20:54.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.559+0000 7f18c1c0e800 20 add_watcher() i=6 2024-09-22T08:20:54.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.560+0000 7f18c1c0e800 20 add_watcher() i=7 2024-09-22T08:20:54.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.560+0000 7f18c1c0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f17737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f18c1c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f18c1c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f18c1c0e800 5 note: GC not initialized 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f17727e4640 20 reqs_thread_entry: start 2024-09-22T08:20:54.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f18c1c0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f18c1c0e800 20 Filter name: none 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.562+0000 7f16e3fff640 20 reqs_thread_entry: start 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:54.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 INFO: main: starting shard=0 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.563+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.564+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.564+0000 7f18c1c0e800 20 INFO: main: starting shard=1 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.564+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: starting shard=2 2024-09-22T08:20:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: starting shard=3 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 INFO: main: starting shard=4 2024-09-22T08:20:54.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.565+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 INFO: main: starting shard=5 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 INFO: main: starting shard=6 2024-09-22T08:20:54.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.566+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 INFO: main: starting shard=7 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 INFO: main: starting shard=8 2024-09-22T08:20:54.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.567+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.568+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.568+0000 7f18c1c0e800 20 INFO: main: starting shard=9 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.568+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.569+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.569+0000 7f18c1c0e800 20 INFO: main: starting shard=10 2024-09-22T08:20:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.569+0000 7f18c1c0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:54.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.569+0000 7f18c1c0e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:20:54.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.569+0000 7f18c1c0e800 20 INFO: main: done 2024-09-22T08:20:54.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.570+0000 7f17737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:54.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.573+0000 7f18c1c0e800 20 remove_watcher() i=0 2024-09-22T08:20:54.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.573+0000 7f18c1c0e800 2 removed watcher, disabling cache 2024-09-22T08:20:54.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.574+0000 7f18c1c0e800 20 remove_watcher() i=1 2024-09-22T08:20:54.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.575+0000 7f18c1c0e800 20 remove_watcher() i=2 2024-09-22T08:20:54.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.576+0000 7f18c1c0e800 20 remove_watcher() i=3 2024-09-22T08:20:54.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.577+0000 7f18c1c0e800 20 remove_watcher() i=4 2024-09-22T08:20:54.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.581+0000 7f18c1c0e800 20 remove_watcher() i=5 2024-09-22T08:20:54.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.582+0000 7f18c1c0e800 20 remove_watcher() i=6 2024-09-22T08:20:54.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:54.585+0000 7f18c1c0e800 20 remove_watcher() i=7 2024-09-22T08:20:54.621 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:20:55.012 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:20:55.402 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-22T08:20:55.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:55.404 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:20:55.436 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:55.436 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:55.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.472+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 20 realm 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:55.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.474+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.475+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.475+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.475+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:55.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.475+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.476+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:55.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.476+0000 7f488ae92800 20 searching for the correct realm 2024-09-22T08:20:55.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.479+0000 7f488917d640 0 -- 172.21.15.78:0/833190243 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f487c00b040 msgr2=0x7f487c067140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:55.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.482+0000 7f488817b640 0 -- 172.21.15.78:0/833190243 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f48800d4020 msgr2=0x7f48800638f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.487+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 zone default found 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 4 Realm: () 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 zonegroup default 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.488+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.489+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.489+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.489+0000 7f488ae92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.489+0000 7f488ae92800 20 started sync module instance, tier type = 2024-09-22T08:20:55.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.489+0000 7f488ae92800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=0 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=1 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=2 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=3 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=4 2024-09-22T08:20:55.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=5 2024-09-22T08:20:55.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.511+0000 7f488ae92800 20 add_watcher() i=6 2024-09-22T08:20:55.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.512+0000 7f488ae92800 20 add_watcher() i=7 2024-09-22T08:20:55.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.512+0000 7f488ae92800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:55.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.514+0000 7f473efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 5 note: GC not initialized 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f473dfe3640 20 reqs_thread_entry: start 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:55.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 20 Filter name: none 2024-09-22T08:20:55.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f46af7fe640 20 reqs_thread_entry: start 2024-09-22T08:20:55.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:55.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.515+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:55.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.516+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.517+0000 7f488ae92800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:20:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.517+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.518+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.518+0000 7f488ae92800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.518+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.519+0000 7f488ae92800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.519+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:55.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.519+0000 7f488ae92800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:20:55.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.519+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.519+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.520+0000 7f488ae92800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.520+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.520+0000 7f488ae92800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.520+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:55.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.521+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:55.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.521+0000 7f488ae92800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:20:55.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.521+0000 7f488ae92800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:55.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.522+0000 7f488ae92800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-22T08:20:55.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.522+0000 7f488ae92800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-22T08:20:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.522+0000 7f488ae92800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-22T08:20:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.523+0000 7f488ae92800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-22T08:20:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.523+0000 7f488ae92800 1 NOTICE: finished all shards (4 entries found) 2024-09-22T08:20:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.523+0000 7f473efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:55.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.526+0000 7f488ae92800 20 remove_watcher() i=0 2024-09-22T08:20:55.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.526+0000 7f488ae92800 2 removed watcher, disabling cache 2024-09-22T08:20:55.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.527+0000 7f488ae92800 20 remove_watcher() i=1 2024-09-22T08:20:55.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.528+0000 7f488ae92800 20 remove_watcher() i=2 2024-09-22T08:20:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.529+0000 7f488ae92800 20 remove_watcher() i=3 2024-09-22T08:20:55.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.530+0000 7f488ae92800 20 remove_watcher() i=4 2024-09-22T08:20:55.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.534+0000 7f488ae92800 20 remove_watcher() i=5 2024-09-22T08:20:55.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.535+0000 7f488ae92800 20 remove_watcher() i=6 2024-09-22T08:20:55.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.538+0000 7f488ae92800 20 remove_watcher() i=7 2024-09-22T08:20:55.548 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: unlinked entries are not listable 2024-09-22T08:20:55.548 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:55.664 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-22T08:20:55.664 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:55.793 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-22T08:20:55.793 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:55.794 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:20:55.829 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:55.829 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:55.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.866+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 realm 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:55.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.868+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.869+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:55.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.869+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:55.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.870+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:55.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.870+0000 7f58c7f31800 20 searching for the correct realm 2024-09-22T08:20:55.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:55.872+0000 7f58c4477640 0 -- 172.21.15.78:0/56500371 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f58ac01b040 msgr2=0x7f58ac04f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:56.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.077+0000 7f58bb475640 0 -- 172.21.15.78:0/56500371 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f58bc087440 msgr2=0x7f58bc0878c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:56.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.083+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 zone default found 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 4 Realm: () 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 zonegroup default 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.084+0000 7f58c7f31800 20 started sync module instance, tier type = 2024-09-22T08:20:56.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.085+0000 7f58c7f31800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=0 2024-09-22T08:20:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=1 2024-09-22T08:20:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=2 2024-09-22T08:20:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=3 2024-09-22T08:20:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=4 2024-09-22T08:20:56.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=5 2024-09-22T08:20:56.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.102+0000 7f58c7f31800 20 add_watcher() i=6 2024-09-22T08:20:56.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.105+0000 7f58c7f31800 20 add_watcher() i=7 2024-09-22T08:20:56.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.105+0000 7f58c7f31800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:56.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f5779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:56.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f58c7f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:56.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f58c7f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:56.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f58c7f31800 5 note: GC not initialized 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f5778fe1640 20 reqs_thread_entry: start 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f58c7f31800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f58c7f31800 20 Filter name: none 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.107+0000 7f56f27fc640 20 reqs_thread_entry: start 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.108+0000 7f58c7f31800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:56.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:56.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:20:56.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.109+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.110+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:56.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.110+0000 7f58c7f31800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:20:56.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.110+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:56.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.111+0000 7f58c7f31800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:20:56.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.111+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:56.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.111+0000 7f58c7f31800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:20:56.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.111+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.112+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:56.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.112+0000 7f58c7f31800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:20:56.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.112+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:56.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.113+0000 7f58c7f31800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:20:56.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.113+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.113+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:56.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.114+0000 7f58c7f31800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:20:56.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.114+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.115+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.115+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f51e0f0 obj=check-bucket:e state=0x55f77f7eb418 s->prefetch_data=0 2024-09-22T08:20:56.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.115+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.115+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f546890 obj=check-bucket:d state=0x55f77f7e95d8 s->prefetch_data=0 2024-09-22T08:20:56.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.115+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f7ea2e0 obj=check-bucket:c state=0x55f77f7ed4f8 s->prefetch_data=0 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f888d40 obj=check-bucket:f state=0x55f77f8878a8 s->prefetch_data=0 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to 5sv3wgdtx9vp28guq6utp2lvcxkefbpa 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state_impl: setting s->olh_tag to vsbg3r2e93v2i2bup4d3c0vjp5mve7h4 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vsbg3r2e93v2i2bup4d3c0vjp5mve7h4 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to 2uug9i5e62sgja5qkgwd0dtnf2w9z501 2024-09-22T08:20:56.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state_impl: setting s->olh_tag to boeqgxrragof8ls3w3dz80i1f28lk1zo 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=boeqgxrragof8ls3w3dz80i1f28lk1zo 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to dyc5nmmavdwcrz75lhuxa6p2qa0jpdal 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 get_obj_state_impl: setting s->olh_tag to za5xmt1sxmcb19n3lqz6pt4g8ys0q5tj 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.116+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=za5xmt1sxmcb19n3lqz6pt4g8ys0q5tj 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.117+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to f1p2xf64n2kp42tcnfgsk2vzw4f1hhax 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.117+0000 7f58c7f31800 20 get_obj_state_impl: setting s->olh_tag to ndhz3d3qyu1fjst0r1vgpd2iaucp2nnk 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.117+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ndhz3d3qyu1fjst0r1vgpd2iaucp2nnk 2024-09-22T08:20:56.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.118+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.119+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.121+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.121+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.123+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.123+0000 7f58c7f31800 20 olh_log_entry: epoch=3 op=3 key=c[2vFV13jAbKSQs44IFe2wFvcWK015bZc] 2024-09-22T08:20:56.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.123+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f7ea2e0 obj=check-bucket:_:2vFV13jAbKSQs44IFe2wFvcWK015bZc_c state=0x55f77f8a3148 s->prefetch_data=0 2024-09-22T08:20:56.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.124+0000 7f58c7f31800 10 manifest: total_size = 9 2024-09-22T08:20:56.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.124+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6733150216867735727 2024-09-22T08:20:56.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.124+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f7ea2e0 obj=check-bucket:_:2vFV13jAbKSQs44IFe2wFvcWK015bZc_c state=0x55f77f8a3148 s->prefetch_data=0 2024-09-22T08:20:56.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.124+0000 7f58c7f31800 20 prepare_atomic_modification: state is not atomic. state=0x55f77f8a3148 2024-09-22T08:20:56.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.124+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 olh_log_entry: epoch=2 op=3 key=e[c2CRmcQ8Op9fH-505yxHXNVOFjLA8sn] 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f51e0f0 obj=check-bucket:_:c2CRmcQ8Op9fH-505yxHXNVOFjLA8sn_e state=0x55f77f8ac1a8 s->prefetch_data=0 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 olh_log_entry: epoch=2 op=3 key=f[t5KaZ4PNA4xtSqk3sZ02rWxmNIphqWZ] 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f888d40 obj=check-bucket:_:t5KaZ4PNA4xtSqk3sZ02rWxmNIphqWZ_f state=0x55f77f89d978 s->prefetch_data=0 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 olh_log_entry: epoch=3 op=3 key=d[BzxWBIQSdKOjl-yudP9H-bCkZ8uteBA] 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f546890 obj=check-bucket:_:BzxWBIQSdKOjl-yudP9H-bCkZ8uteBA_d state=0x55f77f8b69e8 s->prefetch_data=0 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 10 manifest: total_size = 12 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16507684917302766708 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f51e0f0 obj=check-bucket:_:c2CRmcQ8Op9fH-505yxHXNVOFjLA8sn_e state=0x55f77f8ac1a8 s->prefetch_data=0 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 prepare_atomic_modification: state is not atomic. state=0x55f77f8ac1a8 2024-09-22T08:20:56.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.126+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 10 manifest: total_size = 11 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6540783648235090482 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f888d40 obj=check-bucket:_:t5KaZ4PNA4xtSqk3sZ02rWxmNIphqWZ_f state=0x55f77f89d978 s->prefetch_data=0 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 prepare_atomic_modification: state is not atomic. state=0x55f77f89d978 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 10 manifest: total_size = 22 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9073032161612569431 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f546890 obj=check-bucket:_:BzxWBIQSdKOjl-yudP9H-bCkZ8uteBA_d state=0x55f77f8b69e8 s->prefetch_data=0 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 prepare_atomic_modification: state is not atomic. state=0x55f77f8b69e8 2024-09-22T08:20:56.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.127+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:20:56.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-22T08:20:56.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:20:56.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:c2CRmcQ8Op9fH-505yxHXNVOFjLA8sn_.gZOGFuHDZWuQ5Yhz1905-Eoagq6hyOf_0 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.132+0000 7f58c7f31800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:2vFV13jAbKSQs44IFe2wFvcWK015bZc_.JoXDHQgJvbLuBSommOCVS9zym2bhUW3_0 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:20:56.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.133+0000 7f58c7f31800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:t5KaZ4PNA4xtSqk3sZ02rWxmNIphqWZ_.3Nq1sEZwHENJklpdO2Ap2EIaQoZaLPQ_0 2024-09-22T08:20:56.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.134+0000 7f58c7f31800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:20:56.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.134+0000 7f58c7f31800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-22T08:20:56.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.134+0000 7f58c7f31800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:20:56.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.134+0000 7f58c7f31800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:BzxWBIQSdKOjl-yudP9H-bCkZ8uteBA_.jpfL7PBdZiyLHo7JC1M6MFix55qEggY_0 2024-09-22T08:20:56.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.136+0000 7f57a2ffd640 20 handle_completion(): completion ok for obj=e[c2CRmcQ8Op9fH-505yxHXNVOFjLA8sn] 2024-09-22T08:20:56.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.136+0000 7f57a27fc640 20 handle_completion(): completion ok for obj=f[t5KaZ4PNA4xtSqk3sZ02rWxmNIphqWZ] 2024-09-22T08:20:56.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.136+0000 7f57a2ffd640 20 handle_completion(): completion ok for obj=d[BzxWBIQSdKOjl-yudP9H-bCkZ8uteBA] 2024-09-22T08:20:56.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.138+0000 7f57a27fc640 20 handle_completion(): completion ok for obj=c[2vFV13jAbKSQs44IFe2wFvcWK015bZc] 2024-09-22T08:20:56.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.138+0000 7f58c7f31800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:20:56.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.139+0000 7f58c7f31800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:20:56.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.139+0000 7f58c7f31800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:20:56.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.139+0000 7f58c7f31800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:20:56.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.140+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f888d40 obj=check-bucket:f state=0x55f77f8878a8 s->prefetch_data=0 2024-09-22T08:20:56.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.140+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ndhz3d3qyu1fjst0r1vgpd2iaucp2nnk 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.141+0000 7f58c7f31800 20 get_obj_state: octx=0x55f77f51e0f0 obj=check-bucket:e state=0x55f77f7eb418 s->prefetch_data=0 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.141+0000 7f58c7f31800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vsbg3r2e93v2i2bup4d3c0vjp5mve7h4 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.141+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.141+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.142+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.142+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.144+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.144+0000 7f58c7f31800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:20:56.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.147+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.147+0000 7f58c7f31800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:20:56.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.150+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.150+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.153+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.153+0000 7f58c7f31800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-22T08:20:56.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.153+0000 7f58c7f31800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.153+0000 7f58c7f31800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-22T08:20:56.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.153+0000 7f58c7f31800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:20:56.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.154+0000 7f5779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:56.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.156+0000 7f58c7f31800 20 remove_watcher() i=0 2024-09-22T08:20:56.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.156+0000 7f58c7f31800 2 removed watcher, disabling cache 2024-09-22T08:20:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.157+0000 7f58c7f31800 20 remove_watcher() i=1 2024-09-22T08:20:56.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.158+0000 7f58c7f31800 20 remove_watcher() i=2 2024-09-22T08:20:56.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.160+0000 7f58c7f31800 20 remove_watcher() i=3 2024-09-22T08:20:56.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.161+0000 7f58c7f31800 20 remove_watcher() i=4 2024-09-22T08:20:56.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.162+0000 7f58c7f31800 20 remove_watcher() i=5 2024-09-22T08:20:56.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.163+0000 7f58c7f31800 20 remove_watcher() i=6 2024-09-22T08:20:56.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.164+0000 7f58c7f31800 20 remove_watcher() i=7 2024-09-22T08:20:56.255 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-22T08:20:56.255 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:56.417 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-22T08:20:56.417 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:56.418 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:20:56.452 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:56.452 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:56.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.489+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 20 realm 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.490+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.491+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.491+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.491+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:56.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.491+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.492+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:56.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.492+0000 7f8ae4b26800 20 searching for the correct realm 2024-09-22T08:20:56.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.494+0000 7f8ae0f0a640 0 -- 172.21.15.78:0/3644409473 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f8ac80ae500 msgr2=0x7f8ac80aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:56.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.699+0000 7f8adff08640 0 -- 172.21.15.78:0/3644409473 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f8ad002c060 msgr2=0x7f8ad006c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:56.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.704+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:56.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 zone default found 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 4 Realm: () 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 zonegroup default 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.705+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.706+0000 7f8ae4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.706+0000 7f8ae4b26800 20 started sync module instance, tier type = 2024-09-22T08:20:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.706+0000 7f8ae4b26800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=0 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=1 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=2 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=3 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=4 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=5 2024-09-22T08:20:56.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.720+0000 7f8ae4b26800 20 add_watcher() i=6 2024-09-22T08:20:56.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.721+0000 7f8ae4b26800 20 add_watcher() i=7 2024-09-22T08:20:56.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.721+0000 7f8ae4b26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.723+0000 7f8996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 5 note: GC not initialized 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8995fdb640 20 reqs_thread_entry: start 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 20 Filter name: none 2024-09-22T08:20:56.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f89077fe640 20 reqs_thread_entry: start 2024-09-22T08:20:56.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:56.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.724+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 20 rados->read ofs=0 len=0 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:56.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.725+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:56.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.726+0000 7f8ae4b26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:20:56.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.726+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:56.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.726+0000 7f8ae4b26800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:20:56.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.726+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.727+0000 7f8ae4b26800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.727+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.727+0000 7f8ae4b26800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.727+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.728+0000 7f8ae4b26800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.728+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.728+0000 7f8ae4b26800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:20:56.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.728+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.729+0000 7f8ae4b26800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.729+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.729+0000 7f8ae4b26800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.729+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.730+0000 7f8ae4b26800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:20:56.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.730+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:56.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.730+0000 7f8ae4b26800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:20:56.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.730+0000 7f8ae4b26800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:56.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.731+0000 7f8ae4b26800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:20:56.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.731+0000 7f8ae4b26800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:20:56.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.732+0000 7f8996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.734+0000 7f8ae4b26800 20 remove_watcher() i=0 2024-09-22T08:20:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.734+0000 7f8ae4b26800 2 removed watcher, disabling cache 2024-09-22T08:20:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.735+0000 7f8ae4b26800 20 remove_watcher() i=1 2024-09-22T08:20:56.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.736+0000 7f8ae4b26800 20 remove_watcher() i=2 2024-09-22T08:20:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.738+0000 7f8ae4b26800 20 remove_watcher() i=3 2024-09-22T08:20:56.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.739+0000 7f8ae4b26800 20 remove_watcher() i=4 2024-09-22T08:20:56.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.740+0000 7f8ae4b26800 20 remove_watcher() i=5 2024-09-22T08:20:56.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.741+0000 7f8ae4b26800 20 remove_watcher() i=6 2024-09-22T08:20:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:56.743+0000 7f8ae4b26800 20 remove_watcher() i=7 2024-09-22T08:20:56.949 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:20:56.979 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:56.979 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:57.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.014+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 realm 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.017+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.018+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.018+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.018+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:57.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.018+0000 7fd516146800 20 searching for the correct realm 2024-09-22T08:20:57.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.021+0000 7fd514438640 0 -- 172.21.15.78:0/3753234083 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd4fc0024d0 msgr2=0x7fd4fc04a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:57.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.225+0000 7fd50b436640 0 -- 172.21.15.78:0/3753234083 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd50c088040 msgr2=0x7fd50c088930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:57.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.230+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:57.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 zone default found 2024-09-22T08:20:57.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 4 Realm: () 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 zonegroup default 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.231+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 started sync module instance, tier type = 2024-09-22T08:20:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.232+0000 7fd516146800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=0 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=1 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=2 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=3 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=4 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=5 2024-09-22T08:20:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.243+0000 7fd516146800 20 add_watcher() i=6 2024-09-22T08:20:57.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.244+0000 7fd516146800 20 add_watcher() i=7 2024-09-22T08:20:57.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.244+0000 7fd516146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.245+0000 7fd3c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 5 note: GC not initialized 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd3c8fe1640 20 reqs_thread_entry: start 2024-09-22T08:20:57.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 20 Filter name: none 2024-09-22T08:20:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd3427fc640 20 reqs_thread_entry: start 2024-09-22T08:20:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.246+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.247+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.247+0000 7fd516146800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 INFO: main: starting shard=0 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 INFO: main: starting shard=1 2024-09-22T08:20:57.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.248+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:57.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.249+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.249+0000 7fd516146800 20 INFO: main: starting shard=2 2024-09-22T08:20:57.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.249+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:57.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 INFO: main: starting shard=3 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 INFO: main: starting shard=4 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.250+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 INFO: main: starting shard=5 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 INFO: main: starting shard=6 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.251+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 INFO: main: starting shard=7 2024-09-22T08:20:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:57.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 INFO: main: starting shard=8 2024-09-22T08:20:57.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.252+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:57.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:20:57.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 INFO: main: starting shard=9 2024-09-22T08:20:57.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:57.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 INFO: main: starting shard=10 2024-09-22T08:20:57.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.253+0000 7fd516146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:57.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.254+0000 7fd516146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.254+0000 7fd516146800 20 INFO: main: done 2024-09-22T08:20:57.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.255+0000 7fd3c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.257+0000 7fd516146800 20 remove_watcher() i=0 2024-09-22T08:20:57.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.257+0000 7fd516146800 2 removed watcher, disabling cache 2024-09-22T08:20:57.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.258+0000 7fd516146800 20 remove_watcher() i=1 2024-09-22T08:20:57.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.259+0000 7fd516146800 20 remove_watcher() i=2 2024-09-22T08:20:57.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.260+0000 7fd516146800 20 remove_watcher() i=3 2024-09-22T08:20:57.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.261+0000 7fd516146800 20 remove_watcher() i=4 2024-09-22T08:20:57.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.262+0000 7fd516146800 20 remove_watcher() i=5 2024-09-22T08:20:57.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.263+0000 7fd516146800 20 remove_watcher() i=6 2024-09-22T08:20:57.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.264+0000 7fd516146800 20 remove_watcher() i=7 2024-09-22T08:20:57.276 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:20:57.307 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:57.307 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:57.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.342+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 20 realm 2024-09-22T08:20:57.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.344+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.345+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.345+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.345+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.345+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.346+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:57.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.346+0000 7fd180e0f800 20 searching for the correct realm 2024-09-22T08:20:57.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.348+0000 7fd17cd93640 0 -- 172.21.15.78:0/2372487793 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd16403e960 msgr2=0x7fd16403d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:57.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.552+0000 7fd173d91640 0 -- 172.21.15.78:0/2372487793 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd17406a040 msgr2=0x7fd1740b52e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:57.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.557+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 zone default found 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 4 Realm: () 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 zonegroup default 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.558+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.559+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.559+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.559+0000 7fd180e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.559+0000 7fd180e0f800 20 started sync module instance, tier type = 2024-09-22T08:20:57.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.559+0000 7fd180e0f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:57.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=0 2024-09-22T08:20:57.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=1 2024-09-22T08:20:57.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=2 2024-09-22T08:20:57.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=3 2024-09-22T08:20:57.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=4 2024-09-22T08:20:57.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=5 2024-09-22T08:20:57.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.569+0000 7fd180e0f800 20 add_watcher() i=6 2024-09-22T08:20:57.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.572+0000 7fd180e0f800 20 add_watcher() i=7 2024-09-22T08:20:57.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.572+0000 7fd180e0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.574+0000 7fd032fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.574+0000 7fd180e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.574+0000 7fd180e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.574+0000 7fd180e0f800 5 note: GC not initialized 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd031fdb640 20 reqs_thread_entry: start 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd180e0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd180e0f800 20 Filter name: none 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fcfa37fe640 20 reqs_thread_entry: start 2024-09-22T08:20:57.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.575+0000 7fd180e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 INFO: main: starting shard=0 2024-09-22T08:20:57.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 INFO: main: starting shard=1 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.576+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 INFO: main: starting shard=2 2024-09-22T08:20:57.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 INFO: main: starting shard=3 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.577+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 INFO: main: starting shard=4 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 INFO: main: starting shard=5 2024-09-22T08:20:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.578+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:57.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.579+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:20:57.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.579+0000 7fd180e0f800 20 INFO: main: starting shard=6 2024-09-22T08:20:57.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.579+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:57.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 INFO: main: starting shard=7 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 INFO: main: starting shard=8 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.580+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 INFO: main: starting shard=9 2024-09-22T08:20:57.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:57.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 INFO: main: starting shard=10 2024-09-22T08:20:57.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.581+0000 7fd180e0f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:57.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.582+0000 7fd180e0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:57.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.582+0000 7fd180e0f800 20 INFO: main: done 2024-09-22T08:20:57.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.583+0000 7fd032fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.585+0000 7fd180e0f800 20 remove_watcher() i=0 2024-09-22T08:20:57.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.585+0000 7fd180e0f800 2 removed watcher, disabling cache 2024-09-22T08:20:57.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.587+0000 7fd180e0f800 20 remove_watcher() i=1 2024-09-22T08:20:57.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.588+0000 7fd180e0f800 20 remove_watcher() i=2 2024-09-22T08:20:57.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.589+0000 7fd180e0f800 20 remove_watcher() i=3 2024-09-22T08:20:57.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.590+0000 7fd180e0f800 20 remove_watcher() i=4 2024-09-22T08:20:57.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.591+0000 7fd180e0f800 20 remove_watcher() i=5 2024-09-22T08:20:57.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.592+0000 7fd180e0f800 20 remove_watcher() i=6 2024-09-22T08:20:57.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.593+0000 7fd180e0f800 20 remove_watcher() i=7 2024-09-22T08:20:57.604 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-22T08:20:57.604 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:57.606 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:20:57.637 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:57.637 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:57.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.673+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 realm 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.675+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.676+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.676+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.677+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:57.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.677+0000 7fe86fd46800 20 searching for the correct realm 2024-09-22T08:20:57.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.679+0000 7fe865036640 0 -- 172.21.15.78:0/2997878344 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x559ecd6902a0 msgr2=0x559ecd692690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:57.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.682+0000 7fe865036640 0 -- 172.21.15.78:0/2997878344 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fe868038040 msgr2=0x7fe868039940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:20:57.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:57.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.888+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 zone default found 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 4 Realm: () 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:57.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:57.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 zonegroup default 2024-09-22T08:20:57.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.889+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.890+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.890+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.890+0000 7fe86fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:57.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.890+0000 7fe86fd46800 20 started sync module instance, tier type = 2024-09-22T08:20:57.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.890+0000 7fe86fd46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:57.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=0 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=1 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=2 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=3 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=4 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=5 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.902+0000 7fe86fd46800 20 add_watcher() i=6 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.903+0000 7fe86fd46800 20 add_watcher() i=7 2024-09-22T08:20:57.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.903+0000 7fe86fd46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.904+0000 7fe71ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe86fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe86fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe86fd46800 5 note: GC not initialized 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe71effd640 20 reqs_thread_entry: start 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe86fd46800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.905+0000 7fe86fd46800 20 Filter name: none 2024-09-22T08:20:57.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe71cff9640 20 reqs_thread_entry: start 2024-09-22T08:20:57.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:57.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.906+0000 7fe86fd46800 20 rados->read ofs=0 len=0 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:57.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:57.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:57.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:57.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:20:57.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.907+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.908+0000 7fe86fd46800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.908+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:57.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:20:57.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.909+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:57.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.910+0000 7fe86fd46800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-22T08:20:57.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.910+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:57.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.911+0000 7fe86fd46800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:20:57.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.911+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:57.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.911+0000 7fe86fd46800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:20:57.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.911+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:57.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.912+0000 7fe86fd46800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-22T08:20:57.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.912+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:57.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.912+0000 7fe86fd46800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:20:57.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.912+0000 7fe86fd46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:57.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.913+0000 7fe86fd46800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:20:57.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.913+0000 7fe86fd46800 1 NOTICE: finished all shards (2 entries found) 2024-09-22T08:20:57.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.913+0000 7fe71ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:57.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.916+0000 7fe86fd46800 20 remove_watcher() i=0 2024-09-22T08:20:57.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.916+0000 7fe86fd46800 2 removed watcher, disabling cache 2024-09-22T08:20:57.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.917+0000 7fe86fd46800 20 remove_watcher() i=1 2024-09-22T08:20:57.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.918+0000 7fe86fd46800 20 remove_watcher() i=2 2024-09-22T08:20:57.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.920+0000 7fe86fd46800 20 remove_watcher() i=3 2024-09-22T08:20:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.922+0000 7fe86fd46800 20 remove_watcher() i=4 2024-09-22T08:20:57.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.923+0000 7fe86fd46800 20 remove_watcher() i=5 2024-09-22T08:20:57.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.925+0000 7fe86fd46800 20 remove_watcher() i=6 2024-09-22T08:20:57.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:57.926+0000 7fe86fd46800 20 remove_watcher() i=7 2024-09-22T08:20:57.937 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-22T08:20:57.937 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:57.939 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:20:57.972 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:57.972 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:58.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.009+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 20 realm 2024-09-22T08:20:58.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.010+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.011+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.011+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.011+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.011+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.012+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:58.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.012+0000 7f261eb2c800 20 searching for the correct realm 2024-09-22T08:20:58.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.014+0000 7f261b0ae640 0 -- 172.21.15.78:0/2582522402 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2610089030 msgr2=0x7f2610089920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:58.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.219+0000 7f261a0ac640 0 -- 172.21.15.78:0/2582522402 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f261406f040 msgr2=0x7f26140133d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:58.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:58.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.223+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 zone default found 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 4 Realm: () 2024-09-22T08:20:58.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:58.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:58.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:58.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 zonegroup default 2024-09-22T08:20:58.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.224+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 started sync module instance, tier type = 2024-09-22T08:20:58.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.225+0000 7f261eb2c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=0 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=1 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=2 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=3 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=4 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=5 2024-09-22T08:20:58.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.239+0000 7f261eb2c800 20 add_watcher() i=6 2024-09-22T08:20:58.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.242+0000 7f261eb2c800 20 add_watcher() i=7 2024-09-22T08:20:58.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.242+0000 7f261eb2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:58.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f24d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f261eb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:58.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f261eb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f261eb2c800 5 note: GC not initialized 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f244bfff640 20 reqs_thread_entry: start 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.244+0000 7f261eb2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 20 Filter name: none 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f2449ffb640 20 reqs_thread_entry: start 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:58.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.245+0000 7f261eb2c800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:58.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.246+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.247+0000 7f261eb2c800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.247+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.248+0000 7f261eb2c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:20:58.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.248+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:58.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.248+0000 7f261eb2c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:20:58.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.248+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:58.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.249+0000 7f261eb2c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:20:58.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.249+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:58.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.249+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccf9d510f0 obj=check-bucket:d state=0x55ccfa022388 s->prefetch_data=0 2024-09-22T08:20:58.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.249+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:58.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.250+0000 7f261eb2c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:20:58.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.250+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:58.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.250+0000 7f261eb2c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:20:58.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.250+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:58.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.250+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccf9d79890 obj=check-bucket:c state=0x55ccfa022ef8 s->prefetch_data=0 2024-09-22T08:20:58.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:58.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:20:58.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 get_obj_state: setting s->obj_tag to 2uug9i5e62sgja5qkgwd0dtnf2w9z501 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 get_obj_state_impl: setting s->olh_tag to boeqgxrragof8ls3w3dz80i1f28lk1zo 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:58.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 get_obj_state: setting s->obj_tag to dyc5nmmavdwcrz75lhuxa6p2qa0jpdal 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 get_obj_state_impl: setting s->olh_tag to za5xmt1sxmcb19n3lqz6pt4g8ys0q5tj 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.251+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 olh_log_entry: epoch=4 op=3 key=c[18VPVOd17nHxzlz5Ld28TpV.UKqEYgZ] 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccfa07beb0 obj=check-bucket:_:18VPVOd17nHxzlz5Ld28TpV.UKqEYgZ_c state=0x55ccfa020f68 s->prefetch_data=0 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 olh_log_entry: epoch=4 op=3 key=d[zPUqpaMOxVtE3r4hiAekLQ3p2.qC-.V] 2024-09-22T08:20:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.252+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccfa05beb0 obj=check-bucket:_:zPUqpaMOxVtE3r4hiAekLQ3p2.qC-.V_d state=0x55ccfa089db8 s->prefetch_data=0 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccfa05beb0 obj=check-bucket:d state=0x55ccfa020f28 s->prefetch_data=0 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state: octx=0x55ccfa07beb0 obj=check-bucket:c state=0x55ccfa08ae88 s->prefetch_data=0 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state: setting s->obj_tag to 2uug9i5e62sgja5qkgwd0dtnf2w9z501 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state_impl: setting s->olh_tag to boeqgxrragof8ls3w3dz80i1f28lk1zo 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=boeqgxrragof8ls3w3dz80i1f28lk1zo 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state: setting s->obj_tag to dyc5nmmavdwcrz75lhuxa6p2qa0jpdal 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 get_obj_state_impl: setting s->olh_tag to za5xmt1sxmcb19n3lqz6pt4g8ys0q5tj 2024-09-22T08:20:58.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.254+0000 7f261eb2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=za5xmt1sxmcb19n3lqz6pt4g8ys0q5tj 2024-09-22T08:20:58.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.264+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:58.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.266+0000 7f261eb2c800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:20:58.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.267+0000 7f261eb2c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:58.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.270+0000 7f261eb2c800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:20:58.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.270+0000 7f261eb2c800 1 NOTICE: finished all shards (2 entries removed) 2024-09-22T08:20:58.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.271+0000 7f24d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.273+0000 7f261eb2c800 20 remove_watcher() i=0 2024-09-22T08:20:58.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.273+0000 7f261eb2c800 2 removed watcher, disabling cache 2024-09-22T08:20:58.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.274+0000 7f261eb2c800 20 remove_watcher() i=1 2024-09-22T08:20:58.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.275+0000 7f261eb2c800 20 remove_watcher() i=2 2024-09-22T08:20:58.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.276+0000 7f261eb2c800 20 remove_watcher() i=3 2024-09-22T08:20:58.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.277+0000 7f261eb2c800 20 remove_watcher() i=4 2024-09-22T08:20:58.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.278+0000 7f261eb2c800 20 remove_watcher() i=5 2024-09-22T08:20:58.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.279+0000 7f261eb2c800 20 remove_watcher() i=6 2024-09-22T08:20:58.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.280+0000 7f261eb2c800 20 remove_watcher() i=7 2024-09-22T08:20:58.292 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:20:58.323 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:58.323 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.360+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 realm 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.362+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.363+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.363+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.364+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:58.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.364+0000 7fcb41820800 20 searching for the correct realm 2024-09-22T08:20:58.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.365+0000 7fcb3eb10640 0 -- 172.21.15.78:0/706714198 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x560094ef37e0 msgr2=0x560094ef5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:58.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.369+0000 7fcb3eb10640 0 -- 172.21.15.78:0/706714198 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fcb3808c940 msgr2=0x7fcb3808b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:58.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.575+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:58.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 zone default found 2024-09-22T08:20:58.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 4 Realm: () 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 zonegroup default 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.576+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 started sync module instance, tier type = 2024-09-22T08:20:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.577+0000 7fcb41820800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=0 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=1 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=2 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=3 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=4 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=5 2024-09-22T08:20:58.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.589+0000 7fcb41820800 20 add_watcher() i=6 2024-09-22T08:20:58.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.592+0000 7fcb41820800 20 add_watcher() i=7 2024-09-22T08:20:58.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.592+0000 7fcb41820800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:58.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fc9f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fcb41820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fcb41820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fcb41820800 5 note: GC not initialized 2024-09-22T08:20:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fc9f4fe1640 20 reqs_thread_entry: start 2024-09-22T08:20:58.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fcb41820800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:58.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fcb41820800 20 Filter name: none 2024-09-22T08:20:58.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.594+0000 7fc96e7fc640 20 reqs_thread_entry: start 2024-09-22T08:20:58.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 INFO: main: starting shard=0 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.595+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 INFO: main: starting shard=1 2024-09-22T08:20:58.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 INFO: main: starting shard=2 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.596+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 INFO: main: starting shard=3 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 INFO: main: starting shard=4 2024-09-22T08:20:58.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.597+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 INFO: main: starting shard=5 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 INFO: main: starting shard=6 2024-09-22T08:20:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.598+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.599+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.599+0000 7fcb41820800 20 INFO: main: starting shard=7 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.599+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 INFO: main: starting shard=8 2024-09-22T08:20:58.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:58.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 INFO: main: starting shard=9 2024-09-22T08:20:58.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.600+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:58.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.601+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.601+0000 7fcb41820800 20 INFO: main: starting shard=10 2024-09-22T08:20:58.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.601+0000 7fcb41820800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:58.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.601+0000 7fcb41820800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.601+0000 7fcb41820800 20 INFO: main: done 2024-09-22T08:20:58.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.602+0000 7fc9f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.604+0000 7fcb41820800 20 remove_watcher() i=0 2024-09-22T08:20:58.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.604+0000 7fcb41820800 2 removed watcher, disabling cache 2024-09-22T08:20:58.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.606+0000 7fcb41820800 20 remove_watcher() i=1 2024-09-22T08:20:58.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.607+0000 7fcb41820800 20 remove_watcher() i=2 2024-09-22T08:20:58.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.608+0000 7fcb41820800 20 remove_watcher() i=3 2024-09-22T08:20:58.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.609+0000 7fcb41820800 20 remove_watcher() i=4 2024-09-22T08:20:58.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.610+0000 7fcb41820800 20 remove_watcher() i=5 2024-09-22T08:20:58.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.611+0000 7fcb41820800 20 remove_watcher() i=6 2024-09-22T08:20:58.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.612+0000 7fcb41820800 20 remove_watcher() i=7 2024-09-22T08:20:58.625 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:20:58.655 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:58.655 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:58.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.691+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 20 realm 2024-09-22T08:20:58.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.693+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.694+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.694+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.694+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.694+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.695+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:58.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.695+0000 7f086992e800 20 searching for the correct realm 2024-09-22T08:20:58.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.697+0000 7f0865ede640 0 -- 172.21.15.78:0/335419183 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f085c02b070 msgr2=0x7f085c044430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:20:58.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.902+0000 7f0864edc640 0 -- 172.21.15.78:0/335419183 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f08600abe60 msgr2=0x7f08600aa8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:58.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.908+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 zone default found 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 4 Realm: () 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 zonegroup default 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.909+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.910+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.910+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.910+0000 7f086992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:58.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.910+0000 7f086992e800 20 started sync module instance, tier type = 2024-09-22T08:20:58.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.910+0000 7f086992e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=0 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=1 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=2 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=3 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=4 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=5 2024-09-22T08:20:58.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.923+0000 7f086992e800 20 add_watcher() i=6 2024-09-22T08:20:58.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.924+0000 7f086992e800 20 add_watcher() i=7 2024-09-22T08:20:58.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.924+0000 7f086992e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:58.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.926+0000 7f071b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.926+0000 7f086992e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.926+0000 7f086992e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f086992e800 5 note: GC not initialized 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f071a7e4640 20 reqs_thread_entry: start 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f086992e800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f086992e800 20 Filter name: none 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f068bfff640 20 reqs_thread_entry: start 2024-09-22T08:20:58.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.927+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 rados->read ofs=0 len=0 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 INFO: main: starting shard=0 2024-09-22T08:20:58.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.928+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 INFO: main: starting shard=1 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 INFO: main: starting shard=2 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.929+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 INFO: main: starting shard=3 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 INFO: main: starting shard=4 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.930+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.931+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.931+0000 7f086992e800 20 INFO: main: starting shard=5 2024-09-22T08:20:58.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.931+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:58.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 INFO: main: starting shard=6 2024-09-22T08:20:58.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 INFO: main: starting shard=7 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.932+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: starting shard=8 2024-09-22T08:20:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: starting shard=9 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 INFO: main: starting shard=10 2024-09-22T08:20:58.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.933+0000 7f086992e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:58.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.934+0000 7f086992e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:20:58.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.934+0000 7f086992e800 20 INFO: main: done 2024-09-22T08:20:58.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.935+0000 7f071b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:58.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.937+0000 7f086992e800 20 remove_watcher() i=0 2024-09-22T08:20:58.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.937+0000 7f086992e800 2 removed watcher, disabling cache 2024-09-22T08:20:58.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.938+0000 7f086992e800 20 remove_watcher() i=1 2024-09-22T08:20:58.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.940+0000 7f086992e800 20 remove_watcher() i=2 2024-09-22T08:20:58.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.941+0000 7f086992e800 20 remove_watcher() i=3 2024-09-22T08:20:58.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.942+0000 7f086992e800 20 remove_watcher() i=4 2024-09-22T08:20:58.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.943+0000 7f086992e800 20 remove_watcher() i=5 2024-09-22T08:20:58.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.944+0000 7f086992e800 20 remove_watcher() i=6 2024-09-22T08:20:58.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:58.945+0000 7f086992e800 20 remove_watcher() i=7 2024-09-22T08:20:58.956 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-22T08:20:58.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:58.957 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:20:58.988 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:20:58.988 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:20:59.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.024+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 20 realm 2024-09-22T08:20:59.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:20:59.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.025+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.026+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.026+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.026+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:59.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.026+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.027+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:20:59.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.027+0000 7fa33901d800 20 searching for the correct realm 2024-09-22T08:20:59.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.029+0000 7fa334fec640 0 -- 172.21.15.78:0/2591913023 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa328078b30 msgr2=0x7fa32803da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:59.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.234+0000 7fa333fea640 0 -- 172.21.15.78:0/2591913023 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa32c082430 msgr2=0x7fa32c0828b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:20:59.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.240+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 zone default found 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 4 Realm: () 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:20:59.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 zonegroup default 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.241+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.242+0000 7fa33901d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.242+0000 7fa33901d800 20 started sync module instance, tier type = 2024-09-22T08:20:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.242+0000 7fa33901d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:20:59.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=0 2024-09-22T08:20:59.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=1 2024-09-22T08:20:59.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=2 2024-09-22T08:20:59.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=3 2024-09-22T08:20:59.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=4 2024-09-22T08:20:59.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=5 2024-09-22T08:20:59.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.253+0000 7fa33901d800 20 add_watcher() i=6 2024-09-22T08:20:59.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.254+0000 7fa33901d800 20 add_watcher() i=7 2024-09-22T08:20:59.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.254+0000 7fa33901d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:20:59.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa1eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:59.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa33901d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:20:59.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa33901d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:20:59.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa33901d800 5 note: GC not initialized 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa1e9fdb640 20 reqs_thread_entry: start 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa33901d800 20 init_complete bucket index max shards: 11 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa33901d800 20 Filter name: none 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.256+0000 7fa15b7fe640 20 reqs_thread_entry: start 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:20:59.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.257+0000 7fa33901d800 20 rados->read ofs=0 len=0 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:20:59.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:20:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.258+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.259+0000 7fa33901d800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.259+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.259+0000 7fa33901d800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.259+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.260+0000 7fa33901d800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.260+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.260+0000 7fa33901d800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T08:20:59.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.260+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:20:59.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.261+0000 7fa33901d800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T08:20:59.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.261+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:20:59.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.261+0000 7fa33901d800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T08:20:59.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.261+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:20:59.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.262+0000 7fa33901d800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T08:20:59.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.262+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:20:59.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.262+0000 7fa33901d800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T08:20:59.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.262+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:20:59.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.263+0000 7fa33901d800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T08:20:59.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.263+0000 7fa33901d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:20:59.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.263+0000 7fa33901d800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T08:20:59.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.263+0000 7fa33901d800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:20:59.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.265+0000 7fa1eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:20:59.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.267+0000 7fa33901d800 20 remove_watcher() i=0 2024-09-22T08:20:59.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.267+0000 7fa33901d800 2 removed watcher, disabling cache 2024-09-22T08:20:59.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.268+0000 7fa33901d800 20 remove_watcher() i=1 2024-09-22T08:20:59.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.269+0000 7fa33901d800 20 remove_watcher() i=2 2024-09-22T08:20:59.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.271+0000 7fa33901d800 20 remove_watcher() i=3 2024-09-22T08:20:59.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.273+0000 7fa33901d800 20 remove_watcher() i=4 2024-09-22T08:20:59.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.275+0000 7fa33901d800 20 remove_watcher() i=5 2024-09-22T08:20:59.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.276+0000 7fa33901d800 20 remove_watcher() i=6 2024-09-22T08:20:59.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:20:59.277+0000 7fa33901d800 20 remove_watcher() i=7 2024-09-22T08:20:59.288 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-22T08:20:59.289 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:20:59.406 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-22T08:20:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:21:00.160 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:21:00.570 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:21:02.066 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:21:02.067 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:21:02.098 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:02.098 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:02.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.136+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 20 realm 2024-09-22T08:21:02.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.138+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.139+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.139+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.139+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.139+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.342+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:02.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.342+0000 7fcc3a82f800 20 searching for the correct realm 2024-09-22T08:21:02.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.344+0000 7fcc38b1a640 0 -- 172.21.15.78:0/4032538185 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fcc200ad0c0 msgr2=0x7fcc200a50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:02.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.348+0000 7fcc2fb18640 0 -- 172.21.15.78:0/4032538185 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fcc3000e040 msgr2=0x7fcc30071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.353+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 zone default found 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 4 Realm: () 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:02.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 zonegroup default 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.354+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.355+0000 7fcc3a82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.355+0000 7fcc3a82f800 20 started sync module instance, tier type = 2024-09-22T08:21:02.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.355+0000 7fcc3a82f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:02.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=0 2024-09-22T08:21:02.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=1 2024-09-22T08:21:02.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=2 2024-09-22T08:21:02.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=3 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=4 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.370+0000 7fcc3a82f800 20 add_watcher() i=5 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.371+0000 7fcc3a82f800 20 add_watcher() i=6 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.372+0000 7fcc3a82f800 20 add_watcher() i=7 2024-09-22T08:21:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.372+0000 7fcc3a82f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcc3a82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcc3a82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:02.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcc3a82f800 5 note: GC not initialized 2024-09-22T08:21:02.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcaedfe3640 20 reqs_thread_entry: start 2024-09-22T08:21:02.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.374+0000 7fcc3a82f800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:02.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.375+0000 7fcc3a82f800 20 Filter name: none 2024-09-22T08:21:02.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.375+0000 7fcae6ffd640 20 reqs_thread_entry: start 2024-09-22T08:21:02.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.375+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.375+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.375+0000 7fcc3a82f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 INFO: main: starting shard=0 2024-09-22T08:21:02.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 INFO: main: starting shard=1 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.376+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 INFO: main: starting shard=2 2024-09-22T08:21:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 INFO: main: starting shard=3 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.377+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.378+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.378+0000 7fcc3a82f800 20 INFO: main: starting shard=4 2024-09-22T08:21:02.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.378+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:02.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 INFO: main: starting shard=5 2024-09-22T08:21:02.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 INFO: main: starting shard=6 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.379+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.380+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.380+0000 7fcc3a82f800 20 INFO: main: starting shard=7 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.380+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 INFO: main: starting shard=8 2024-09-22T08:21:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:02.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:21:02.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 INFO: main: starting shard=9 2024-09-22T08:21:02.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.381+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:02.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.382+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.382+0000 7fcc3a82f800 20 INFO: main: starting shard=10 2024-09-22T08:21:02.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.382+0000 7fcc3a82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:02.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.382+0000 7fcc3a82f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.382+0000 7fcc3a82f800 20 INFO: main: done 2024-09-22T08:21:02.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.383+0000 7fcaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:02.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.385+0000 7fcc3a82f800 20 remove_watcher() i=0 2024-09-22T08:21:02.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.385+0000 7fcc3a82f800 2 removed watcher, disabling cache 2024-09-22T08:21:02.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.386+0000 7fcc3a82f800 20 remove_watcher() i=1 2024-09-22T08:21:02.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.388+0000 7fcc3a82f800 20 remove_watcher() i=2 2024-09-22T08:21:02.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.389+0000 7fcc3a82f800 20 remove_watcher() i=3 2024-09-22T08:21:02.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.390+0000 7fcc3a82f800 20 remove_watcher() i=4 2024-09-22T08:21:02.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.391+0000 7fcc3a82f800 20 remove_watcher() i=5 2024-09-22T08:21:02.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.392+0000 7fcc3a82f800 20 remove_watcher() i=6 2024-09-22T08:21:02.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.394+0000 7fcc3a82f800 20 remove_watcher() i=7 2024-09-22T08:21:02.538 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:21:02.539 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:21:02.569 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:02.569 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:02.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.605+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 20 realm 2024-09-22T08:21:02.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.607+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.608+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.608+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.608+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.608+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.609+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:02.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.609+0000 7f6412c2f800 20 searching for the correct realm 2024-09-22T08:21:02.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.611+0000 7f6407f18640 0 -- 172.21.15.78:0/670875263 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x56374ef98980 msgr2=0x56374ef9ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:02.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.614+0000 7f6407f18640 0 -- 172.21.15.78:0/670875263 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f6408018040 msgr2=0x7f6408067b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.821+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 zone default found 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 4 Realm: () 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:02.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 zonegroup default 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.822+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.823+0000 7f6412c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.823+0000 7f6412c2f800 20 started sync module instance, tier type = 2024-09-22T08:21:02.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.823+0000 7f6412c2f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=0 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=1 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=2 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=3 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=4 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.833+0000 7f6412c2f800 20 add_watcher() i=5 2024-09-22T08:21:02.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.834+0000 7f6412c2f800 20 add_watcher() i=6 2024-09-22T08:21:02.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.835+0000 7f6412c2f800 20 add_watcher() i=7 2024-09-22T08:21:02.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.835+0000 7f6412c2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f62c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 5 note: GC not initialized 2024-09-22T08:21:02.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f62c57e2640 20 reqs_thread_entry: start 2024-09-22T08:21:02.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:02.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 20 Filter name: none 2024-09-22T08:21:02.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6236ffd640 20 reqs_thread_entry: start 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.837+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 INFO: main: starting shard=0 2024-09-22T08:21:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.838+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.839+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.839+0000 7f6412c2f800 20 INFO: main: starting shard=1 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.839+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 INFO: main: starting shard=2 2024-09-22T08:21:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 INFO: main: starting shard=3 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.840+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 INFO: main: starting shard=4 2024-09-22T08:21:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 INFO: main: starting shard=5 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.841+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 INFO: main: starting shard=6 2024-09-22T08:21:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 INFO: main: starting shard=7 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.842+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 INFO: main: starting shard=8 2024-09-22T08:21:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 INFO: main: starting shard=9 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.843+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.844+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.844+0000 7f6412c2f800 20 INFO: main: starting shard=10 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.844+0000 7f6412c2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.845+0000 7f6412c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.845+0000 7f6412c2f800 20 INFO: main: done 2024-09-22T08:21:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.845+0000 7f62c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:02.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.848+0000 7f6412c2f800 20 remove_watcher() i=0 2024-09-22T08:21:02.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.848+0000 7f6412c2f800 2 removed watcher, disabling cache 2024-09-22T08:21:02.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.849+0000 7f6412c2f800 20 remove_watcher() i=1 2024-09-22T08:21:02.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.850+0000 7f6412c2f800 20 remove_watcher() i=2 2024-09-22T08:21:02.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.851+0000 7f6412c2f800 20 remove_watcher() i=3 2024-09-22T08:21:02.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.852+0000 7f6412c2f800 20 remove_watcher() i=4 2024-09-22T08:21:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.853+0000 7f6412c2f800 20 remove_watcher() i=5 2024-09-22T08:21:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.854+0000 7f6412c2f800 20 remove_watcher() i=6 2024-09-22T08:21:02.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:02.855+0000 7f6412c2f800 20 remove_watcher() i=7 2024-09-22T08:21:02.999 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:21:03.000 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:21:03.030 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:03.030 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:03.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.066+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 20 realm 2024-09-22T08:21:03.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.068+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.069+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.069+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.069+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:03.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.069+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.070+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:03.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.070+0000 7f35e812e800 20 searching for the correct realm 2024-09-22T08:21:03.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.072+0000 7f35e46de640 0 -- 172.21.15.78:0/907661841 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f35cc0913f0 msgr2=0x7f35cc091850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:21:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.278+0000 7f35db6dc640 0 -- 172.21.15.78:0/907661841 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f35dc00e070 msgr2=0x7f35dc07b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:03.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.283+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:03.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 zone default found 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 4 Realm: () 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 zonegroup default 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.284+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.285+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.285+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.285+0000 7f35e812e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.285+0000 7f35e812e800 20 started sync module instance, tier type = 2024-09-22T08:21:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.285+0000 7f35e812e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=0 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=1 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=2 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=3 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=4 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=5 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.296+0000 7f35e812e800 20 add_watcher() i=6 2024-09-22T08:21:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.297+0000 7f35e812e800 20 add_watcher() i=7 2024-09-22T08:21:03.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.297+0000 7f35e812e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:03.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.298+0000 7f3499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 5 note: GC not initialized 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f3498fe1640 20 reqs_thread_entry: start 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 20 Filter name: none 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f34127fc640 20 reqs_thread_entry: start 2024-09-22T08:21:03.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.299+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:21:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 INFO: main: starting shard=0 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.300+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 INFO: main: starting shard=1 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 INFO: main: starting shard=2 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.301+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.302+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.302+0000 7f35e812e800 20 INFO: main: starting shard=3 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.302+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 INFO: main: starting shard=4 2024-09-22T08:21:03.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:03.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 INFO: main: starting shard=5 2024-09-22T08:21:03.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.303+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 INFO: main: starting shard=6 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 INFO: main: starting shard=7 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.304+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:03.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 INFO: main: starting shard=8 2024-09-22T08:21:03.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:03.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 INFO: main: starting shard=9 2024-09-22T08:21:03.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.305+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.306+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.306+0000 7f35e812e800 20 INFO: main: starting shard=10 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.306+0000 7f35e812e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.306+0000 7f35e812e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.306+0000 7f35e812e800 20 INFO: main: done 2024-09-22T08:21:03.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.307+0000 7f3499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:03.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.310+0000 7f35e812e800 20 remove_watcher() i=0 2024-09-22T08:21:03.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.310+0000 7f35e812e800 2 removed watcher, disabling cache 2024-09-22T08:21:03.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.311+0000 7f35e812e800 20 remove_watcher() i=1 2024-09-22T08:21:03.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.312+0000 7f35e812e800 20 remove_watcher() i=2 2024-09-22T08:21:03.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.313+0000 7f35e812e800 20 remove_watcher() i=3 2024-09-22T08:21:03.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.314+0000 7f35e812e800 20 remove_watcher() i=4 2024-09-22T08:21:03.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.315+0000 7f35e812e800 20 remove_watcher() i=5 2024-09-22T08:21:03.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.316+0000 7f35e812e800 20 remove_watcher() i=6 2024-09-22T08:21:03.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.318+0000 7f35e812e800 20 remove_watcher() i=7 2024-09-22T08:21:03.439 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:21:03.440 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:21:03.470 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:03.470 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:03.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.506+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 realm 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.508+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.509+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.509+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.510+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:03.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.510+0000 7fe41e72c800 20 searching for the correct realm 2024-09-22T08:21:03.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.512+0000 7fe41ac50640 0 -- 172.21.15.78:0/3123059143 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fe404087070 msgr2=0x7fe404066a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:03.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.718+0000 7fe411c4e640 0 -- 172.21.15.78:0/3123059143 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fe414018040 msgr2=0x7fe414051420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.723+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:03.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 zone default found 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 4 Realm: () 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 zonegroup default 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.724+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 started sync module instance, tier type = 2024-09-22T08:21:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.725+0000 7fe41e72c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:03.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=0 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=1 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=2 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=3 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=4 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=5 2024-09-22T08:21:03.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.744+0000 7fe41e72c800 20 add_watcher() i=6 2024-09-22T08:21:03.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.747+0000 7fe41e72c800 20 add_watcher() i=7 2024-09-22T08:21:03.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.747+0000 7fe41e72c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:03.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.748+0000 7fe2d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 5 note: GC not initialized 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe24b7fe640 20 reqs_thread_entry: start 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 20 Filter name: none 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe2497fa640 20 reqs_thread_entry: start 2024-09-22T08:21:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.749+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 rados->read ofs=0 len=0 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 INFO: main: starting shard=0 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.750+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 INFO: main: starting shard=1 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:03.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 INFO: main: starting shard=2 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.751+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 INFO: main: starting shard=3 2024-09-22T08:21:03.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 INFO: main: starting shard=4 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.752+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.753+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.753+0000 7fe41e72c800 20 INFO: main: starting shard=5 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.753+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 INFO: main: starting shard=6 2024-09-22T08:21:03.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:03.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 INFO: main: starting shard=7 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.754+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: starting shard=8 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: starting shard=9 2024-09-22T08:21:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:03.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:21:03.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.755+0000 7fe41e72c800 20 INFO: main: starting shard=10 2024-09-22T08:21:03.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.756+0000 7fe41e72c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:03.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.756+0000 7fe41e72c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:21:03.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.756+0000 7fe41e72c800 20 INFO: main: done 2024-09-22T08:21:03.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.757+0000 7fe2d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:03.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.759+0000 7fe41e72c800 20 remove_watcher() i=0 2024-09-22T08:21:03.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.759+0000 7fe41e72c800 2 removed watcher, disabling cache 2024-09-22T08:21:03.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.761+0000 7fe41e72c800 20 remove_watcher() i=1 2024-09-22T08:21:03.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.762+0000 7fe41e72c800 20 remove_watcher() i=2 2024-09-22T08:21:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.763+0000 7fe41e72c800 20 remove_watcher() i=3 2024-09-22T08:21:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.764+0000 7fe41e72c800 20 remove_watcher() i=4 2024-09-22T08:21:03.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.765+0000 7fe41e72c800 20 remove_watcher() i=5 2024-09-22T08:21:03.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.766+0000 7fe41e72c800 20 remove_watcher() i=6 2024-09-22T08:21:03.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:03.769+0000 7fe41e72c800 20 remove_watcher() i=7 2024-09-22T08:21:03.805 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:21:04.200 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:21:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:21:04.619 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:04.620 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:04.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.655+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 realm 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.657+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.658+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:04.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.658+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.659+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:04.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.659+0000 7ff4e2146800 20 searching for the correct realm 2024-09-22T08:21:04.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.661+0000 7ff4e0438640 0 -- 172.21.15.78:0/1839294757 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7ff4c8080ad0 msgr2=0x7ff4c80a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:04.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.866+0000 7ff4df436640 0 -- 172.21.15.78:0/1839294757 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7ff4d801b040 msgr2=0x7ff4d803b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:04.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.871+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:04.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:04.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 zone default found 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 4 Realm: () 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 zonegroup default 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.872+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 started sync module instance, tier type = 2024-09-22T08:21:04.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.873+0000 7ff4e2146800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=0 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=1 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=2 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=3 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=4 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=5 2024-09-22T08:21:04.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.883+0000 7ff4e2146800 20 add_watcher() i=6 2024-09-22T08:21:04.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.884+0000 7ff4e2146800 20 add_watcher() i=7 2024-09-22T08:21:04.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.884+0000 7ff4e2146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:04.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.886+0000 7ff3967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:04.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:04.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:04.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 5 note: GC not initialized 2024-09-22T08:21:04.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff3957e2640 20 reqs_thread_entry: start 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 20 Filter name: none 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff38e7fc640 20 reqs_thread_entry: start 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.887+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:21:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 20 rados->read ofs=0 len=0 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:21:04.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.888+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:04.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.889+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:04.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.890+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:04.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.890+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:04.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.891+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:04.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.891+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:04.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.892+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:04.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.893+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:04.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.893+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:04.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.894+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:04.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.894+0000 7ff4e2146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:04.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.903+0000 7ff3967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:04.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.905+0000 7ff4e2146800 20 remove_watcher() i=0 2024-09-22T08:21:04.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.905+0000 7ff4e2146800 2 removed watcher, disabling cache 2024-09-22T08:21:04.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.906+0000 7ff4e2146800 20 remove_watcher() i=1 2024-09-22T08:21:04.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.908+0000 7ff4e2146800 20 remove_watcher() i=2 2024-09-22T08:21:04.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.912+0000 7ff4e2146800 20 remove_watcher() i=3 2024-09-22T08:21:04.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.913+0000 7ff4e2146800 20 remove_watcher() i=4 2024-09-22T08:21:04.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.914+0000 7ff4e2146800 20 remove_watcher() i=5 2024-09-22T08:21:04.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.915+0000 7ff4e2146800 20 remove_watcher() i=6 2024-09-22T08:21:04.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.916+0000 7ff4e2146800 20 remove_watcher() i=7 2024-09-22T08:21:04.929 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:21:04.963 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:04.964 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:05.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:04.999+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 realm 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:05.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.001+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.002+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:05.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.002+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.003+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:05.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.003+0000 7f4bf4413800 20 searching for the correct realm 2024-09-22T08:21:05.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.005+0000 7f4bf0349640 0 -- 172.21.15.78:0/1394182684 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f4be4001c20 msgr2=0x7f4be40680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.211+0000 7f4bef347640 0 -- 172.21.15.78:0/1394182684 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f4be806d040 msgr2=0x7f4be8085940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:05.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.216+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 zone default found 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 4 Realm: () 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:05.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 zonegroup default 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.217+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 started sync module instance, tier type = 2024-09-22T08:21:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.218+0000 7f4bf4413800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=0 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=1 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=2 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=3 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=4 2024-09-22T08:21:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=5 2024-09-22T08:21:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.228+0000 7f4bf4413800 20 add_watcher() i=6 2024-09-22T08:21:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.229+0000 7f4bf4413800 20 add_watcher() i=7 2024-09-22T08:21:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.229+0000 7f4bf4413800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:05.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.231+0000 7f4aa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 5 note: GC not initialized 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4aa4fe1640 20 reqs_thread_entry: start 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 20 Filter name: none 2024-09-22T08:21:05.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4a1e7fc640 20 reqs_thread_entry: start 2024-09-22T08:21:05.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:21:05.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.232+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 : miss 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 info.flags=0x17 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 to cache LRU end 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2 2024-09-22T08:21:05.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.233+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.0 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.234+0000 7f4bf4413800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.234+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.234+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.2 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.235+0000 7f4bf4413800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.235+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.3 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.235+0000 7f4bf4413800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:21:05.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.235+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.4 2024-09-22T08:21:05.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.236+0000 7f4bf4413800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:21:05.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.236+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.237+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.6 2024-09-22T08:21:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.237+0000 7f4bf4413800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:21:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.237+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.7 2024-09-22T08:21:05.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.238+0000 7f4bf4413800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:21:05.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.238+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.238+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.9 2024-09-22T08:21:05.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.239+0000 7f4bf4413800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-22T08:21:05.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.239+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.240+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.240+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d80e0f0 obj=check-bucket:e state=0x55eb2daddca8 s->prefetch_data=0 2024-09-22T08:21:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.240+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.240+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d836890 obj=check-bucket:d state=0x55eb2db7a168 s->prefetch_data=0 2024-09-22T08:21:05.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.240+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2db7b810 obj=check-bucket:c state=0x55eb2dae0698 s->prefetch_data=0 2024-09-22T08:21:05.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2dae1290 obj=check-bucket:f state=0x55eb2db7cea8 s->prefetch_data=0 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to tg343b594nnvq5cdsrskoghg1x4cwgca 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state_impl: setting s->olh_tag to 4wajoub1nw9aqpenxm6a7vrnulopvsh2 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4wajoub1nw9aqpenxm6a7vrnulopvsh2 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to pye2j9o22ipv9287uf1gqjcb89q5o37k 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state_impl: setting s->olh_tag to s4jkhxkovgwtyd3pr0191h9rby0ircz2 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s4jkhxkovgwtyd3pr0191h9rby0ircz2 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to 392igmidqk5zljr5ysm48gldmaaw8uwg 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 get_obj_state_impl: setting s->olh_tag to 7out765flq9yky2qfdc61etdqnmyapll 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.241+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7out765flq9yky2qfdc61etdqnmyapll 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.242+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to hqoajwcwr4j9uk8dw8acqdcxbm0dq4k2 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.242+0000 7f4bf4413800 20 get_obj_state_impl: setting s->olh_tag to p1jc3l3qey3oe7vibzoyqecbvwy960vz 2024-09-22T08:21:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.242+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p1jc3l3qey3oe7vibzoyqecbvwy960vz 2024-09-22T08:21:05.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.243+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.243+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.244+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.244+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 olh_log_entry: epoch=2 op=3 key=e[sXxJOmy8HcXyGttlzSGCVAPBmepkopp] 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d80e0f0 obj=check-bucket:_:sXxJOmy8HcXyGttlzSGCVAPBmepkopp_e state=0x55eb2db94628 s->prefetch_data=0 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 10 manifest: total_size = 22 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12149712913235013434 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d80e0f0 obj=check-bucket:_:sXxJOmy8HcXyGttlzSGCVAPBmepkopp_e state=0x55eb2db94628 s->prefetch_data=0 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 prepare_atomic_modification: state is not atomic. state=0x55eb2db94628 2024-09-22T08:21:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.245+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 olh_log_entry: epoch=3 op=3 key=c[QxzOsc-8E87IekJ.peOBrfTa4.1VcA.] 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2db7b810 obj=check-bucket:_:QxzOsc-8E87IekJ.peOBrfTa4.1VcA._c state=0x55eb2db9ecb8 s->prefetch_data=0 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 olh_log_entry: epoch=3 op=3 key=d[hvONzA6fTS2rEzDIRIlYpznG.Zd6GJL] 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.246+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d836890 obj=check-bucket:_:hvONzA6fTS2rEzDIRIlYpznG.Zd6GJL_d state=0x55eb2dba4878 s->prefetch_data=0 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 10 manifest: total_size = 9 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10929989236050745955 2024-09-22T08:21:05.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2db7b810 obj=check-bucket:_:QxzOsc-8E87IekJ.peOBrfTa4.1VcA._c state=0x55eb2db9ecb8 s->prefetch_data=0 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 prepare_atomic_modification: state is not atomic. state=0x55eb2db9ecb8 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 10 manifest: total_size = 12 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13008479725613388704 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d836890 obj=check-bucket:_:hvONzA6fTS2rEzDIRIlYpznG.Zd6GJL_d state=0x55eb2dba4878 s->prefetch_data=0 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 prepare_atomic_modification: state is not atomic. state=0x55eb2dba4878 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 olh_log_entry: epoch=2 op=3 key=f[Gk-uA0zCajOhhG2iatK7JLlv8V.Q3VY] 2024-09-22T08:21:05.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.247+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2dae1290 obj=check-bucket:_:Gk-uA0zCajOhhG2iatK7JLlv8V.Q3VY_f state=0x55eb2dbaf248 s->prefetch_data=0 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 10 manifest: total_size = 22 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12360787378377616468 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2dae1290 obj=check-bucket:_:Gk-uA0zCajOhhG2iatK7JLlv8V.Q3VY_f state=0x55eb2dbaf248 s->prefetch_data=0 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 prepare_atomic_modification: state is not atomic. state=0x55eb2dbaf248 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:21:05.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.248+0000 7f4bf4413800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:sXxJOmy8HcXyGttlzSGCVAPBmepkopp_.mMDDuv5Sr3TXLJ8RGB06hUXb8i_7cK2_0 2024-09-22T08:21:05.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.250+0000 7f4aceffd640 20 handle_completion(): completion ok for obj=e[sXxJOmy8HcXyGttlzSGCVAPBmepkopp] 2024-09-22T08:21:05.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.250+0000 7f4bf4413800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:21:05.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.251+0000 7f4bf4413800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:21:05.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.251+0000 7f4bf4413800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-22T08:21:05.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.251+0000 7f4bf4413800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:21:05.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.251+0000 7f4bf4413800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:QxzOsc-8E87IekJ.peOBrfTa4.1VcA._.51M-0kCc87igV3zA-DWDIO2e7HLS7SD_0 2024-09-22T08:21:05.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.252+0000 7f4bf4413800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:21:05.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.252+0000 7f4bf4413800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-22T08:21:05.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.252+0000 7f4bf4413800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:21:05.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.252+0000 7f4bf4413800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:hvONzA6fTS2rEzDIRIlYpznG.Zd6GJL_.Xafk6Bx13vMbaFNxqWEhn4mb4yFEX4d_0 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4ace7fc640 20 handle_completion(): completion ok for obj=c[QxzOsc-8E87IekJ.peOBrfTa4.1VcA.] 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2d80e0f0 obj=check-bucket:e state=0x55eb2daddca8 s->prefetch_data=0 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4wajoub1nw9aqpenxm6a7vrnulopvsh2 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:21:05.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-22T08:21:05.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:21:05.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2__shadow:Gk-uA0zCajOhhG2iatK7JLlv8V.Q3VY_.Msyq5X5TyJePXZBKGPh0aOUyy1kxiah_0 2024-09-22T08:21:05.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.253+0000 7f4bf4413800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:21:05.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.254+0000 7f4aceffd640 20 handle_completion(): completion ok for obj=d[hvONzA6fTS2rEzDIRIlYpznG.Zd6GJL] 2024-09-22T08:21:05.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.255+0000 7f4bf4413800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:21:05.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.258+0000 7f4ace7fc640 20 handle_completion(): completion ok for obj=f[Gk-uA0zCajOhhG2iatK7JLlv8V.Q3VY] 2024-09-22T08:21:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.259+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.259+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.260+0000 7f4bf4413800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:21:05.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.264+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.264+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.265+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.8 2024-09-22T08:21:05.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.265+0000 7f4bf4413800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-22T08:21:05.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.265+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.267+0000 7f4bf4413800 20 get_obj_state: octx=0x55eb2dae1290 obj=check-bucket:f state=0x55eb2db7cea8 s->prefetch_data=0 2024-09-22T08:21:05.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.267+0000 7f4bf4413800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p1jc3l3qey3oe7vibzoyqecbvwy960vz 2024-09-22T08:21:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.270+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.5 2024-09-22T08:21:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.270+0000 7f4bf4413800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-22T08:21:05.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.273+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.1 2024-09-22T08:21:05.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.273+0000 7f4bf4413800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-22T08:21:05.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.276+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.278+0000 7f4bf4413800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2.10 2024-09-22T08:21:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.278+0000 7f4bf4413800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-22T08:21:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.278+0000 7f4bf4413800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:21:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.278+0000 7f4aa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.281+0000 7f4bf4413800 20 remove_watcher() i=0 2024-09-22T08:21:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.281+0000 7f4bf4413800 2 removed watcher, disabling cache 2024-09-22T08:21:05.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.282+0000 7f4bf4413800 20 remove_watcher() i=1 2024-09-22T08:21:05.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.283+0000 7f4bf4413800 20 remove_watcher() i=2 2024-09-22T08:21:05.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.284+0000 7f4bf4413800 20 remove_watcher() i=3 2024-09-22T08:21:05.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.285+0000 7f4bf4413800 20 remove_watcher() i=4 2024-09-22T08:21:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.286+0000 7f4bf4413800 20 remove_watcher() i=5 2024-09-22T08:21:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.287+0000 7f4bf4413800 20 remove_watcher() i=6 2024-09-22T08:21:05.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.288+0000 7f4bf4413800 20 remove_watcher() i=7 2024-09-22T08:21:05.535 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:21:05.564 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:21:05.564 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:21:05.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.599+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 realm 2024-09-22T08:21:05.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.600+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.601+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:05.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.601+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.602+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:21:05.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.602+0000 7fb0f373b800 20 searching for the correct realm 2024-09-22T08:21:05.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.604+0000 7fb0efc26640 0 -- 172.21.15.78:0/4291115163 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fb0d804b020 msgr2=0x7fb0d80a5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:05.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.809+0000 7fb0e6c24640 0 -- 172.21.15.78:0/4291115163 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fb0e8017020 msgr2=0x7fb0e802d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:21:05.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.814+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 zone default found 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 4 Realm: () 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 zonegroup default 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.815+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.816+0000 7fb0f373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.816+0000 7fb0f373b800 20 started sync module instance, tier type = 2024-09-22T08:21:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.816+0000 7fb0f373b800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=0 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=1 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=2 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=3 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=4 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=5 2024-09-22T08:21:05.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.826+0000 7fb0f373b800 20 add_watcher() i=6 2024-09-22T08:21:05.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.827+0000 7fb0f373b800 20 add_watcher() i=7 2024-09-22T08:21:05.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.827+0000 7fb0f373b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:21:05.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fafa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:05.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:21:05.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:21:05.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 5 note: GC not initialized 2024-09-22T08:21:05.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fafa4fe1640 20 reqs_thread_entry: start 2024-09-22T08:21:05.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 20 init_complete bucket index max shards: 11 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 20 Filter name: none 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7faf1e7fc640 20 reqs_thread_entry: start 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.829+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.830+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.830+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.830+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.830+0000 7fb0f373b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.830+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.831+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:21:05.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.831+0000 7fb0f373b800 20 rados->read ofs=0 len=0 2024-09-22T08:21:05.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.831+0000 7fb0f373b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:21:05.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.831+0000 7fb0f373b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:21:05.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.832+0000 7fafa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:21:05.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.834+0000 7fb0f373b800 20 remove_watcher() i=0 2024-09-22T08:21:05.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.834+0000 7fb0f373b800 2 removed watcher, disabling cache 2024-09-22T08:21:05.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.835+0000 7fb0f373b800 20 remove_watcher() i=1 2024-09-22T08:21:05.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.837+0000 7fb0f373b800 20 remove_watcher() i=2 2024-09-22T08:21:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.838+0000 7fb0f373b800 20 remove_watcher() i=3 2024-09-22T08:21:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.839+0000 7fb0f373b800 20 remove_watcher() i=4 2024-09-22T08:21:05.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.840+0000 7fb0f373b800 20 remove_watcher() i=5 2024-09-22T08:21:05.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.841+0000 7fb0f373b800 20 remove_watcher() i=6 2024-09-22T08:21:05.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:21:05.841+0000 7fb0f373b800 20 remove_watcher() i=7 2024-09-22T08:21:05.854 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T08:21:05.854 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket check-bucket 2024-09-22T08:21:06.082 INFO:tasks.workunit.client.0.smithi078.stderr:Completed bucket check tests 2024-09-22T08:21:06.082 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:21:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-22T08:21:06.143 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-22T08:21:06.144 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-22T08:21:06.144 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:21:06.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:21:06.223 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-22T08:21:06.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:21:06.582 DEBUG:teuthology.parallel:result is None 2024-09-22T08:21:06.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:21:06.621 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:21:06.621 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:21:06.689 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:21:06.689 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:21:06.698 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:21:06.698 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:21:06.698 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:21:06.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:21:06.759 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:21:06.759 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:21:06.827 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:21:06.828 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:21:06.897 INFO:tasks.workunit:timeout=3h 2024-09-22T08:21:06.897 INFO:tasks.workunit:cleanup=True 2024-09-22T08:21:06.897 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:21:06.966 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:22:07.511 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.512 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T08:22:07.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.513 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:22:07.513 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:22:07.513 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:22:07.516 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:22:07.585 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:22:07.587 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:22:07.587 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:22:07.635 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:22:07.684 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:22:07.723 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:22:07.724 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:22:07.724 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:22:07.762 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:22:07.766 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:22:07.766 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:22:07.834 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-22T08:22:07.835 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-22T08:22:07.836 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-22T08:22:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:22:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:22:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:22:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from ClsLock 2024-09-22T08:22:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-22T08:22:09.856 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:09.856 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-22T08:22:09.856 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:09.856 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:09.856 INFO:tasks.workunit.client.0.smithi078.stdout: client.5292 expiration=2024-09-22T08:24:09.852486+0000 addr=v1:172.21.15.78:0/2393827360 cookie= 2024-09-22T08:22:09.861 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:09.861 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-22T08:22:09.861 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:09.861 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:09.862 INFO:tasks.workunit.client.0.smithi078.stdout: client.5084 expiration=0.000000 addr=v1:172.21.15.78:0/3854872027 cookie= 2024-09-22T08:22:09.862 INFO:tasks.workunit.client.0.smithi078.stdout: client.5292 expiration=2024-09-22T08:24:09.860373+0000 addr=v1:172.21.15.78:0/2393827360 cookie= 2024-09-22T08:22:09.862 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:09.863 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-22T08:22:09.863 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:09.863 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:09.863 INFO:tasks.workunit.client.0.smithi078.stdout: client.5084 expiration=0.000000 addr=v1:172.21.15.78:0/3854872027 cookie= 2024-09-22T08:22:10.835 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMultiLocking (2916 ms) 2024-09-22T08:22:10.836 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMeta 2024-09-22T08:22:12.880 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:12.880 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-22T08:22:12.880 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:12.880 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:12.880 INFO:tasks.workunit.client.0.smithi078.stdout: client.5093 expiration=0.000000 addr=v1:172.21.15.78:0/4005935839 cookie= 2024-09-22T08:22:12.884 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:12.884 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-22T08:22:12.884 INFO:tasks.workunit.client.0.smithi078.stdout: tag: new_tag 2024-09-22T08:22:12.884 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:12.884 INFO:tasks.workunit.client.0.smithi078.stdout: client.5307 expiration=0.000000 addr=v1:172.21.15.78:0/1415506703 cookie= 2024-09-22T08:22:13.840 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMeta (3005 ms) 2024-09-22T08:22:13.840 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestCookie 2024-09-22T08:22:15.895 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:15.895 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-22T08:22:15.895 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:15.896 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:15.899 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-22T08:22:15.899 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-22T08:22:15.899 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-22T08:22:15.900 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-22T08:22:15.900 INFO:tasks.workunit.client.0.smithi078.stdout: client.5099 expiration=0.000000 addr=v1:172.21.15.78:0/82253888 cookie= 2024-09-22T08:22:15.900 INFO:tasks.workunit.client.0.smithi078.stdout: client.5099 expiration=0.000000 addr=v1:172.21.15.78:0/82253888 cookie=new cookie 2024-09-22T08:22:16.875 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestCookie (3035 ms) 2024-09-22T08:22:16.876 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-22T08:22:19.894 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMultipleLocks (3019 ms) 2024-09-22T08:22:19.894 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-22T08:22:27.927 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestLockDuration (8032 ms) 2024-09-22T08:22:27.927 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-22T08:22:30.961 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestAssertLocked (3035 ms) 2024-09-22T08:22:30.961 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-22T08:22:33.960 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestSetCookie (2999 ms) 2024-09-22T08:22:33.960 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestRenew 2024-09-22T08:22:55.020 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestRenew (21059 ms) 2024-09-22T08:22:55.020 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-22T08:23:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6085 ms) 2024-09-22T08:23:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-22T08:23:08.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7089 ms) 2024-09-22T08:23:08.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-22T08:23:16.230 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8037 ms) 2024-09-22T08:23:16.230 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from ClsLock (68311 ms total) 2024-09-22T08:23:16.231 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:23:16.231 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:23:16.231 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (68311 ms total) 2024-09-22T08:23:16.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-22T08:23:16.233 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:23:16.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:23:16.276 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-22T08:23:16.278 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-22T08:23:16.278 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-22T08:23:16.361 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:23:16.361 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:23:16.361 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:23:16.361 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from cls_log 2024-09-22T08:23:16.361 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-22T08:23:19.256 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.test_log_add_same_time (2895 ms) 2024-09-22T08:23:19.257 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-22T08:23:22.265 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.test_log_add_different_time (3009 ms) 2024-09-22T08:23:22.265 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.trim_by_time 2024-09-22T08:23:25.307 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.trim_by_time (3042 ms) 2024-09-22T08:23:25.307 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-22T08:23:28.316 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.trim_by_marker (3009 ms) 2024-09-22T08:23:28.317 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from cls_log (11955 ms total) 2024-09-22T08:23:28.317 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:23:28.317 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:23:28.317 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (11955 ms total) 2024-09-22T08:23:28.317 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-22T08:23:28.319 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:23:28.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:23:28.362 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-22T08:23:28.363 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-22T08:23:28.363 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-22T08:23:28.447 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:23:28.447 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:23:28.447 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:23:28.447 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from cls_refcount 2024-09-22T08:23:28.448 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-22T08:23:31.340 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit (2893 ms) 2024-09-22T08:23:31.340 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-22T08:23:34.349 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3009 ms) 2024-09-22T08:23:34.349 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-22T08:23:43.421 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_put_snap (9072 ms) 2024-09-22T08:23:43.421 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-22T08:23:46.429 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_explicit (3008 ms) 2024-09-22T08:23:46.430 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.set 2024-09-22T08:23:49.461 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.set (3032 ms) 2024-09-22T08:23:49.461 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-22T08:23:56.479 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_ec (7018 ms) 2024-09-22T08:23:56.479 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-22T08:24:03.521 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7042 ms) 2024-09-22T08:24:03.521 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-22T08:24:15.620 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_put_snap_ec (12099 ms) 2024-09-22T08:24:15.620 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-22T08:24:22.678 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_explicit_ec (7058 ms) 2024-09-22T08:24:22.679 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.set_ec 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.set_ec (7013 ms) 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from cls_refcount (61244 ms total) 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 10 tests from 1 test suite ran. (61245 ms total) 2024-09-22T08:24:29.692 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 10 tests. 2024-09-22T08:24:29.694 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:24:29.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:24:29.740 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-22T08:24:29.741 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-22T08:24:29.741 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-22T08:24:29.790 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:24:29.790 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:24:29.790 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:24:29.790 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from cls_rgw 2024-09-22T08:24:31.711 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_basic 2024-09-22T08:24:31.767 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_basic (56 ms) 2024-09-22T08:24:31.767 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-22T08:24:31.796 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (29 ms) 2024-09-22T08:24:31.797 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-22T08:24:31.832 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_remove_object (36 ms) 2024-09-22T08:24:31.832 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-22T08:24:33.308 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_suggest (1476 ms) 2024-09-22T08:24:33.308 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-22T08:24:33.319 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_suggest_complete (11 ms) 2024-09-22T08:24:33.319 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_list 2024-09-22T08:24:33.349 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_list (30 ms) 2024-09-22T08:24:33.349 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-22T08:24:56.792 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_list_delimited (23442 ms) 2024-09-22T08:24:56.792 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_list 2024-09-22T08:24:56.890 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_list (99 ms) 2024-09-22T08:24:56.890 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_set 2024-09-22T08:24:56.902 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-22T08:24:56.902 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_list 2024-09-22T08:24:56.913 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-22T08:24:56.913 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-22T08:25:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_defer (7892 ms) 2024-09-22T08:25:04.806 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-22T08:25:04.893 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_basic (88 ms) 2024-09-22T08:25:04.893 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-22T08:25:04.898 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-22T08:25:04.898 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-22T08:25:05.025 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_clear (127 ms) 2024-09-22T08:25:05.025 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-22T08:25:05.075 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_log_trim (50 ms) 2024-09-22T08:25:05.075 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-22T08:25:05.089 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_racing_removes (15 ms) 2024-09-22T08:25:05.090 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-22T08:25:05.110 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.reshardlog_list (20 ms) 2024-09-22T08:25:05.110 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-22T08:25:05.121 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-22T08:25:05.121 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-22T08:25:05.149 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_put_entries (28 ms) 2024-09-22T08:25:05.806 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from cls_rgw (33439 ms total) 2024-09-22T08:25:05.806 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:25:05.806 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:05.806 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (36016 ms total) 2024-09-22T08:25:05.806 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-22T08:25:05.809 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:25:05.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:25:05.852 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-22T08:25:05.853 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-22T08:25:05.853 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-22T08:25:05.938 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:25:05.939 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:25:05.939 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:05.939 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-22T08:25:05.939 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.init 2024-09-22T08:25:07.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.init (1888 ms) 2024-09-22T08:25:07.828 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-22T08:25:07.841 INFO:tasks.workunit.client.0.smithi078.stderr:[ ] list info tag = chain-0 2024-09-22T08:25:07.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (14 ms) 2024-09-22T08:25:07.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-22T08:25:07.847 INFO:tasks.workunit.client.0.smithi078.stderr:[ ] next_marker is: = 0/4263 2024-09-22T08:25:07.848 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-22T08:25:07.848 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-22T08:25:07.856 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-22T08:25:07.856 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-22T08:25:07.863 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (7 ms) 2024-09-22T08:25:07.863 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-22T08:25:07.871 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-22T08:25:07.871 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-22T08:25:07.881 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (10 ms) 2024-09-22T08:25:07.881 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-22T08:25:07.888 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-22T08:25:07.888 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-22T08:25:08.836 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.finalize (948 ms) 2024-09-22T08:25:08.836 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from cls_rgw_gc (2897 ms total) 2024-09-22T08:25:08.836 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:25:08.836 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:08.837 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (2897 ms total) 2024-09-22T08:25:08.837 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-22T08:25:08.839 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:25:08.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:25:08.883 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-22T08:25:08.884 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-22T08:25:08.885 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-22T08:25:08.940 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:25:08.940 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:25:08.941 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 1 test from 1 test suite. 2024-09-22T08:25:08.941 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:10.837 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 1 test from cls_rgw_stats 2024-09-22T08:25:10.837 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-22T08:25:10.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.850+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=R88V4KC0PJVI type=del size=1550520 2024-09-22T08:25:10.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.853+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.0 size=1048576 2024-09-22T08:25:10.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.854+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.1 size=1048576 2024-09-22T08:25:10.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.855+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.2 size=277504 2024-09-22T08:25:10.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.855+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=PP4U9WH9DPKT tag=E964D7DD6Y12 type=write size=3423232 2024-09-22T08:25:10.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.858+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~V5QQ1G6REG8R.0 size=321407 2024-09-22T08:25:10.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.858+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=V5QQ1G6REG8R tag=7A2X47P86OTI type=write size=1369983 2024-09-22T08:25:10.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.859+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=O06KWBD9VD0Z type=del size=1928692 2024-09-22T08:25:10.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.861+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=ZJCK20SWVPOY type=write size=365055 2024-09-22T08:25:10.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.863+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~VUFDZ06O3A9U.0 size=1048576 2024-09-22T08:25:10.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.864+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~VUFDZ06O3A9U.1 size=416145 2024-09-22T08:25:10.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.864+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=VUFDZ06O3A9U tag=GQ1KOPN29H8C type=write size=2513297 2024-09-22T08:25:10.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.866+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=DX7KDJM14C3Z type=del size=1985803 2024-09-22T08:25:10.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.868+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=4J62M4DVUE0I type=del size=1198270 2024-09-22T08:25:10.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.869+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=3HZK9ALUC6IM type=del size=2482608 2024-09-22T08:25:10.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.870+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=NGLJZYAEBPCS type=del size=4110217 2024-09-22T08:25:10.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.872+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=59Z4TLEU8621 type=write size=277416 2024-09-22T08:25:10.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.874+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~50BVN6DREEI2.0 size=2925 2024-09-22T08:25:10.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.874+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=50BVN6DREEI2 tag=GLKZC3EHMZ8T type=write size=1051501 2024-09-22T08:25:10.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.876+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=D9NH0AVTQ829 type=write size=772878 2024-09-22T08:25:10.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.878+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=WCAY8PN7DOBV type=del size=1626994 2024-09-22T08:25:10.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.885+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.0 size=1048576 2024-09-22T08:25:10.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.886+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.1 size=1048576 2024-09-22T08:25:10.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.887+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.2 size=251140 2024-09-22T08:25:10.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.887+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=9LX18MR7NRER tag=CQQ3V1U0MFCP type=write size=3396868 2024-09-22T08:25:10.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.890+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~JRQTMP61YTXL.0 size=1048576 2024-09-22T08:25:10.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.891+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~JRQTMP61YTXL.1 size=246455 2024-09-22T08:25:10.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.891+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=JRQTMP61YTXL tag=E6WPDNI990AY type=write size=2343607 2024-09-22T08:25:10.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.892+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=R88V4KC0PJVI type=del 2024-09-22T08:25:10.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.894+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=NRUH53G8TQO1 type=del size=1292808 2024-09-22T08:25:10.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.895+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.0 size=1048576 2024-09-22T08:25:10.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.897+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.1 size=1048576 2024-09-22T08:25:10.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.898+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~PP4U9WH9DPKT.2 size=277504 2024-09-22T08:25:10.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.901+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=PP4U9WH9DPKT tag=E964D7DD6Y12 type=write size=3423232 2024-09-22T08:25:10.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.903+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.0 size=1048576 2024-09-22T08:25:10.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.904+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.1 size=1048576 2024-09-22T08:25:10.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.905+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.2 size=94213 2024-09-22T08:25:10.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.905+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=03SQ1E90D8FJ tag=7Y3FKAFD38G5 type=write size=3239941 2024-09-22T08:25:10.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.907+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~V5QQ1G6REG8R.0 size=321407 2024-09-22T08:25:10.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.909+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=V5QQ1G6REG8R tag=7A2X47P86OTI type=write size=1369983 2024-09-22T08:25:10.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.910+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=63T321F9G98Q type=del size=486628 2024-09-22T08:25:10.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.913+0000 7f8a8d811780 1 < suggested update operation key=226G7R10IR1B tag=O06KWBD9VD0Z type=del size=1928692 2024-09-22T08:25:10.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.915+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=JM15IXXWD2Q4 type=del size=3259648 2024-09-22T08:25:10.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.917+0000 7f8a8d811780 1 < suggested remove operation key=0HCXP53D9NMP tag=ZJCK20SWVPOY type=write 2024-09-22T08:25:10.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.919+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=UP8ZN3KG59SL type=del size=3213212 2024-09-22T08:25:10.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.920+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~VUFDZ06O3A9U.0 size=1048576 2024-09-22T08:25:10.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.921+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~VUFDZ06O3A9U.1 size=416145 2024-09-22T08:25:10.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.924+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=VUFDZ06O3A9U tag=GQ1KOPN29H8C type=write size=2513297 2024-09-22T08:25:10.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.927+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.0 size=1048576 2024-09-22T08:25:10.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.928+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.1 size=1048576 2024-09-22T08:25:10.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.929+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.2 size=371134 2024-09-22T08:25:10.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.929+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=F0CBHET5CSGE tag=JL876PXTM1WL type=write size=3516862 2024-09-22T08:25:10.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.931+0000 7f8a8d811780 -1 < failed to complete operation key=0HCXP53D9NMP tag=DX7KDJM14C3Z type=del size=1985803: (22) Invalid argument 2024-09-22T08:25:10.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.933+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=MTV3DJN4XXMJ type=del size=99007 2024-09-22T08:25:10.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.934+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=4J62M4DVUE0I type=del 2024-09-22T08:25:10.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.935+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=GVXHBLJSRJ8Q type=del size=544934 2024-09-22T08:25:10.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.937+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=3HZK9ALUC6IM type=del 2024-09-22T08:25:10.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.940+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~JA7WPGBXF04X.0 size=919189 2024-09-22T08:25:10.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.940+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=JA7WPGBXF04X tag=4K3RLT2L18SS type=write size=1967765 2024-09-22T08:25:10.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.942+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=NGLJZYAEBPCS type=del 2024-09-22T08:25:10.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.943+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=C814ESWGI0RJ type=del size=2379209 2024-09-22T08:25:10.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.946+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=59Z4TLEU8621 type=write size=277416 2024-09-22T08:25:10.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.949+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~I20B866NT1E7.0 size=395332 2024-09-22T08:25:10.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.949+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=I20B866NT1E7 tag=BJDUMZWY5KS9 type=write size=1443908 2024-09-22T08:25:10.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.950+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~50BVN6DREEI2.0 size=2925 2024-09-22T08:25:10.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.953+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=50BVN6DREEI2 tag=GLKZC3EHMZ8T type=write size=1051501 2024-09-22T08:25:10.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.955+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~URFG3MPJDH4N.0 size=955612 2024-09-22T08:25:10.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.955+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=URFG3MPJDH4N tag=EBO23L5ZHNCI type=write size=2004188 2024-09-22T08:25:10.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.959+0000 7f8a8d811780 1 < suggested remove operation key=RL59H41J8ZNF tag=D9NH0AVTQ829 type=write 2024-09-22T08:25:10.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.961+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=H37EFP35NV0Q type=del size=705903 2024-09-22T08:25:10.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.962+0000 7f8a8d811780 1 < canceled operation key=WR1JR0APSOKN tag=WCAY8PN7DOBV type=del size=1626994 2024-09-22T08:25:10.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.964+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=RVMZYBKJJPKS type=del size=3771886 2024-09-22T08:25:10.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.966+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.0 size=1048576 2024-09-22T08:25:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.967+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.1 size=1048576 2024-09-22T08:25:10.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.968+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~9LX18MR7NRER.2 size=251140 2024-09-22T08:25:10.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.971+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=9LX18MR7NRER tag=CQQ3V1U0MFCP type=write size=3396868 2024-09-22T08:25:10.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.974+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~B0KTT7GODYT5.0 size=1048576 2024-09-22T08:25:10.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.976+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~B0KTT7GODYT5.1 size=917135 2024-09-22T08:25:10.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.976+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=B0KTT7GODYT5 tag=6WLQ0JOJKMR6 type=write size=3014287 2024-09-22T08:25:10.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.977+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~JRQTMP61YTXL.0 size=1048576 2024-09-22T08:25:10.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.979+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~JRQTMP61YTXL.1 size=246455 2024-09-22T08:25:10.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.980+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=JRQTMP61YTXL tag=E6WPDNI990AY type=write size=2343607 2024-09-22T08:25:10.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.983+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=STX86NLNZGU7 type=del size=804193 2024-09-22T08:25:10.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.985+0000 7f8a8d811780 1 < suggested update operation key=KIJ2DW4NSZKG tag=NRUH53G8TQO1 type=del size=1292808 2024-09-22T08:25:10.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.987+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=MTIKXL9SXRPI type=del size=1811794 2024-09-22T08:25:10.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.988+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.0 size=1048576 2024-09-22T08:25:10.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.990+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.1 size=1048576 2024-09-22T08:25:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.991+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~03SQ1E90D8FJ.2 size=94213 2024-09-22T08:25:10.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.993+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=03SQ1E90D8FJ tag=7Y3FKAFD38G5 type=write size=3239941 2024-09-22T08:25:10.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.994+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=HN83DB5MNU94 type=del size=2275290 2024-09-22T08:25:10.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.996+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=63T321F9G98Q type=del 2024-09-22T08:25:10.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.997+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=WIVTFF00W9NT type=del size=2142028 2024-09-22T08:25:10.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:10.998+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=JM15IXXWD2Q4 type=del 2024-09-22T08:25:11.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.000+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=AUL3DY42MWPW type=write size=424855 2024-09-22T08:25:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.004+0000 7f8a8d811780 1 < suggested update operation key=226G7R10IR1B tag=UP8ZN3KG59SL type=del size=3213212 2024-09-22T08:25:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.004+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=5040CGMVU3UV type=write size=75368 2024-09-22T08:25:11.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.007+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.0 size=1048576 2024-09-22T08:25:11.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.008+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.1 size=1048576 2024-09-22T08:25:11.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.008+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~F0CBHET5CSGE.2 size=371134 2024-09-22T08:25:11.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.010+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=F0CBHET5CSGE tag=JL876PXTM1WL type=write size=3516862 2024-09-22T08:25:11.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.012+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=3V6ON5HIGYLI type=del size=1913395 2024-09-22T08:25:11.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.014+0000 7f8a8d811780 1 < suggested update operation key=0AOI0OB2YFVV tag=MTV3DJN4XXMJ type=del size=99007 2024-09-22T08:25:11.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.016+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=A89E8F10RV2B type=del size=392937 2024-09-22T08:25:11.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.017+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=GVXHBLJSRJ8Q type=del 2024-09-22T08:25:11.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.020+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~VTT6A1DNG81O.0 size=300897 2024-09-22T08:25:11.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.020+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=VTT6A1DNG81O tag=W6OS1AP344F8 type=write size=1349473 2024-09-22T08:25:11.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.021+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~JA7WPGBXF04X.0 size=919189 2024-09-22T08:25:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.023+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=JA7WPGBXF04X tag=4K3RLT2L18SS type=write size=1967765 2024-09-22T08:25:11.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.025+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=CBQUJ1RMTFMY type=del size=3933947 2024-09-22T08:25:11.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.026+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=C814ESWGI0RJ type=del 2024-09-22T08:25:11.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.029+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~PY0GYVPDC1S6.0 size=797698 2024-09-22T08:25:11.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.029+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=PY0GYVPDC1S6 tag=RSSGWCGOFMTR type=write size=1846274 2024-09-22T08:25:11.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.030+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~I20B866NT1E7.0 size=395332 2024-09-22T08:25:11.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.032+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=I20B866NT1E7 tag=BJDUMZWY5KS9 type=write size=1443908 2024-09-22T08:25:11.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.034+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=QH23BQ5N03HS type=del size=3919023 2024-09-22T08:25:11.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.035+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~URFG3MPJDH4N.0 size=955612 2024-09-22T08:25:11.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.037+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=URFG3MPJDH4N tag=EBO23L5ZHNCI type=write size=2004188 2024-09-22T08:25:11.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.039+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=Z0BGV4GEX67Y type=write size=28018 2024-09-22T08:25:11.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.040+0000 7f8a8d811780 1 < canceled operation key=MJJPUJP2NSOK tag=H37EFP35NV0Q type=del size=705903 2024-09-22T08:25:11.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.043+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~IF535N1DP2LJ.0 size=1048576 2024-09-22T08:25:11.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.044+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~IF535N1DP2LJ.1 size=327987 2024-09-22T08:25:11.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.044+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=IF535N1DP2LJ tag=KGYT23O7KHNL type=write size=2425139 2024-09-22T08:25:11.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.045+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=RVMZYBKJJPKS type=del 2024-09-22T08:25:11.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.047+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=JAEY13IA7A86 type=write size=513973 2024-09-22T08:25:11.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.048+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~B0KTT7GODYT5.0 size=1048576 2024-09-22T08:25:11.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.050+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~B0KTT7GODYT5.1 size=917135 2024-09-22T08:25:11.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.052+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=B0KTT7GODYT5 tag=6WLQ0JOJKMR6 type=write size=3014287 2024-09-22T08:25:11.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.053+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=E9G7W3UB9RJJ type=write size=911732 2024-09-22T08:25:11.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.056+0000 7f8a8d811780 1 < suggested remove operation key=T5IAHQ3CUIFR tag=STX86NLNZGU7 type=del 2024-09-22T08:25:11.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.057+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=VEOVDQBLL2PI type=del size=1713869 2024-09-22T08:25:11.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.060+0000 7f8a8d811780 1 < suggested remove operation key=7LLAS815MLFH tag=MTIKXL9SXRPI type=del 2024-09-22T08:25:11.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.061+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=AN5Q43M93IF0 type=del size=1815116 2024-09-22T08:25:11.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.064+0000 7f8a8d811780 1 < suggested update operation key=LRFF14FU7C5I tag=HN83DB5MNU94 type=del size=2275290 2024-09-22T08:25:11.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.065+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=EHL2PG89PWHA type=del size=1548746 2024-09-22T08:25:11.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.067+0000 7f8a8d811780 -1 < failed to complete operation key=7LLAS815MLFH tag=WIVTFF00W9NT type=del size=2142028: (22) Invalid argument 2024-09-22T08:25:11.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.069+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.0 size=1048576 2024-09-22T08:25:11.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.071+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.1 size=1048576 2024-09-22T08:25:11.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.072+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.2 size=452369 2024-09-22T08:25:11.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.072+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=Y1FWFHUQNRHD tag=W2AQLPQDPN2A type=write size=3598097 2024-09-22T08:25:11.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.073+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=AUL3DY42MWPW type=write size=424855 2024-09-22T08:25:11.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.075+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=9TVZDEKNA1N1 type=del size=2135626 2024-09-22T08:25:11.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.076+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=5040CGMVU3UV type=write size=75368 2024-09-22T08:25:11.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.077+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=1QC0UWIDJV5Q type=del size=2367370 2024-09-22T08:25:11.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.079+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=3V6ON5HIGYLI type=del 2024-09-22T08:25:11.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.080+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=M1HC4U9324NS type=write size=544425 2024-09-22T08:25:11.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.081+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=A89E8F10RV2B type=del 2024-09-22T08:25:11.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.083+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=MLUQDPW51OR2 type=del size=1887523 2024-09-22T08:25:11.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.084+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~VTT6A1DNG81O.0 size=300897 2024-09-22T08:25:11.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.086+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=VTT6A1DNG81O tag=W6OS1AP344F8 type=write size=1349473 2024-09-22T08:25:11.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.089+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~CMXCYAE47WR7.0 size=318334 2024-09-22T08:25:11.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.089+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=CMXCYAE47WR7 tag=OF590QIGNW25 type=write size=1366910 2024-09-22T08:25:11.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.091+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=CBQUJ1RMTFMY type=del 2024-09-22T08:25:11.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.092+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=6SC537KV69HX type=write size=79134 2024-09-22T08:25:11.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.093+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~PY0GYVPDC1S6.0 size=797698 2024-09-22T08:25:11.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.096+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=PY0GYVPDC1S6 tag=RSSGWCGOFMTR type=write size=1846274 2024-09-22T08:25:11.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.097+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=B68YKPN1W0PT type=del size=3581568 2024-09-22T08:25:11.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.099+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=QH23BQ5N03HS type=del 2024-09-22T08:25:11.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.102+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~GAQIETGJ82QG.0 size=609921 2024-09-22T08:25:11.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.102+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=GAQIETGJ82QG tag=UVD9YS8X8VAC type=write size=1658497 2024-09-22T08:25:11.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.103+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=Z0BGV4GEX67Y type=write size=28018 2024-09-22T08:25:11.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.104+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=WL4YBQN9GSRS type=write size=293561 2024-09-22T08:25:11.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.105+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~IF535N1DP2LJ.0 size=1048576 2024-09-22T08:25:11.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.105+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~IF535N1DP2LJ.1 size=327987 2024-09-22T08:25:11.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.107+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=IF535N1DP2LJ tag=KGYT23O7KHNL type=write size=2425139 2024-09-22T08:25:11.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.109+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=XAZOISBFDFD6 type=write size=887866 2024-09-22T08:25:11.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.110+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=JAEY13IA7A86 type=write size=513973 2024-09-22T08:25:11.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.111+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=AL5U52M9TBQ1 type=del size=1526368 2024-09-22T08:25:11.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.113+0000 7f8a8d811780 1 < completed write operation key=2EB57FFNN986 tag=E9G7W3UB9RJJ type=write size=911732 2024-09-22T08:25:11.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.115+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~65TT0HZPTCH6.0 size=322522 2024-09-22T08:25:11.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.115+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=65TT0HZPTCH6 tag=DCNUQ7IESK0W type=write size=1371098 2024-09-22T08:25:11.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.117+0000 7f8a8d811780 -1 < failed to complete operation key=LRFF14FU7C5I tag=VEOVDQBLL2PI type=del size=1713869: (22) Invalid argument 2024-09-22T08:25:11.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.119+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~8XLLE67J1FD1.0 size=534555 2024-09-22T08:25:11.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.119+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=8XLLE67J1FD1 tag=IJVTONDPIGZB type=write size=1583131 2024-09-22T08:25:11.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.121+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=AN5Q43M93IF0 type=del 2024-09-22T08:25:11.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.123+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.0 size=1048576 2024-09-22T08:25:11.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.124+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.1 size=1048576 2024-09-22T08:25:11.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.125+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.2 size=993189 2024-09-22T08:25:11.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.125+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=LL6MAG8UY98D tag=OS90S59NTWMA type=write size=4138917 2024-09-22T08:25:11.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.126+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=EHL2PG89PWHA type=del 2024-09-22T08:25:11.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.128+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=AV29H4OC8M0C type=del size=35392 2024-09-22T08:25:11.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.129+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.0 size=1048576 2024-09-22T08:25:11.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.130+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.1 size=1048576 2024-09-22T08:25:11.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.131+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y1FWFHUQNRHD.2 size=452369 2024-09-22T08:25:11.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.133+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=Y1FWFHUQNRHD tag=W2AQLPQDPN2A type=write size=3598097 2024-09-22T08:25:11.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.135+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=5QCLJTHG270M type=del size=143607 2024-09-22T08:25:11.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.136+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=9TVZDEKNA1N1 type=del 2024-09-22T08:25:11.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.139+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=3B6UAJO6JNFJ type=del size=3820012 2024-09-22T08:25:11.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.141+0000 7f8a8d811780 1 < suggested remove operation key=911851NVIUQS tag=1QC0UWIDJV5Q type=del 2024-09-22T08:25:11.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.144+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~CTBHWHXKIIOQ.0 size=324658 2024-09-22T08:25:11.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.144+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=CTBHWHXKIIOQ tag=7BOOPKKS69ME type=write size=1373234 2024-09-22T08:25:11.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.145+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=M1HC4U9324NS type=write size=544425 2024-09-22T08:25:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.147+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~Z7XE1QHYG258.0 size=197716 2024-09-22T08:25:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.147+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=Z7XE1QHYG258 tag=27T4363N4A63 type=write size=1246292 2024-09-22T08:25:11.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.150+0000 7f8a8d811780 1 < suggested remove operation key=RL59H41J8ZNF tag=MLUQDPW51OR2 type=del 2024-09-22T08:25:11.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.151+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=3YNFF3HSOSYL type=del size=2144988 2024-09-22T08:25:11.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.153+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~CMXCYAE47WR7.0 size=318334 2024-09-22T08:25:11.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.155+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=CMXCYAE47WR7 tag=OF590QIGNW25 type=write size=1366910 2024-09-22T08:25:11.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.156+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=CBOIM0LO5Q5U type=write size=174860 2024-09-22T08:25:11.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.158+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=6SC537KV69HX type=write size=79134 2024-09-22T08:25:11.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.159+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=ZQ4JAUT7MX3L type=del size=1192852 2024-09-22T08:25:11.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.161+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=B68YKPN1W0PT type=del 2024-09-22T08:25:11.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.162+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=1YPGVW0R2P89 type=del size=386049 2024-09-22T08:25:11.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.163+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~GAQIETGJ82QG.0 size=609921 2024-09-22T08:25:11.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.165+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=GAQIETGJ82QG tag=UVD9YS8X8VAC type=write size=1658497 2024-09-22T08:25:11.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.168+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.0 size=1048576 2024-09-22T08:25:11.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.169+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.1 size=1048576 2024-09-22T08:25:11.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.170+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.2 size=937950 2024-09-22T08:25:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.170+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=YD2XC28UM6NW tag=KPUITSO2GME0 type=write size=4083678 2024-09-22T08:25:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.171+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=WL4YBQN9GSRS type=write size=293561 2024-09-22T08:25:11.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.172+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=CALTIKVZ673O type=write size=428784 2024-09-22T08:25:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.174+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=XAZOISBFDFD6 type=write size=887866 2024-09-22T08:25:11.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.175+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=3098GFJPOITA type=del size=4052465 2024-09-22T08:25:11.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.176+0000 7f8a8d811780 -1 < failed to complete operation key=RL59H41J8ZNF tag=AL5U52M9TBQ1 type=del size=1526368: (22) Invalid argument 2024-09-22T08:25:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.179+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.0 size=1048576 2024-09-22T08:25:11.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.180+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.1 size=1048576 2024-09-22T08:25:11.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.181+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.2 size=402555 2024-09-22T08:25:11.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.181+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=4KSBRLI6YHH7 tag=5OH3U1686D46 type=write size=3548283 2024-09-22T08:25:11.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.182+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~65TT0HZPTCH6.0 size=322522 2024-09-22T08:25:11.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.185+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=65TT0HZPTCH6 tag=DCNUQ7IESK0W type=write size=1371098 2024-09-22T08:25:11.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.186+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=P2KHDE00DTWZ type=write size=730574 2024-09-22T08:25:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.188+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~8XLLE67J1FD1.0 size=534555 2024-09-22T08:25:11.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.190+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=8XLLE67J1FD1 tag=IJVTONDPIGZB type=write size=1583131 2024-09-22T08:25:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.192+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~E69P9VQI8I76.0 size=1048576 2024-09-22T08:25:11.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.193+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~E69P9VQI8I76.1 size=293543 2024-09-22T08:25:11.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.193+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=E69P9VQI8I76 tag=7KYC4BHY5TO7 type=write size=2390695 2024-09-22T08:25:11.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.194+0000 7f8a8d811780 1 < canceled part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.0 size=1048576 2024-09-22T08:25:11.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.195+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.1 size=1048576 2024-09-22T08:25:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.196+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~LL6MAG8UY98D.2 size=993189 2024-09-22T08:25:11.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.199+0000 7f8a8d811780 1 < canceled multipart upload key=GMNVYF2BY872 upload=LL6MAG8UY98D tag=OS90S59NTWMA type=write size=4138917 2024-09-22T08:25:11.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.201+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~3AB8BGE8HB0Q.0 size=1048576 2024-09-22T08:25:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.202+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~3AB8BGE8HB0Q.1 size=747621 2024-09-22T08:25:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.202+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=3AB8BGE8HB0Q tag=6NRHCYIVU70X type=write size=2844773 2024-09-22T08:25:11.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.204+0000 7f8a8d811780 1 < canceled operation key=9EY50PUC6AJJ tag=AV29H4OC8M0C type=del size=35392 2024-09-22T08:25:11.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.205+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=FKAO53T04OJ2 type=del size=3742421 2024-09-22T08:25:11.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.207+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=5QCLJTHG270M type=del 2024-09-22T08:25:11.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.208+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=X8Z6JA17WJ0J type=del size=3501118 2024-09-22T08:25:11.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.210+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=3B6UAJO6JNFJ type=del 2024-09-22T08:25:11.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.211+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=17YN80NY1T8J type=write size=903966 2024-09-22T08:25:11.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.213+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~CTBHWHXKIIOQ.0 size=324658 2024-09-22T08:25:11.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.215+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=CTBHWHXKIIOQ tag=7BOOPKKS69ME type=write size=1373234 2024-09-22T08:25:11.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.216+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=7N9FT37LU1D2 type=del size=213592 2024-09-22T08:25:11.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.218+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~Z7XE1QHYG258.0 size=197716 2024-09-22T08:25:11.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.220+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=Z7XE1QHYG258 tag=27T4363N4A63 type=write size=1246292 2024-09-22T08:25:11.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.222+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.0 size=1048576 2024-09-22T08:25:11.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.224+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.1 size=1048576 2024-09-22T08:25:11.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.226+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.2 size=313739 2024-09-22T08:25:11.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.226+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=PAG34TYP9UGP tag=RX19OCKDUXWO type=write size=3459467 2024-09-22T08:25:11.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.227+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=3YNFF3HSOSYL type=del 2024-09-22T08:25:11.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.229+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.0 size=1048576 2024-09-22T08:25:11.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.230+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.1 size=1048576 2024-09-22T08:25:11.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.231+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.2 size=917719 2024-09-22T08:25:11.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.231+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=DT2HEJVJ4ZXY tag=UWI8ZZ9VVBVT type=write size=4063447 2024-09-22T08:25:11.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.233+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=CBOIM0LO5Q5U type=write size=174860 2024-09-22T08:25:11.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.235+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=NQF1PGHAVAFQ type=del size=2373650 2024-09-22T08:25:11.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.236+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=ZQ4JAUT7MX3L type=del 2024-09-22T08:25:11.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.237+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=RGWQSFY2VJGQ type=del size=2294351 2024-09-22T08:25:11.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.239+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=1YPGVW0R2P89 type=del 2024-09-22T08:25:11.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.240+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=X77IFGJ9CR3C type=del size=87669 2024-09-22T08:25:11.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.242+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.0 size=1048576 2024-09-22T08:25:11.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.243+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.1 size=1048576 2024-09-22T08:25:11.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.244+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~YD2XC28UM6NW.2 size=937950 2024-09-22T08:25:11.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.247+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=YD2XC28UM6NW tag=KPUITSO2GME0 type=write size=4083678 2024-09-22T08:25:11.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.248+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=N6NW6ROAYKUN type=del size=894296 2024-09-22T08:25:11.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.249+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=CALTIKVZ673O type=write size=428784 2024-09-22T08:25:11.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.251+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=CF95QBY24OJ0 type=write size=964542 2024-09-22T08:25:11.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.253+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=3098GFJPOITA type=del 2024-09-22T08:25:11.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.255+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=Z0WC23AQG1L6 type=del size=992858 2024-09-22T08:25:11.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.256+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.0 size=1048576 2024-09-22T08:25:11.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.257+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.1 size=1048576 2024-09-22T08:25:11.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.259+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~4KSBRLI6YHH7.2 size=402555 2024-09-22T08:25:11.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.260+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=4KSBRLI6YHH7 tag=5OH3U1686D46 type=write size=3548283 2024-09-22T08:25:11.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.262+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=M5U5OS0XX48L type=del size=1232394 2024-09-22T08:25:11.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.263+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=P2KHDE00DTWZ type=write size=730574 2024-09-22T08:25:11.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.266+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~XTW340PBLXL5.0 size=66834 2024-09-22T08:25:11.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.266+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=XTW340PBLXL5 tag=LUSQRVVP9WUG type=write size=1115410 2024-09-22T08:25:11.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.267+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~E69P9VQI8I76.0 size=1048576 2024-09-22T08:25:11.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.269+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~E69P9VQI8I76.1 size=293543 2024-09-22T08:25:11.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.271+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=E69P9VQI8I76 tag=7KYC4BHY5TO7 type=write size=2390695 2024-09-22T08:25:11.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.274+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~RL8I2OZABRN3.0 size=1048576 2024-09-22T08:25:11.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.275+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~RL8I2OZABRN3.1 size=373728 2024-09-22T08:25:11.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.275+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=RL8I2OZABRN3 tag=TGMAA0Z30HU2 type=write size=2470880 2024-09-22T08:25:11.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.276+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~3AB8BGE8HB0Q.0 size=1048576 2024-09-22T08:25:11.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.277+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~3AB8BGE8HB0Q.1 size=747621 2024-09-22T08:25:11.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.280+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=3AB8BGE8HB0Q tag=6NRHCYIVU70X type=write size=2844773 2024-09-22T08:25:11.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.282+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~H0HBFPBOKG6F.0 size=89806 2024-09-22T08:25:11.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.282+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=H0HBFPBOKG6F tag=ND1RTSJI48ML type=write size=1138382 2024-09-22T08:25:11.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.283+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=FKAO53T04OJ2 type=del 2024-09-22T08:25:11.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.285+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=77CNSLX0S0KL type=del size=2159445 2024-09-22T08:25:11.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.288+0000 7f8a8d811780 1 < suggested remove operation key=MJJPUJP2NSOK tag=X8Z6JA17WJ0J type=del 2024-09-22T08:25:11.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.289+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=QH02FBW3RP22 type=del size=3117990 2024-09-22T08:25:11.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.291+0000 7f8a8d811780 1 < completed write operation key=QE6XEMOZMCF1 tag=17YN80NY1T8J type=write size=903966 2024-09-22T08:25:11.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.292+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=5R7RNYE5Y880 type=del size=1087136 2024-09-22T08:25:11.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.294+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=7N9FT37LU1D2 type=del 2024-09-22T08:25:11.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.297+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~107GB65V4CPN.0 size=1048576 2024-09-22T08:25:11.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.298+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~107GB65V4CPN.1 size=907308 2024-09-22T08:25:11.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.298+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=107GB65V4CPN tag=O1TVEUVYZGPB type=write size=3004460 2024-09-22T08:25:11.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.299+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.0 size=1048576 2024-09-22T08:25:11.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.300+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.1 size=1048576 2024-09-22T08:25:11.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.301+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~PAG34TYP9UGP.2 size=313739 2024-09-22T08:25:11.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.303+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=PAG34TYP9UGP tag=RX19OCKDUXWO type=write size=3459467 2024-09-22T08:25:11.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.304+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=KH739XM5ANW7 type=write size=702211 2024-09-22T08:25:11.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.305+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.0 size=1048576 2024-09-22T08:25:11.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.307+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.1 size=1048576 2024-09-22T08:25:11.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.308+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~DT2HEJVJ4ZXY.2 size=917719 2024-09-22T08:25:11.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.310+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=DT2HEJVJ4ZXY tag=UWI8ZZ9VVBVT type=write size=4063447 2024-09-22T08:25:11.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.313+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~SCATI6A7GL1E.0 size=833742 2024-09-22T08:25:11.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.313+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=SCATI6A7GL1E tag=776WV08L3G0J type=write size=1882318 2024-09-22T08:25:11.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.314+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=NQF1PGHAVAFQ type=del 2024-09-22T08:25:11.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.316+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=7KGUXSSAE1HU type=del size=523368 2024-09-22T08:25:11.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.317+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=RGWQSFY2VJGQ type=del size=2294351 2024-09-22T08:25:11.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.319+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=V4E89W9ANFLL type=del size=2399614 2024-09-22T08:25:11.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.320+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=X77IFGJ9CR3C type=del 2024-09-22T08:25:11.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.322+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~Y9Y6LSPSR9I6.0 size=182308 2024-09-22T08:25:11.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.322+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=Y9Y6LSPSR9I6 tag=0713NM493IDS type=write size=1230884 2024-09-22T08:25:11.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.324+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=N6NW6ROAYKUN type=del 2024-09-22T08:25:11.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.327+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~R6FO9HWZRIMG.0 size=363311 2024-09-22T08:25:11.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.327+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=R6FO9HWZRIMG tag=A0JJ4ISLI41V type=write size=1411887 2024-09-22T08:25:11.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.328+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=CF95QBY24OJ0 type=write size=964542 2024-09-22T08:25:11.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.329+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=DKHMN8UCDIL5 type=del size=1018092 2024-09-22T08:25:11.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.331+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=Z0WC23AQG1L6 type=del 2024-09-22T08:25:11.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.334+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.0 size=1048576 2024-09-22T08:25:11.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.334+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.1 size=1048576 2024-09-22T08:25:11.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.335+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.2 size=435242 2024-09-22T08:25:11.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.335+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=8AB17HTNVLI5 tag=F8DX1716GGLY type=write size=3580970 2024-09-22T08:25:11.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.339+0000 7f8a8d811780 1 < suggested remove operation key=LRFF14FU7C5I tag=M5U5OS0XX48L type=del 2024-09-22T08:25:11.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.340+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=AE64B54U61FT type=del size=1916959 2024-09-22T08:25:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.341+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~XTW340PBLXL5.0 size=66834 2024-09-22T08:25:11.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.343+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=XTW340PBLXL5 tag=LUSQRVVP9WUG type=write size=1115410 2024-09-22T08:25:11.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.346+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~XHPEWX0IZ50Q.0 size=1048576 2024-09-22T08:25:11.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.347+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~XHPEWX0IZ50Q.1 size=519002 2024-09-22T08:25:11.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.347+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=XHPEWX0IZ50Q tag=N8P0MOTY1NM0 type=write size=2616154 2024-09-22T08:25:11.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.348+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~RL8I2OZABRN3.0 size=1048576 2024-09-22T08:25:11.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.350+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~RL8I2OZABRN3.1 size=373728 2024-09-22T08:25:11.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.352+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=RL8I2OZABRN3 tag=TGMAA0Z30HU2 type=write size=2470880 2024-09-22T08:25:11.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.355+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.0 size=1048576 2024-09-22T08:25:11.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.356+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.1 size=1048576 2024-09-22T08:25:11.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.358+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.2 size=589986 2024-09-22T08:25:11.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.358+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=E2WMF73TORW8 tag=DZKCJIIMKS7H type=write size=3735714 2024-09-22T08:25:11.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.359+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~H0HBFPBOKG6F.0 size=89806 2024-09-22T08:25:11.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.362+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=H0HBFPBOKG6F tag=ND1RTSJI48ML type=write size=1138382 2024-09-22T08:25:11.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.364+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~XMWWHQBD117S.0 size=1048576 2024-09-22T08:25:11.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.365+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~XMWWHQBD117S.1 size=857837 2024-09-22T08:25:11.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.365+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=XMWWHQBD117S tag=2A99O0PLUA0U type=write size=2954989 2024-09-22T08:25:11.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.366+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=77CNSLX0S0KL type=del 2024-09-22T08:25:11.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.367+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=E0L3KGNDKXP0 type=del size=3028377 2024-09-22T08:25:11.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.369+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=QH02FBW3RP22 type=del 2024-09-22T08:25:11.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.370+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=1VBYY0AP2B0J type=del size=1970981 2024-09-22T08:25:11.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.371+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=5R7RNYE5Y880 type=del 2024-09-22T08:25:11.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.373+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=7O2LL4A86NVD type=del size=2073221 2024-09-22T08:25:11.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.374+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~107GB65V4CPN.0 size=1048576 2024-09-22T08:25:11.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.375+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~107GB65V4CPN.1 size=907308 2024-09-22T08:25:11.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.378+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=107GB65V4CPN tag=O1TVEUVYZGPB type=write size=3004460 2024-09-22T08:25:11.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.380+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~XNCEZS9MUTE8.0 size=1048576 2024-09-22T08:25:11.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.381+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~XNCEZS9MUTE8.1 size=627717 2024-09-22T08:25:11.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.381+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=XNCEZS9MUTE8 tag=5E37NH6NUXFW type=write size=2724869 2024-09-22T08:25:11.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.383+0000 7f8a8d811780 1 < completed write operation key=MJJPUJP2NSOK tag=KH739XM5ANW7 type=write size=702211 2024-09-22T08:25:11.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.386+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~G37UYY0SZF0Z.0 size=324130 2024-09-22T08:25:11.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.386+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=G37UYY0SZF0Z tag=1BNK418FWR33 type=write size=1372706 2024-09-22T08:25:11.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.387+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~SCATI6A7GL1E.0 size=833742 2024-09-22T08:25:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.390+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=SCATI6A7GL1E tag=776WV08L3G0J type=write size=1882318 2024-09-22T08:25:11.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.391+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=ZPF9TQV57E6I type=write size=826971 2024-09-22T08:25:11.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.393+0000 7f8a8d811780 1 < suggested remove operation key=H504PU8223G9 tag=7KGUXSSAE1HU type=del 2024-09-22T08:25:11.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.396+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.0 size=1048576 2024-09-22T08:25:11.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.398+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.1 size=1048576 2024-09-22T08:25:11.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.400+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.2 size=373694 2024-09-22T08:25:11.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.400+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=H8TKV6F1332W tag=67KTURAQW52D type=write size=3519422 2024-09-22T08:25:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.402+0000 7f8a8d811780 1 < suggested update operation key=1719KI1YP1FT tag=V4E89W9ANFLL type=del size=2399614 2024-09-22T08:25:11.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.404+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~Z7W6WR9BOUCL.0 size=1048576 2024-09-22T08:25:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.405+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~Z7W6WR9BOUCL.1 size=1023582 2024-09-22T08:25:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.405+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=Z7W6WR9BOUCL tag=3EPUF0LJ0JLL type=write size=3120734 2024-09-22T08:25:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.407+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~Y9Y6LSPSR9I6.0 size=182308 2024-09-22T08:25:11.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.409+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=Y9Y6LSPSR9I6 tag=0713NM493IDS type=write size=1230884 2024-09-22T08:25:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.412+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~3PVTAZ9M6GOS.0 size=1048576 2024-09-22T08:25:11.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.413+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~3PVTAZ9M6GOS.1 size=520712 2024-09-22T08:25:11.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.413+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=3PVTAZ9M6GOS tag=XPCCJCBN5NIB type=write size=2617864 2024-09-22T08:25:11.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.414+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~R6FO9HWZRIMG.0 size=363311 2024-09-22T08:25:11.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.417+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=R6FO9HWZRIMG tag=A0JJ4ISLI41V type=write size=1411887 2024-09-22T08:25:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.419+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.0 size=1048576 2024-09-22T08:25:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.420+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.1 size=1048576 2024-09-22T08:25:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.421+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.2 size=812756 2024-09-22T08:25:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.421+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=7LH5LVQIWXUJ tag=FBYM92YEG5WO type=write size=3958484 2024-09-22T08:25:11.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.423+0000 7f8a8d811780 1 < canceled operation key=0HCXP53D9NMP tag=DKHMN8UCDIL5 type=del size=1018092 2024-09-22T08:25:11.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.424+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=EJZAXREQ4GZF type=del size=240197 2024-09-22T08:25:11.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.426+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.0 size=1048576 2024-09-22T08:25:11.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.427+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.1 size=1048576 2024-09-22T08:25:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.428+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~8AB17HTNVLI5.2 size=435242 2024-09-22T08:25:11.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.431+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=8AB17HTNVLI5 tag=F8DX1716GGLY type=write size=3580970 2024-09-22T08:25:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.433+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.0 size=1048576 2024-09-22T08:25:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.434+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.1 size=1048576 2024-09-22T08:25:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.436+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.2 size=720121 2024-09-22T08:25:11.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.436+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=2RZ9DT01CQ0L tag=CTGQT42EC86U type=write size=3865849 2024-09-22T08:25:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.437+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=AE64B54U61FT type=del 2024-09-22T08:25:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.439+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=PPDVL059I1ZR type=del size=2584155 2024-09-22T08:25:11.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.440+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~XHPEWX0IZ50Q.0 size=1048576 2024-09-22T08:25:11.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.441+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~XHPEWX0IZ50Q.1 size=519002 2024-09-22T08:25:11.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.444+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=XHPEWX0IZ50Q tag=N8P0MOTY1NM0 type=write size=2616154 2024-09-22T08:25:11.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.446+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.0 size=1048576 2024-09-22T08:25:11.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.447+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.1 size=1048576 2024-09-22T08:25:11.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.449+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.2 size=638157 2024-09-22T08:25:11.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.449+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=TGY0BZFOOC2O tag=KBYL9IHG96IJ type=write size=3783885 2024-09-22T08:25:11.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.449+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.0 size=1048576 2024-09-22T08:25:11.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.450+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.1 size=1048576 2024-09-22T08:25:11.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.451+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~E2WMF73TORW8.2 size=589986 2024-09-22T08:25:11.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.453+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=E2WMF73TORW8 tag=DZKCJIIMKS7H type=write size=3735714 2024-09-22T08:25:11.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.455+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.0 size=1048576 2024-09-22T08:25:11.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.456+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.1 size=1048576 2024-09-22T08:25:11.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.457+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.2 size=87482 2024-09-22T08:25:11.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.457+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=RSWAHRWJ20ZA tag=TEPD5SF5MXJG type=write size=3233210 2024-09-22T08:25:11.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.459+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~XMWWHQBD117S.0 size=1048576 2024-09-22T08:25:11.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.460+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~XMWWHQBD117S.1 size=857837 2024-09-22T08:25:11.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.462+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=XMWWHQBD117S tag=2A99O0PLUA0U type=write size=2954989 2024-09-22T08:25:11.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.465+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~07R33NB0OULA.0 size=1048576 2024-09-22T08:25:11.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.466+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~07R33NB0OULA.1 size=475569 2024-09-22T08:25:11.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.466+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=07R33NB0OULA tag=AEZXQUVDQ7IQ type=write size=2572721 2024-09-22T08:25:11.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.467+0000 7f8a8d811780 1 < canceled operation key=JWJ9T6XYCUYR tag=E0L3KGNDKXP0 type=del size=3028377 2024-09-22T08:25:11.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.469+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=3HTE4KIDLI3B type=del size=2207380 2024-09-22T08:25:11.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.470+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=1VBYY0AP2B0J type=del 2024-09-22T08:25:11.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.473+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.0 size=1048576 2024-09-22T08:25:11.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.474+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.1 size=1048576 2024-09-22T08:25:11.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.475+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.2 size=645507 2024-09-22T08:25:11.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.475+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=CNHNA98M626P tag=GW53CJ6B9OMU type=write size=3791235 2024-09-22T08:25:11.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.478+0000 7f8a8d811780 1 < suggested update operation key=3T2TX83CSE2D tag=7O2LL4A86NVD type=del size=2073221 2024-09-22T08:25:11.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.479+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=SPFCHZWKS3OY type=del size=892592 2024-09-22T08:25:11.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.480+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~XNCEZS9MUTE8.0 size=1048576 2024-09-22T08:25:11.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.482+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~XNCEZS9MUTE8.1 size=627717 2024-09-22T08:25:11.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.486+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=XNCEZS9MUTE8 tag=5E37NH6NUXFW type=write size=2724869 2024-09-22T08:25:11.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.488+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~VQXBLCGNVD98.0 size=208572 2024-09-22T08:25:11.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.488+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=VQXBLCGNVD98 tag=88B83164MQUU type=write size=1257148 2024-09-22T08:25:11.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.490+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~G37UYY0SZF0Z.0 size=324130 2024-09-22T08:25:11.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.493+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=G37UYY0SZF0Z tag=1BNK418FWR33 type=write size=1372706 2024-09-22T08:25:11.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.495+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.0 size=1048576 2024-09-22T08:25:11.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.497+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.1 size=1048576 2024-09-22T08:25:11.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.498+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.2 size=598822 2024-09-22T08:25:11.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.498+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=KW6XZ5TO3HMH tag=GN7E2ES0I5PQ type=write size=3744550 2024-09-22T08:25:11.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.499+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=ZPF9TQV57E6I type=write size=826971 2024-09-22T08:25:11.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.502+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~18MCGCDFPHV3.0 size=766357 2024-09-22T08:25:11.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.502+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=18MCGCDFPHV3 tag=N0HIV18JRN06 type=write size=1814933 2024-09-22T08:25:11.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.503+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.0 size=1048576 2024-09-22T08:25:11.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.504+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.1 size=1048576 2024-09-22T08:25:11.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.505+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~H8TKV6F1332W.2 size=373694 2024-09-22T08:25:11.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.508+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=H8TKV6F1332W tag=67KTURAQW52D type=write size=3519422 2024-09-22T08:25:11.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.509+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=7LLBTQGOI7QC type=del size=467584 2024-09-22T08:25:11.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.510+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~Z7W6WR9BOUCL.0 size=1048576 2024-09-22T08:25:11.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.512+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~Z7W6WR9BOUCL.1 size=1023582 2024-09-22T08:25:11.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.514+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=Z7W6WR9BOUCL tag=3EPUF0LJ0JLL type=write size=3120734 2024-09-22T08:25:11.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.517+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~LQK2MNXAWWZA.0 size=1048576 2024-09-22T08:25:11.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.518+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~LQK2MNXAWWZA.1 size=426236 2024-09-22T08:25:11.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.518+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=LQK2MNXAWWZA tag=WZ03SSKN892K type=write size=2523388 2024-09-22T08:25:11.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.519+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~3PVTAZ9M6GOS.0 size=1048576 2024-09-22T08:25:11.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.521+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~3PVTAZ9M6GOS.1 size=520712 2024-09-22T08:25:11.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.523+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=3PVTAZ9M6GOS tag=XPCCJCBN5NIB type=write size=2617864 2024-09-22T08:25:11.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.526+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~7FL37FUXP5Z0.0 size=1048576 2024-09-22T08:25:11.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.527+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~7FL37FUXP5Z0.1 size=569224 2024-09-22T08:25:11.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.527+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=7FL37FUXP5Z0 tag=AHT3Q9174K3M type=write size=2666376 2024-09-22T08:25:11.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.529+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.0 size=1048576 2024-09-22T08:25:11.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.530+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.1 size=1048576 2024-09-22T08:25:11.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.531+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~7LH5LVQIWXUJ.2 size=812756 2024-09-22T08:25:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.533+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=7LH5LVQIWXUJ tag=FBYM92YEG5WO type=write size=3958484 2024-09-22T08:25:11.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.536+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~KAB441LE14UN.0 size=642677 2024-09-22T08:25:11.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.536+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=KAB441LE14UN tag=6LY24HL8VE7G type=write size=1691253 2024-09-22T08:25:11.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.538+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=EJZAXREQ4GZF type=del 2024-09-22T08:25:11.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.541+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~2QCP2QMRWS4G.0 size=1008105 2024-09-22T08:25:11.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.541+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=2QCP2QMRWS4G tag=IPNB8Q5IK1C8 type=write size=2056681 2024-09-22T08:25:11.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.542+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.0 size=1048576 2024-09-22T08:25:11.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.544+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.1 size=1048576 2024-09-22T08:25:11.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.545+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~2RZ9DT01CQ0L.2 size=720121 2024-09-22T08:25:11.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.548+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=2RZ9DT01CQ0L tag=CTGQT42EC86U type=write size=3865849 2024-09-22T08:25:11.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.549+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=P4I4MUI63AX0 type=del size=676827 2024-09-22T08:25:11.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.551+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=PPDVL059I1ZR type=del 2024-09-22T08:25:11.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.554+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~FEZLDQ6ZO8RZ.0 size=1048576 2024-09-22T08:25:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.555+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~FEZLDQ6ZO8RZ.1 size=390551 2024-09-22T08:25:11.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.555+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=FEZLDQ6ZO8RZ tag=85UEXD5TKJ37 type=write size=2487703 2024-09-22T08:25:11.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.555+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.0 size=1048576 2024-09-22T08:25:11.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.556+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.1 size=1048576 2024-09-22T08:25:11.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.557+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~TGY0BZFOOC2O.2 size=638157 2024-09-22T08:25:11.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.561+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=TGY0BZFOOC2O tag=KBYL9IHG96IJ type=write size=3783885 2024-09-22T08:25:11.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.562+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=5F3UJ3I32O2M type=write size=496002 2024-09-22T08:25:11.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.563+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.0 size=1048576 2024-09-22T08:25:11.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.564+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.1 size=1048576 2024-09-22T08:25:11.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.566+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~RSWAHRWJ20ZA.2 size=87482 2024-09-22T08:25:11.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.568+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=RSWAHRWJ20ZA tag=TEPD5SF5MXJG type=write size=3233210 2024-09-22T08:25:11.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.570+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=JW37IPEVH3LS type=del size=2161872 2024-09-22T08:25:11.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.572+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~07R33NB0OULA.0 size=1048576 2024-09-22T08:25:11.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.573+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~07R33NB0OULA.1 size=475569 2024-09-22T08:25:11.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.575+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=07R33NB0OULA tag=AEZXQUVDQ7IQ type=write size=2572721 2024-09-22T08:25:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.577+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=TANCDT0WIPLH type=del size=3324093 2024-09-22T08:25:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.579+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=3HTE4KIDLI3B type=del 2024-09-22T08:25:11.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.580+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=R0Y9Q96OSVD3 type=write size=492994 2024-09-22T08:25:11.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.582+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.0 size=1048576 2024-09-22T08:25:11.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.583+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.1 size=1048576 2024-09-22T08:25:11.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.584+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~CNHNA98M626P.2 size=645507 2024-09-22T08:25:11.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.587+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=CNHNA98M626P tag=GW53CJ6B9OMU type=write size=3791235 2024-09-22T08:25:11.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.590+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~0LABE2Z0KCCB.0 size=277943 2024-09-22T08:25:11.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.590+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=0LABE2Z0KCCB tag=XQX10KEXAM6C type=write size=1326519 2024-09-22T08:25:11.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.594+0000 7f8a8d811780 1 < suggested update operation key=JP7IZ0CMXTSX tag=SPFCHZWKS3OY type=del size=892592 2024-09-22T08:25:11.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.596+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.0 size=1048576 2024-09-22T08:25:11.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.598+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.1 size=1048576 2024-09-22T08:25:11.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.599+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.2 size=846343 2024-09-22T08:25:11.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.599+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=VI3Q36346BEU tag=QBIAXJVC0KV1 type=write size=3992071 2024-09-22T08:25:11.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.600+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~VQXBLCGNVD98.0 size=208572 2024-09-22T08:25:11.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.603+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=VQXBLCGNVD98 tag=88B83164MQUU type=write size=1257148 2024-09-22T08:25:11.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.605+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.0 size=1048576 2024-09-22T08:25:11.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.606+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.1 size=1048576 2024-09-22T08:25:11.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.607+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.2 size=810911 2024-09-22T08:25:11.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.607+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=UC94EEO7GJAM tag=2QHUWWMHMM8U type=write size=3956639 2024-09-22T08:25:11.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.608+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.0 size=1048576 2024-09-22T08:25:11.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.609+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.1 size=1048576 2024-09-22T08:25:11.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.610+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~KW6XZ5TO3HMH.2 size=598822 2024-09-22T08:25:11.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.613+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=KW6XZ5TO3HMH tag=GN7E2ES0I5PQ type=write size=3744550 2024-09-22T08:25:11.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.615+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=ZDUSAEVA5JBW type=del size=835359 2024-09-22T08:25:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.616+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~18MCGCDFPHV3.0 size=766357 2024-09-22T08:25:11.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.619+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=18MCGCDFPHV3 tag=N0HIV18JRN06 type=write size=1814933 2024-09-22T08:25:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.621+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=RJDTDO7ITZLS type=del size=927278 2024-09-22T08:25:11.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.622+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=7LLBTQGOI7QC type=del 2024-09-22T08:25:11.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.624+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=1XJAW4027T6Z type=del size=2377874 2024-09-22T08:25:11.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.625+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~LQK2MNXAWWZA.0 size=1048576 2024-09-22T08:25:11.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.626+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~LQK2MNXAWWZA.1 size=426236 2024-09-22T08:25:11.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.629+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=LQK2MNXAWWZA tag=WZ03SSKN892K type=write size=2523388 2024-09-22T08:25:11.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.630+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=89F6TCQH7V2B type=write size=880286 2024-09-22T08:25:11.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.632+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~7FL37FUXP5Z0.0 size=1048576 2024-09-22T08:25:11.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.633+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~7FL37FUXP5Z0.1 size=569224 2024-09-22T08:25:11.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.636+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=7FL37FUXP5Z0 tag=AHT3Q9174K3M type=write size=2666376 2024-09-22T08:25:11.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.638+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=LRX84D2SJ9OX type=del size=1315761 2024-09-22T08:25:11.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.638+0000 7f8a8d811780 1 < canceled part key=_multipart_2EB57FFNN986.2~KAB441LE14UN.0 size=642677 2024-09-22T08:25:11.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.641+0000 7f8a8d811780 1 < canceled multipart upload key=2EB57FFNN986 upload=KAB441LE14UN tag=6LY24HL8VE7G type=write size=1691253 2024-09-22T08:25:11.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.642+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=FJ3FKYXQZ0U6 type=del size=3135229 2024-09-22T08:25:11.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.644+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~2QCP2QMRWS4G.0 size=1008105 2024-09-22T08:25:11.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.646+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=2QCP2QMRWS4G tag=IPNB8Q5IK1C8 type=write size=2056681 2024-09-22T08:25:11.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.648+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=1SR836K8TTYI type=del size=3345239 2024-09-22T08:25:11.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.649+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=P4I4MUI63AX0 type=del 2024-09-22T08:25:11.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.650+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=6OTAQSPATOG8 type=write size=686804 2024-09-22T08:25:11.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.651+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~FEZLDQ6ZO8RZ.0 size=1048576 2024-09-22T08:25:11.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.653+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~FEZLDQ6ZO8RZ.1 size=390551 2024-09-22T08:25:11.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.655+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=FEZLDQ6ZO8RZ tag=85UEXD5TKJ37 type=write size=2487703 2024-09-22T08:25:11.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.656+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=WZB9L38PEWOJ type=del size=961424 2024-09-22T08:25:11.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.658+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=5F3UJ3I32O2M type=write size=496002 2024-09-22T08:25:11.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.659+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=3SQ146WWU825 type=del size=3080276 2024-09-22T08:25:11.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.660+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=JW37IPEVH3LS type=del 2024-09-22T08:25:11.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.663+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=NVJ63170NJG9 type=del size=1449714 2024-09-22T08:25:11.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.665+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=TANCDT0WIPLH type=del 2024-09-22T08:25:11.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.668+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~A28MVFDISWPB.0 size=1048576 2024-09-22T08:25:11.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.669+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~A28MVFDISWPB.1 size=795407 2024-09-22T08:25:11.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.669+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=A28MVFDISWPB tag=ZT41HPVD5JK1 type=write size=2892559 2024-09-22T08:25:11.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.672+0000 7f8a8d811780 1 < suggested update operation key=7XNMR51803Y6 tag=R0Y9Q96OSVD3 type=write size=492994 2024-09-22T08:25:11.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.673+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=91X9X38LQ42P type=del size=41927 2024-09-22T08:25:11.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.675+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~0LABE2Z0KCCB.0 size=277943 2024-09-22T08:25:11.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.678+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=0LABE2Z0KCCB tag=XQX10KEXAM6C type=write size=1326519 2024-09-22T08:25:11.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.679+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=ZUK107ZY2BJ7 type=del size=1639746 2024-09-22T08:25:11.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.680+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.0 size=1048576 2024-09-22T08:25:11.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.681+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.1 size=1048576 2024-09-22T08:25:11.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.683+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~VI3Q36346BEU.2 size=846343 2024-09-22T08:25:11.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.685+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=VI3Q36346BEU tag=QBIAXJVC0KV1 type=write size=3992071 2024-09-22T08:25:11.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.687+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~2K0GORYNUGAS.0 size=1048576 2024-09-22T08:25:11.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.689+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~2K0GORYNUGAS.1 size=828257 2024-09-22T08:25:11.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.689+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=2K0GORYNUGAS tag=BA42JRCXRCEF type=write size=2925409 2024-09-22T08:25:11.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.691+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.0 size=1048576 2024-09-22T08:25:11.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.692+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.1 size=1048576 2024-09-22T08:25:11.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.692+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UC94EEO7GJAM.2 size=810911 2024-09-22T08:25:11.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.695+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=UC94EEO7GJAM tag=2QHUWWMHMM8U type=write size=3956639 2024-09-22T08:25:11.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.697+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=RM7HEFETIEJB type=write size=750116 2024-09-22T08:25:11.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.698+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=ZDUSAEVA5JBW type=del 2024-09-22T08:25:11.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.699+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=MX5QG3Y71RC3 type=del size=2671115 2024-09-22T08:25:11.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.701+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=RJDTDO7ITZLS type=del 2024-09-22T08:25:11.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.703+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.0 size=1048576 2024-09-22T08:25:11.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.704+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.1 size=1048576 2024-09-22T08:25:11.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.705+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.2 size=228405 2024-09-22T08:25:11.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.705+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=91YID4O26RS7 tag=T3CYDF732QSM type=write size=3374133 2024-09-22T08:25:11.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.707+0000 7f8a8d811780 1 < canceled operation key=IOZ7IXVOB70S tag=1XJAW4027T6Z type=del size=2377874 2024-09-22T08:25:11.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.708+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=PGZ201UL2I0X type=del size=1104854 2024-09-22T08:25:11.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.710+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=89F6TCQH7V2B type=write size=880286 2024-09-22T08:25:11.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.711+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=ZLYXHWP06ZG5 type=del size=3478898 2024-09-22T08:25:11.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.713+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=LRX84D2SJ9OX type=del size=1315761 2024-09-22T08:25:11.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.714+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=HK1LT424XTM9 type=del size=1231805 2024-09-22T08:25:11.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.715+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=FJ3FKYXQZ0U6 type=del 2024-09-22T08:25:11.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.717+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=BQMTCX9Y1OSF type=write size=845370 2024-09-22T08:25:11.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.718+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=1SR836K8TTYI type=del 2024-09-22T08:25:11.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.721+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.0 size=1048576 2024-09-22T08:25:11.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.722+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.1 size=1048576 2024-09-22T08:25:11.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.723+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.2 size=179718 2024-09-22T08:25:11.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.723+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=Q9YRBF3KEJVM tag=5T366JZ54BVH type=write size=3325446 2024-09-22T08:25:11.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.725+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=6OTAQSPATOG8 type=write size=686804 2024-09-22T08:25:11.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.726+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=I8YY9EH7BLC0 type=write size=92188 2024-09-22T08:25:11.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.728+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=WZB9L38PEWOJ type=del 2024-09-22T08:25:11.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.730+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=BP3SGUMEQYNU type=del size=667979 2024-09-22T08:25:11.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.731+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=3SQ146WWU825 type=del 2024-09-22T08:25:11.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.733+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=XK6OGE2MG10U type=del size=3625373 2024-09-22T08:25:11.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.734+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=NVJ63170NJG9 type=del 2024-09-22T08:25:11.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.736+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=SXDYMNKW3NMM type=del size=444973 2024-09-22T08:25:11.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.738+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~A28MVFDISWPB.0 size=1048576 2024-09-22T08:25:11.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.739+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~A28MVFDISWPB.1 size=795407 2024-09-22T08:25:11.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.742+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=A28MVFDISWPB tag=ZT41HPVD5JK1 type=write size=2892559 2024-09-22T08:25:11.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.742+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=NRCP5HDAXNLY type=write size=438834 2024-09-22T08:25:11.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.744+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=91X9X38LQ42P type=del size=41927 2024-09-22T08:25:11.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.746+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=CJHFGTO05WRA type=del size=3235980 2024-09-22T08:25:11.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.747+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=ZUK107ZY2BJ7 type=del 2024-09-22T08:25:11.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.748+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=EOUROIBDSJ8U type=del size=2719336 2024-09-22T08:25:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.750+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~2K0GORYNUGAS.0 size=1048576 2024-09-22T08:25:11.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.751+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~2K0GORYNUGAS.1 size=828257 2024-09-22T08:25:11.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.754+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=2K0GORYNUGAS tag=BA42JRCXRCEF type=write size=2925409 2024-09-22T08:25:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.756+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.0 size=1048576 2024-09-22T08:25:11.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.757+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.1 size=1048576 2024-09-22T08:25:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.758+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.2 size=643534 2024-09-22T08:25:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.758+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=PCJIHZZ1JMTZ tag=0JFD1LPK1X25 type=write size=3789262 2024-09-22T08:25:11.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.761+0000 7f8a8d811780 1 < suggested remove operation key=7XBR6QIHD8TJ tag=RM7HEFETIEJB type=write 2024-09-22T08:25:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.763+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=J9DIFD206BDU type=del size=1922141 2024-09-22T08:25:11.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.766+0000 7f8a8d811780 1 < suggested update operation key=QE6XEMOZMCF1 tag=MX5QG3Y71RC3 type=del size=2671115 2024-09-22T08:25:11.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.769+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~932LVTX5UWEU.0 size=1048576 2024-09-22T08:25:11.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.770+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~932LVTX5UWEU.1 size=242853 2024-09-22T08:25:11.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.770+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=932LVTX5UWEU tag=XNM7G2LQVSZ3 type=write size=2340005 2024-09-22T08:25:11.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.771+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.0 size=1048576 2024-09-22T08:25:11.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.772+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.1 size=1048576 2024-09-22T08:25:11.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.774+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~91YID4O26RS7.2 size=228405 2024-09-22T08:25:11.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.776+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=91YID4O26RS7 tag=T3CYDF732QSM type=write size=3374133 2024-09-22T08:25:11.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.777+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=FT34FI2NRMZH type=write size=479160 2024-09-22T08:25:11.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.780+0000 7f8a8d811780 1 < suggested remove operation key=RL59H41J8ZNF tag=PGZ201UL2I0X type=del 2024-09-22T08:25:11.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.782+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=8C0C4YVYB5UJ type=del size=2051674 2024-09-22T08:25:11.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.784+0000 7f8a8d811780 1 < suggested remove operation key=KIJ2DW4NSZKG tag=ZLYXHWP06ZG5 type=del 2024-09-22T08:25:11.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.787+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~YX9962O0OMIZ.0 size=576405 2024-09-22T08:25:11.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.787+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=YX9962O0OMIZ tag=Z9AJJXY1QWDQ type=write size=1624981 2024-09-22T08:25:11.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.788+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=HK1LT424XTM9 type=del 2024-09-22T08:25:11.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.790+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=1S4OBHAS4UJ0 type=write size=840683 2024-09-22T08:25:11.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.794+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=BQMTCX9Y1OSF type=write size=845370 2024-09-22T08:25:11.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.795+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=PETXAK7RUC2A type=del size=1058840 2024-09-22T08:25:11.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.796+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.0 size=1048576 2024-09-22T08:25:11.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.797+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.1 size=1048576 2024-09-22T08:25:11.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.798+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~Q9YRBF3KEJVM.2 size=179718 2024-09-22T08:25:11.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.802+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=Q9YRBF3KEJVM tag=5T366JZ54BVH type=write size=3325446 2024-09-22T08:25:11.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.804+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=17W2TX00Z86B type=del size=3297262 2024-09-22T08:25:11.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.805+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=I8YY9EH7BLC0 type=write size=92188 2024-09-22T08:25:11.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.806+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=71JV0FM9M229 type=write size=452285 2024-09-22T08:25:11.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.808+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=BP3SGUMEQYNU type=del 2024-09-22T08:25:11.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.810+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~14ZZSL1PY1CC.0 size=1048576 2024-09-22T08:25:11.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.811+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~14ZZSL1PY1CC.1 size=458734 2024-09-22T08:25:11.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.811+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=14ZZSL1PY1CC tag=54L9UW6KN5UQ type=write size=2555886 2024-09-22T08:25:11.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.813+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=XK6OGE2MG10U type=del 2024-09-22T08:25:11.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.814+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=0WTBE2IN2JCX type=del size=1694597 2024-09-22T08:25:11.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.817+0000 7f8a8d811780 1 < suggested update operation key=QE6XEMOZMCF1 tag=SXDYMNKW3NMM type=del size=444973 2024-09-22T08:25:11.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.820+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.0 size=1048576 2024-09-22T08:25:11.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.821+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.1 size=1048576 2024-09-22T08:25:11.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.822+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.2 size=456522 2024-09-22T08:25:11.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.822+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=VSDID9JTRUCX tag=A6VYG3F2SP87 type=write size=3602250 2024-09-22T08:25:11.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.824+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=NRCP5HDAXNLY type=write size=438834 2024-09-22T08:25:11.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.826+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=HO3C5W5ANTTJ type=write size=706220 2024-09-22T08:25:11.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.827+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=CJHFGTO05WRA type=del 2024-09-22T08:25:11.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.828+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=II53K0S2WFFF type=del size=570430 2024-09-22T08:25:11.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.830+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=EOUROIBDSJ8U type=del 2024-09-22T08:25:11.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.831+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=BIP1U7RLVI8F type=write size=24031 2024-09-22T08:25:11.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.835+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.0 size=1048576 2024-09-22T08:25:11.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.841+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.1 size=1048576 2024-09-22T08:25:11.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.841+0000 7f8a8d811780 1 < canceled part key=_multipart_S9JCKGZS5QLY.2~PCJIHZZ1JMTZ.2 size=643534 2024-09-22T08:25:11.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.846+0000 7f8a8d811780 1 < canceled multipart upload key=S9JCKGZS5QLY upload=PCJIHZZ1JMTZ tag=0JFD1LPK1X25 type=write size=3789262 2024-09-22T08:25:11.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.847+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=UI1AHF28VRYN type=write size=40251 2024-09-22T08:25:11.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.849+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=J9DIFD206BDU type=del 2024-09-22T08:25:11.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.851+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.0 size=1048576 2024-09-22T08:25:11.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.853+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.1 size=1048576 2024-09-22T08:25:11.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.854+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.2 size=692853 2024-09-22T08:25:11.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.854+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=R05WW3IA5U42 tag=303UKW6R2C28 type=write size=3838581 2024-09-22T08:25:11.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.856+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~932LVTX5UWEU.0 size=1048576 2024-09-22T08:25:11.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.857+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~932LVTX5UWEU.1 size=242853 2024-09-22T08:25:11.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.860+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=932LVTX5UWEU tag=XNM7G2LQVSZ3 type=write size=2340005 2024-09-22T08:25:11.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.863+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~ZO93FTEE71YB.0 size=948658 2024-09-22T08:25:11.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.863+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=ZO93FTEE71YB tag=DGP216TWNSXG type=write size=1997234 2024-09-22T08:25:11.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.864+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=FT34FI2NRMZH type=write size=479160 2024-09-22T08:25:11.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.865+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=A8D0YW5IB323 type=del size=1003725 2024-09-22T08:25:11.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.868+0000 7f8a8d811780 1 < suggested update operation key=9EY50PUC6AJJ tag=8C0C4YVYB5UJ type=del size=2051674 2024-09-22T08:25:11.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.869+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=RCS95H3YWW6Z type=del size=2234479 2024-09-22T08:25:11.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.871+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~YX9962O0OMIZ.0 size=576405 2024-09-22T08:25:11.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.873+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=YX9962O0OMIZ tag=Z9AJJXY1QWDQ type=write size=1624981 2024-09-22T08:25:11.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.875+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~E13PM5W92BLO.0 size=1048576 2024-09-22T08:25:11.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.876+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~E13PM5W92BLO.1 size=99284 2024-09-22T08:25:11.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.876+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=E13PM5W92BLO tag=9NUCYXGSG16R type=write size=2196436 2024-09-22T08:25:11.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.879+0000 7f8a8d811780 1 < suggested update operation key=2EB57FFNN986 tag=1S4OBHAS4UJ0 type=write size=840683 2024-09-22T08:25:11.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.881+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=NCRRLXHS8MNA type=del size=2538235 2024-09-22T08:25:11.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.882+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=PETXAK7RUC2A type=del size=1058840 2024-09-22T08:25:11.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.885+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.0 size=1048576 2024-09-22T08:25:11.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.886+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.1 size=1048576 2024-09-22T08:25:11.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.887+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.2 size=97397 2024-09-22T08:25:11.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.887+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=5BYCE4EU7DWT tag=HT7X06YHX92D type=write size=3243125 2024-09-22T08:25:11.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.890+0000 7f8a8d811780 1 < suggested update operation key=0AOI0OB2YFVV tag=17W2TX00Z86B type=del size=3297262 2024-09-22T08:25:11.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.891+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=FKOBMTYHC8L8 type=write size=729912 2024-09-22T08:25:11.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.894+0000 7f8a8d811780 1 < suggested update operation key=WOSCCX4WX2FN tag=71JV0FM9M229 type=write size=452285 2024-09-22T08:25:11.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.896+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=C3GTCCFOSZPG type=del size=270268 2024-09-22T08:25:11.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.897+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~14ZZSL1PY1CC.0 size=1048576 2024-09-22T08:25:11.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.898+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~14ZZSL1PY1CC.1 size=458734 2024-09-22T08:25:11.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.901+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=14ZZSL1PY1CC tag=54L9UW6KN5UQ type=write size=2555886 2024-09-22T08:25:11.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.902+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=N3CNWE5NNXJI type=del size=1205500 2024-09-22T08:25:11.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.905+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=0WTBE2IN2JCX type=del size=1694597 2024-09-22T08:25:11.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.906+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=ZY7XY7LNA3K3 type=write size=1010654 2024-09-22T08:25:11.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.907+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.0 size=1048576 2024-09-22T08:25:11.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.908+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.1 size=1048576 2024-09-22T08:25:11.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.910+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~VSDID9JTRUCX.2 size=456522 2024-09-22T08:25:11.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.913+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=VSDID9JTRUCX tag=A6VYG3F2SP87 type=write size=3602250 2024-09-22T08:25:11.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.914+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=4OUP5EN705Y6 type=del size=3961357 2024-09-22T08:25:11.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.915+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=HO3C5W5ANTTJ type=write size=706220 2024-09-22T08:25:11.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.916+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=W2J6OOIXTCFF type=write size=412459 2024-09-22T08:25:11.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.918+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=II53K0S2WFFF type=del 2024-09-22T08:25:11.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.919+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=ZKBNXDQZCNHS type=write size=374019 2024-09-22T08:25:11.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.921+0000 7f8a8d811780 1 < completed write operation key=7LLAS815MLFH tag=BIP1U7RLVI8F type=write size=24031 2024-09-22T08:25:11.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.924+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~7OXKP8SRWMJM.0 size=1048576 2024-09-22T08:25:11.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.925+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~7OXKP8SRWMJM.1 size=146245 2024-09-22T08:25:11.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.925+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=7OXKP8SRWMJM tag=6V09U5US9RY4 type=write size=2243397 2024-09-22T08:25:11.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.926+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=UI1AHF28VRYN type=write size=40251 2024-09-22T08:25:11.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.928+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=77NLVJRQKY3O type=write size=764412 2024-09-22T08:25:11.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.928+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.0 size=1048576 2024-09-22T08:25:11.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.929+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.1 size=1048576 2024-09-22T08:25:11.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.930+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~R05WW3IA5U42.2 size=692853 2024-09-22T08:25:11.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.933+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=R05WW3IA5U42 tag=303UKW6R2C28 type=write size=3838581 2024-09-22T08:25:11.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.934+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=W7L6OKZA5D5U type=write size=616461 2024-09-22T08:25:11.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.936+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~ZO93FTEE71YB.0 size=948658 2024-09-22T08:25:11.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.938+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=ZO93FTEE71YB tag=DGP216TWNSXG type=write size=1997234 2024-09-22T08:25:11.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.939+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=CNCMPV94CZN2 type=del size=1584374 2024-09-22T08:25:11.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.941+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=A8D0YW5IB323 type=del 2024-09-22T08:25:11.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.942+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=MLONUPT2VAWK type=write size=190505 2024-09-22T08:25:11.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.944+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=RCS95H3YWW6Z type=del 2024-09-22T08:25:11.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.946+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=DFZ08BYE1Q6N type=write size=80718 2024-09-22T08:25:11.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.948+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~E13PM5W92BLO.0 size=1048576 2024-09-22T08:25:11.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.950+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~E13PM5W92BLO.1 size=99284 2024-09-22T08:25:11.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.952+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=E13PM5W92BLO tag=9NUCYXGSG16R type=write size=2196436 2024-09-22T08:25:11.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.954+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~WP1SINTKDGX0.0 size=42478 2024-09-22T08:25:11.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.955+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=WP1SINTKDGX0 tag=3ZK3AA9X699D type=write size=1091054 2024-09-22T08:25:11.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.956+0000 7f8a8d811780 -1 < failed to complete operation key=WOSCCX4WX2FN tag=NCRRLXHS8MNA type=del size=2538235: (22) Invalid argument 2024-09-22T08:25:11.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.957+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=YCP8LQOJKOVU type=del size=695309 2024-09-22T08:25:11.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.959+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.0 size=1048576 2024-09-22T08:25:11.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.960+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.1 size=1048576 2024-09-22T08:25:11.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.961+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~5BYCE4EU7DWT.2 size=97397 2024-09-22T08:25:11.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.963+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=5BYCE4EU7DWT tag=HT7X06YHX92D type=write size=3243125 2024-09-22T08:25:11.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.964+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=24HEJ16EKLGT type=write size=712238 2024-09-22T08:25:11.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.966+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=FKOBMTYHC8L8 type=write size=729912 2024-09-22T08:25:11.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.968+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~DLGM3PRA8DNZ.0 size=1004834 2024-09-22T08:25:11.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.968+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=DLGM3PRA8DNZ tag=ACMQEFVIGH92 type=write size=2053410 2024-09-22T08:25:11.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.971+0000 7f8a8d811780 1 < suggested update operation key=A8TGVQ273MNF tag=C3GTCCFOSZPG type=del size=270268 2024-09-22T08:25:11.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.972+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=K7G892EFN1K2 type=del size=1398026 2024-09-22T08:25:11.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.974+0000 7f8a8d811780 1 < canceled operation key=RRTLTMWJIWSW tag=N3CNWE5NNXJI type=del size=1205500 2024-09-22T08:25:11.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.977+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~YIRAUOLIR7UY.0 size=1048576 2024-09-22T08:25:11.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.979+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~YIRAUOLIR7UY.1 size=385428 2024-09-22T08:25:11.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.979+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=YIRAUOLIR7UY tag=1THGB13PBRKA type=write size=2482580 2024-09-22T08:25:11.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.980+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=ZY7XY7LNA3K3 type=write size=1010654 2024-09-22T08:25:11.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.981+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=AOCBSIHKXIEN type=del size=1697098 2024-09-22T08:25:11.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.984+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=4OUP5EN705Y6 type=del size=3961357 2024-09-22T08:25:11.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.985+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=1DTEKYEPXNW1 type=del size=1026693 2024-09-22T08:25:11.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.987+0000 7f8a8d811780 1 < canceled operation key=5VU70RE1GJS2 tag=W2J6OOIXTCFF type=write size=412459 2024-09-22T08:25:11.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.988+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=IGGZR094JQ1Q type=del size=2308516 2024-09-22T08:25:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.990+0000 7f8a8d811780 1 < completed write operation key=1719KI1YP1FT tag=ZKBNXDQZCNHS type=write size=374019 2024-09-22T08:25:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.991+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=IEQHE4NMXT60 type=write size=221087 2024-09-22T08:25:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.992+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~7OXKP8SRWMJM.0 size=1048576 2024-09-22T08:25:11.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.993+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~7OXKP8SRWMJM.1 size=146245 2024-09-22T08:25:11.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.996+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=7OXKP8SRWMJM tag=6V09U5US9RY4 type=write size=2243397 2024-09-22T08:25:11.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.997+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=82N73K4JZZLG type=del size=3885912 2024-09-22T08:25:11.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:11.998+0000 7f8a8d811780 1 < completed write operation key=JP7IZ0CMXTSX tag=77NLVJRQKY3O type=write size=764412 2024-09-22T08:25:12.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.000+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=387PI3TSVK0I type=del size=3412736 2024-09-22T08:25:12.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.001+0000 7f8a8d811780 1 < completed write operation key=S9JCKGZS5QLY tag=W7L6OKZA5D5U type=write size=616461 2024-09-22T08:25:12.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.003+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=R076FKVGEVSA type=del size=3120011 2024-09-22T08:25:12.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.004+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=CNCMPV94CZN2 type=del 2024-09-22T08:25:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.006+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~04KVPQU9PQGQ.0 size=441209 2024-09-22T08:25:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.006+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=04KVPQU9PQGQ tag=UM327VVOC3NV type=write size=1489785 2024-09-22T08:25:12.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.008+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=MLONUPT2VAWK type=write size=190505 2024-09-22T08:25:12.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.009+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=H2DX12U0NLIT type=del size=1052920 2024-09-22T08:25:12.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.010+0000 7f8a8d811780 1 < completed write operation key=RCHUCAL6CQ4F tag=DFZ08BYE1Q6N type=write size=80718 2024-09-22T08:25:12.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.012+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=A3AOUEJ9SW9X type=del size=321382 2024-09-22T08:25:12.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.014+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~WP1SINTKDGX0.0 size=42478 2024-09-22T08:25:12.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.015+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=WP1SINTKDGX0 tag=3ZK3AA9X699D type=write size=1091054 2024-09-22T08:25:12.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.017+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=WSEEQEVNVCYO type=del size=4017390 2024-09-22T08:25:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.018+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=YCP8LQOJKOVU type=del 2024-09-22T08:25:12.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.021+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~RPVQIR2UH646.0 size=319383 2024-09-22T08:25:12.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.021+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=RPVQIR2UH646 tag=97ER5NVP712W type=write size=1367959 2024-09-22T08:25:12.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.022+0000 7f8a8d811780 1 < completed write operation key=RCHUCAL6CQ4F tag=24HEJ16EKLGT type=write size=712238 2024-09-22T08:25:12.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.024+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=HZ9XU1DU6OF4 type=del size=2215100 2024-09-22T08:25:12.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.026+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~DLGM3PRA8DNZ.0 size=1004834 2024-09-22T08:25:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.027+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=DLGM3PRA8DNZ tag=ACMQEFVIGH92 type=write size=2053410 2024-09-22T08:25:12.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.029+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~9GM7221USIHU.0 size=1048576 2024-09-22T08:25:12.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.031+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~9GM7221USIHU.1 size=68170 2024-09-22T08:25:12.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.031+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=9GM7221USIHU tag=YJOG8AK0B044 type=write size=2165322 2024-09-22T08:25:12.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.032+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=K7G892EFN1K2 type=del 2024-09-22T08:25:12.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.035+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.0 size=1048576 2024-09-22T08:25:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.036+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.1 size=1048576 2024-09-22T08:25:12.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.037+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.2 size=290497 2024-09-22T08:25:12.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.037+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=R6FFZ08XIG93 tag=LM86MG7ENJ3O type=write size=3436225 2024-09-22T08:25:12.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.038+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~YIRAUOLIR7UY.0 size=1048576 2024-09-22T08:25:12.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.039+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~YIRAUOLIR7UY.1 size=385428 2024-09-22T08:25:12.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.042+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=YIRAUOLIR7UY tag=1THGB13PBRKA type=write size=2482580 2024-09-22T08:25:12.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.044+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~YV0JN4TOZV0H.0 size=527265 2024-09-22T08:25:12.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.044+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=YV0JN4TOZV0H tag=WQW78F5QRY9J type=write size=1575841 2024-09-22T08:25:12.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.047+0000 7f8a8d811780 1 < suggested remove operation key=RL59H41J8ZNF tag=AOCBSIHKXIEN type=del 2024-09-22T08:25:12.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.049+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=8NVLFUG5WB3Q type=del size=1118970 2024-09-22T08:25:12.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.050+0000 7f8a8d811780 1 < canceled operation key=MJJPUJP2NSOK tag=1DTEKYEPXNW1 type=del size=1026693 2024-09-22T08:25:12.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.051+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=V0I9IG2FE9JL type=del size=3430707 2024-09-22T08:25:12.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.052+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=IGGZR094JQ1Q type=del 2024-09-22T08:25:12.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.055+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~8E6YNRZ4XOO0.0 size=1048576 2024-09-22T08:25:12.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.056+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~8E6YNRZ4XOO0.1 size=313146 2024-09-22T08:25:12.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.056+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=8E6YNRZ4XOO0 tag=6EXRA2M169HO type=write size=2410298 2024-09-22T08:25:12.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.057+0000 7f8a8d811780 1 < completed write operation key=RCHUCAL6CQ4F tag=IEQHE4NMXT60 type=write size=221087 2024-09-22T08:25:12.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.059+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=QKZ2U4AZ452J type=del size=3233520 2024-09-22T08:25:12.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.060+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=82N73K4JZZLG type=del 2024-09-22T08:25:12.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.061+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=ISRRLHRI22UN type=del size=138489 2024-09-22T08:25:12.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.063+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=387PI3TSVK0I type=del 2024-09-22T08:25:12.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.065+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~S9X582ZPE42M.0 size=1048576 2024-09-22T08:25:12.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.066+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~S9X582ZPE42M.1 size=590766 2024-09-22T08:25:12.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.066+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=S9X582ZPE42M tag=YQF13I0BBRGW type=write size=2687918 2024-09-22T08:25:12.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.068+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=R076FKVGEVSA type=del 2024-09-22T08:25:12.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.069+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=VU8OYVX82OMS type=del size=2722547 2024-09-22T08:25:12.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.071+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~04KVPQU9PQGQ.0 size=441209 2024-09-22T08:25:12.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.073+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=04KVPQU9PQGQ tag=UM327VVOC3NV type=write size=1489785 2024-09-22T08:25:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.075+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=OFAWALLVU45E type=del size=3564324 2024-09-22T08:25:12.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.076+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=H2DX12U0NLIT type=del 2024-09-22T08:25:12.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.080+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~LRFIFB6D881E.0 size=1048576 2024-09-22T08:25:12.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.081+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~LRFIFB6D881E.1 size=258161 2024-09-22T08:25:12.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.081+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=LRFIFB6D881E tag=FUJWAHKPC09Z type=write size=2355313 2024-09-22T08:25:12.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.082+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=A3AOUEJ9SW9X type=del 2024-09-22T08:25:12.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.083+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=YHVBYZLABB3X type=del size=2452586 2024-09-22T08:25:12.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.085+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=WSEEQEVNVCYO type=del 2024-09-22T08:25:12.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.086+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=005NIG68R0FF type=del size=4190905 2024-09-22T08:25:12.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.088+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~RPVQIR2UH646.0 size=319383 2024-09-22T08:25:12.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.090+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=RPVQIR2UH646 tag=97ER5NVP712W type=write size=1367959 2024-09-22T08:25:12.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.091+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=UNYL963YVCX6 type=del size=56334 2024-09-22T08:25:12.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.095+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=HZ9XU1DU6OF4 type=del 2024-09-22T08:25:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.096+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=LRY939JVPXYB type=del size=3097113 2024-09-22T08:25:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.097+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~9GM7221USIHU.0 size=1048576 2024-09-22T08:25:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.098+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~9GM7221USIHU.1 size=68170 2024-09-22T08:25:12.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.101+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=9GM7221USIHU tag=YJOG8AK0B044 type=write size=2165322 2024-09-22T08:25:12.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.103+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.0 size=1048576 2024-09-22T08:25:12.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.104+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.1 size=1048576 2024-09-22T08:25:12.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.105+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.2 size=608155 2024-09-22T08:25:12.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.105+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=QP927SJ931BQ tag=2FUCWV9RAK0A type=write size=3753883 2024-09-22T08:25:12.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.107+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.0 size=1048576 2024-09-22T08:25:12.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.108+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.1 size=1048576 2024-09-22T08:25:12.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.109+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~R6FFZ08XIG93.2 size=290497 2024-09-22T08:25:12.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.111+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=R6FFZ08XIG93 tag=LM86MG7ENJ3O type=write size=3436225 2024-09-22T08:25:12.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.113+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=0ZRF3L1JA0W4 type=del size=1567455 2024-09-22T08:25:12.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.115+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~YV0JN4TOZV0H.0 size=527265 2024-09-22T08:25:12.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.117+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=YV0JN4TOZV0H tag=WQW78F5QRY9J type=write size=1575841 2024-09-22T08:25:12.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.118+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=VVJV63LS30GV type=del size=3846783 2024-09-22T08:25:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.120+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=8NVLFUG5WB3Q type=del 2024-09-22T08:25:12.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.121+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=MZ8LVNHX7K9B type=del size=1345453 2024-09-22T08:25:12.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.123+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=V0I9IG2FE9JL type=del 2024-09-22T08:25:12.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.124+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=QR9P4MHTC9RF type=write size=315716 2024-09-22T08:25:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.126+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~8E6YNRZ4XOO0.0 size=1048576 2024-09-22T08:25:12.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.127+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~8E6YNRZ4XOO0.1 size=313146 2024-09-22T08:25:12.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.129+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=8E6YNRZ4XOO0 tag=6EXRA2M169HO type=write size=2410298 2024-09-22T08:25:12.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.130+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=VQOHIODE0D1R type=del size=1475790 2024-09-22T08:25:12.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.131+0000 7f8a8d811780 1 < canceled operation key=LRFF14FU7C5I tag=QKZ2U4AZ452J type=del size=3233520 2024-09-22T08:25:12.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.134+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.0 size=1048576 2024-09-22T08:25:12.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.135+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.1 size=1048576 2024-09-22T08:25:12.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.136+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.2 size=161411 2024-09-22T08:25:12.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.136+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=BT8WQOZ7I9X3 tag=JCREOSTBJ2F3 type=write size=3307139 2024-09-22T08:25:12.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.140+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=ISRRLHRI22UN type=del size=138489 2024-09-22T08:25:12.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.141+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=IFQ18IX2OP6I type=del size=2463841 2024-09-22T08:25:12.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.143+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~S9X582ZPE42M.0 size=1048576 2024-09-22T08:25:12.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.144+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~S9X582ZPE42M.1 size=590766 2024-09-22T08:25:12.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.146+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=S9X582ZPE42M tag=YQF13I0BBRGW type=write size=2687918 2024-09-22T08:25:12.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.148+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.0 size=1048576 2024-09-22T08:25:12.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.149+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.1 size=1048576 2024-09-22T08:25:12.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.150+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.2 size=346543 2024-09-22T08:25:12.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.150+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=83V1TN6B8FS5 tag=K832GUGVB3S5 type=write size=3492271 2024-09-22T08:25:12.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.152+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=VU8OYVX82OMS type=del 2024-09-22T08:25:12.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.153+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=J31Y60ILGYD2 type=del size=2688543 2024-09-22T08:25:12.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.157+0000 7f8a8d811780 1 < suggested remove operation key=0AOI0OB2YFVV tag=OFAWALLVU45E type=del 2024-09-22T08:25:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.158+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=JL391GEOJ8HL type=del size=1062439 2024-09-22T08:25:12.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.159+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~LRFIFB6D881E.0 size=1048576 2024-09-22T08:25:12.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.162+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~LRFIFB6D881E.1 size=258161 2024-09-22T08:25:12.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.164+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=LRFIFB6D881E tag=FUJWAHKPC09Z type=write size=2355313 2024-09-22T08:25:12.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.166+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=TQUPRNXBNOUM type=del size=3144894 2024-09-22T08:25:12.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.169+0000 7f8a8d811780 1 < suggested remove operation key=911851NVIUQS tag=YHVBYZLABB3X type=del 2024-09-22T08:25:12.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.171+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.0 size=1048576 2024-09-22T08:25:12.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.172+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.1 size=1048576 2024-09-22T08:25:12.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.173+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.2 size=617560 2024-09-22T08:25:12.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.173+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=LIXQ8BV6QTB4 tag=V8TEIBI02F8V type=write size=3763288 2024-09-22T08:25:12.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.175+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=005NIG68R0FF type=del 2024-09-22T08:25:12.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.176+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=HKPPFVOGAZ73 type=del size=957403 2024-09-22T08:25:12.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.177+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=UNYL963YVCX6 type=del 2024-09-22T08:25:12.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.179+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=UDU7ZJA5J213 type=del size=650693 2024-09-22T08:25:12.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.179+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=0AOI0OB2YFVV tag=LRY939JVPXYB type=del size=3097113: (2) No such file or directory 2024-09-22T08:25:12.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.181+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=4DA1AAQNATUU type=del size=656223 2024-09-22T08:25:12.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.182+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.0 size=1048576 2024-09-22T08:25:12.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.184+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.1 size=1048576 2024-09-22T08:25:12.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.186+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~QP927SJ931BQ.2 size=608155 2024-09-22T08:25:12.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.187+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=QP927SJ931BQ tag=2FUCWV9RAK0A type=write size=3753883 2024-09-22T08:25:12.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.190+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=P1VDCF7FKPW7 type=del size=3441985 2024-09-22T08:25:12.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.191+0000 7f8a8d811780 -1 < failed to complete operation key=PIRW8N555T52 tag=0ZRF3L1JA0W4 type=del size=1567455: (22) Invalid argument 2024-09-22T08:25:12.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.193+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=L05Y30XBNKF9 type=del size=2556853 2024-09-22T08:25:12.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.194+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=VVJV63LS30GV type=del 2024-09-22T08:25:12.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.195+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=0WVZ820COY5E type=del size=1160267 2024-09-22T08:25:12.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.198+0000 7f8a8d811780 1 < suggested remove operation key=226G7R10IR1B tag=MZ8LVNHX7K9B type=del 2024-09-22T08:25:12.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.199+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=8OA4ZIK7TAEK type=del size=886688 2024-09-22T08:25:12.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.202+0000 7f8a8d811780 1 < suggested update operation key=9EY50PUC6AJJ tag=QR9P4MHTC9RF type=write size=315716 2024-09-22T08:25:12.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.204+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~ARKJ7BEJIG78.0 size=17851 2024-09-22T08:25:12.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.204+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=ARKJ7BEJIG78 tag=7MS4X5VQWI7A type=write size=1066427 2024-09-22T08:25:12.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.206+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=VQOHIODE0D1R type=del 2024-09-22T08:25:12.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.207+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=2SGBOG7XMEV8 type=del size=4176283 2024-09-22T08:25:12.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.208+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.0 size=1048576 2024-09-22T08:25:12.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.210+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.1 size=1048576 2024-09-22T08:25:12.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.211+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~BT8WQOZ7I9X3.2 size=161411 2024-09-22T08:25:12.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.214+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=BT8WQOZ7I9X3 tag=JCREOSTBJ2F3 type=write size=3307139 2024-09-22T08:25:12.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.216+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=Y8WZF6I2Y1AW type=write size=309233 2024-09-22T08:25:12.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.217+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=IFQ18IX2OP6I type=del 2024-09-22T08:25:12.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.219+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=T1XR7H9HLJQG type=del size=1756486 2024-09-22T08:25:12.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.220+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.0 size=1048576 2024-09-22T08:25:12.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.221+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.1 size=1048576 2024-09-22T08:25:12.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.222+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~83V1TN6B8FS5.2 size=346543 2024-09-22T08:25:12.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.225+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=83V1TN6B8FS5 tag=K832GUGVB3S5 type=write size=3492271 2024-09-22T08:25:12.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.226+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=LS3L8P226Y42 type=del size=1279188 2024-09-22T08:25:12.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.228+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=J31Y60ILGYD2 type=del 2024-09-22T08:25:12.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.231+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.0 size=1048576 2024-09-22T08:25:12.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.232+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.1 size=1048576 2024-09-22T08:25:12.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.233+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.2 size=435186 2024-09-22T08:25:12.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.233+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=K5R7FKC930Y0 tag=CSD1ABDL22OJ type=write size=3580914 2024-09-22T08:25:12.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.234+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=JL391GEOJ8HL type=del size=1062439 2024-09-22T08:25:12.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.237+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.0 size=1048576 2024-09-22T08:25:12.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.238+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.1 size=1048576 2024-09-22T08:25:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.239+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.2 size=617919 2024-09-22T08:25:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.239+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=NR3RK9KU2G91 tag=U47DPA1308F2 type=write size=3763647 2024-09-22T08:25:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.240+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=TQUPRNXBNOUM type=del 2024-09-22T08:25:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.243+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.0 size=1048576 2024-09-22T08:25:12.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.244+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.1 size=1048576 2024-09-22T08:25:12.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.245+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.2 size=804868 2024-09-22T08:25:12.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.245+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=7AUCCLRQV825 tag=WFZ4Z5L51VMF type=write size=3950596 2024-09-22T08:25:12.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.246+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.0 size=1048576 2024-09-22T08:25:12.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.247+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.1 size=1048576 2024-09-22T08:25:12.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.248+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~LIXQ8BV6QTB4.2 size=617560 2024-09-22T08:25:12.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.251+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=LIXQ8BV6QTB4 tag=V8TEIBI02F8V type=write size=3763288 2024-09-22T08:25:12.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.254+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~DBR3DUU2HHFO.0 size=1048576 2024-09-22T08:25:12.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.255+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~DBR3DUU2HHFO.1 size=962478 2024-09-22T08:25:12.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.255+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=DBR3DUU2HHFO tag=8GLJFMP5W5LA type=write size=3059630 2024-09-22T08:25:12.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.258+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=HKPPFVOGAZ73 type=del 2024-09-22T08:25:12.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.260+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=Z1SQ7W25SBGV type=del size=2533681 2024-09-22T08:25:12.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.262+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=UDU7ZJA5J213 type=del 2024-09-22T08:25:12.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.263+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=K1CJVPEG6R20 type=del size=1409352 2024-09-22T08:25:12.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.264+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=4DA1AAQNATUU type=del 2024-09-22T08:25:12.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.266+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=3626S67FSOL1 type=del size=809534 2024-09-22T08:25:12.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.268+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=P1VDCF7FKPW7 type=del 2024-09-22T08:25:12.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.269+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=F3EOQ7QOUHL0 type=del size=1495929 2024-09-22T08:25:12.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.271+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=L05Y30XBNKF9 type=del 2024-09-22T08:25:12.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.274+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~2YKRTOQSHE5H.0 size=694691 2024-09-22T08:25:12.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.274+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=2YKRTOQSHE5H tag=23S2KW7A3SKQ type=write size=1743267 2024-09-22T08:25:12.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.276+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=0WVZ820COY5E type=del 2024-09-22T08:25:12.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.277+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=TB1ESL4PV030 type=del size=859831 2024-09-22T08:25:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.278+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=8OA4ZIK7TAEK type=del 2024-09-22T08:25:12.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.279+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=X0B7QAE8Y6LR type=write size=635552 2024-09-22T08:25:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.281+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~ARKJ7BEJIG78.0 size=17851 2024-09-22T08:25:12.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.283+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=ARKJ7BEJIG78 tag=7MS4X5VQWI7A type=write size=1066427 2024-09-22T08:25:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.284+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=3LK59JPSK61G type=del size=1303958 2024-09-22T08:25:12.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.286+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=2SGBOG7XMEV8 type=del 2024-09-22T08:25:12.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.289+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.0 size=1048576 2024-09-22T08:25:12.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.290+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.1 size=1048576 2024-09-22T08:25:12.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.291+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.2 size=1031068 2024-09-22T08:25:12.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.291+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=26LZTQD0UAHU tag=DDH0WGTDK75Q type=write size=4176796 2024-09-22T08:25:12.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.291+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=7XNMR51803Y6 tag=Y8WZF6I2Y1AW type=write size=309233: (2) No such file or directory 2024-09-22T08:25:12.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.293+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=WX0H1YZET63W type=del size=2937950 2024-09-22T08:25:12.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.294+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=T1XR7H9HLJQG type=del 2024-09-22T08:25:12.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.296+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=RJ1UO3Z6S9LK type=del size=1672197 2024-09-22T08:25:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.298+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=LS3L8P226Y42 type=del 2024-09-22T08:25:12.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.301+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~KPL78V4U7IKB.0 size=698923 2024-09-22T08:25:12.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.301+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=KPL78V4U7IKB tag=4322XISU65HM type=write size=1747499 2024-09-22T08:25:12.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.302+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.0 size=1048576 2024-09-22T08:25:12.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.303+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.1 size=1048576 2024-09-22T08:25:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.305+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~K5R7FKC930Y0.2 size=435186 2024-09-22T08:25:12.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.308+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=K5R7FKC930Y0 tag=CSD1ABDL22OJ type=write size=3580914 2024-09-22T08:25:12.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.309+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=Q4SWCU1RZDNU type=del size=502633 2024-09-22T08:25:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.310+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.0 size=1048576 2024-09-22T08:25:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.310+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.1 size=1048576 2024-09-22T08:25:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.311+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~NR3RK9KU2G91.2 size=617919 2024-09-22T08:25:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.314+0000 7f8a8d811780 1 < canceled multipart upload key=226G7R10IR1B upload=NR3RK9KU2G91 tag=U47DPA1308F2 type=write size=3763647 2024-09-22T08:25:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.315+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=13LSCC1NQN1S type=del size=680424 2024-09-22T08:25:12.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.317+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.0 size=1048576 2024-09-22T08:25:12.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.318+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.1 size=1048576 2024-09-22T08:25:12.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.319+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~7AUCCLRQV825.2 size=804868 2024-09-22T08:25:12.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.321+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=7AUCCLRQV825 tag=WFZ4Z5L51VMF type=write size=3950596 2024-09-22T08:25:12.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.323+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=D6YGZ3CGARIX type=del size=4185796 2024-09-22T08:25:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.325+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~DBR3DUU2HHFO.0 size=1048576 2024-09-22T08:25:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.325+0000 7f8a8d811780 1 < canceled part key=_multipart_RRTLTMWJIWSW.2~DBR3DUU2HHFO.1 size=962478 2024-09-22T08:25:12.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.327+0000 7f8a8d811780 1 < canceled multipart upload key=RRTLTMWJIWSW upload=DBR3DUU2HHFO tag=8GLJFMP5W5LA type=write size=3059630 2024-09-22T08:25:12.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.328+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=V8Y2L6GM4W65 type=del size=2027713 2024-09-22T08:25:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.330+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=Z1SQ7W25SBGV type=del 2024-09-22T08:25:12.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.333+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~DAK0DW9HSF39.0 size=1048576 2024-09-22T08:25:12.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.334+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~DAK0DW9HSF39.1 size=990108 2024-09-22T08:25:12.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.334+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=DAK0DW9HSF39 tag=6DUYDU6RU1Y0 type=write size=3087260 2024-09-22T08:25:12.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.335+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=K1CJVPEG6R20 type=del 2024-09-22T08:25:12.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.336+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=BZQ7WE2FMJT1 type=del size=958541 2024-09-22T08:25:12.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.338+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=3626S67FSOL1 type=del 2024-09-22T08:25:12.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.339+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=AD0LHGY6YA7O type=del size=3808155 2024-09-22T08:25:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.341+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=F3EOQ7QOUHL0 type=del 2024-09-22T08:25:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.342+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=HNHK12S6SOAE type=del size=2483431 2024-09-22T08:25:12.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.344+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~2YKRTOQSHE5H.0 size=694691 2024-09-22T08:25:12.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.346+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=2YKRTOQSHE5H tag=23S2KW7A3SKQ type=write size=1743267 2024-09-22T08:25:12.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.347+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=XZVRAMR9TSO1 type=del size=791781 2024-09-22T08:25:12.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.348+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=TB1ESL4PV030 type=del 2024-09-22T08:25:12.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.350+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=QXU7G1A42QA3 type=del size=2176408 2024-09-22T08:25:12.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.352+0000 7f8a8d811780 1 < canceled operation key=0AOI0OB2YFVV tag=X0B7QAE8Y6LR type=write size=635552 2024-09-22T08:25:12.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.353+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=IYO40NZW8KL0 type=del size=1148079 2024-09-22T08:25:12.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.354+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=3LK59JPSK61G type=del 2024-09-22T08:25:12.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.357+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~QFQC7E0ZA5EB.0 size=1045516 2024-09-22T08:25:12.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.357+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=QFQC7E0ZA5EB tag=VMRC7WYYQB4H type=write size=2094092 2024-09-22T08:25:12.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.358+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.0 size=1048576 2024-09-22T08:25:12.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.358+0000 7f8a8d811780 1 < canceled part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.1 size=1048576 2024-09-22T08:25:12.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.360+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~26LZTQD0UAHU.2 size=1031068 2024-09-22T08:25:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.362+0000 7f8a8d811780 1 < canceled multipart upload key=7XBR6QIHD8TJ upload=26LZTQD0UAHU tag=DDH0WGTDK75Q type=write size=4176796 2024-09-22T08:25:12.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.365+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~U3FA8TPVQM0J.0 size=1048576 2024-09-22T08:25:12.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.366+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~U3FA8TPVQM0J.1 size=38778 2024-09-22T08:25:12.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.366+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=U3FA8TPVQM0J tag=6I762F4IK5L2 type=write size=2135930 2024-09-22T08:25:12.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.368+0000 7f8a8d811780 1 < suggested update operation key=911851NVIUQS tag=WX0H1YZET63W type=del size=2937950 2024-09-22T08:25:12.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.371+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~56MSXMISLN7M.0 size=1048576 2024-09-22T08:25:12.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.372+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~56MSXMISLN7M.1 size=192331 2024-09-22T08:25:12.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.372+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=56MSXMISLN7M tag=O6JPNDUFPQSQ type=write size=2289483 2024-09-22T08:25:12.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.374+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=RJ1UO3Z6S9LK type=del 2024-09-22T08:25:12.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.376+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=0L8EUD51KX7K type=del size=847741 2024-09-22T08:25:12.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.377+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~KPL78V4U7IKB.0 size=698923 2024-09-22T08:25:12.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.379+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=KPL78V4U7IKB tag=4322XISU65HM type=write size=1747499 2024-09-22T08:25:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.380+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=QP080WG229K7 type=del size=2963209 2024-09-22T08:25:12.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.382+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=Q4SWCU1RZDNU type=del 2024-09-22T08:25:12.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.383+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=XZXSPRJRTDS7 type=write size=55701 2024-09-22T08:25:12.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.385+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=13LSCC1NQN1S type=del 2024-09-22T08:25:12.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.387+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.0 size=1048576 2024-09-22T08:25:12.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.388+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.1 size=1048576 2024-09-22T08:25:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.389+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.2 size=735539 2024-09-22T08:25:12.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.389+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=LA5H3SZ283K0 tag=Y99ZZQPP4AF9 type=write size=3881267 2024-09-22T08:25:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.392+0000 7f8a8d811780 1 < suggested remove operation key=MJJPUJP2NSOK tag=D6YGZ3CGARIX type=del 2024-09-22T08:25:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.394+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=YM8AMAQ7FB5E type=del size=3236088 2024-09-22T08:25:12.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.395+0000 7f8a8d811780 -1 < failed to complete operation key=911851NVIUQS tag=V8Y2L6GM4W65 type=del size=2027713: (22) Invalid argument 2024-09-22T08:25:12.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.396+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=0UI5UK7GXZFW type=del size=1607273 2024-09-22T08:25:12.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.397+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~DAK0DW9HSF39.0 size=1048576 2024-09-22T08:25:12.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.398+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~DAK0DW9HSF39.1 size=990108 2024-09-22T08:25:12.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.401+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=DAK0DW9HSF39 tag=6DUYDU6RU1Y0 type=write size=3087260 2024-09-22T08:25:12.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.404+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.0 size=1048576 2024-09-22T08:25:12.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.405+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.1 size=1048576 2024-09-22T08:25:12.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.406+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.2 size=1004209 2024-09-22T08:25:12.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.406+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=X8DUYSCR5D64 tag=7E8DDHGRDS37 type=write size=4149937 2024-09-22T08:25:12.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.407+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=BZQ7WE2FMJT1 type=del 2024-09-22T08:25:12.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.408+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=UZ93YHD48NBX type=del size=3188414 2024-09-22T08:25:12.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.410+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=AD0LHGY6YA7O type=del 2024-09-22T08:25:12.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.412+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=OURUEI48NJXM type=del size=4101297 2024-09-22T08:25:12.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.414+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=HNHK12S6SOAE type=del 2024-09-22T08:25:12.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.416+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=VA6XE9P30PMG type=del size=3857671 2024-09-22T08:25:12.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.417+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=XZVRAMR9TSO1 type=del 2024-09-22T08:25:12.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.419+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=9L83W9OYKXXG type=del size=2525518 2024-09-22T08:25:12.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.421+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=QXU7G1A42QA3 type=del 2024-09-22T08:25:12.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.423+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=YSHIM4X5TIPC type=del size=1304915 2024-09-22T08:25:12.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.424+0000 7f8a8d811780 -1 < failed to complete operation key=5VU70RE1GJS2 tag=IYO40NZW8KL0 type=del size=1148079: (22) Invalid argument 2024-09-22T08:25:12.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.426+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=DD8TP8FCFEC8 type=del size=1324724 2024-09-22T08:25:12.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.428+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~QFQC7E0ZA5EB.0 size=1045516 2024-09-22T08:25:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.429+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=QFQC7E0ZA5EB tag=VMRC7WYYQB4H type=write size=2094092 2024-09-22T08:25:12.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.431+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=A50JXY4DGHAH type=del size=177584 2024-09-22T08:25:12.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.432+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~U3FA8TPVQM0J.0 size=1048576 2024-09-22T08:25:12.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.433+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~U3FA8TPVQM0J.1 size=38778 2024-09-22T08:25:12.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.436+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=U3FA8TPVQM0J tag=6I762F4IK5L2 type=write size=2135930 2024-09-22T08:25:12.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.437+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=WS3ON8JF29HY type=del size=1725205 2024-09-22T08:25:12.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.439+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~56MSXMISLN7M.0 size=1048576 2024-09-22T08:25:12.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.440+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~56MSXMISLN7M.1 size=192331 2024-09-22T08:25:12.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.443+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=56MSXMISLN7M tag=O6JPNDUFPQSQ type=write size=2289483 2024-09-22T08:25:12.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.444+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=TNQZZ0GU7Q1L type=write size=106958 2024-09-22T08:25:12.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.446+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=0L8EUD51KX7K type=del 2024-09-22T08:25:12.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.449+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~KPQPHDIJZLRP.0 size=242505 2024-09-22T08:25:12.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.449+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=KPQPHDIJZLRP tag=09USA1ETWNDN type=write size=1291081 2024-09-22T08:25:12.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.450+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=QP080WG229K7 type=del 2024-09-22T08:25:12.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.452+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=K3J44Y5LYHSX type=del size=3500867 2024-09-22T08:25:12.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.453+0000 7f8a8d811780 1 < completed write operation key=KIJ2DW4NSZKG tag=XZXSPRJRTDS7 type=write size=55701 2024-09-22T08:25:12.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.456+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.0 size=1048576 2024-09-22T08:25:12.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.457+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.1 size=1048576 2024-09-22T08:25:12.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.458+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.2 size=34666 2024-09-22T08:25:12.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.458+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=6GJTUW7ID9V5 tag=GWYOZ7ICEBSQ type=write size=3180394 2024-09-22T08:25:12.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.460+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.0 size=1048576 2024-09-22T08:25:12.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.461+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.1 size=1048576 2024-09-22T08:25:12.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.461+0000 7f8a8d811780 1 < canceled part key=_multipart_RCHUCAL6CQ4F.2~LA5H3SZ283K0.2 size=735539 2024-09-22T08:25:12.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.463+0000 7f8a8d811780 1 < canceled multipart upload key=RCHUCAL6CQ4F upload=LA5H3SZ283K0 tag=Y99ZZQPP4AF9 type=write size=3881267 2024-09-22T08:25:12.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.465+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=T47LNPW65RXK type=del size=3038481 2024-09-22T08:25:12.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.466+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=YM8AMAQ7FB5E type=del 2024-09-22T08:25:12.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.467+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=BUN4QUR94JN9 type=del size=3137230 2024-09-22T08:25:12.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.469+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=0UI5UK7GXZFW type=del 2024-09-22T08:25:12.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.472+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~PIQRC41YL8JC.0 size=1048576 2024-09-22T08:25:12.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.473+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~PIQRC41YL8JC.1 size=336851 2024-09-22T08:25:12.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.473+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=PIQRC41YL8JC tag=DCL8F6HDN5GN type=write size=2434003 2024-09-22T08:25:12.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.475+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.0 size=1048576 2024-09-22T08:25:12.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.476+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.1 size=1048576 2024-09-22T08:25:12.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.477+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~X8DUYSCR5D64.2 size=1004209 2024-09-22T08:25:12.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.479+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=X8DUYSCR5D64 tag=7E8DDHGRDS37 type=write size=4149937 2024-09-22T08:25:12.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.481+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=RH1ZZIVF4KZW type=del size=384990 2024-09-22T08:25:12.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.483+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=UZ93YHD48NBX type=del 2024-09-22T08:25:12.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.484+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=UG1U9L5KZWC5 type=del size=289182 2024-09-22T08:25:12.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.486+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=OURUEI48NJXM type=del 2024-09-22T08:25:12.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.488+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=PYKSYIWEQD9O type=del size=3539114 2024-09-22T08:25:12.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.489+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=VA6XE9P30PMG type=del 2024-09-22T08:25:12.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.492+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~R07RWEDP2AM2.0 size=1048576 2024-09-22T08:25:12.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.494+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~R07RWEDP2AM2.1 size=793890 2024-09-22T08:25:12.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.494+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=R07RWEDP2AM2 tag=J9ASBDZUG3J2 type=write size=2891042 2024-09-22T08:25:12.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.494+0000 7f8a8d811780 1 < canceled operation key=3T2TX83CSE2D tag=9L83W9OYKXXG type=del size=2525518 2024-09-22T08:25:12.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.496+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=F254IFHGZ0WE type=del size=3499306 2024-09-22T08:25:12.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.498+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=YSHIM4X5TIPC type=del 2024-09-22T08:25:12.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.499+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=XP6TFRKNXXP1 type=del size=3371470 2024-09-22T08:25:12.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.501+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=DD8TP8FCFEC8 type=del 2024-09-22T08:25:12.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.504+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.0 size=1048576 2024-09-22T08:25:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.505+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.1 size=1048576 2024-09-22T08:25:12.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.506+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.2 size=1014388 2024-09-22T08:25:12.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.506+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=KNMN7C7SAJPM tag=LS5K2IE3PCU7 type=write size=4160116 2024-09-22T08:25:12.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.508+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=A50JXY4DGHAH type=del 2024-09-22T08:25:12.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.510+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.0 size=1048576 2024-09-22T08:25:12.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.512+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.1 size=1048576 2024-09-22T08:25:12.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.513+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.2 size=446570 2024-09-22T08:25:12.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.513+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=9HPRP2T0OL3S tag=JAPDE4CLLK3G type=write size=3592298 2024-09-22T08:25:12.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.514+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=WS3ON8JF29HY type=del 2024-09-22T08:25:12.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.516+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=6Y0DB3UL4XT5 type=write size=97904 2024-09-22T08:25:12.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.517+0000 7f8a8d811780 1 < completed write operation key=S9JCKGZS5QLY tag=TNQZZ0GU7Q1L type=write size=106958 2024-09-22T08:25:12.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.519+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=I1BWEJUSVAHK type=write size=562877 2024-09-22T08:25:12.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.519+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~KPQPHDIJZLRP.0 size=242505 2024-09-22T08:25:12.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.522+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=KPQPHDIJZLRP tag=09USA1ETWNDN type=write size=1291081 2024-09-22T08:25:12.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.525+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~AHKM3HCJ57YD.0 size=1048576 2024-09-22T08:25:12.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.526+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~AHKM3HCJ57YD.1 size=624487 2024-09-22T08:25:12.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.526+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=AHKM3HCJ57YD tag=W9N1EYCDWLXC type=write size=2721639 2024-09-22T08:25:12.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.528+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=K3J44Y5LYHSX type=del 2024-09-22T08:25:12.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.530+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=45KHS5M7MTJA type=del size=2870850 2024-09-22T08:25:12.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.531+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.0 size=1048576 2024-09-22T08:25:12.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.532+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.1 size=1048576 2024-09-22T08:25:12.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.532+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~6GJTUW7ID9V5.2 size=34666 2024-09-22T08:25:12.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.536+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=6GJTUW7ID9V5 tag=GWYOZ7ICEBSQ type=write size=3180394 2024-09-22T08:25:12.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.537+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=DC8JNXO55M1B type=del size=4056253 2024-09-22T08:25:12.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.538+0000 7f8a8d811780 1 < canceled operation key=7XBR6QIHD8TJ tag=T47LNPW65RXK type=del size=3038481 2024-09-22T08:25:12.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.540+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=AS5N349XC7KV type=del size=610140 2024-09-22T08:25:12.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.542+0000 7f8a8d811780 1 < suggested update operation key=WR1JR0APSOKN tag=BUN4QUR94JN9 type=del size=3137230 2024-09-22T08:25:12.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.544+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=WQBJU3ZPV19M type=write size=1010043 2024-09-22T08:25:12.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.546+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~PIQRC41YL8JC.0 size=1048576 2024-09-22T08:25:12.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.547+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~PIQRC41YL8JC.1 size=336851 2024-09-22T08:25:12.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.549+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=PIQRC41YL8JC tag=DCL8F6HDN5GN type=write size=2434003 2024-09-22T08:25:12.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.551+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~M1NQMUWP2K8U.0 size=1048576 2024-09-22T08:25:12.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.552+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~M1NQMUWP2K8U.1 size=986917 2024-09-22T08:25:12.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.552+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=M1NQMUWP2K8U tag=0OOJ1QC2K0JT type=write size=3084069 2024-09-22T08:25:12.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.554+0000 7f8a8d811780 1 < canceled operation key=1719KI1YP1FT tag=RH1ZZIVF4KZW type=del size=384990 2024-09-22T08:25:12.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.555+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=SRW5PO008XJD type=del size=3889912 2024-09-22T08:25:12.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.557+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=UG1U9L5KZWC5 type=del 2024-09-22T08:25:12.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.558+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=P8E37F4UL028 type=del size=214346 2024-09-22T08:25:12.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.561+0000 7f8a8d811780 1 < suggested remove operation key=WOSCCX4WX2FN tag=PYKSYIWEQD9O type=del 2024-09-22T08:25:12.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.562+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=0TGNYPPJN4KQ type=del size=2292681 2024-09-22T08:25:12.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.563+0000 7f8a8d811780 1 < canceled part key=_multipart_T5IAHQ3CUIFR.2~R07RWEDP2AM2.0 size=1048576 2024-09-22T08:25:12.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.564+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~R07RWEDP2AM2.1 size=793890 2024-09-22T08:25:12.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.566+0000 7f8a8d811780 1 < canceled multipart upload key=T5IAHQ3CUIFR upload=R07RWEDP2AM2 tag=J9ASBDZUG3J2 type=write size=2891042 2024-09-22T08:25:12.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.567+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=7ILBIP5S9R6K type=del size=3416852 2024-09-22T08:25:12.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.569+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=F254IFHGZ0WE type=del 2024-09-22T08:25:12.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.571+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~1OY6KDEVAU3L.0 size=1048576 2024-09-22T08:25:12.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.572+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~1OY6KDEVAU3L.1 size=786080 2024-09-22T08:25:12.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.572+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=1OY6KDEVAU3L tag=F23EAPLPOZMS type=write size=2883232 2024-09-22T08:25:12.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.574+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=XP6TFRKNXXP1 type=del 2024-09-22T08:25:12.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.575+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=JPST9H4U6Z9K type=del size=3818116 2024-09-22T08:25:12.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.577+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.0 size=1048576 2024-09-22T08:25:12.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.578+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.1 size=1048576 2024-09-22T08:25:12.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.579+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~KNMN7C7SAJPM.2 size=1014388 2024-09-22T08:25:12.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.581+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=KNMN7C7SAJPM tag=LS5K2IE3PCU7 type=write size=4160116 2024-09-22T08:25:12.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.582+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=ZGO9JOVYMU9D type=del size=222264 2024-09-22T08:25:12.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.584+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.0 size=1048576 2024-09-22T08:25:12.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.586+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.1 size=1048576 2024-09-22T08:25:12.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.586+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~9HPRP2T0OL3S.2 size=446570 2024-09-22T08:25:12.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.590+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=9HPRP2T0OL3S tag=JAPDE4CLLK3G type=write size=3592298 2024-09-22T08:25:12.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.590+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=HE7HYJQLT22B type=write size=48430 2024-09-22T08:25:12.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.592+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=6Y0DB3UL4XT5 type=write size=97904 2024-09-22T08:25:12.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.593+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=1X2OOT2G160G type=del size=3968983 2024-09-22T08:25:12.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.595+0000 7f8a8d811780 1 < canceled operation key=IOZ7IXVOB70S tag=I1BWEJUSVAHK type=write size=562877 2024-09-22T08:25:12.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.596+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=8TL4T73EWT59 type=del size=1740480 2024-09-22T08:25:12.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.598+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~AHKM3HCJ57YD.0 size=1048576 2024-09-22T08:25:12.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.599+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~AHKM3HCJ57YD.1 size=624487 2024-09-22T08:25:12.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.601+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=AHKM3HCJ57YD tag=W9N1EYCDWLXC type=write size=2721639 2024-09-22T08:25:12.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.602+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=2941ZFWQ6NQG type=del size=4086922 2024-09-22T08:25:12.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.604+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=45KHS5M7MTJA type=del 2024-09-22T08:25:12.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.606+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.0 size=1048576 2024-09-22T08:25:12.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.607+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.1 size=1048576 2024-09-22T08:25:12.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.609+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.2 size=634753 2024-09-22T08:25:12.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.609+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=TSHOCT21L6NP tag=1BE7G0KYNGS2 type=write size=3780481 2024-09-22T08:25:12.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.611+0000 7f8a8d811780 1 < suggested update operation key=KIJ2DW4NSZKG tag=DC8JNXO55M1B type=del size=4056253 2024-09-22T08:25:12.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.614+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~TWCVI0KWOYWF.0 size=85344 2024-09-22T08:25:12.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.614+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=TWCVI0KWOYWF tag=6Z592VOZLN8M type=write size=1133920 2024-09-22T08:25:12.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.615+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=AS5N349XC7KV type=del 2024-09-22T08:25:12.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.618+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.0 size=1048576 2024-09-22T08:25:12.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.620+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.1 size=1048576 2024-09-22T08:25:12.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.621+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.2 size=282276 2024-09-22T08:25:12.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.621+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=LHNK1540IPJH tag=F6UKECMNEDJ2 type=write size=3428004 2024-09-22T08:25:12.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.624+0000 7f8a8d811780 1 < completed write operation key=RRTLTMWJIWSW tag=WQBJU3ZPV19M type=write size=1010043 2024-09-22T08:25:12.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.625+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=MQHAUD13PKN5 type=write size=586853 2024-09-22T08:25:12.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.627+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~M1NQMUWP2K8U.0 size=1048576 2024-09-22T08:25:12.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.627+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~M1NQMUWP2K8U.1 size=986917 2024-09-22T08:25:12.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.629+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=M1NQMUWP2K8U tag=0OOJ1QC2K0JT type=write size=3084069 2024-09-22T08:25:12.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.632+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~44QLO11YKUDT.0 size=1048576 2024-09-22T08:25:12.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.633+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~44QLO11YKUDT.1 size=500562 2024-09-22T08:25:12.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.633+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=44QLO11YKUDT tag=5U1P4694ON1G type=write size=2597714 2024-09-22T08:25:12.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.634+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=SRW5PO008XJD type=del 2024-09-22T08:25:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.636+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=H1B5FEU3THLD type=del size=1391186 2024-09-22T08:25:12.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.637+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=P8E37F4UL028 type=del 2024-09-22T08:25:12.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.640+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.0 size=1048576 2024-09-22T08:25:12.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.641+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.1 size=1048576 2024-09-22T08:25:12.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.642+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.2 size=625060 2024-09-22T08:25:12.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.642+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=L0FF4INM39C2 tag=WDIL79ZJ59QK type=write size=3770788 2024-09-22T08:25:12.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.643+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=0TGNYPPJN4KQ type=del 2024-09-22T08:25:12.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.645+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=Q0TDQZJRV9YF type=del size=349798 2024-09-22T08:25:12.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.646+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=7ILBIP5S9R6K type=del 2024-09-22T08:25:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.649+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.0 size=1048576 2024-09-22T08:25:12.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.650+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.1 size=1048576 2024-09-22T08:25:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.651+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.2 size=812101 2024-09-22T08:25:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.651+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=02UDLLXE6WWC tag=12A9WXYJZ9L9 type=write size=3957829 2024-09-22T08:25:12.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.652+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~1OY6KDEVAU3L.0 size=1048576 2024-09-22T08:25:12.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.653+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~1OY6KDEVAU3L.1 size=786080 2024-09-22T08:25:12.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.656+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=1OY6KDEVAU3L tag=F23EAPLPOZMS type=write size=2883232 2024-09-22T08:25:12.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.657+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=HHLC958056SB type=del size=3232057 2024-09-22T08:25:12.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.658+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=JPST9H4U6Z9K type=del 2024-09-22T08:25:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.659+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=B1IYBW7RD117 type=del size=752760 2024-09-22T08:25:12.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.661+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=ZGO9JOVYMU9D type=del 2024-09-22T08:25:12.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.662+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=EVYSBZA7XOWL type=del size=3327384 2024-09-22T08:25:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.665+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=HE7HYJQLT22B type=write size=48430 2024-09-22T08:25:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.666+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=AM5D04XLZ44K type=write size=151687 2024-09-22T08:25:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.668+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=1X2OOT2G160G type=del 2024-09-22T08:25:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.671+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~8ZA4KFXZQY0K.0 size=1048576 2024-09-22T08:25:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.672+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~8ZA4KFXZQY0K.1 size=247827 2024-09-22T08:25:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.672+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=8ZA4KFXZQY0K tag=BZMSJGULK3I3 type=write size=2344979 2024-09-22T08:25:12.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.674+0000 7f8a8d811780 1 < suggested remove operation key=JP7IZ0CMXTSX tag=8TL4T73EWT59 type=del 2024-09-22T08:25:12.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.676+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=29T2N7LA1DR8 type=write size=400320 2024-09-22T08:25:12.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.677+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=2941ZFWQ6NQG type=del 2024-09-22T08:25:12.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.680+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~PAB9ZDZRF9NW.0 size=1048576 2024-09-22T08:25:12.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.681+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~PAB9ZDZRF9NW.1 size=420950 2024-09-22T08:25:12.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.681+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=PAB9ZDZRF9NW tag=G3TS3DFCIJKP type=write size=2518102 2024-09-22T08:25:12.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.682+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.0 size=1048576 2024-09-22T08:25:12.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.683+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.1 size=1048576 2024-09-22T08:25:12.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.684+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~TSHOCT21L6NP.2 size=634753 2024-09-22T08:25:12.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.686+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=TSHOCT21L6NP tag=1BE7G0KYNGS2 type=write size=3780481 2024-09-22T08:25:12.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.690+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~3UVV35OVHKK6.0 size=1048576 2024-09-22T08:25:12.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.690+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~3UVV35OVHKK6.1 size=195603 2024-09-22T08:25:12.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.690+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=3UVV35OVHKK6 tag=KJPP6GU3SOMI type=write size=2292755 2024-09-22T08:25:12.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.692+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~TWCVI0KWOYWF.0 size=85344 2024-09-22T08:25:12.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.694+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=TWCVI0KWOYWF tag=6Z592VOZLN8M type=write size=1133920 2024-09-22T08:25:12.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.695+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=2C80HR5K3ZVF type=del size=1213924 2024-09-22T08:25:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.697+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.0 size=1048576 2024-09-22T08:25:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.697+0000 7f8a8d811780 1 < canceled part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.1 size=1048576 2024-09-22T08:25:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.698+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~LHNK1540IPJH.2 size=282276 2024-09-22T08:25:12.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.700+0000 7f8a8d811780 1 < canceled multipart upload key=MJJPUJP2NSOK upload=LHNK1540IPJH tag=F6UKECMNEDJ2 type=write size=3428004 2024-09-22T08:25:12.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.701+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=NZ84CLTVJFHD type=del size=1445954 2024-09-22T08:25:12.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.703+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=MQHAUD13PKN5 type=write size=586853 2024-09-22T08:25:12.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.705+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~I6AH26Q3PF7I.0 size=128679 2024-09-22T08:25:12.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.705+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=I6AH26Q3PF7I tag=4V9GQB8EAI0E type=write size=1177255 2024-09-22T08:25:12.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.707+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~44QLO11YKUDT.0 size=1048576 2024-09-22T08:25:12.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.708+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~44QLO11YKUDT.1 size=500562 2024-09-22T08:25:12.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.711+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=44QLO11YKUDT tag=5U1P4694ON1G type=write size=2597714 2024-09-22T08:25:12.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.713+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~SMGC3NUB1F1U.0 size=780974 2024-09-22T08:25:12.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.713+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=SMGC3NUB1F1U tag=955T463HWDIO type=write size=1829550 2024-09-22T08:25:12.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.715+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=H1B5FEU3THLD type=del 2024-09-22T08:25:12.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.717+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~2KUP54RFY9KQ.0 size=448242 2024-09-22T08:25:12.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.717+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=2KUP54RFY9KQ tag=P5VHNX6OP6Q6 type=write size=1496818 2024-09-22T08:25:12.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.719+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.0 size=1048576 2024-09-22T08:25:12.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.720+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.1 size=1048576 2024-09-22T08:25:12.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.720+0000 7f8a8d811780 1 < canceled part key=_multipart_WR1JR0APSOKN.2~L0FF4INM39C2.2 size=625060 2024-09-22T08:25:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.723+0000 7f8a8d811780 1 < canceled multipart upload key=WR1JR0APSOKN upload=L0FF4INM39C2 tag=WDIL79ZJ59QK type=write size=3770788 2024-09-22T08:25:12.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.726+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~YNRA4ZMDUALA.0 size=869231 2024-09-22T08:25:12.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.726+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=YNRA4ZMDUALA tag=Y8GP032SRZZF type=write size=1917807 2024-09-22T08:25:12.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.727+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=Q0TDQZJRV9YF type=del 2024-09-22T08:25:12.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.729+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=E4HJVAFI7VTK type=del size=962178 2024-09-22T08:25:12.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.729+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.0 size=1048576 2024-09-22T08:25:12.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.729+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.1 size=1048576 2024-09-22T08:25:12.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.730+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~02UDLLXE6WWC.2 size=812101 2024-09-22T08:25:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.732+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=02UDLLXE6WWC tag=12A9WXYJZ9L9 type=write size=3957829 2024-09-22T08:25:12.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.733+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=L5AAT464BBNB type=del size=456703 2024-09-22T08:25:12.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.735+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=HHLC958056SB type=del 2024-09-22T08:25:12.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.738+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.0 size=1048576 2024-09-22T08:25:12.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.739+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.1 size=1048576 2024-09-22T08:25:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.740+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.2 size=721649 2024-09-22T08:25:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.740+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=8ZJRFK1JNXL6 tag=BCBB2DETEH4A type=write size=3867377 2024-09-22T08:25:12.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.742+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=B1IYBW7RD117 type=del 2024-09-22T08:25:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.743+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=YCF2RAUL5XED type=write size=212129 2024-09-22T08:25:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.745+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=EVYSBZA7XOWL type=del 2024-09-22T08:25:12.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.746+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=S2HDV64Z3UB3 type=del size=2903289 2024-09-22T08:25:12.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.747+0000 7f8a8d811780 1 < canceled operation key=9EY50PUC6AJJ tag=AM5D04XLZ44K type=write size=151687 2024-09-22T08:25:12.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.749+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=S0Y1JV287O7L type=write size=89293 2024-09-22T08:25:12.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.750+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~8ZA4KFXZQY0K.0 size=1048576 2024-09-22T08:25:12.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.752+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~8ZA4KFXZQY0K.1 size=247827 2024-09-22T08:25:12.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.754+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=8ZA4KFXZQY0K tag=BZMSJGULK3I3 type=write size=2344979 2024-09-22T08:25:12.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.757+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~APLS7OTY3515.0 size=1048576 2024-09-22T08:25:12.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.758+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~APLS7OTY3515.1 size=45889 2024-09-22T08:25:12.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.758+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=APLS7OTY3515 tag=1F6LC6ZFLCFV type=write size=2143041 2024-09-22T08:25:12.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.759+0000 7f8a8d811780 1 < completed write operation key=MJJPUJP2NSOK tag=29T2N7LA1DR8 type=write size=400320 2024-09-22T08:25:12.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.760+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=J4K0MVZHMXXB type=del size=3524023 2024-09-22T08:25:12.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.762+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~PAB9ZDZRF9NW.0 size=1048576 2024-09-22T08:25:12.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.763+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~PAB9ZDZRF9NW.1 size=420950 2024-09-22T08:25:12.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.766+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=PAB9ZDZRF9NW tag=G3TS3DFCIJKP type=write size=2518102 2024-09-22T08:25:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.767+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~G1CSA9ETASP8.0 size=607037 2024-09-22T08:25:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.767+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=G1CSA9ETASP8 tag=SDRFP5V6CM53 type=write size=1655613 2024-09-22T08:25:12.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.769+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~3UVV35OVHKK6.0 size=1048576 2024-09-22T08:25:12.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.770+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~3UVV35OVHKK6.1 size=195603 2024-09-22T08:25:12.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.772+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=3UVV35OVHKK6 tag=KJPP6GU3SOMI type=write size=2292755 2024-09-22T08:25:12.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.773+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=B5BZ5LWP4P55 type=del size=3746699 2024-09-22T08:25:12.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.775+0000 7f8a8d811780 1 < canceled operation key=KIJ2DW4NSZKG tag=2C80HR5K3ZVF type=del size=1213924 2024-09-22T08:25:12.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.778+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.0 size=1048576 2024-09-22T08:25:12.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.779+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.1 size=1048576 2024-09-22T08:25:12.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.780+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.2 size=1019269 2024-09-22T08:25:12.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.780+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=O1F09GL9HY53 tag=69HK0H7R7GRC type=write size=4164997 2024-09-22T08:25:12.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.781+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=NZ84CLTVJFHD type=del 2024-09-22T08:25:12.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.783+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~Y2GBVYDUFMMM.0 size=275899 2024-09-22T08:25:12.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.783+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=Y2GBVYDUFMMM tag=GWBUY75QEOJ1 type=write size=1324475 2024-09-22T08:25:12.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.785+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~I6AH26Q3PF7I.0 size=128679 2024-09-22T08:25:12.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.787+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=I6AH26Q3PF7I tag=4V9GQB8EAI0E type=write size=1177255 2024-09-22T08:25:12.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.789+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=T45FT0WV81OT type=del size=1580959 2024-09-22T08:25:12.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.790+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~SMGC3NUB1F1U.0 size=780974 2024-09-22T08:25:12.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.793+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=SMGC3NUB1F1U tag=955T463HWDIO type=write size=1829550 2024-09-22T08:25:12.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.795+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~QEKTWJL980N5.0 size=1048576 2024-09-22T08:25:12.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.797+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~QEKTWJL980N5.1 size=401672 2024-09-22T08:25:12.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.797+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=QEKTWJL980N5 tag=A928ZRQ84RO1 type=write size=2498824 2024-09-22T08:25:12.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.797+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~2KUP54RFY9KQ.0 size=448242 2024-09-22T08:25:12.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.800+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=2KUP54RFY9KQ tag=P5VHNX6OP6Q6 type=write size=1496818 2024-09-22T08:25:12.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.802+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~TMNQV05BPLWK.0 size=1048576 2024-09-22T08:25:12.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.803+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~TMNQV05BPLWK.1 size=765893 2024-09-22T08:25:12.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.803+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=TMNQV05BPLWK tag=K88CU6CVOTO0 type=write size=2863045 2024-09-22T08:25:12.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.805+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~YNRA4ZMDUALA.0 size=869231 2024-09-22T08:25:12.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.807+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=YNRA4ZMDUALA tag=Y8GP032SRZZF type=write size=1917807 2024-09-22T08:25:12.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.809+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YHE2HM0Q8QMM.0 size=718111 2024-09-22T08:25:12.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.809+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=YHE2HM0Q8QMM tag=6Z6Y4WR0DJXL type=write size=1766687 2024-09-22T08:25:12.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.811+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=E4HJVAFI7VTK type=del 2024-09-22T08:25:12.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.812+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=6BIFPSV8CCSQ type=del size=2611073 2024-09-22T08:25:12.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.815+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=L5AAT464BBNB type=del 2024-09-22T08:25:12.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.816+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=4QMBP8NQUP1Z type=del size=3213248 2024-09-22T08:25:12.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.818+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.0 size=1048576 2024-09-22T08:25:12.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.820+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.1 size=1048576 2024-09-22T08:25:12.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.820+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~8ZJRFK1JNXL6.2 size=721649 2024-09-22T08:25:12.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.823+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=8ZJRFK1JNXL6 tag=BCBB2DETEH4A type=write size=3867377 2024-09-22T08:25:12.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.824+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=2V5PRDGLCVMJ type=del size=3864981 2024-09-22T08:25:12.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.828+0000 7f8a8d811780 1 < suggested update operation key=RRTLTMWJIWSW tag=YCF2RAUL5XED type=write size=212129 2024-09-22T08:25:12.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.830+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.0 size=1048576 2024-09-22T08:25:12.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.831+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.1 size=1048576 2024-09-22T08:25:12.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.832+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.2 size=343837 2024-09-22T08:25:12.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.832+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=BOPTLE28SDQE tag=IRLCP81RG9EY type=write size=3489565 2024-09-22T08:25:12.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.833+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=S2HDV64Z3UB3 type=del 2024-09-22T08:25:12.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.836+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~636QA5IYZZ8Z.0 size=1048576 2024-09-22T08:25:12.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.837+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~636QA5IYZZ8Z.1 size=418197 2024-09-22T08:25:12.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.837+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=636QA5IYZZ8Z tag=YZD7VX5YNALE type=write size=2515349 2024-09-22T08:25:12.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.838+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=S0Y1JV287O7L type=write size=89293 2024-09-22T08:25:12.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.841+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.0 size=1048576 2024-09-22T08:25:12.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.842+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.1 size=1048576 2024-09-22T08:25:12.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.843+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.2 size=478602 2024-09-22T08:25:12.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.843+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=ARZ33GXPV5HS tag=9B7RNE652Q0Y type=write size=3624330 2024-09-22T08:25:12.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.844+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~APLS7OTY3515.0 size=1048576 2024-09-22T08:25:12.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.844+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~APLS7OTY3515.1 size=45889 2024-09-22T08:25:12.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.846+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=APLS7OTY3515 tag=1F6LC6ZFLCFV type=write size=2143041 2024-09-22T08:25:12.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.848+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=ERHG3PQM5ANR type=del size=4171762 2024-09-22T08:25:12.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.849+0000 7f8a8d811780 1 < canceled operation key=9EY50PUC6AJJ tag=J4K0MVZHMXXB type=del size=3524023 2024-09-22T08:25:12.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.851+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=QC9667RBX3GG type=del size=2472460 2024-09-22T08:25:12.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.851+0000 7f8a8d811780 1 < canceled part key=_multipart_T5IAHQ3CUIFR.2~G1CSA9ETASP8.0 size=607037 2024-09-22T08:25:12.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.853+0000 7f8a8d811780 1 < canceled multipart upload key=T5IAHQ3CUIFR upload=G1CSA9ETASP8 tag=SDRFP5V6CM53 type=write size=1655613 2024-09-22T08:25:12.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.856+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~1BDB2E5PGKBI.0 size=468960 2024-09-22T08:25:12.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.856+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=1BDB2E5PGKBI tag=Q24AL4WZBRE3 type=write size=1517536 2024-09-22T08:25:12.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.857+0000 7f8a8d811780 1 < canceled operation key=911851NVIUQS tag=B5BZ5LWP4P55 type=del size=3746699 2024-09-22T08:25:12.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.858+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=Y6114JKL1O0N type=del size=173670 2024-09-22T08:25:12.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.860+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.0 size=1048576 2024-09-22T08:25:12.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.861+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.1 size=1048576 2024-09-22T08:25:12.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.862+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~O1F09GL9HY53.2 size=1019269 2024-09-22T08:25:12.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.864+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=O1F09GL9HY53 tag=69HK0H7R7GRC type=write size=4164997 2024-09-22T08:25:12.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.865+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=5IS20WNNC7BB type=del size=118758 2024-09-22T08:25:12.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.867+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~Y2GBVYDUFMMM.0 size=275899 2024-09-22T08:25:12.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.869+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=Y2GBVYDUFMMM tag=GWBUY75QEOJ1 type=write size=1324475 2024-09-22T08:25:12.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.871+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~82XGIQ8FJNO3.0 size=1048576 2024-09-22T08:25:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.873+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~82XGIQ8FJNO3.1 size=274038 2024-09-22T08:25:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.873+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=82XGIQ8FJNO3 tag=WT1HD3CV3NO9 type=write size=2371190 2024-09-22T08:25:12.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.874+0000 7f8a8d811780 1 < canceled operation key=911851NVIUQS tag=T45FT0WV81OT type=del size=1580959 2024-09-22T08:25:12.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.877+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~5VGOTFSFF29L.0 size=308768 2024-09-22T08:25:12.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.877+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=5VGOTFSFF29L tag=2ORHB4292TBN type=write size=1357344 2024-09-22T08:25:12.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.880+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~QEKTWJL980N5.0 size=1048576 2024-09-22T08:25:12.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.881+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~QEKTWJL980N5.1 size=401672 2024-09-22T08:25:12.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.885+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=QEKTWJL980N5 tag=A928ZRQ84RO1 type=write size=2498824 2024-09-22T08:25:12.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.886+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=QS2RHHYGC2VO type=write size=294144 2024-09-22T08:25:12.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.888+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~TMNQV05BPLWK.0 size=1048576 2024-09-22T08:25:12.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.889+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~TMNQV05BPLWK.1 size=765893 2024-09-22T08:25:12.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.891+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=TMNQV05BPLWK tag=K88CU6CVOTO0 type=write size=2863045 2024-09-22T08:25:12.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.892+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=4L8BZQGSBM6D type=del size=3522661 2024-09-22T08:25:12.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.893+0000 7f8a8d811780 1 < canceled part key=_multipart_7LLAS815MLFH.2~YHE2HM0Q8QMM.0 size=718111 2024-09-22T08:25:12.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.895+0000 7f8a8d811780 1 < canceled multipart upload key=7LLAS815MLFH upload=YHE2HM0Q8QMM tag=6Z6Y4WR0DJXL type=write size=1766687 2024-09-22T08:25:12.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.898+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~SYVIIKO5HOAO.0 size=836463 2024-09-22T08:25:12.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.898+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=SYVIIKO5HOAO tag=3E0LMVWNPV1C type=write size=1885039 2024-09-22T08:25:12.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.899+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=6BIFPSV8CCSQ type=del 2024-09-22T08:25:12.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.900+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=VCIRA2MMO4DG type=del size=3341174 2024-09-22T08:25:12.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.903+0000 7f8a8d811780 1 < suggested remove operation key=3T2TX83CSE2D tag=4QMBP8NQUP1Z type=del 2024-09-22T08:25:12.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.905+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~FS21V3LCABYY.0 size=577681 2024-09-22T08:25:12.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.905+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=FS21V3LCABYY tag=5DUDLSZIGORK type=write size=1626257 2024-09-22T08:25:12.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.906+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=2V5PRDGLCVMJ type=del 2024-09-22T08:25:12.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.908+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=35477VCB1I6I type=del size=2227199 2024-09-22T08:25:12.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.911+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.0 size=1048576 2024-09-22T08:25:12.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.912+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.1 size=1048576 2024-09-22T08:25:12.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.912+0000 7f8a8d811780 1 < canceled part key=_multipart_GMNVYF2BY872.2~BOPTLE28SDQE.2 size=343837 2024-09-22T08:25:12.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.914+0000 7f8a8d811780 1 < canceled multipart upload key=GMNVYF2BY872 upload=BOPTLE28SDQE tag=IRLCP81RG9EY type=write size=3489565 2024-09-22T08:25:12.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.916+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~MSAQSEQL02YG.0 size=1048576 2024-09-22T08:25:12.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.917+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~MSAQSEQL02YG.1 size=407269 2024-09-22T08:25:12.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.917+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=MSAQSEQL02YG tag=DA0XDJDZSMMA type=write size=2504421 2024-09-22T08:25:12.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.919+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~636QA5IYZZ8Z.0 size=1048576 2024-09-22T08:25:12.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.920+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~636QA5IYZZ8Z.1 size=418197 2024-09-22T08:25:12.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.922+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=636QA5IYZZ8Z tag=YZD7VX5YNALE type=write size=2515349 2024-09-22T08:25:12.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.924+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=BAAFOU7WI88T type=del size=1006098 2024-09-22T08:25:12.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.925+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.0 size=1048576 2024-09-22T08:25:12.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.926+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.1 size=1048576 2024-09-22T08:25:12.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.928+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ARZ33GXPV5HS.2 size=478602 2024-09-22T08:25:12.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.930+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=ARZ33GXPV5HS tag=9B7RNE652Q0Y type=write size=3624330 2024-09-22T08:25:12.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.932+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=DYQM8FWURN9K type=write size=923038 2024-09-22T08:25:12.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.933+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=ERHG3PQM5ANR type=del 2024-09-22T08:25:12.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.936+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~WTKKJTEEOM12.0 size=255231 2024-09-22T08:25:12.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.936+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=WTKKJTEEOM12 tag=ZV3QZJHM1Z6P type=write size=1303807 2024-09-22T08:25:12.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.939+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=QC9667RBX3GG type=del 2024-09-22T08:25:12.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.942+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.0 size=1048576 2024-09-22T08:25:12.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.943+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.1 size=1048576 2024-09-22T08:25:12.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.944+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.2 size=368767 2024-09-22T08:25:12.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.944+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=946E4O6I02F4 tag=7JM07RR5TCZJ type=write size=3514495 2024-09-22T08:25:12.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.946+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~1BDB2E5PGKBI.0 size=468960 2024-09-22T08:25:12.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.949+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=1BDB2E5PGKBI tag=Q24AL4WZBRE3 type=write size=1517536 2024-09-22T08:25:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.950+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=DD4RDD9S6P2S type=del size=744371 2024-09-22T08:25:12.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.952+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=Y6114JKL1O0N type=del 2024-09-22T08:25:12.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.955+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~INU21SX2DJYO.0 size=1048576 2024-09-22T08:25:12.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.956+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~INU21SX2DJYO.1 size=115383 2024-09-22T08:25:12.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.956+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=INU21SX2DJYO tag=P23Y7TZSE79B type=write size=2212535 2024-09-22T08:25:12.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.957+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=5IS20WNNC7BB type=del 2024-09-22T08:25:12.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.959+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=CIYQPSIBK26R type=del size=2457849 2024-09-22T08:25:12.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.960+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~82XGIQ8FJNO3.0 size=1048576 2024-09-22T08:25:12.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.962+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~82XGIQ8FJNO3.1 size=274038 2024-09-22T08:25:12.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.964+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=82XGIQ8FJNO3 tag=WT1HD3CV3NO9 type=write size=2371190 2024-09-22T08:25:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.965+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=CRKTVTZ5Q5KT type=del size=2112976 2024-09-22T08:25:12.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.969+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~5VGOTFSFF29L.0 size=308768 2024-09-22T08:25:12.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.971+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=5VGOTFSFF29L tag=2ORHB4292TBN type=write size=1357344 2024-09-22T08:25:12.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.973+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~LPQCKYF20XF1.0 size=1048576 2024-09-22T08:25:12.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.975+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~LPQCKYF20XF1.1 size=1015348 2024-09-22T08:25:12.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.975+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=LPQCKYF20XF1 tag=FV2SYXNI7SED type=write size=3112500 2024-09-22T08:25:12.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.975+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=QS2RHHYGC2VO type=write size=294144 2024-09-22T08:25:12.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.978+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~LXE0HB7NXB2R.0 size=804562 2024-09-22T08:25:12.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.978+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=LXE0HB7NXB2R tag=4GP1S0EFA2MD type=write size=1853138 2024-09-22T08:25:12.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.980+0000 7f8a8d811780 1 < suggested remove operation key=H504PU8223G9 tag=4L8BZQGSBM6D type=del 2024-09-22T08:25:12.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.982+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=SV4MO4VL4H15 type=del size=2406026 2024-09-22T08:25:12.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.983+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~SYVIIKO5HOAO.0 size=836463 2024-09-22T08:25:12.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.986+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=SYVIIKO5HOAO tag=3E0LMVWNPV1C type=write size=1885039 2024-09-22T08:25:12.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.987+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=6VTXX9QYYEJ7 type=del size=2333156 2024-09-22T08:25:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.988+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=VCIRA2MMO4DG type=del 2024-09-22T08:25:12.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.991+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.0 size=1048576 2024-09-22T08:25:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.993+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.1 size=1048576 2024-09-22T08:25:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.994+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.2 size=267992 2024-09-22T08:25:12.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.994+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=KZ6J6BPG3JR2 tag=1QVRQW93M1HA type=write size=3413720 2024-09-22T08:25:12.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.995+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~FS21V3LCABYY.0 size=577681 2024-09-22T08:25:12.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.998+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=FS21V3LCABYY tag=5DUDLSZIGORK type=write size=1626257 2024-09-22T08:25:13.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:12.999+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=F01GDKCD0EEM type=del size=1101509 2024-09-22T08:25:13.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.001+0000 7f8a8d811780 1 < suggested remove operation key=LRFF14FU7C5I tag=35477VCB1I6I type=del 2024-09-22T08:25:13.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.003+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=M39XKFHWFN7I type=del size=691115 2024-09-22T08:25:13.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.004+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~MSAQSEQL02YG.0 size=1048576 2024-09-22T08:25:13.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.006+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~MSAQSEQL02YG.1 size=407269 2024-09-22T08:25:13.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.008+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=MSAQSEQL02YG tag=DA0XDJDZSMMA type=write size=2504421 2024-09-22T08:25:13.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.009+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=2QGCK43MSCHQ type=del size=3932324 2024-09-22T08:25:13.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.011+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=BAAFOU7WI88T type=del 2024-09-22T08:25:13.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.012+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=CLYF5Q31NS79 type=write size=940487 2024-09-22T08:25:13.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.016+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=DYQM8FWURN9K type=write 2024-09-22T08:25:13.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.018+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=S04ID4YUFF3M type=del size=2410926 2024-09-22T08:25:13.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.019+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~WTKKJTEEOM12.0 size=255231 2024-09-22T08:25:13.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.021+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=WTKKJTEEOM12 tag=ZV3QZJHM1Z6P type=write size=1303807 2024-09-22T08:25:13.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.024+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~KN9AZG3BQO38.0 size=642306 2024-09-22T08:25:13.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.024+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=KN9AZG3BQO38 tag=AF6CKIZHU0QO type=write size=1690882 2024-09-22T08:25:13.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.025+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.0 size=1048576 2024-09-22T08:25:13.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.026+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.1 size=1048576 2024-09-22T08:25:13.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.028+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~946E4O6I02F4.2 size=368767 2024-09-22T08:25:13.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.030+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=946E4O6I02F4 tag=7JM07RR5TCZJ type=write size=3514495 2024-09-22T08:25:13.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.031+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=Y1GLOPU5NFTW type=del size=1352722 2024-09-22T08:25:13.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.032+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=DD4RDD9S6P2S type=del 2024-09-22T08:25:13.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.034+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=O27S4W35R1J9 type=del size=1440741 2024-09-22T08:25:13.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.035+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~INU21SX2DJYO.0 size=1048576 2024-09-22T08:25:13.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.035+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~INU21SX2DJYO.1 size=115383 2024-09-22T08:25:13.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.037+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=INU21SX2DJYO tag=P23Y7TZSE79B type=write size=2212535 2024-09-22T08:25:13.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.039+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=43TKEQPQXVBW type=del size=2659243 2024-09-22T08:25:13.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.040+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=CIYQPSIBK26R type=del size=2457849 2024-09-22T08:25:13.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.043+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~T743YGPHXLKQ.0 size=1048576 2024-09-22T08:25:13.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.044+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~T743YGPHXLKQ.1 size=886959 2024-09-22T08:25:13.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.044+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=T743YGPHXLKQ tag=89065KDE3QXW type=write size=2984111 2024-09-22T08:25:13.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.047+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=CRKTVTZ5Q5KT type=del 2024-09-22T08:25:13.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.048+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=D27IGUZV6WRQ type=del size=1686289 2024-09-22T08:25:13.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.050+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~LPQCKYF20XF1.0 size=1048576 2024-09-22T08:25:13.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.051+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~LPQCKYF20XF1.1 size=1015348 2024-09-22T08:25:13.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.053+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=LPQCKYF20XF1 tag=FV2SYXNI7SED type=write size=3112500 2024-09-22T08:25:13.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.056+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~8DM41Y5AFYAO.0 size=392765 2024-09-22T08:25:13.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.056+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=8DM41Y5AFYAO tag=IZJT9B5UW520 type=write size=1441341 2024-09-22T08:25:13.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.057+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~LXE0HB7NXB2R.0 size=804562 2024-09-22T08:25:13.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.060+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=LXE0HB7NXB2R tag=4GP1S0EFA2MD type=write size=1853138 2024-09-22T08:25:13.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.061+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=P6AD3I75X3AR type=del size=607168 2024-09-22T08:25:13.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.063+0000 7f8a8d811780 1 < suggested remove operation key=911851NVIUQS tag=SV4MO4VL4H15 type=del 2024-09-22T08:25:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.065+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=W8J1X5T5HWD6 type=write size=316763 2024-09-22T08:25:13.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.066+0000 7f8a8d811780 -1 < failed to complete operation key=5VU70RE1GJS2 tag=6VTXX9QYYEJ7 type=del size=2333156: (22) Invalid argument 2024-09-22T08:25:13.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.068+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=EDN8AUQR6O6R type=write size=1001237 2024-09-22T08:25:13.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.070+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.0 size=1048576 2024-09-22T08:25:13.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.070+0000 7f8a8d811780 1 < canceled part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.1 size=1048576 2024-09-22T08:25:13.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.071+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~KZ6J6BPG3JR2.2 size=267992 2024-09-22T08:25:13.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.073+0000 7f8a8d811780 1 < canceled multipart upload key=7XNMR51803Y6 upload=KZ6J6BPG3JR2 tag=1QVRQW93M1HA type=write size=3413720 2024-09-22T08:25:13.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.075+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=2IK06JS8SN6Z type=write size=483053 2024-09-22T08:25:13.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.076+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=F01GDKCD0EEM type=del 2024-09-22T08:25:13.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.079+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.0 size=1048576 2024-09-22T08:25:13.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.080+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.1 size=1048576 2024-09-22T08:25:13.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.081+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.2 size=994109 2024-09-22T08:25:13.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.081+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=YFU8YC4RPR2K tag=PYWGL4LWFM4M type=write size=4139837 2024-09-22T08:25:13.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.082+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=M39XKFHWFN7I type=del 2024-09-22T08:25:13.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.084+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=5EM5TL4EQY10 type=del size=907247 2024-09-22T08:25:13.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.085+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=2QGCK43MSCHQ type=del 2024-09-22T08:25:13.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.088+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~79VQN37X030C.0 size=1048576 2024-09-22T08:25:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.089+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~79VQN37X030C.1 size=227187 2024-09-22T08:25:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.089+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=79VQN37X030C tag=D2YKHM71G4Z4 type=write size=2324339 2024-09-22T08:25:13.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.091+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=CLYF5Q31NS79 type=write size=940487 2024-09-22T08:25:13.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.092+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=PFYUE0QNH5HK type=del size=582697 2024-09-22T08:25:13.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.094+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=S04ID4YUFF3M type=del 2024-09-22T08:25:13.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.096+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=XTHSCYNV2HNA type=del size=3550589 2024-09-22T08:25:13.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.098+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~KN9AZG3BQO38.0 size=642306 2024-09-22T08:25:13.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.100+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=KN9AZG3BQO38 tag=AF6CKIZHU0QO type=write size=1690882 2024-09-22T08:25:13.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.101+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=2NC3LIYN8BD1 type=del size=1616819 2024-09-22T08:25:13.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.103+0000 7f8a8d811780 1 < canceled operation key=7XBR6QIHD8TJ tag=Y1GLOPU5NFTW type=del size=1352722 2024-09-22T08:25:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.105+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=O3N7KB00KY9A type=del size=3398634 2024-09-22T08:25:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.106+0000 7f8a8d811780 1 < canceled operation key=7XNMR51803Y6 tag=O27S4W35R1J9 type=del size=1440741 2024-09-22T08:25:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.107+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=MK0N7ZRYGSGH type=del size=3306258 2024-09-22T08:25:13.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.110+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=43TKEQPQXVBW type=del 2024-09-22T08:25:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.110+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=0VGQ061TK0VV type=del size=4089981 2024-09-22T08:25:13.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.112+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~T743YGPHXLKQ.0 size=1048576 2024-09-22T08:25:13.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.113+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~T743YGPHXLKQ.1 size=886959 2024-09-22T08:25:13.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.115+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=T743YGPHXLKQ tag=89065KDE3QXW type=write size=2984111 2024-09-22T08:25:13.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.117+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=QRL7D168T4JR type=del size=4119099 2024-09-22T08:25:13.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.118+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=D27IGUZV6WRQ type=del 2024-09-22T08:25:13.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.120+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=U2DTLFOO2ZX5 type=del size=476678 2024-09-22T08:25:13.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.121+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~8DM41Y5AFYAO.0 size=392765 2024-09-22T08:25:13.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.123+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=8DM41Y5AFYAO tag=IZJT9B5UW520 type=write size=1441341 2024-09-22T08:25:13.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.125+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=K9XUVKW6I2E1 type=write size=58881 2024-09-22T08:25:13.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.126+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=P6AD3I75X3AR type=del 2024-09-22T08:25:13.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.127+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=0PJ5UI369UPY type=del size=2261488 2024-09-22T08:25:13.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.129+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=W8J1X5T5HWD6 type=write size=316763 2024-09-22T08:25:13.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.130+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=W1QQJD8W5NYZ type=del size=2664319 2024-09-22T08:25:13.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.132+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=EDN8AUQR6O6R type=write size=1001237 2024-09-22T08:25:13.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.134+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.0 size=1048576 2024-09-22T08:25:13.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.135+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.1 size=1048576 2024-09-22T08:25:13.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.136+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.2 size=961868 2024-09-22T08:25:13.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.136+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=LUS77OKCQUBZ tag=7QHK70RMIP95 type=write size=4107596 2024-09-22T08:25:13.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.138+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=2IK06JS8SN6Z type=write size=483053 2024-09-22T08:25:13.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.139+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=LYA1U5IOXSX0 type=del size=3124526 2024-09-22T08:25:13.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.141+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.0 size=1048576 2024-09-22T08:25:13.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.142+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.1 size=1048576 2024-09-22T08:25:13.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.142+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~YFU8YC4RPR2K.2 size=994109 2024-09-22T08:25:13.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.144+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=YFU8YC4RPR2K tag=PYWGL4LWFM4M type=write size=4139837 2024-09-22T08:25:13.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.145+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=H3P9DZIA61PP type=del size=1210519 2024-09-22T08:25:13.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.148+0000 7f8a8d811780 1 < suggested update operation key=MJJPUJP2NSOK tag=5EM5TL4EQY10 type=del size=907247 2024-09-22T08:25:13.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.151+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=XIXVLGQ148RU type=write size=319542 2024-09-22T08:25:13.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.152+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~79VQN37X030C.0 size=1048576 2024-09-22T08:25:13.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.154+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~79VQN37X030C.1 size=227187 2024-09-22T08:25:13.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.156+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=79VQN37X030C tag=D2YKHM71G4Z4 type=write size=2324339 2024-09-22T08:25:13.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.157+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=ATKQA4O6NTSQ type=write size=435826 2024-09-22T08:25:13.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.159+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=PFYUE0QNH5HK type=del 2024-09-22T08:25:13.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.161+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=BMTHX8IHN8DF type=del size=775681 2024-09-22T08:25:13.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.163+0000 7f8a8d811780 1 < suggested update operation key=GMNVYF2BY872 tag=XTHSCYNV2HNA type=del size=3550589 2024-09-22T08:25:13.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.165+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.0 size=1048576 2024-09-22T08:25:13.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.166+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.1 size=1048576 2024-09-22T08:25:13.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.168+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.2 size=435383 2024-09-22T08:25:13.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.168+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=0KH03M3UPK8X tag=EJNFKGS0KW8S type=write size=3581111 2024-09-22T08:25:13.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.169+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=2NC3LIYN8BD1 type=del 2024-09-22T08:25:13.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.170+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=AEHN2N9S3Q8X type=write size=321494 2024-09-22T08:25:13.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.172+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=O3N7KB00KY9A type=del 2024-09-22T08:25:13.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.173+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=7UTTMMVQPBZ6 type=del size=593901 2024-09-22T08:25:13.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.176+0000 7f8a8d811780 1 < suggested update operation key=7XBR6QIHD8TJ tag=MK0N7ZRYGSGH type=del size=3306258 2024-09-22T08:25:13.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.178+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LLNM73GM6V34.0 size=1048576 2024-09-22T08:25:13.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.180+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LLNM73GM6V34.1 size=946113 2024-09-22T08:25:13.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.180+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=LLNM73GM6V34 tag=NVMPTKMPFBV2 type=write size=3043265 2024-09-22T08:25:13.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.181+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=0VGQ061TK0VV type=del 2024-09-22T08:25:13.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.183+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=9P5DKEE8ZEEK type=del size=3929537 2024-09-22T08:25:13.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.186+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=QRL7D168T4JR type=del 2024-09-22T08:25:13.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.187+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=MZ7YQCJCNNXU type=del size=813466 2024-09-22T08:25:13.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.190+0000 7f8a8d811780 1 < suggested remove operation key=JP7IZ0CMXTSX tag=U2DTLFOO2ZX5 type=del 2024-09-22T08:25:13.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.192+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~0FSYTZXM727P.0 size=744966 2024-09-22T08:25:13.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.192+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=0FSYTZXM727P tag=CO1DLV8IPRVK type=write size=1793542 2024-09-22T08:25:13.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.194+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=K9XUVKW6I2E1 type=write size=58881 2024-09-22T08:25:13.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.195+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=UI4GTYSNSSFZ type=del size=3116191 2024-09-22T08:25:13.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.197+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=0PJ5UI369UPY type=del 2024-09-22T08:25:13.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.198+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=4YPIS6GI0T02 type=write size=618856 2024-09-22T08:25:13.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.200+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=W1QQJD8W5NYZ type=del 2024-09-22T08:25:13.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.201+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=50C60DW3PFYP type=del size=3837696 2024-09-22T08:25:13.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.203+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.0 size=1048576 2024-09-22T08:25:13.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.204+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.1 size=1048576 2024-09-22T08:25:13.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.205+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~LUS77OKCQUBZ.2 size=961868 2024-09-22T08:25:13.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.208+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=LUS77OKCQUBZ tag=7QHK70RMIP95 type=write size=4107596 2024-09-22T08:25:13.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.209+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=Y7O420713U1A type=del size=2713108 2024-09-22T08:25:13.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.210+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=LYA1U5IOXSX0 type=del 2024-09-22T08:25:13.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.213+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.0 size=1048576 2024-09-22T08:25:13.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.214+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.1 size=1048576 2024-09-22T08:25:13.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.215+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.2 size=821208 2024-09-22T08:25:13.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.215+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=6AM7RQQWNU0C tag=H7N7SLUQKMNH type=write size=3966936 2024-09-22T08:25:13.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.217+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=H3P9DZIA61PP type=del 2024-09-22T08:25:13.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.220+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~EKG25583AWG9.0 size=1048576 2024-09-22T08:25:13.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.220+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~EKG25583AWG9.1 size=434379 2024-09-22T08:25:13.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.220+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=EKG25583AWG9 tag=8YO67HVOL3VY type=write size=2531531 2024-09-22T08:25:13.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.221+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=JP7IZ0CMXTSX tag=XIXVLGQ148RU type=write size=319542: (2) No such file or directory 2024-09-22T08:25:13.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.222+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=NV5TVG90RU9W type=del size=405734 2024-09-22T08:25:13.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.224+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=ATKQA4O6NTSQ type=write size=435826 2024-09-22T08:25:13.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.225+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=2840SUKXULX4 type=del size=1585880 2024-09-22T08:25:13.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.227+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=BMTHX8IHN8DF type=del 2024-09-22T08:25:13.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.228+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=VEA7S8M6LJIM type=del size=819197 2024-09-22T08:25:13.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.229+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.0 size=1048576 2024-09-22T08:25:13.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.229+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.1 size=1048576 2024-09-22T08:25:13.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.230+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~0KH03M3UPK8X.2 size=435383 2024-09-22T08:25:13.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.233+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=0KH03M3UPK8X tag=EJNFKGS0KW8S type=write size=3581111 2024-09-22T08:25:13.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.234+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=UC13Y4YORQKH type=del size=1611809 2024-09-22T08:25:13.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.236+0000 7f8a8d811780 1 < canceled operation key=911851NVIUQS tag=AEHN2N9S3Q8X type=write size=321494 2024-09-22T08:25:13.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.237+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=4WZ3TNNP6377 type=del size=2294939 2024-09-22T08:25:13.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.238+0000 7f8a8d811780 1 < canceled operation key=IOZ7IXVOB70S tag=7UTTMMVQPBZ6 type=del size=593901 2024-09-22T08:25:13.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.241+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~89J6QEYW8DJB.0 size=889068 2024-09-22T08:25:13.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.241+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=89J6QEYW8DJB tag=ROZQ34S0AY4H type=write size=1937644 2024-09-22T08:25:13.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.243+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~LLNM73GM6V34.0 size=1048576 2024-09-22T08:25:13.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.244+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~LLNM73GM6V34.1 size=946113 2024-09-22T08:25:13.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.246+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=LLNM73GM6V34 tag=NVMPTKMPFBV2 type=write size=3043265 2024-09-22T08:25:13.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.247+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=LSL4ULI09UVQ type=del size=265409 2024-09-22T08:25:13.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.249+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=9P5DKEE8ZEEK type=del 2024-09-22T08:25:13.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.250+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=TR7R6MG3U7IK type=write size=449794 2024-09-22T08:25:13.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.251+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=MZ7YQCJCNNXU type=del 2024-09-22T08:25:13.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.253+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=QPEM4QZSPFW4 type=del size=689967 2024-09-22T08:25:13.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.254+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~0FSYTZXM727P.0 size=744966 2024-09-22T08:25:13.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.256+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=0FSYTZXM727P tag=CO1DLV8IPRVK type=write size=1793542 2024-09-22T08:25:13.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.259+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.0 size=1048576 2024-09-22T08:25:13.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.260+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.1 size=1048576 2024-09-22T08:25:13.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.262+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.2 size=106890 2024-09-22T08:25:13.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.262+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=401CFBIN6153 tag=HCFB0HLJWU43 type=write size=3252618 2024-09-22T08:25:13.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.265+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=UI4GTYSNSSFZ type=del size=3116191 2024-09-22T08:25:13.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.268+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~4BAJ6D9XA7XH.0 size=500495 2024-09-22T08:25:13.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.268+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=4BAJ6D9XA7XH tag=TE8RDZPKTVW4 type=write size=1549071 2024-09-22T08:25:13.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.270+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=4YPIS6GI0T02 type=write size=618856 2024-09-22T08:25:13.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.272+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=5MLDN7WA7XSV type=del size=615350 2024-09-22T08:25:13.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.274+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=50C60DW3PFYP type=del 2024-09-22T08:25:13.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.276+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.0 size=1048576 2024-09-22T08:25:13.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.277+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.1 size=1048576 2024-09-22T08:25:13.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.278+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.2 size=195351 2024-09-22T08:25:13.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.278+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=3FSFQGAAISMM tag=EF1R36BWNJCH type=write size=3341079 2024-09-22T08:25:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.280+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=Y7O420713U1A type=del 2024-09-22T08:25:13.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.282+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.0 size=1048576 2024-09-22T08:25:13.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.284+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.1 size=1048576 2024-09-22T08:25:13.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.286+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.2 size=104251 2024-09-22T08:25:13.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.286+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=0671QEP4K3GX tag=H9QQLUVYPMFD type=write size=3249979 2024-09-22T08:25:13.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.288+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.0 size=1048576 2024-09-22T08:25:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.289+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.1 size=1048576 2024-09-22T08:25:13.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.290+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~6AM7RQQWNU0C.2 size=821208 2024-09-22T08:25:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.292+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=6AM7RQQWNU0C tag=H7N7SLUQKMNH type=write size=3966936 2024-09-22T08:25:13.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.295+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.0 size=1048576 2024-09-22T08:25:13.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.297+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.1 size=1048576 2024-09-22T08:25:13.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.297+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.2 size=1003011 2024-09-22T08:25:13.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.297+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=GVS9TOSZTJXO tag=2W4V9F5DLZSS type=write size=4148739 2024-09-22T08:25:13.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.299+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~EKG25583AWG9.0 size=1048576 2024-09-22T08:25:13.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.300+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~EKG25583AWG9.1 size=434379 2024-09-22T08:25:13.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.303+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=EKG25583AWG9 tag=8YO67HVOL3VY type=write size=2531531 2024-09-22T08:25:13.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.304+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=IQ7GLOW2TWUY type=del size=814209 2024-09-22T08:25:13.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.307+0000 7f8a8d811780 1 < suggested remove operation key=MJJPUJP2NSOK tag=NV5TVG90RU9W type=del 2024-09-22T08:25:13.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.309+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~IXVM5CIFVANB.0 size=386393 2024-09-22T08:25:13.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.309+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=IXVM5CIFVANB tag=8MPP0NOVUKJC type=write size=1434969 2024-09-22T08:25:13.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.310+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=2840SUKXULX4 type=del 2024-09-22T08:25:13.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.313+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.0 size=1048576 2024-09-22T08:25:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.314+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.1 size=1048576 2024-09-22T08:25:13.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.315+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.2 size=768412 2024-09-22T08:25:13.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.315+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=P1L5OV1RK70Z tag=2QR0SV8F6X2Z type=write size=3914140 2024-09-22T08:25:13.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.316+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=VEA7S8M6LJIM type=del 2024-09-22T08:25:13.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.318+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=R468LLMI0RYU type=del size=957770 2024-09-22T08:25:13.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.319+0000 7f8a8d811780 -1 < failed to complete operation key=5VU70RE1GJS2 tag=UC13Y4YORQKH type=del size=1611809: (22) Invalid argument 2024-09-22T08:25:13.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.322+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~8RC051F2G64S.0 size=1048576 2024-09-22T08:25:13.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.323+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~8RC051F2G64S.1 size=31639 2024-09-22T08:25:13.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.323+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=8RC051F2G64S tag=EU860C490HNP type=write size=2128791 2024-09-22T08:25:13.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.324+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=4WZ3TNNP6377 type=del 2024-09-22T08:25:13.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.326+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=QSEVHJMXQRQ2 type=del size=1070334 2024-09-22T08:25:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.327+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~89J6QEYW8DJB.0 size=889068 2024-09-22T08:25:13.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.330+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=89J6QEYW8DJB tag=ROZQ34S0AY4H type=write size=1937644 2024-09-22T08:25:13.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.333+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~B57PS9RBCFMO.0 size=366357 2024-09-22T08:25:13.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.333+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=B57PS9RBCFMO tag=VJL7BKS70K2M type=write size=1414933 2024-09-22T08:25:13.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.334+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=LSL4ULI09UVQ type=del 2024-09-22T08:25:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.337+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~LLSJXD245S7O.0 size=86251 2024-09-22T08:25:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.337+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=LLSJXD245S7O tag=TURI87G3039K type=write size=1134827 2024-09-22T08:25:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.339+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=TR7R6MG3U7IK type=write size=449794 2024-09-22T08:25:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.341+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~RHDUVHZ3892Q.0 size=1048576 2024-09-22T08:25:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.342+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~RHDUVHZ3892Q.1 size=939909 2024-09-22T08:25:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.342+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=RHDUVHZ3892Q tag=C84MOG2YRWZ3 type=write size=3037061 2024-09-22T08:25:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.344+0000 7f8a8d811780 1 < canceled operation key=LRFF14FU7C5I tag=QPEM4QZSPFW4 type=del size=689967 2024-09-22T08:25:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.346+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.0 size=1048576 2024-09-22T08:25:13.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.348+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.1 size=1048576 2024-09-22T08:25:13.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.349+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.2 size=426598 2024-09-22T08:25:13.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.349+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=HX3N5S9BMBZW tag=MRB1HGRXEQWO type=write size=3572326 2024-09-22T08:25:13.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.351+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.0 size=1048576 2024-09-22T08:25:13.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.352+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.1 size=1048576 2024-09-22T08:25:13.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.353+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~401CFBIN6153.2 size=106890 2024-09-22T08:25:13.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.356+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=401CFBIN6153 tag=HCFB0HLJWU43 type=write size=3252618 2024-09-22T08:25:13.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.359+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.0 size=1048576 2024-09-22T08:25:13.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.360+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.1 size=1048576 2024-09-22T08:25:13.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.361+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.2 size=550516 2024-09-22T08:25:13.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.361+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=H03IOYNJEDYR tag=F3QL81ESSY6A type=write size=3696244 2024-09-22T08:25:13.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.363+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~4BAJ6D9XA7XH.0 size=500495 2024-09-22T08:25:13.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.365+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=4BAJ6D9XA7XH tag=TE8RDZPKTVW4 type=write size=1549071 2024-09-22T08:25:13.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.366+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=8JADENO6JQ3I type=write size=520926 2024-09-22T08:25:13.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.368+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=5MLDN7WA7XSV type=del 2024-09-22T08:25:13.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.370+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=5SWPG2RKY0WF type=del size=2569060 2024-09-22T08:25:13.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.371+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.0 size=1048576 2024-09-22T08:25:13.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.372+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.1 size=1048576 2024-09-22T08:25:13.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.374+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~3FSFQGAAISMM.2 size=195351 2024-09-22T08:25:13.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.376+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=3FSFQGAAISMM tag=EF1R36BWNJCH type=write size=3341079 2024-09-22T08:25:13.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.378+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=P2F1RWGSW508 type=del size=2952216 2024-09-22T08:25:13.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.379+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.0 size=1048576 2024-09-22T08:25:13.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.380+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.1 size=1048576 2024-09-22T08:25:13.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.381+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~0671QEP4K3GX.2 size=104251 2024-09-22T08:25:13.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.383+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=0671QEP4K3GX tag=H9QQLUVYPMFD type=write size=3249979 2024-09-22T08:25:13.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.386+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~B5PD7CJ1N7T0.0 size=1014512 2024-09-22T08:25:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.386+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=B5PD7CJ1N7T0 tag=PLORKUUC65VU type=write size=2063088 2024-09-22T08:25:13.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.387+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.0 size=1048576 2024-09-22T08:25:13.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.388+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.1 size=1048576 2024-09-22T08:25:13.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.389+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~GVS9TOSZTJXO.2 size=1003011 2024-09-22T08:25:13.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.392+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=GVS9TOSZTJXO tag=2W4V9F5DLZSS type=write size=4148739 2024-09-22T08:25:13.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.393+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=QB6ZT3DKDW8L type=del size=2077453 2024-09-22T08:25:13.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.395+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=IQ7GLOW2TWUY type=del 2024-09-22T08:25:13.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.398+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~GYRU0XY1F5E4.0 size=1048576 2024-09-22T08:25:13.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.400+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~GYRU0XY1F5E4.1 size=950330 2024-09-22T08:25:13.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.400+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=GYRU0XY1F5E4 tag=L6EV9SZ9VX78 type=write size=3047482 2024-09-22T08:25:13.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.401+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~IXVM5CIFVANB.0 size=386393 2024-09-22T08:25:13.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.403+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=IXVM5CIFVANB tag=8MPP0NOVUKJC type=write size=1434969 2024-09-22T08:25:13.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.405+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=DXTPDHF5STMX type=del size=434504 2024-09-22T08:25:13.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.406+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.0 size=1048576 2024-09-22T08:25:13.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.407+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.1 size=1048576 2024-09-22T08:25:13.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.409+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~P1L5OV1RK70Z.2 size=768412 2024-09-22T08:25:13.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.411+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=P1L5OV1RK70Z tag=2QR0SV8F6X2Z type=write size=3914140 2024-09-22T08:25:13.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.414+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~PRAJ8Z5B8Z14.0 size=1048576 2024-09-22T08:25:13.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.415+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~PRAJ8Z5B8Z14.1 size=661843 2024-09-22T08:25:13.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.415+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=PRAJ8Z5B8Z14 tag=QH06HKIGL6BL type=write size=2758995 2024-09-22T08:25:13.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.416+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=R468LLMI0RYU type=del 2024-09-22T08:25:13.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.420+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~XFVK4GAG06M8.0 size=1048576 2024-09-22T08:25:13.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.421+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~XFVK4GAG06M8.1 size=487837 2024-09-22T08:25:13.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.421+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=XFVK4GAG06M8 tag=2F6JY0UUBCW0 type=write size=2584989 2024-09-22T08:25:13.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.421+0000 7f8a8d811780 1 < canceled part key=_multipart_1719KI1YP1FT.2~8RC051F2G64S.0 size=1048576 2024-09-22T08:25:13.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.423+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~8RC051F2G64S.1 size=31639 2024-09-22T08:25:13.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.425+0000 7f8a8d811780 1 < canceled multipart upload key=1719KI1YP1FT upload=8RC051F2G64S tag=EU860C490HNP type=write size=2128791 2024-09-22T08:25:13.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.426+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=LDKN3BZTLE70 type=del size=3497061 2024-09-22T08:25:13.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.428+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=QSEVHJMXQRQ2 type=del 2024-09-22T08:25:13.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.430+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~AFEG7HAYCW71.0 size=1048576 2024-09-22T08:25:13.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.432+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~AFEG7HAYCW71.1 size=600092 2024-09-22T08:25:13.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.432+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=AFEG7HAYCW71 tag=IVNBWW7YOW66 type=write size=2697244 2024-09-22T08:25:13.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.432+0000 7f8a8d811780 1 < canceled part key=_multipart_MJJPUJP2NSOK.2~B57PS9RBCFMO.0 size=366357 2024-09-22T08:25:13.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.434+0000 7f8a8d811780 1 < canceled multipart upload key=MJJPUJP2NSOK upload=B57PS9RBCFMO tag=VJL7BKS70K2M type=write size=1414933 2024-09-22T08:25:13.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.436+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=UJYDLGJYO0J5 type=del size=806007 2024-09-22T08:25:13.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.437+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~LLSJXD245S7O.0 size=86251 2024-09-22T08:25:13.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.440+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=LLSJXD245S7O tag=TURI87G3039K type=write size=1134827 2024-09-22T08:25:13.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.442+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=VAVTFS0F77P2 type=del size=2833510 2024-09-22T08:25:13.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.443+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~RHDUVHZ3892Q.0 size=1048576 2024-09-22T08:25:13.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.444+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~RHDUVHZ3892Q.1 size=939909 2024-09-22T08:25:13.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.446+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=RHDUVHZ3892Q tag=C84MOG2YRWZ3 type=write size=3037061 2024-09-22T08:25:13.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.448+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=K29PHWILNHLZ type=del size=1123210 2024-09-22T08:25:13.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.448+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.0 size=1048576 2024-09-22T08:25:13.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.449+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.1 size=1048576 2024-09-22T08:25:13.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.451+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~HX3N5S9BMBZW.2 size=426598 2024-09-22T08:25:13.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.453+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=HX3N5S9BMBZW tag=MRB1HGRXEQWO type=write size=3572326 2024-09-22T08:25:13.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.454+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=FIJSO7U7JS52 type=del size=1470595 2024-09-22T08:25:13.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.456+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.0 size=1048576 2024-09-22T08:25:13.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.457+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.1 size=1048576 2024-09-22T08:25:13.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.457+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~H03IOYNJEDYR.2 size=550516 2024-09-22T08:25:13.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.460+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=H03IOYNJEDYR tag=F3QL81ESSY6A type=write size=3696244 2024-09-22T08:25:13.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.462+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~9SO8K4ACJYGG.0 size=254632 2024-09-22T08:25:13.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.462+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=9SO8K4ACJYGG tag=7L4YDJONIDCR type=write size=1303208 2024-09-22T08:25:13.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.463+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=8JADENO6JQ3I type=write size=520926 2024-09-22T08:25:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.465+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=CDPZD71UVE5K type=del size=441532 2024-09-22T08:25:13.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.466+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=5SWPG2RKY0WF type=del 2024-09-22T08:25:13.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.468+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=WVDCTLZ0NQ3V type=del size=1928090 2024-09-22T08:25:13.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.469+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=P2F1RWGSW508 type=del 2024-09-22T08:25:13.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.472+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~3ZL2V45LCH2H.0 size=1048576 2024-09-22T08:25:13.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.473+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~3ZL2V45LCH2H.1 size=26834 2024-09-22T08:25:13.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.473+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=3ZL2V45LCH2H tag=IN8Z4QQNBTH1 type=write size=2123986 2024-09-22T08:25:13.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.475+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~B5PD7CJ1N7T0.0 size=1014512 2024-09-22T08:25:13.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.477+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=B5PD7CJ1N7T0 tag=PLORKUUC65VU type=write size=2063088 2024-09-22T08:25:13.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.479+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~MW9IZ69ASSCX.0 size=1048576 2024-09-22T08:25:13.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.481+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~MW9IZ69ASSCX.1 size=774072 2024-09-22T08:25:13.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.481+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=MW9IZ69ASSCX tag=DFYGWSVEXUI2 type=write size=2871224 2024-09-22T08:25:13.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.482+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=QB6ZT3DKDW8L type=del 2024-09-22T08:25:13.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.484+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~ZOM9IGL0YLKT.0 size=1048576 2024-09-22T08:25:13.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.486+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~ZOM9IGL0YLKT.1 size=996444 2024-09-22T08:25:13.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.486+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=ZOM9IGL0YLKT tag=QKVEP4LZ5U1D type=write size=3093596 2024-09-22T08:25:13.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.487+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~GYRU0XY1F5E4.0 size=1048576 2024-09-22T08:25:13.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.489+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~GYRU0XY1F5E4.1 size=950330 2024-09-22T08:25:13.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.491+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=GYRU0XY1F5E4 tag=L6EV9SZ9VX78 type=write size=3047482 2024-09-22T08:25:13.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.494+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.0 size=1048576 2024-09-22T08:25:13.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.495+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.1 size=1048576 2024-09-22T08:25:13.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.497+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.2 size=950510 2024-09-22T08:25:13.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.497+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=6GKXHGBA3AEI tag=MRLR1905A3BQ type=write size=4096238 2024-09-22T08:25:13.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.498+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=DXTPDHF5STMX type=del 2024-09-22T08:25:13.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.499+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=NBAZ7UZQE4LX type=del size=2378687 2024-09-22T08:25:13.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.500+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~PRAJ8Z5B8Z14.0 size=1048576 2024-09-22T08:25:13.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.501+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~PRAJ8Z5B8Z14.1 size=661843 2024-09-22T08:25:13.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.503+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=PRAJ8Z5B8Z14 tag=QH06HKIGL6BL type=write size=2758995 2024-09-22T08:25:13.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.506+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~4SAUGLG6C27H.0 size=1048576 2024-09-22T08:25:13.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.507+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~4SAUGLG6C27H.1 size=468884 2024-09-22T08:25:13.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.507+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=4SAUGLG6C27H tag=QK4A6TTWGQ1D type=write size=2566036 2024-09-22T08:25:13.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.508+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~XFVK4GAG06M8.0 size=1048576 2024-09-22T08:25:13.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.509+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~XFVK4GAG06M8.1 size=487837 2024-09-22T08:25:13.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.512+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=XFVK4GAG06M8 tag=2F6JY0UUBCW0 type=write size=2584989 2024-09-22T08:25:13.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.513+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=KNT611WQNU1T type=del size=3771494 2024-09-22T08:25:13.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.516+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=LDKN3BZTLE70 type=del 2024-09-22T08:25:13.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.517+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=F22WYQ761CQC type=del size=1637732 2024-09-22T08:25:13.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.519+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~AFEG7HAYCW71.0 size=1048576 2024-09-22T08:25:13.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.521+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~AFEG7HAYCW71.1 size=600092 2024-09-22T08:25:13.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.523+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=AFEG7HAYCW71 tag=IVNBWW7YOW66 type=write size=2697244 2024-09-22T08:25:13.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.526+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.0 size=1048576 2024-09-22T08:25:13.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.527+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.1 size=1048576 2024-09-22T08:25:13.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.528+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.2 size=215635 2024-09-22T08:25:13.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.528+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=FY29EHQEQ7GT tag=HXI5ZD0G19U3 type=write size=3361363 2024-09-22T08:25:13.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.529+0000 7f8a8d811780 1 < canceled operation key=WR1JR0APSOKN tag=UJYDLGJYO0J5 type=del size=806007 2024-09-22T08:25:13.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.531+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=PFTBELEQA416 type=del size=3697334 2024-09-22T08:25:13.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.532+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=VAVTFS0F77P2 type=del 2024-09-22T08:25:13.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.534+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=EL2MIBQ3AGWD type=del size=3690456 2024-09-22T08:25:13.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.537+0000 7f8a8d811780 1 < suggested update operation key=MJJPUJP2NSOK tag=K29PHWILNHLZ type=del size=1123210 2024-09-22T08:25:13.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.539+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.0 size=1048576 2024-09-22T08:25:13.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.540+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.1 size=1048576 2024-09-22T08:25:13.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.541+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.2 size=790997 2024-09-22T08:25:13.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.541+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=5QWFA7PL5PVQ tag=8KJ7HFLHQXO0 type=write size=3936725 2024-09-22T08:25:13.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.543+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=FIJSO7U7JS52 type=del size=1470595 2024-09-22T08:25:13.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.546+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=UDDRF0DFG9GU type=write size=542361 2024-09-22T08:25:13.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.546+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~9SO8K4ACJYGG.0 size=254632 2024-09-22T08:25:13.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.549+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=9SO8K4ACJYGG tag=7L4YDJONIDCR type=write size=1303208 2024-09-22T08:25:13.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.550+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=5ZJH29KO2AND type=del size=461648 2024-09-22T08:25:13.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.553+0000 7f8a8d811780 1 < suggested remove operation key=0AOI0OB2YFVV tag=CDPZD71UVE5K type=del 2024-09-22T08:25:13.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.555+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=7WVVMSNIBOSV type=del size=1012248 2024-09-22T08:25:13.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.559+0000 7f8a8d811780 1 < suggested remove operation key=1719KI1YP1FT tag=WVDCTLZ0NQ3V type=del 2024-09-22T08:25:13.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.561+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.0 size=1048576 2024-09-22T08:25:13.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.562+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.1 size=1048576 2024-09-22T08:25:13.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.563+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.2 size=458473 2024-09-22T08:25:13.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.563+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=MFGK73LPOBHM tag=CRQ2AJMAOP31 type=write size=3604201 2024-09-22T08:25:13.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.565+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~3ZL2V45LCH2H.0 size=1048576 2024-09-22T08:25:13.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.566+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~3ZL2V45LCH2H.1 size=26834 2024-09-22T08:25:13.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.568+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=3ZL2V45LCH2H tag=IN8Z4QQNBTH1 type=write size=2123986 2024-09-22T08:25:13.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.569+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=Y6T6T04SYTW1 type=write size=145050 2024-09-22T08:25:13.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.570+0000 7f8a8d811780 1 < canceled part key=_multipart_QE6XEMOZMCF1.2~MW9IZ69ASSCX.0 size=1048576 2024-09-22T08:25:13.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.572+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~MW9IZ69ASSCX.1 size=774072 2024-09-22T08:25:13.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.574+0000 7f8a8d811780 1 < canceled multipart upload key=QE6XEMOZMCF1 upload=MW9IZ69ASSCX tag=DFYGWSVEXUI2 type=write size=2871224 2024-09-22T08:25:13.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.576+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=7VNE9ZDU28KE type=del size=877152 2024-09-22T08:25:13.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.577+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~ZOM9IGL0YLKT.0 size=1048576 2024-09-22T08:25:13.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.578+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~ZOM9IGL0YLKT.1 size=996444 2024-09-22T08:25:13.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.580+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=ZOM9IGL0YLKT tag=QKVEP4LZ5U1D type=write size=3093596 2024-09-22T08:25:13.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.582+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=1LSQKMTZZVP7 type=del size=1774019 2024-09-22T08:25:13.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.583+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.0 size=1048576 2024-09-22T08:25:13.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.584+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.1 size=1048576 2024-09-22T08:25:13.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.585+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~6GKXHGBA3AEI.2 size=950510 2024-09-22T08:25:13.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.588+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=6GKXHGBA3AEI tag=MRLR1905A3BQ type=write size=4096238 2024-09-22T08:25:13.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.590+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~G3TH6O6XJZ9B.0 size=228160 2024-09-22T08:25:13.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.590+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=G3TH6O6XJZ9B tag=F2NK1A6BKRWJ type=write size=1276736 2024-09-22T08:25:13.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.592+0000 7f8a8d811780 1 < canceled operation key=7XBR6QIHD8TJ tag=NBAZ7UZQE4LX type=del size=2378687 2024-09-22T08:25:13.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.593+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=31IF8QL7MSZL type=del size=1973843 2024-09-22T08:25:13.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.595+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~4SAUGLG6C27H.0 size=1048576 2024-09-22T08:25:13.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.597+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~4SAUGLG6C27H.1 size=468884 2024-09-22T08:25:13.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.598+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=4SAUGLG6C27H tag=QK4A6TTWGQ1D type=write size=2566036 2024-09-22T08:25:13.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.600+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=1RN7H9LANDRG type=del size=3267224 2024-09-22T08:25:13.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.602+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=KNT611WQNU1T type=del 2024-09-22T08:25:13.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.603+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=EPWBN4F40YC2 type=write size=275096 2024-09-22T08:25:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.606+0000 7f8a8d811780 1 < suggested update operation key=3T2TX83CSE2D tag=F22WYQ761CQC type=del size=1637732 2024-09-22T08:25:13.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.608+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=QHN50D49SUY4 type=del size=2640851 2024-09-22T08:25:13.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.609+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.0 size=1048576 2024-09-22T08:25:13.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.610+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.1 size=1048576 2024-09-22T08:25:13.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.611+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~FY29EHQEQ7GT.2 size=215635 2024-09-22T08:25:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.613+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=FY29EHQEQ7GT tag=HXI5ZD0G19U3 type=write size=3361363 2024-09-22T08:25:13.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.616+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~09VOLRMTS6ZL.0 size=406592 2024-09-22T08:25:13.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.616+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=09VOLRMTS6ZL tag=EOIK5Z184DQT type=write size=1455168 2024-09-22T08:25:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.617+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=PFTBELEQA416 type=del 2024-09-22T08:25:13.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.620+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~Q88A0ZH6WZRJ.0 size=680985 2024-09-22T08:25:13.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.620+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=Q88A0ZH6WZRJ tag=50ZZE9JTK99D type=write size=1729561 2024-09-22T08:25:13.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.622+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=EL2MIBQ3AGWD type=del 2024-09-22T08:25:13.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.623+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=U4ZM1FPKS9W8 type=del size=1627871 2024-09-22T08:25:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.624+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.0 size=1048576 2024-09-22T08:25:13.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.625+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.1 size=1048576 2024-09-22T08:25:13.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.627+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~5QWFA7PL5PVQ.2 size=790997 2024-09-22T08:25:13.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.629+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=5QWFA7PL5PVQ tag=8KJ7HFLHQXO0 type=write size=3936725 2024-09-22T08:25:13.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.631+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.0 size=1048576 2024-09-22T08:25:13.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.633+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.1 size=1048576 2024-09-22T08:25:13.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.634+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.2 size=656519 2024-09-22T08:25:13.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.634+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=Z8H9E1UGBOYF tag=OW5Y55EFXOWC type=write size=3802247 2024-09-22T08:25:13.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.637+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=UDDRF0DFG9GU type=write 2024-09-22T08:25:13.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.639+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.0 size=1048576 2024-09-22T08:25:13.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.640+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.1 size=1048576 2024-09-22T08:25:13.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.641+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.2 size=655121 2024-09-22T08:25:13.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.641+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=8VK5U935I833 tag=GGOZCG9BUO2S type=write size=3800849 2024-09-22T08:25:13.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.643+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=5ZJH29KO2AND type=del 2024-09-22T08:25:13.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.644+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=LXNJUNS68FO9 type=del size=2219857 2024-09-22T08:25:13.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.645+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=7WVVMSNIBOSV type=del 2024-09-22T08:25:13.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.647+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=MFEY7TVWKUVM type=del size=1610856 2024-09-22T08:25:13.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.648+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.0 size=1048576 2024-09-22T08:25:13.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.649+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.1 size=1048576 2024-09-22T08:25:13.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.650+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~MFGK73LPOBHM.2 size=458473 2024-09-22T08:25:13.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.653+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=MFGK73LPOBHM tag=CRQ2AJMAOP31 type=write size=3604201 2024-09-22T08:25:13.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.654+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=BWBGAV7YC2BR type=del size=3085847 2024-09-22T08:25:13.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.657+0000 7f8a8d811780 1 < suggested update operation key=A8TGVQ273MNF tag=Y6T6T04SYTW1 type=write size=145050 2024-09-22T08:25:13.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.659+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=I5GMVRAPFV7Z type=del size=3442005 2024-09-22T08:25:13.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.660+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=7VNE9ZDU28KE type=del 2024-09-22T08:25:13.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.661+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=ZH9SWKW8EA43 type=del size=3622978 2024-09-22T08:25:13.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.664+0000 7f8a8d811780 1 < suggested remove operation key=1719KI1YP1FT tag=1LSQKMTZZVP7 type=del 2024-09-22T08:25:13.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.665+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=NYBVGBBPRUFA type=del size=1199620 2024-09-22T08:25:13.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.667+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~G3TH6O6XJZ9B.0 size=228160 2024-09-22T08:25:13.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.669+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=G3TH6O6XJZ9B tag=F2NK1A6BKRWJ type=write size=1276736 2024-09-22T08:25:13.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.672+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~IC5MSKU8LTWC.0 size=1048576 2024-09-22T08:25:13.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.673+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~IC5MSKU8LTWC.1 size=313352 2024-09-22T08:25:13.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.673+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=IC5MSKU8LTWC tag=5IADUA6ULNPC type=write size=2410504 2024-09-22T08:25:13.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.676+0000 7f8a8d811780 1 < suggested remove operation key=WOSCCX4WX2FN tag=31IF8QL7MSZL type=del 2024-09-22T08:25:13.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.678+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.0 size=1048576 2024-09-22T08:25:13.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.679+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.1 size=1048576 2024-09-22T08:25:13.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.680+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.2 size=569375 2024-09-22T08:25:13.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.680+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=E6MN5JZ3HUPQ tag=3BRTWNN9DJQ3 type=write size=3715103 2024-09-22T08:25:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.682+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=1RN7H9LANDRG type=del 2024-09-22T08:25:13.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.685+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~GCXEKN1PGNE8.0 size=1048576 2024-09-22T08:25:13.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.686+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~GCXEKN1PGNE8.1 size=874885 2024-09-22T08:25:13.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.686+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=GCXEKN1PGNE8 tag=B591OOIU59WC type=write size=2972037 2024-09-22T08:25:13.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.688+0000 7f8a8d811780 1 < completed write operation key=MJJPUJP2NSOK tag=EPWBN4F40YC2 type=write size=275096 2024-09-22T08:25:13.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.691+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~A3QLV061OOJH.0 size=1048576 2024-09-22T08:25:13.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.691+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~A3QLV061OOJH.1 size=143086 2024-09-22T08:25:13.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.691+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=A3QLV061OOJH tag=ZZT2AIJN3A37 type=write size=2240238 2024-09-22T08:25:13.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.694+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=QHN50D49SUY4 type=del 2024-09-22T08:25:13.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.696+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~R9UY04XNZQO0.0 size=1048576 2024-09-22T08:25:13.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.697+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~R9UY04XNZQO0.1 size=478147 2024-09-22T08:25:13.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.697+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=R9UY04XNZQO0 tag=IS9ONZ0HCH9R type=write size=2575299 2024-09-22T08:25:13.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.698+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~09VOLRMTS6ZL.0 size=406592 2024-09-22T08:25:13.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.701+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=09VOLRMTS6ZL tag=EOIK5Z184DQT type=write size=1455168 2024-09-22T08:25:13.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.703+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~OQLNDNZW7LWA.0 size=1048576 2024-09-22T08:25:13.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.705+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~OQLNDNZW7LWA.1 size=167633 2024-09-22T08:25:13.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.705+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=OQLNDNZW7LWA tag=Z7OYDYDSA6BO type=write size=2264785 2024-09-22T08:25:13.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.707+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~Q88A0ZH6WZRJ.0 size=680985 2024-09-22T08:25:13.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.709+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=Q88A0ZH6WZRJ tag=50ZZE9JTK99D type=write size=1729561 2024-09-22T08:25:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.713+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~LO5XNYGDC9X4.0 size=91168 2024-09-22T08:25:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.713+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=LO5XNYGDC9X4 tag=HNYIKXNR193Z type=write size=1139744 2024-09-22T08:25:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.715+0000 7f8a8d811780 1 < suggested update operation key=A8TGVQ273MNF tag=U4ZM1FPKS9W8 type=del size=1627871 2024-09-22T08:25:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.717+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=G91IC3WZLMF9 type=write size=87712 2024-09-22T08:25:13.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.718+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.0 size=1048576 2024-09-22T08:25:13.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.718+0000 7f8a8d811780 1 < canceled part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.1 size=1048576 2024-09-22T08:25:13.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.719+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~Z8H9E1UGBOYF.2 size=656519 2024-09-22T08:25:13.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.722+0000 7f8a8d811780 1 < canceled multipart upload key=9EY50PUC6AJJ upload=Z8H9E1UGBOYF tag=OW5Y55EFXOWC type=write size=3802247 2024-09-22T08:25:13.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.724+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=HT0CYQP3K47I type=del size=667265 2024-09-22T08:25:13.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.725+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.0 size=1048576 2024-09-22T08:25:13.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.726+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.1 size=1048576 2024-09-22T08:25:13.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.727+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~8VK5U935I833.2 size=655121 2024-09-22T08:25:13.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.729+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=8VK5U935I833 tag=GGOZCG9BUO2S type=write size=3800849 2024-09-22T08:25:13.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.732+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~B1U65HRIAFQC.0 size=947997 2024-09-22T08:25:13.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.732+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=B1U65HRIAFQC tag=4FH0SC7WKDWS type=write size=1996573 2024-09-22T08:25:13.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.733+0000 7f8a8d811780 -1 < failed to complete operation key=A8TGVQ273MNF tag=LXNJUNS68FO9 type=del size=2219857: (22) Invalid argument 2024-09-22T08:25:13.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.734+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=SA9MK1JSP29G type=del size=1632 2024-09-22T08:25:13.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.736+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=MFEY7TVWKUVM type=del 2024-09-22T08:25:13.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.738+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.0 size=1048576 2024-09-22T08:25:13.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.739+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.1 size=1048576 2024-09-22T08:25:13.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.741+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.2 size=421417 2024-09-22T08:25:13.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.741+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=NVQXZ4VHXCA9 tag=1D0UWZKP2YV2 type=write size=3567145 2024-09-22T08:25:13.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.742+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=BWBGAV7YC2BR type=del 2024-09-22T08:25:13.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.745+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~0KZQA67UEG6W.0 size=774361 2024-09-22T08:25:13.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.745+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=0KZQA67UEG6W tag=LA7S0O52CH06 type=write size=1822937 2024-09-22T08:25:13.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.746+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=I5GMVRAPFV7Z type=del 2024-09-22T08:25:13.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.748+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=9O33SKOSQSR5 type=del size=2293160 2024-09-22T08:25:13.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.749+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=ZH9SWKW8EA43 type=del 2024-09-22T08:25:13.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.752+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~B9OOKGL4FEAK.0 size=412321 2024-09-22T08:25:13.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.752+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=B9OOKGL4FEAK tag=Z0LNS3Y6I5RO type=write size=1460897 2024-09-22T08:25:13.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.753+0000 7f8a8d811780 -1 < failed to complete operation key=WOSCCX4WX2FN tag=NYBVGBBPRUFA type=del size=1199620: (22) Invalid argument 2024-09-22T08:25:13.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.754+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=37BQ2BM73XEL type=del size=2286056 2024-09-22T08:25:13.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.756+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~IC5MSKU8LTWC.0 size=1048576 2024-09-22T08:25:13.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.756+0000 7f8a8d811780 1 < canceled part key=_multipart_RRTLTMWJIWSW.2~IC5MSKU8LTWC.1 size=313352 2024-09-22T08:25:13.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.758+0000 7f8a8d811780 1 < canceled multipart upload key=RRTLTMWJIWSW upload=IC5MSKU8LTWC tag=5IADUA6ULNPC type=write size=2410504 2024-09-22T08:25:13.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.761+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~HCQPC1B9Y18J.0 size=1048576 2024-09-22T08:25:13.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.762+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~HCQPC1B9Y18J.1 size=945458 2024-09-22T08:25:13.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.762+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=HCQPC1B9Y18J tag=57KBIEEPDEW4 type=write size=3042610 2024-09-22T08:25:13.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.764+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.0 size=1048576 2024-09-22T08:25:13.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.765+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.1 size=1048576 2024-09-22T08:25:13.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.766+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~E6MN5JZ3HUPQ.2 size=569375 2024-09-22T08:25:13.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.769+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=E6MN5JZ3HUPQ tag=3BRTWNN9DJQ3 type=write size=3715103 2024-09-22T08:25:13.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.771+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~IWTXZ7RZ5DZX.0 size=903051 2024-09-22T08:25:13.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.771+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=IWTXZ7RZ5DZX tag=YIXR17Y5BJIB type=write size=1951627 2024-09-22T08:25:13.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.771+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~GCXEKN1PGNE8.0 size=1048576 2024-09-22T08:25:13.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.772+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~GCXEKN1PGNE8.1 size=874885 2024-09-22T08:25:13.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.775+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=GCXEKN1PGNE8 tag=B591OOIU59WC type=write size=2972037 2024-09-22T08:25:13.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.776+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=NDT8EZWDVQMH type=del size=1933074 2024-09-22T08:25:13.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.777+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~A3QLV061OOJH.0 size=1048576 2024-09-22T08:25:13.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.779+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~A3QLV061OOJH.1 size=143086 2024-09-22T08:25:13.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.781+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=A3QLV061OOJH tag=ZZT2AIJN3A37 type=write size=2240238 2024-09-22T08:25:13.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.784+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~3LXKN9X22RGW.0 size=1048576 2024-09-22T08:25:13.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.785+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~3LXKN9X22RGW.1 size=807494 2024-09-22T08:25:13.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.785+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=3LXKN9X22RGW tag=D5CTFIPYDXNN type=write size=2904646 2024-09-22T08:25:13.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.786+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~R9UY04XNZQO0.0 size=1048576 2024-09-22T08:25:13.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.788+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~R9UY04XNZQO0.1 size=478147 2024-09-22T08:25:13.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.790+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=R9UY04XNZQO0 tag=IS9ONZ0HCH9R type=write size=2575299 2024-09-22T08:25:13.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.793+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~2QQOANSHV5KP.0 size=1048576 2024-09-22T08:25:13.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.794+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~2QQOANSHV5KP.1 size=550521 2024-09-22T08:25:13.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.794+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=2QQOANSHV5KP tag=USMGSKQ298WY type=write size=2647673 2024-09-22T08:25:13.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.795+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~OQLNDNZW7LWA.0 size=1048576 2024-09-22T08:25:13.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.796+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~OQLNDNZW7LWA.1 size=167633 2024-09-22T08:25:13.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.799+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=OQLNDNZW7LWA tag=Z7OYDYDSA6BO type=write size=2264785 2024-09-22T08:25:13.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.800+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=4Z1X20OJZ1U7 type=del size=811961 2024-09-22T08:25:13.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.802+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~LO5XNYGDC9X4.0 size=91168 2024-09-22T08:25:13.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.805+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=LO5XNYGDC9X4 tag=HNYIKXNR193Z type=write size=1139744 2024-09-22T08:25:13.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.807+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~Q4RYAZ0TGV70.0 size=537550 2024-09-22T08:25:13.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.807+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=Q4RYAZ0TGV70 tag=CZCK8134EZCW type=write size=1586126 2024-09-22T08:25:13.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.808+0000 7f8a8d811780 1 < completed write operation key=RRTLTMWJIWSW tag=G91IC3WZLMF9 type=write size=87712 2024-09-22T08:25:13.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.812+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~SZY3UUXPVD3H.0 size=1048576 2024-09-22T08:25:13.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.813+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~SZY3UUXPVD3H.1 size=199345 2024-09-22T08:25:13.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.813+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=SZY3UUXPVD3H tag=A0NPPPUQM25U type=write size=2296497 2024-09-22T08:25:13.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.814+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=HT0CYQP3K47I type=del 2024-09-22T08:25:13.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.815+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=EMVKM950ZFJ6 type=del size=268899 2024-09-22T08:25:13.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.818+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~B1U65HRIAFQC.0 size=947997 2024-09-22T08:25:13.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.821+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=B1U65HRIAFQC tag=4FH0SC7WKDWS type=write size=1996573 2024-09-22T08:25:13.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.822+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=59PZZG4SZN3H type=write size=413138 2024-09-22T08:25:13.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.825+0000 7f8a8d811780 1 < suggested remove operation key=JWJ9T6XYCUYR tag=SA9MK1JSP29G type=del 2024-09-22T08:25:13.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.828+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~8C2GZDSZAFHC.0 size=1048576 2024-09-22T08:25:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.829+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~8C2GZDSZAFHC.1 size=654784 2024-09-22T08:25:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.829+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=8C2GZDSZAFHC tag=6HUF6MQGMOSH type=write size=2751936 2024-09-22T08:25:13.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.830+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.0 size=1048576 2024-09-22T08:25:13.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.831+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.1 size=1048576 2024-09-22T08:25:13.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.832+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~NVQXZ4VHXCA9.2 size=421417 2024-09-22T08:25:13.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.835+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=NVQXZ4VHXCA9 tag=1D0UWZKP2YV2 type=write size=3567145 2024-09-22T08:25:13.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.836+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=9DWQ4RV312QL type=del size=1997271 2024-09-22T08:25:13.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.837+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~0KZQA67UEG6W.0 size=774361 2024-09-22T08:25:13.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.839+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=0KZQA67UEG6W tag=LA7S0O52CH06 type=write size=1822937 2024-09-22T08:25:13.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.841+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=RMPRZ9NZ9A7P type=del size=3280018 2024-09-22T08:25:13.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:13.842+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=9O33SKOSQSR5 type=del 2024-09-22T08:25:14.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.047+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~C99O7W3VPQ53.0 size=1048576 2024-09-22T08:25:14.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.049+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~C99O7W3VPQ53.1 size=853586 2024-09-22T08:25:14.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.049+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=C99O7W3VPQ53 tag=A0RLUFJ969OF type=write size=2950738 2024-09-22T08:25:14.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.051+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~B9OOKGL4FEAK.0 size=412321 2024-09-22T08:25:14.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.054+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=B9OOKGL4FEAK tag=Z0LNS3Y6I5RO type=write size=1460897 2024-09-22T08:25:14.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.055+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=5M310PU3BCNC type=del size=3861209 2024-09-22T08:25:14.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.057+0000 7f8a8d811780 1 < canceled operation key=MJJPUJP2NSOK tag=37BQ2BM73XEL type=del size=2286056 2024-09-22T08:25:14.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.060+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.0 size=1048576 2024-09-22T08:25:14.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.061+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.1 size=1048576 2024-09-22T08:25:14.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.062+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.2 size=331928 2024-09-22T08:25:14.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.062+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=K2IQJ6K7CVHN tag=DVZKXGXDV3OH type=write size=3477656 2024-09-22T08:25:14.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.062+0000 7f8a8d811780 1 < canceled part key=_multipart_S9JCKGZS5QLY.2~HCQPC1B9Y18J.0 size=1048576 2024-09-22T08:25:14.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.063+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~HCQPC1B9Y18J.1 size=945458 2024-09-22T08:25:14.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.066+0000 7f8a8d811780 1 < canceled multipart upload key=S9JCKGZS5QLY upload=HCQPC1B9Y18J tag=57KBIEEPDEW4 type=write size=3042610 2024-09-22T08:25:14.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.069+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.0 size=1048576 2024-09-22T08:25:14.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.070+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.1 size=1048576 2024-09-22T08:25:14.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.072+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.2 size=301874 2024-09-22T08:25:14.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.072+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=7RWXPUEW9ARH tag=FJ9Y7BA4LLOX type=write size=3447602 2024-09-22T08:25:14.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.073+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~IWTXZ7RZ5DZX.0 size=903051 2024-09-22T08:25:14.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.076+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=IWTXZ7RZ5DZX tag=YIXR17Y5BJIB type=write size=1951627 2024-09-22T08:25:14.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.079+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.0 size=1048576 2024-09-22T08:25:14.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.080+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.1 size=1048576 2024-09-22T08:25:14.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.081+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.2 size=672676 2024-09-22T08:25:14.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.081+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=HQ2IQAAHV3ZS tag=SR0CYT77D11Y type=write size=3818404 2024-09-22T08:25:14.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.083+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=NDT8EZWDVQMH type=del 2024-09-22T08:25:14.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.084+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=THHN28PSRRUF type=del size=3389806 2024-09-22T08:25:14.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.086+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~3LXKN9X22RGW.0 size=1048576 2024-09-22T08:25:14.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.088+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~3LXKN9X22RGW.1 size=807494 2024-09-22T08:25:14.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.090+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=3LXKN9X22RGW tag=D5CTFIPYDXNN type=write size=2904646 2024-09-22T08:25:14.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.091+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=60Q9LP6EV15S type=del size=3370667 2024-09-22T08:25:14.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.093+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~2QQOANSHV5KP.0 size=1048576 2024-09-22T08:25:14.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.095+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~2QQOANSHV5KP.1 size=550521 2024-09-22T08:25:14.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.097+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=2QQOANSHV5KP tag=USMGSKQ298WY type=write size=2647673 2024-09-22T08:25:14.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.100+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.0 size=1048576 2024-09-22T08:25:14.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.101+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.1 size=1048576 2024-09-22T08:25:14.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.102+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.2 size=793500 2024-09-22T08:25:14.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.102+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=JAM1T5HJ7XG3 tag=9H8EFCD2IP9J type=write size=3939228 2024-09-22T08:25:14.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.103+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=4Z1X20OJZ1U7 type=del size=811961 2024-09-22T08:25:14.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.106+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.0 size=1048576 2024-09-22T08:25:14.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.107+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.1 size=1048576 2024-09-22T08:25:14.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.108+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.2 size=463410 2024-09-22T08:25:14.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.108+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=N2IVE8F1QLT5 tag=UPPAA2LL2WV7 type=write size=3609138 2024-09-22T08:25:14.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.110+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~Q4RYAZ0TGV70.0 size=537550 2024-09-22T08:25:14.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.113+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=Q4RYAZ0TGV70 tag=CZCK8134EZCW type=write size=1586126 2024-09-22T08:25:14.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.114+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=WD7X3CFXTP17 type=write size=520210 2024-09-22T08:25:14.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.115+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~SZY3UUXPVD3H.0 size=1048576 2024-09-22T08:25:14.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.115+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~SZY3UUXPVD3H.1 size=199345 2024-09-22T08:25:14.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.118+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=SZY3UUXPVD3H tag=A0NPPPUQM25U type=write size=2296497 2024-09-22T08:25:14.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.120+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~FUJH412XLRGS.0 size=82387 2024-09-22T08:25:14.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.120+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=FUJH412XLRGS tag=5N8M80IT31R6 type=write size=1130963 2024-09-22T08:25:14.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.122+0000 7f8a8d811780 1 < canceled operation key=3T2TX83CSE2D tag=EMVKM950ZFJ6 type=del size=268899 2024-09-22T08:25:14.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.123+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=CY9EXAIH13XT type=del size=883357 2024-09-22T08:25:14.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.125+0000 7f8a8d811780 1 < completed write operation key=S9JCKGZS5QLY tag=59PZZG4SZN3H type=write size=413138 2024-09-22T08:25:14.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.127+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=YZRGSJWX3AWX type=del size=184419 2024-09-22T08:25:14.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.128+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~8C2GZDSZAFHC.0 size=1048576 2024-09-22T08:25:14.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.129+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~8C2GZDSZAFHC.1 size=654784 2024-09-22T08:25:14.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.132+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=8C2GZDSZAFHC tag=6HUF6MQGMOSH type=write size=2751936 2024-09-22T08:25:14.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.133+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=JZ600PTTU37F type=del size=3720410 2024-09-22T08:25:14.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.135+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=9DWQ4RV312QL type=del 2024-09-22T08:25:14.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.136+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=N982TH43Q8CP type=del size=1895396 2024-09-22T08:25:14.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.139+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=RMPRZ9NZ9A7P type=del 2024-09-22T08:25:14.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.141+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=LEP3YA9IIAH2 type=write size=608767 2024-09-22T08:25:14.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.142+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~C99O7W3VPQ53.0 size=1048576 2024-09-22T08:25:14.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.143+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~C99O7W3VPQ53.1 size=853586 2024-09-22T08:25:14.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.146+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=C99O7W3VPQ53 tag=A0RLUFJ969OF type=write size=2950738 2024-09-22T08:25:14.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.148+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=AMYHWE7U3XGM type=del size=563378 2024-09-22T08:25:14.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.151+0000 7f8a8d811780 1 < suggested update operation key=JP7IZ0CMXTSX tag=5M310PU3BCNC type=del size=3861209 2024-09-22T08:25:14.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.153+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=THPJ9V0ZWRJ2 type=write size=310109 2024-09-22T08:25:14.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.154+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.0 size=1048576 2024-09-22T08:25:14.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.156+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.1 size=1048576 2024-09-22T08:25:14.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.157+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~K2IQJ6K7CVHN.2 size=331928 2024-09-22T08:25:14.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.161+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=K2IQJ6K7CVHN tag=DVZKXGXDV3OH type=write size=3477656 2024-09-22T08:25:14.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.162+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=3D90SEG1VURJ type=del size=1698896 2024-09-22T08:25:14.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.164+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.0 size=1048576 2024-09-22T08:25:14.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.165+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.1 size=1048576 2024-09-22T08:25:14.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.165+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~7RWXPUEW9ARH.2 size=301874 2024-09-22T08:25:14.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.167+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=7RWXPUEW9ARH tag=FJ9Y7BA4LLOX type=write size=3447602 2024-09-22T08:25:14.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.169+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=704MJNLJEZK8 type=del size=2902478 2024-09-22T08:25:14.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.170+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.0 size=1048576 2024-09-22T08:25:14.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.171+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.1 size=1048576 2024-09-22T08:25:14.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.172+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~HQ2IQAAHV3ZS.2 size=672676 2024-09-22T08:25:14.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.175+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=HQ2IQAAHV3ZS tag=SR0CYT77D11Y type=write size=3818404 2024-09-22T08:25:14.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.176+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=ULSYEI26U83R type=del size=2404517 2024-09-22T08:25:14.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.177+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=THHN28PSRRUF type=del 2024-09-22T08:25:14.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.180+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~XI3M25XCL7M9.0 size=542348 2024-09-22T08:25:14.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.180+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=XI3M25XCL7M9 tag=WRXG8LQ6RR7F type=write size=1590924 2024-09-22T08:25:14.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.181+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=60Q9LP6EV15S type=del 2024-09-22T08:25:14.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.184+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~JNEU8BLR771U.0 size=906082 2024-09-22T08:25:14.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.184+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=JNEU8BLR771U tag=91AQIO5ZKJZZ type=write size=1954658 2024-09-22T08:25:14.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.185+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.0 size=1048576 2024-09-22T08:25:14.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.186+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.1 size=1048576 2024-09-22T08:25:14.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.187+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~JAM1T5HJ7XG3.2 size=793500 2024-09-22T08:25:14.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.189+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=JAM1T5HJ7XG3 tag=9H8EFCD2IP9J type=write size=3939228 2024-09-22T08:25:14.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.192+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~K56ZT713BHO4.0 size=258080 2024-09-22T08:25:14.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.192+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=K56ZT713BHO4 tag=BDAVM0PE3XBH type=write size=1306656 2024-09-22T08:25:14.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.193+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.0 size=1048576 2024-09-22T08:25:14.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.195+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.1 size=1048576 2024-09-22T08:25:14.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.196+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~N2IVE8F1QLT5.2 size=463410 2024-09-22T08:25:14.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.198+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=N2IVE8F1QLT5 tag=UPPAA2LL2WV7 type=write size=3609138 2024-09-22T08:25:14.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.200+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=6Y0J2B8CAPZG type=del size=3081658 2024-09-22T08:25:14.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.201+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=WD7X3CFXTP17 type=write size=520210 2024-09-22T08:25:14.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.204+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~MU2XCDAGLGQ1.0 size=847656 2024-09-22T08:25:14.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.204+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=MU2XCDAGLGQ1 tag=C3TTQC2V8WF1 type=write size=1896232 2024-09-22T08:25:14.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.205+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~FUJH412XLRGS.0 size=82387 2024-09-22T08:25:14.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.208+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=FUJH412XLRGS tag=5N8M80IT31R6 type=write size=1130963 2024-09-22T08:25:14.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.211+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.0 size=1048576 2024-09-22T08:25:14.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.212+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.1 size=1048576 2024-09-22T08:25:14.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.213+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.2 size=1021842 2024-09-22T08:25:14.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.213+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=FDX32GSF8BV8 tag=EDRI4336OP64 type=write size=4167570 2024-09-22T08:25:14.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.215+0000 7f8a8d811780 1 < suggested remove operation key=KIJ2DW4NSZKG tag=CY9EXAIH13XT type=del 2024-09-22T08:25:14.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.218+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.0 size=1048576 2024-09-22T08:25:14.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.219+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.1 size=1048576 2024-09-22T08:25:14.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.221+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.2 size=190208 2024-09-22T08:25:14.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.221+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=8O01YW8PS6WY tag=BT8ED826U9Z3 type=write size=3335936 2024-09-22T08:25:14.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.222+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=YZRGSJWX3AWX type=del 2024-09-22T08:25:14.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.223+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=8EG9ZX3XSLDJ type=del size=2178983 2024-09-22T08:25:14.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.224+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=JZ600PTTU37F type=del 2024-09-22T08:25:14.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.226+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=MTEEAR0V43FC type=del size=1215824 2024-09-22T08:25:14.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.227+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=N982TH43Q8CP type=del 2024-09-22T08:25:14.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.230+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.0 size=1048576 2024-09-22T08:25:14.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.231+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.1 size=1048576 2024-09-22T08:25:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.232+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.2 size=977094 2024-09-22T08:25:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.232+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=UORL1BIR7W0B tag=QS9ME9UY8YHR type=write size=4122822 2024-09-22T08:25:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.234+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=LEP3YA9IIAH2 type=write 2024-09-22T08:25:14.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.236+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=2FJI12EB2YFS type=del size=1824973 2024-09-22T08:25:14.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.237+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=AMYHWE7U3XGM type=del 2024-09-22T08:25:14.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.238+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=XNNZSFVONQNZ type=del size=412827 2024-09-22T08:25:14.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.240+0000 7f8a8d811780 -1 < failed to complete operation key=EILTWP17M0NL tag=THPJ9V0ZWRJ2 type=write size=310109: (22) Invalid argument 2024-09-22T08:25:14.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.242+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=CX5VU146XDV6 type=write size=86361 2024-09-22T08:25:14.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.243+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=3D90SEG1VURJ type=del 2024-09-22T08:25:14.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.246+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~1H66TTKMFYE0.0 size=1048576 2024-09-22T08:25:14.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.248+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~1H66TTKMFYE0.1 size=870959 2024-09-22T08:25:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.248+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=1H66TTKMFYE0 tag=83OFFZKAZKCV type=write size=2968111 2024-09-22T08:25:14.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.250+0000 7f8a8d811780 1 < suggested remove operation key=MJJPUJP2NSOK tag=704MJNLJEZK8 type=del 2024-09-22T08:25:14.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.252+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=H4082LSC6PAI type=del size=3625764 2024-09-22T08:25:14.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.254+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=ULSYEI26U83R type=del 2024-09-22T08:25:14.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.257+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~UXLLN21HLAI9.0 size=1048576 2024-09-22T08:25:14.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.258+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~UXLLN21HLAI9.1 size=795672 2024-09-22T08:25:14.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.258+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=UXLLN21HLAI9 tag=2S7L5J2NT0E6 type=write size=2892824 2024-09-22T08:25:14.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.259+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~XI3M25XCL7M9.0 size=542348 2024-09-22T08:25:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.262+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=XI3M25XCL7M9 tag=WRXG8LQ6RR7F type=write size=1590924 2024-09-22T08:25:14.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.264+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=GLPWGHXQS303 type=del size=3084801 2024-09-22T08:25:14.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.265+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~JNEU8BLR771U.0 size=906082 2024-09-22T08:25:14.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.268+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=JNEU8BLR771U tag=91AQIO5ZKJZZ type=write size=1954658 2024-09-22T08:25:14.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.271+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~CLXCTKHDY24U.0 size=1048576 2024-09-22T08:25:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.272+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~CLXCTKHDY24U.1 size=115344 2024-09-22T08:25:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.272+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=CLXCTKHDY24U tag=SVTA28BRI3DP type=write size=2212496 2024-09-22T08:25:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.274+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~K56ZT713BHO4.0 size=258080 2024-09-22T08:25:14.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.276+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=K56ZT713BHO4 tag=BDAVM0PE3XBH type=write size=1306656 2024-09-22T08:25:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.277+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=XTSAZUX0K5K2 type=del size=547301 2024-09-22T08:25:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.279+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=6Y0J2B8CAPZG type=del 2024-09-22T08:25:14.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.280+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=J7S87TUXH1CY type=del size=1699935 2024-09-22T08:25:14.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.282+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~MU2XCDAGLGQ1.0 size=847656 2024-09-22T08:25:14.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.284+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=MU2XCDAGLGQ1 tag=C3TTQC2V8WF1 type=write size=1896232 2024-09-22T08:25:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.286+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=IZ4EX0PUARNP type=del size=3426499 2024-09-22T08:25:14.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.287+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.0 size=1048576 2024-09-22T08:25:14.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.289+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.1 size=1048576 2024-09-22T08:25:14.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.290+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~FDX32GSF8BV8.2 size=1021842 2024-09-22T08:25:14.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.294+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=FDX32GSF8BV8 tag=EDRI4336OP64 type=write size=4167570 2024-09-22T08:25:14.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.297+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~CYG1WBI4Z5UU.0 size=520258 2024-09-22T08:25:14.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.297+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=CYG1WBI4Z5UU tag=5H6IC9ES093W type=write size=1568834 2024-09-22T08:25:14.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.298+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.0 size=1048576 2024-09-22T08:25:14.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.299+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.1 size=1048576 2024-09-22T08:25:14.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.301+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~8O01YW8PS6WY.2 size=190208 2024-09-22T08:25:14.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.303+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=8O01YW8PS6WY tag=BT8ED826U9Z3 type=write size=3335936 2024-09-22T08:25:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.305+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~1B3IHWSDZZ1E.0 size=1048576 2024-09-22T08:25:14.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.306+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~1B3IHWSDZZ1E.1 size=975305 2024-09-22T08:25:14.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.306+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=1B3IHWSDZZ1E tag=1D53NAYDBYYW type=write size=3072457 2024-09-22T08:25:14.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.308+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=8EG9ZX3XSLDJ type=del 2024-09-22T08:25:14.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.311+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.0 size=1048576 2024-09-22T08:25:14.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.312+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.1 size=1048576 2024-09-22T08:25:14.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.313+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.2 size=229819 2024-09-22T08:25:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.313+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=IVS20Z1QB8MQ tag=IZ8IYRZL7IUC type=write size=3375547 2024-09-22T08:25:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.314+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=MTEEAR0V43FC type=del 2024-09-22T08:25:14.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.317+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.0 size=1048576 2024-09-22T08:25:14.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.319+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.1 size=1048576 2024-09-22T08:25:14.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.319+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.2 size=69462 2024-09-22T08:25:14.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.319+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=0TZNAH8HFSFD tag=C72DS5SM7U72 type=write size=3215190 2024-09-22T08:25:14.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.321+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.0 size=1048576 2024-09-22T08:25:14.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.322+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.1 size=1048576 2024-09-22T08:25:14.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.323+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~UORL1BIR7W0B.2 size=977094 2024-09-22T08:25:14.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.325+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=UORL1BIR7W0B tag=QS9ME9UY8YHR type=write size=4122822 2024-09-22T08:25:14.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.326+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=RG9ON0JAT5E3 type=del size=3945697 2024-09-22T08:25:14.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.328+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=2FJI12EB2YFS type=del 2024-09-22T08:25:14.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.329+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=ZX521W3QVQA1 type=write size=715538 2024-09-22T08:25:14.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.330+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=XNNZSFVONQNZ type=del 2024-09-22T08:25:14.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.334+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.0 size=1048576 2024-09-22T08:25:14.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.335+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.1 size=1048576 2024-09-22T08:25:14.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.336+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.2 size=398936 2024-09-22T08:25:14.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.336+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=BT5M39B7Z16A tag=49MT886TX3KN type=write size=3544664 2024-09-22T08:25:14.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.337+0000 7f8a8d811780 1 < canceled operation key=WR1JR0APSOKN tag=CX5VU146XDV6 type=write size=86361 2024-09-22T08:25:14.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.340+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~F0QLP0Q8A4FT.0 size=202101 2024-09-22T08:25:14.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.340+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=F0QLP0Q8A4FT tag=JCL0553UJ91I type=write size=1250677 2024-09-22T08:25:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.341+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~1H66TTKMFYE0.0 size=1048576 2024-09-22T08:25:14.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.342+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~1H66TTKMFYE0.1 size=870959 2024-09-22T08:25:14.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.345+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=1H66TTKMFYE0 tag=83OFFZKAZKCV type=write size=2968111 2024-09-22T08:25:14.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.348+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~JEOI7CYYH4IK.0 size=1048576 2024-09-22T08:25:14.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.349+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~JEOI7CYYH4IK.1 size=843466 2024-09-22T08:25:14.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.349+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=JEOI7CYYH4IK tag=663OQ3NGZVZP type=write size=2940618 2024-09-22T08:25:14.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.350+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=H4082LSC6PAI type=del 2024-09-22T08:25:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.352+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=C2YQ4J1JTQPD type=del size=2159722 2024-09-22T08:25:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.353+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~UXLLN21HLAI9.0 size=1048576 2024-09-22T08:25:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.353+0000 7f8a8d811780 1 < canceled part key=_multipart_0HCXP53D9NMP.2~UXLLN21HLAI9.1 size=795672 2024-09-22T08:25:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.355+0000 7f8a8d811780 1 < canceled multipart upload key=0HCXP53D9NMP upload=UXLLN21HLAI9 tag=2S7L5J2NT0E6 type=write size=2892824 2024-09-22T08:25:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.356+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=59IJ8RLBRQ2T type=write size=668202 2024-09-22T08:25:14.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.358+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=GLPWGHXQS303 type=del 2024-09-22T08:25:14.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.359+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=HFHOUDZMO9DP type=del size=156039 2024-09-22T08:25:14.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.360+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~CLXCTKHDY24U.0 size=1048576 2024-09-22T08:25:14.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.361+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~CLXCTKHDY24U.1 size=115344 2024-09-22T08:25:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.363+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=CLXCTKHDY24U tag=SVTA28BRI3DP type=write size=2212496 2024-09-22T08:25:14.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.365+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~OQ7NGGWETCYG.0 size=1048576 2024-09-22T08:25:14.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.366+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~OQ7NGGWETCYG.1 size=1026132 2024-09-22T08:25:14.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.366+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=OQ7NGGWETCYG tag=S31ZOH92JJD8 type=write size=3123284 2024-09-22T08:25:14.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.368+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=XTSAZUX0K5K2 type=del 2024-09-22T08:25:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.369+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=MHU9Z0Z0PNJB type=write size=605381 2024-09-22T08:25:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.371+0000 7f8a8d811780 1 < canceled operation key=0HCXP53D9NMP tag=J7S87TUXH1CY type=del size=1699935 2024-09-22T08:25:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.373+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.0 size=1048576 2024-09-22T08:25:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.374+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.1 size=1048576 2024-09-22T08:25:14.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.375+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.2 size=518330 2024-09-22T08:25:14.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.375+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=7J39Y0WVHC3W tag=R5BJNKU3CP2X type=write size=3664058 2024-09-22T08:25:14.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.377+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=IZ4EX0PUARNP type=del 2024-09-22T08:25:14.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.378+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=V3N3UAPA7D0N type=del size=2641554 2024-09-22T08:25:14.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.379+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~CYG1WBI4Z5UU.0 size=520258 2024-09-22T08:25:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.382+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=CYG1WBI4Z5UU tag=5H6IC9ES093W type=write size=1568834 2024-09-22T08:25:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.384+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=8WRPW15WQGFF type=del size=350991 2024-09-22T08:25:14.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.385+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~1B3IHWSDZZ1E.0 size=1048576 2024-09-22T08:25:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.386+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~1B3IHWSDZZ1E.1 size=975305 2024-09-22T08:25:14.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.388+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=1B3IHWSDZZ1E tag=1D53NAYDBYYW type=write size=3072457 2024-09-22T08:25:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.390+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=YH63AJLRO44I type=del size=162607 2024-09-22T08:25:14.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.392+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.0 size=1048576 2024-09-22T08:25:14.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.393+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.1 size=1048576 2024-09-22T08:25:14.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.394+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~IVS20Z1QB8MQ.2 size=229819 2024-09-22T08:25:14.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.397+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=IVS20Z1QB8MQ tag=IZ8IYRZL7IUC type=write size=3375547 2024-09-22T08:25:14.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.399+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~G7BMEZOU7EFF.0 size=135443 2024-09-22T08:25:14.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.399+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=G7BMEZOU7EFF tag=E2LYF56C0CWS type=write size=1184019 2024-09-22T08:25:14.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.401+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.0 size=1048576 2024-09-22T08:25:14.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.402+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.1 size=1048576 2024-09-22T08:25:14.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.403+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~0TZNAH8HFSFD.2 size=69462 2024-09-22T08:25:14.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.406+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=0TZNAH8HFSFD tag=C72DS5SM7U72 type=write size=3215190 2024-09-22T08:25:14.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.408+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=XELAOSWBQFHV type=del size=2564872 2024-09-22T08:25:14.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.409+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=RG9ON0JAT5E3 type=del 2024-09-22T08:25:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.412+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.0 size=1048576 2024-09-22T08:25:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.413+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.1 size=1048576 2024-09-22T08:25:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.414+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.2 size=160324 2024-09-22T08:25:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.414+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=272XEFVJ6I6F tag=5VBWT1P1L33E type=write size=3306052 2024-09-22T08:25:14.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.415+0000 7f8a8d811780 1 < completed write operation key=1719KI1YP1FT tag=ZX521W3QVQA1 type=write size=715538 2024-09-22T08:25:14.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.416+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=SDKFITHP790X type=write size=200767 2024-09-22T08:25:14.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.418+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.0 size=1048576 2024-09-22T08:25:14.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.419+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.1 size=1048576 2024-09-22T08:25:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.420+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~BT5M39B7Z16A.2 size=398936 2024-09-22T08:25:14.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.424+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=BT5M39B7Z16A tag=49MT886TX3KN type=write size=3544664 2024-09-22T08:25:14.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.425+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=6SVH5SO7M0EJ type=del size=2545928 2024-09-22T08:25:14.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.427+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~F0QLP0Q8A4FT.0 size=202101 2024-09-22T08:25:14.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.429+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=F0QLP0Q8A4FT tag=JCL0553UJ91I type=write size=1250677 2024-09-22T08:25:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.432+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.0 size=1048576 2024-09-22T08:25:14.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.433+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.1 size=1048576 2024-09-22T08:25:14.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.434+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.2 size=410428 2024-09-22T08:25:14.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.434+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=56VGOPU3PGT9 tag=JDICATD0JGVM type=write size=3556156 2024-09-22T08:25:14.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.434+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~JEOI7CYYH4IK.0 size=1048576 2024-09-22T08:25:14.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.435+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~JEOI7CYYH4IK.1 size=843466 2024-09-22T08:25:14.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.437+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=JEOI7CYYH4IK tag=663OQ3NGZVZP type=write size=2940618 2024-09-22T08:25:14.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.439+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=121HL1YOV63I type=write size=811947 2024-09-22T08:25:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.441+0000 7f8a8d811780 1 < suggested update operation key=3T2TX83CSE2D tag=C2YQ4J1JTQPD type=del size=2159722 2024-09-22T08:25:14.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.444+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~CQAG122ZIGAO.0 size=623162 2024-09-22T08:25:14.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.444+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=CQAG122ZIGAO tag=AI3B51LW27WC type=write size=1671738 2024-09-22T08:25:14.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.446+0000 7f8a8d811780 1 < completed write operation key=RRTLTMWJIWSW tag=59IJ8RLBRQ2T type=write size=668202 2024-09-22T08:25:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.449+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~G7TKV71Q71UA.0 size=1048576 2024-09-22T08:25:14.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.450+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~G7TKV71Q71UA.1 size=830237 2024-09-22T08:25:14.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.450+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=G7TKV71Q71UA tag=38RBF0ZQTNX4 type=write size=2927389 2024-09-22T08:25:14.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.452+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=HFHOUDZMO9DP type=del 2024-09-22T08:25:14.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.453+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=QOBL83KBX7M9 type=del size=1729580 2024-09-22T08:25:14.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.454+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~OQ7NGGWETCYG.0 size=1048576 2024-09-22T08:25:14.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.455+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~OQ7NGGWETCYG.1 size=1026132 2024-09-22T08:25:14.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.458+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=OQ7NGGWETCYG tag=S31ZOH92JJD8 type=write size=3123284 2024-09-22T08:25:14.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.461+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~ZACNTOXM1USR.0 size=1048576 2024-09-22T08:25:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.462+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~ZACNTOXM1USR.1 size=846583 2024-09-22T08:25:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.462+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=ZACNTOXM1USR tag=006LC9HQCEDV type=write size=2943735 2024-09-22T08:25:14.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.463+0000 7f8a8d811780 1 < completed write operation key=WOSCCX4WX2FN tag=MHU9Z0Z0PNJB type=write size=605381 2024-09-22T08:25:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.467+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~GHA76EO1D1NI.0 size=971374 2024-09-22T08:25:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.467+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=GHA76EO1D1NI tag=JZ0DJ3WZ26ZT type=write size=2019950 2024-09-22T08:25:14.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.467+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.0 size=1048576 2024-09-22T08:25:14.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.468+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.1 size=1048576 2024-09-22T08:25:14.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.470+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~7J39Y0WVHC3W.2 size=518330 2024-09-22T08:25:14.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.472+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=7J39Y0WVHC3W tag=R5BJNKU3CP2X type=write size=3664058 2024-09-22T08:25:14.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.474+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=5N273A35WB9C type=del size=1622695 2024-09-22T08:25:14.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.476+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=V3N3UAPA7D0N type=del 2024-09-22T08:25:14.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.477+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=MX6EOXW8OTQ0 type=del size=3585130 2024-09-22T08:25:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.479+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=8WRPW15WQGFF type=del 2024-09-22T08:25:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.481+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=7IVDUN26PV6Q type=del size=1119540 2024-09-22T08:25:14.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.482+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=YH63AJLRO44I type=del 2024-09-22T08:25:14.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.483+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=58AU6ZCUD4TC type=write size=465273 2024-09-22T08:25:14.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.485+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~G7BMEZOU7EFF.0 size=135443 2024-09-22T08:25:14.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.487+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=G7BMEZOU7EFF tag=E2LYF56C0CWS type=write size=1184019 2024-09-22T08:25:14.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.489+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=58I5RLAA43PT type=del size=65910 2024-09-22T08:25:14.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.490+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=XELAOSWBQFHV type=del 2024-09-22T08:25:14.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.492+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=8MN7YSB1OUCB type=del size=1576871 2024-09-22T08:25:14.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.493+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.0 size=1048576 2024-09-22T08:25:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.494+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.1 size=1048576 2024-09-22T08:25:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.495+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~272XEFVJ6I6F.2 size=160324 2024-09-22T08:25:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.498+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=272XEFVJ6I6F tag=5VBWT1P1L33E type=write size=3306052 2024-09-22T08:25:14.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.500+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=XKZFBZOQ66WJ type=del size=654654 2024-09-22T08:25:14.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.503+0000 7f8a8d811780 1 < suggested update operation key=IOZ7IXVOB70S tag=SDKFITHP790X type=write size=200767 2024-09-22T08:25:14.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.504+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=UM4HH9ZNY5VQ type=del size=3416978 2024-09-22T08:25:14.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.506+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=6SVH5SO7M0EJ type=del 2024-09-22T08:25:14.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.507+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=LNK5JDWIPQKD type=del size=1145782 2024-09-22T08:25:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.509+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.0 size=1048576 2024-09-22T08:25:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.509+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.1 size=1048576 2024-09-22T08:25:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.510+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~56VGOPU3PGT9.2 size=410428 2024-09-22T08:25:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.512+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=56VGOPU3PGT9 tag=JDICATD0JGVM type=write size=3556156 2024-09-22T08:25:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.514+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.0 size=1048576 2024-09-22T08:25:14.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.516+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.1 size=1048576 2024-09-22T08:25:14.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.517+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.2 size=704631 2024-09-22T08:25:14.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.517+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=FPCB0FAKLZTQ tag=L7Y9JA0ZFAFN type=write size=3850359 2024-09-22T08:25:14.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.519+0000 7f8a8d811780 -1 < failed to complete operation key=3T2TX83CSE2D tag=121HL1YOV63I type=write size=811947: (22) Invalid argument 2024-09-22T08:25:14.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.520+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=5M6ZT3EI6XMN type=del size=1575739 2024-09-22T08:25:14.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.522+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~CQAG122ZIGAO.0 size=623162 2024-09-22T08:25:14.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.524+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=CQAG122ZIGAO tag=AI3B51LW27WC type=write size=1671738 2024-09-22T08:25:14.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.526+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~7QAX5RWXHXYF.0 size=1048576 2024-09-22T08:25:14.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.528+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~7QAX5RWXHXYF.1 size=904153 2024-09-22T08:25:14.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.528+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=7QAX5RWXHXYF tag=US50NH3UG01M type=write size=3001305 2024-09-22T08:25:14.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.528+0000 7f8a8d811780 1 < canceled part key=_multipart_RCHUCAL6CQ4F.2~G7TKV71Q71UA.0 size=1048576 2024-09-22T08:25:14.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.529+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~G7TKV71Q71UA.1 size=830237 2024-09-22T08:25:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.532+0000 7f8a8d811780 1 < canceled multipart upload key=RCHUCAL6CQ4F upload=G7TKV71Q71UA tag=38RBF0ZQTNX4 type=write size=2927389 2024-09-22T08:25:14.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.534+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~NL2ROA5TCX90.0 size=873869 2024-09-22T08:25:14.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.534+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=NL2ROA5TCX90 tag=1T87OE7D0H0I type=write size=1922445 2024-09-22T08:25:14.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.536+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=QOBL83KBX7M9 type=del 2024-09-22T08:25:14.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.537+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=CFEVUQOJZLYV type=write size=684147 2024-09-22T08:25:14.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.538+0000 7f8a8d811780 1 < canceled part key=_multipart_7XNMR51803Y6.2~ZACNTOXM1USR.0 size=1048576 2024-09-22T08:25:14.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.539+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~ZACNTOXM1USR.1 size=846583 2024-09-22T08:25:14.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.541+0000 7f8a8d811780 1 < canceled multipart upload key=7XNMR51803Y6 upload=ZACNTOXM1USR tag=006LC9HQCEDV type=write size=2943735 2024-09-22T08:25:14.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.543+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=4OG7OH216ZE9 type=del size=2121355 2024-09-22T08:25:14.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.545+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~GHA76EO1D1NI.0 size=971374 2024-09-22T08:25:14.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.547+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=GHA76EO1D1NI tag=JZ0DJ3WZ26ZT type=write size=2019950 2024-09-22T08:25:14.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.550+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.0 size=1048576 2024-09-22T08:25:14.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.550+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.1 size=1048576 2024-09-22T08:25:14.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.552+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.2 size=721349 2024-09-22T08:25:14.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.552+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=RMPV6N1S6WOT tag=YG9EL1HWFBYY type=write size=3867077 2024-09-22T08:25:14.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.553+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=5N273A35WB9C type=del 2024-09-22T08:25:14.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.556+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~QWI82G8CPWNW.0 size=1048576 2024-09-22T08:25:14.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.557+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~QWI82G8CPWNW.1 size=273699 2024-09-22T08:25:14.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.557+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=QWI82G8CPWNW tag=GHXB01WI91G7 type=write size=2370851 2024-09-22T08:25:14.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.559+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=MX6EOXW8OTQ0 type=del 2024-09-22T08:25:14.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.562+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=JX6NZ9EJWWGX type=write size=948272 2024-09-22T08:25:14.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.563+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=7IVDUN26PV6Q type=del 2024-09-22T08:25:14.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.564+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=W52ETKYIM531 type=write size=922789 2024-09-22T08:25:14.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.565+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=58AU6ZCUD4TC type=write size=465273 2024-09-22T08:25:14.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.568+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.0 size=1048576 2024-09-22T08:25:14.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.570+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.1 size=1048576 2024-09-22T08:25:14.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.571+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.2 size=6822 2024-09-22T08:25:14.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.571+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=5U91PPQ0KH9C tag=VU67NAP9MH95 type=write size=3152550 2024-09-22T08:25:14.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.572+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=58I5RLAA43PT type=del 2024-09-22T08:25:14.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.574+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~ICY82NFWER05.0 size=1048576 2024-09-22T08:25:14.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.575+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~ICY82NFWER05.1 size=979005 2024-09-22T08:25:14.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.575+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=ICY82NFWER05 tag=1SPNYMQUKY8P type=write size=3076157 2024-09-22T08:25:14.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.577+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=8MN7YSB1OUCB type=del 2024-09-22T08:25:14.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.580+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~JMAP62K8ZK7B.0 size=1048576 2024-09-22T08:25:14.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.581+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~JMAP62K8ZK7B.1 size=420618 2024-09-22T08:25:14.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.581+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=JMAP62K8ZK7B tag=S11J3FOK9AFO type=write size=2517770 2024-09-22T08:25:14.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.584+0000 7f8a8d811780 1 < suggested remove operation key=ER5UY1ML3R2H tag=XKZFBZOQ66WJ type=del 2024-09-22T08:25:14.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.585+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=W6ZSGO4ZT3ZO type=del size=1741853 2024-09-22T08:25:14.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.589+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=UM4HH9ZNY5VQ type=del size=3416978 2024-09-22T08:25:14.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.590+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=UEDPDP8QRLUL type=del size=1869555 2024-09-22T08:25:14.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.591+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=LNK5JDWIPQKD type=del 2024-09-22T08:25:14.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.593+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=5QB62JVBTNPH type=write size=262682 2024-09-22T08:25:14.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.595+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.0 size=1048576 2024-09-22T08:25:14.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.596+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.1 size=1048576 2024-09-22T08:25:14.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.597+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~FPCB0FAKLZTQ.2 size=704631 2024-09-22T08:25:14.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.599+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=FPCB0FAKLZTQ tag=L7Y9JA0ZFAFN type=write size=3850359 2024-09-22T08:25:14.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.602+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.0 size=1048576 2024-09-22T08:25:14.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.603+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.1 size=1048576 2024-09-22T08:25:14.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.604+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.2 size=412273 2024-09-22T08:25:14.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.604+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=72BYNB22BWS6 tag=UBWW237IV5SV type=write size=3558001 2024-09-22T08:25:14.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.606+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=5M6ZT3EI6XMN type=del 2024-09-22T08:25:14.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.609+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~KOLAPCBQS00C.0 size=1048576 2024-09-22T08:25:14.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.610+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~KOLAPCBQS00C.1 size=962441 2024-09-22T08:25:14.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.610+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=KOLAPCBQS00C tag=2JTVHOM0AUKT type=write size=3059593 2024-09-22T08:25:14.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.611+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~7QAX5RWXHXYF.0 size=1048576 2024-09-22T08:25:14.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.613+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~7QAX5RWXHXYF.1 size=904153 2024-09-22T08:25:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.615+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=7QAX5RWXHXYF tag=US50NH3UG01M type=write size=3001305 2024-09-22T08:25:14.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.618+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~H9D15C06DUO3.0 size=215937 2024-09-22T08:25:14.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.618+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=H9D15C06DUO3 tag=9GSO02UMBO1F type=write size=1264513 2024-09-22T08:25:14.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.619+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~NL2ROA5TCX90.0 size=873869 2024-09-22T08:25:14.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.622+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=NL2ROA5TCX90 tag=1T87OE7D0H0I type=write size=1922445 2024-09-22T08:25:14.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.623+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=1N19JNIN2UCD type=write size=291449 2024-09-22T08:25:14.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.625+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=CFEVUQOJZLYV type=write size=684147 2024-09-22T08:25:14.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.626+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=727L4CUEEK6C type=del size=1220481 2024-09-22T08:25:14.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.627+0000 7f8a8d811780 1 < canceled operation key=7LLAS815MLFH tag=4OG7OH216ZE9 type=del size=2121355 2024-09-22T08:25:14.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.630+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.0 size=1048576 2024-09-22T08:25:14.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.632+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.1 size=1048576 2024-09-22T08:25:14.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.633+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.2 size=966378 2024-09-22T08:25:14.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.633+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=T6E3MHKGERP2 tag=AQI08HLWPRHS type=write size=4112106 2024-09-22T08:25:14.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.634+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.0 size=1048576 2024-09-22T08:25:14.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.635+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.1 size=1048576 2024-09-22T08:25:14.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.636+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~RMPV6N1S6WOT.2 size=721349 2024-09-22T08:25:14.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.638+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=RMPV6N1S6WOT tag=YG9EL1HWFBYY type=write size=3867077 2024-09-22T08:25:14.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.641+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~ESOQYWVEXMGP.0 size=596561 2024-09-22T08:25:14.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.641+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=ESOQYWVEXMGP tag=2QG0W4M7B2WD type=write size=1645137 2024-09-22T08:25:14.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.642+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~QWI82G8CPWNW.0 size=1048576 2024-09-22T08:25:14.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.643+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~QWI82G8CPWNW.1 size=273699 2024-09-22T08:25:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.646+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=QWI82G8CPWNW tag=GHXB01WI91G7 type=write size=2370851 2024-09-22T08:25:14.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.648+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~YCZO98IIF2E5.0 size=1048576 2024-09-22T08:25:14.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.649+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~YCZO98IIF2E5.1 size=935459 2024-09-22T08:25:14.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.649+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=YCZO98IIF2E5 tag=OO084VHIVR25 type=write size=3032611 2024-09-22T08:25:14.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.652+0000 7f8a8d811780 1 < suggested remove operation key=S9JCKGZS5QLY tag=JX6NZ9EJWWGX type=write 2024-09-22T08:25:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.655+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.0 size=1048576 2024-09-22T08:25:14.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.656+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.1 size=1048576 2024-09-22T08:25:14.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.657+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.2 size=1024577 2024-09-22T08:25:14.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.657+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=IBVBJ8SD3TK3 tag=E6C0B10VB6VS type=write size=4170305 2024-09-22T08:25:14.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.660+0000 7f8a8d811780 1 < suggested update operation key=1719KI1YP1FT tag=W52ETKYIM531 type=write size=922789 2024-09-22T08:25:14.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.661+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=P5GY8VWRZJDT type=del size=1775655 2024-09-22T08:25:14.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.663+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.0 size=1048576 2024-09-22T08:25:14.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.664+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.1 size=1048576 2024-09-22T08:25:14.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.665+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~5U91PPQ0KH9C.2 size=6822 2024-09-22T08:25:14.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.667+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=5U91PPQ0KH9C tag=VU67NAP9MH95 type=write size=3152550 2024-09-22T08:25:14.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.669+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~4Z193238L2HJ.0 size=238341 2024-09-22T08:25:14.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.669+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=4Z193238L2HJ tag=SIF7LXACJ45O type=write size=1286917 2024-09-22T08:25:14.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.671+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~ICY82NFWER05.0 size=1048576 2024-09-22T08:25:14.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.671+0000 7f8a8d811780 1 < canceled part key=_multipart_0HCXP53D9NMP.2~ICY82NFWER05.1 size=979005 2024-09-22T08:25:14.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.673+0000 7f8a8d811780 1 < canceled multipart upload key=0HCXP53D9NMP upload=ICY82NFWER05 tag=1SPNYMQUKY8P type=write size=3076157 2024-09-22T08:25:14.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.674+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=KTR6MPO62YMV type=del size=3312180 2024-09-22T08:25:14.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.676+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~JMAP62K8ZK7B.0 size=1048576 2024-09-22T08:25:14.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.676+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~JMAP62K8ZK7B.1 size=420618 2024-09-22T08:25:14.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.678+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=JMAP62K8ZK7B tag=S11J3FOK9AFO type=write size=2517770 2024-09-22T08:25:14.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.680+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~S21SMU78QRJ3.0 size=1048576 2024-09-22T08:25:14.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.681+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~S21SMU78QRJ3.1 size=756977 2024-09-22T08:25:14.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.681+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=S21SMU78QRJ3 tag=Q9FW19U5NS4S type=write size=2854129 2024-09-22T08:25:14.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.683+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=W6ZSGO4ZT3ZO type=del 2024-09-22T08:25:14.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.684+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=2QJPJHDZGLSM type=del size=2395457 2024-09-22T08:25:14.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.685+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=UEDPDP8QRLUL type=del size=1869555 2024-09-22T08:25:14.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.687+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=BS7WQWCM6S9F type=del size=4031480 2024-09-22T08:25:14.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.688+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=5QB62JVBTNPH type=write size=262682 2024-09-22T08:25:14.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.692+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.0 size=1048576 2024-09-22T08:25:14.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.692+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.1 size=1048576 2024-09-22T08:25:14.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.693+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.2 size=410380 2024-09-22T08:25:14.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.693+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=UCQDWI0JIBDI tag=0PUVO8NMOT6Q type=write size=3556108 2024-09-22T08:25:14.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.695+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.0 size=1048576 2024-09-22T08:25:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.696+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.1 size=1048576 2024-09-22T08:25:14.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.697+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~72BYNB22BWS6.2 size=412273 2024-09-22T08:25:14.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.699+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=72BYNB22BWS6 tag=UBWW237IV5SV type=write size=3558001 2024-09-22T08:25:14.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.701+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=IMZM1D4M6NHP type=del size=2550331 2024-09-22T08:25:14.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.702+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~KOLAPCBQS00C.0 size=1048576 2024-09-22T08:25:14.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.703+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~KOLAPCBQS00C.1 size=962441 2024-09-22T08:25:14.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.705+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=KOLAPCBQS00C tag=2JTVHOM0AUKT type=write size=3059593 2024-09-22T08:25:14.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.707+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=TSC21QTTDRJI type=del size=3577057 2024-09-22T08:25:14.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.708+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~H9D15C06DUO3.0 size=215937 2024-09-22T08:25:14.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.710+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=H9D15C06DUO3 tag=9GSO02UMBO1F type=write size=1264513 2024-09-22T08:25:14.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.712+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=N3JSAYJMYHOT type=del size=4097785 2024-09-22T08:25:14.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.715+0000 7f8a8d811780 1 < suggested update operation key=7XNMR51803Y6 tag=1N19JNIN2UCD type=write size=291449 2024-09-22T08:25:14.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.718+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~V4G7R00SD9US.0 size=1048576 2024-09-22T08:25:14.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.719+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~V4G7R00SD9US.1 size=937033 2024-09-22T08:25:14.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.719+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=V4G7R00SD9US tag=XXM2P8ICBLLC type=write size=3034185 2024-09-22T08:25:14.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.721+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=727L4CUEEK6C type=del 2024-09-22T08:25:14.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.723+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~MOPGB9YV7NS5.0 size=1048576 2024-09-22T08:25:14.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.725+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~MOPGB9YV7NS5.1 size=210635 2024-09-22T08:25:14.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.725+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=MOPGB9YV7NS5 tag=GRWR9ZHOZ412 type=write size=2307787 2024-09-22T08:25:14.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.726+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.0 size=1048576 2024-09-22T08:25:14.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.726+0000 7f8a8d811780 1 < canceled part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.1 size=1048576 2024-09-22T08:25:14.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.727+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~T6E3MHKGERP2.2 size=966378 2024-09-22T08:25:14.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.730+0000 7f8a8d811780 1 < canceled multipart upload key=QE6XEMOZMCF1 upload=T6E3MHKGERP2 tag=AQI08HLWPRHS type=write size=4112106 2024-09-22T08:25:14.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.731+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=F97B242JZ87H type=del size=1044145 2024-09-22T08:25:14.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.733+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~ESOQYWVEXMGP.0 size=596561 2024-09-22T08:25:14.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.735+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=ESOQYWVEXMGP tag=2QG0W4M7B2WD type=write size=1645137 2024-09-22T08:25:14.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.736+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=L8INUK272MLS type=del size=1164183 2024-09-22T08:25:14.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.738+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~YCZO98IIF2E5.0 size=1048576 2024-09-22T08:25:14.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.740+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~YCZO98IIF2E5.1 size=935459 2024-09-22T08:25:14.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.742+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=YCZO98IIF2E5 tag=OO084VHIVR25 type=write size=3032611 2024-09-22T08:25:14.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.744+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=Q9XI1ZH9ER7A type=del size=3771867 2024-09-22T08:25:14.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.745+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.0 size=1048576 2024-09-22T08:25:14.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.746+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.1 size=1048576 2024-09-22T08:25:14.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.748+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~IBVBJ8SD3TK3.2 size=1024577 2024-09-22T08:25:14.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.750+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=IBVBJ8SD3TK3 tag=E6C0B10VB6VS type=write size=4170305 2024-09-22T08:25:14.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.752+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~77RGOW9X4JBY.0 size=1048576 2024-09-22T08:25:14.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.753+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~77RGOW9X4JBY.1 size=871831 2024-09-22T08:25:14.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.753+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=77RGOW9X4JBY tag=7BIWNMSDF0S2 type=write size=2968983 2024-09-22T08:25:14.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.755+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=P5GY8VWRZJDT type=del 2024-09-22T08:25:14.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.758+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.0 size=1048576 2024-09-22T08:25:14.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.760+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.1 size=1048576 2024-09-22T08:25:14.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.761+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.2 size=458954 2024-09-22T08:25:14.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.761+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=NTE083Q37BFA tag=L1UTX56W4RML type=write size=3604682 2024-09-22T08:25:14.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.762+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~4Z193238L2HJ.0 size=238341 2024-09-22T08:25:14.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.764+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=4Z193238L2HJ tag=SIF7LXACJ45O type=write size=1286917 2024-09-22T08:25:14.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.765+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=LRMVJ72W3FAP type=del size=2772884 2024-09-22T08:25:14.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.767+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=KTR6MPO62YMV type=del 2024-09-22T08:25:14.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.769+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=3RCM48LYGKL3 type=del size=1834121 2024-09-22T08:25:14.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.770+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~S21SMU78QRJ3.0 size=1048576 2024-09-22T08:25:14.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.771+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~S21SMU78QRJ3.1 size=756977 2024-09-22T08:25:14.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.773+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=S21SMU78QRJ3 tag=Q9FW19U5NS4S type=write size=2854129 2024-09-22T08:25:14.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.775+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=OR3MGA24H153 type=del size=2050682 2024-09-22T08:25:14.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.778+0000 7f8a8d811780 1 < suggested remove operation key=2EB57FFNN986 tag=2QJPJHDZGLSM type=del 2024-09-22T08:25:14.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.780+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~1DULA2QTCSG1.0 size=1048576 2024-09-22T08:25:14.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.781+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~1DULA2QTCSG1.1 size=195020 2024-09-22T08:25:14.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.781+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=1DULA2QTCSG1 tag=6AKWSS8AXK7L type=write size=2292172 2024-09-22T08:25:14.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.783+0000 7f8a8d811780 1 < canceled operation key=5VU70RE1GJS2 tag=BS7WQWCM6S9F type=del size=4031480 2024-09-22T08:25:14.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.784+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=YN35U34J3OMB type=del size=1336623 2024-09-22T08:25:14.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.786+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.0 size=1048576 2024-09-22T08:25:14.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.787+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.1 size=1048576 2024-09-22T08:25:14.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.788+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~UCQDWI0JIBDI.2 size=410380 2024-09-22T08:25:14.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.791+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=UCQDWI0JIBDI tag=0PUVO8NMOT6Q type=write size=3556108 2024-09-22T08:25:14.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.794+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~8GGAVNUVO8UH.0 size=115354 2024-09-22T08:25:14.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.794+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=8GGAVNUVO8UH tag=SA6842VDFT9D type=write size=1163930 2024-09-22T08:25:14.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.794+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=IMZM1D4M6NHP type=del 2024-09-22T08:25:14.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.796+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=ABELOURFVTEZ type=del size=1901049 2024-09-22T08:25:14.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.797+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=TSC21QTTDRJI type=del 2024-09-22T08:25:14.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.799+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~3ESHFTJRSTJX.0 size=1048576 2024-09-22T08:25:14.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.801+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~3ESHFTJRSTJX.1 size=391865 2024-09-22T08:25:14.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.801+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=3ESHFTJRSTJX tag=3KS7HEDQBAZR type=write size=2489017 2024-09-22T08:25:14.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.804+0000 7f8a8d811780 1 < suggested remove operation key=A8TGVQ273MNF tag=N3JSAYJMYHOT type=del 2024-09-22T08:25:14.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.805+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=YY0CI7MJY2V1 type=del size=4124529 2024-09-22T08:25:14.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.806+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~V4G7R00SD9US.0 size=1048576 2024-09-22T08:25:14.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.807+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~V4G7R00SD9US.1 size=937033 2024-09-22T08:25:14.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.810+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=V4G7R00SD9US tag=XXM2P8ICBLLC type=write size=3034185 2024-09-22T08:25:14.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.811+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=96Z3H3EA2ADX type=del size=2710921 2024-09-22T08:25:14.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.813+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~MOPGB9YV7NS5.0 size=1048576 2024-09-22T08:25:14.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.813+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~MOPGB9YV7NS5.1 size=210635 2024-09-22T08:25:14.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.815+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=MOPGB9YV7NS5 tag=GRWR9ZHOZ412 type=write size=2307787 2024-09-22T08:25:14.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.816+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=RXKYF41E6FV8 type=write size=404606 2024-09-22T08:25:14.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.819+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=F97B242JZ87H type=del size=1044145 2024-09-22T08:25:14.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.823+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~1NSUFSFHYS5A.0 size=362690 2024-09-22T08:25:14.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.823+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=1NSUFSFHYS5A tag=G5BG5KDGPMSG type=write size=1411266 2024-09-22T08:25:14.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.825+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=L8INUK272MLS type=del size=1164183 2024-09-22T08:25:14.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.826+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=3E9QA41VBKD4 type=del size=216838 2024-09-22T08:25:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.828+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=Q9XI1ZH9ER7A type=del size=3771867 2024-09-22T08:25:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.831+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.0 size=1048576 2024-09-22T08:25:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.832+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.1 size=1048576 2024-09-22T08:25:14.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.833+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.2 size=767077 2024-09-22T08:25:14.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.833+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=1IT6LKJEGG31 tag=XIJW04FC69QI type=write size=3912805 2024-09-22T08:25:14.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.835+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~77RGOW9X4JBY.0 size=1048576 2024-09-22T08:25:14.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.836+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~77RGOW9X4JBY.1 size=871831 2024-09-22T08:25:14.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.838+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=77RGOW9X4JBY tag=7BIWNMSDF0S2 type=write size=2968983 2024-09-22T08:25:14.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.840+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=W8COZ4SNHPIU type=write size=698070 2024-09-22T08:25:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.842+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.0 size=1048576 2024-09-22T08:25:14.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.842+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.1 size=1048576 2024-09-22T08:25:14.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.844+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~NTE083Q37BFA.2 size=458954 2024-09-22T08:25:14.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.847+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=NTE083Q37BFA tag=L1UTX56W4RML type=write size=3604682 2024-09-22T08:25:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.848+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=5WVFWV2OC8QT type=del size=3380710 2024-09-22T08:25:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.849+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=LRMVJ72W3FAP type=del 2024-09-22T08:25:14.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.850+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=MAUQF1NQL5KJ type=del size=262992 2024-09-22T08:25:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.852+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=3RCM48LYGKL3 type=del 2024-09-22T08:25:14.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.853+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=30O8VUJFFLCO type=del size=1924235 2024-09-22T08:25:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.855+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=OR3MGA24H153 type=del 2024-09-22T08:25:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.856+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=1YQKJ1CO8S91 type=write size=168826 2024-09-22T08:25:14.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.858+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~1DULA2QTCSG1.0 size=1048576 2024-09-22T08:25:14.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.859+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~1DULA2QTCSG1.1 size=195020 2024-09-22T08:25:14.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.861+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=1DULA2QTCSG1 tag=6AKWSS8AXK7L type=write size=2292172 2024-09-22T08:25:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.863+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~MNLP2F2AM2LV.0 size=323094 2024-09-22T08:25:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.863+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=MNLP2F2AM2LV tag=SP1BRS5A0SP9 type=write size=1371670 2024-09-22T08:25:14.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.865+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=YN35U34J3OMB type=del 2024-09-22T08:25:14.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.866+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=VW2MAWAQJY59 type=write size=496994 2024-09-22T08:25:14.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.868+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~8GGAVNUVO8UH.0 size=115354 2024-09-22T08:25:14.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.870+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=8GGAVNUVO8UH tag=SA6842VDFT9D type=write size=1163930 2024-09-22T08:25:14.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.872+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=DG7HP4SQORWW type=del size=3498300 2024-09-22T08:25:14.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.873+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=ABELOURFVTEZ type=del 2024-09-22T08:25:14.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.874+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=W3RIU5E5239I type=del size=3616964 2024-09-22T08:25:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.876+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~3ESHFTJRSTJX.0 size=1048576 2024-09-22T08:25:14.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.877+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~3ESHFTJRSTJX.1 size=391865 2024-09-22T08:25:14.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.879+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=3ESHFTJRSTJX tag=3KS7HEDQBAZR type=write size=2489017 2024-09-22T08:25:14.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.882+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.0 size=1048576 2024-09-22T08:25:14.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.883+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.1 size=1048576 2024-09-22T08:25:14.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.884+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.2 size=207780 2024-09-22T08:25:14.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.884+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=C6OWCVPGKOHC tag=NUP6KP4XLKUW type=write size=3353508 2024-09-22T08:25:14.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.885+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=YY0CI7MJY2V1 type=del 2024-09-22T08:25:14.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.888+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~Q6A1W6C18HDM.0 size=1048576 2024-09-22T08:25:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.889+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~Q6A1W6C18HDM.1 size=504478 2024-09-22T08:25:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.889+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=Q6A1W6C18HDM tag=2P4N0UXW1J1X type=write size=2601630 2024-09-22T08:25:14.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.891+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=96Z3H3EA2ADX type=del 2024-09-22T08:25:14.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.892+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=5BKMD29V250P type=del size=3939828 2024-09-22T08:25:14.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.894+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=RXKYF41E6FV8 type=write size=404606 2024-09-22T08:25:14.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.895+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=X66DRJCMJL8G type=del size=3336408 2024-09-22T08:25:14.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.897+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~1NSUFSFHYS5A.0 size=362690 2024-09-22T08:25:14.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.899+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=1NSUFSFHYS5A tag=G5BG5KDGPMSG type=write size=1411266 2024-09-22T08:25:14.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.902+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.0 size=1048576 2024-09-22T08:25:14.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.903+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.1 size=1048576 2024-09-22T08:25:14.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.905+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.2 size=550090 2024-09-22T08:25:14.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.905+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=MOL8GW7IBV9V tag=7AJKW20PJ70H type=write size=3695818 2024-09-22T08:25:14.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.906+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=3E9QA41VBKD4 type=del 2024-09-22T08:25:14.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.908+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.0 size=1048576 2024-09-22T08:25:14.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.909+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.1 size=1048576 2024-09-22T08:25:14.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.910+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.2 size=446502 2024-09-22T08:25:14.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.910+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=6Z4POLBC5LHZ tag=BVDHI0338NET type=write size=3592230 2024-09-22T08:25:14.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.912+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.0 size=1048576 2024-09-22T08:25:14.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.913+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.1 size=1048576 2024-09-22T08:25:14.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.914+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~1IT6LKJEGG31.2 size=767077 2024-09-22T08:25:14.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.916+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=1IT6LKJEGG31 tag=XIJW04FC69QI type=write size=3912805 2024-09-22T08:25:14.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.919+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~CDPAVSAAO3DR.0 size=478319 2024-09-22T08:25:14.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.919+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=CDPAVSAAO3DR tag=Z139QISAIWT3 type=write size=1526895 2024-09-22T08:25:14.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.920+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=W8COZ4SNHPIU type=write size=698070 2024-09-22T08:25:14.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.921+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=8UV6SPZE23S0 type=write size=895752 2024-09-22T08:25:14.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.924+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=5WVFWV2OC8QT type=del 2024-09-22T08:25:14.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.926+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.0 size=1048576 2024-09-22T08:25:14.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.927+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.1 size=1048576 2024-09-22T08:25:14.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.928+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.2 size=437208 2024-09-22T08:25:14.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.928+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=M2353ZVYUI6J tag=41M8SN2ZLSUX type=write size=3582936 2024-09-22T08:25:14.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.931+0000 7f8a8d811780 1 < suggested update operation key=WOSCCX4WX2FN tag=MAUQF1NQL5KJ type=del size=262992 2024-09-22T08:25:14.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.933+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=91L2LM3IM8V1 type=write size=992155 2024-09-22T08:25:14.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.934+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=30O8VUJFFLCO type=del 2024-09-22T08:25:14.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.937+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~K3W0KR1RA1FZ.0 size=1048576 2024-09-22T08:25:14.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.938+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~K3W0KR1RA1FZ.1 size=890018 2024-09-22T08:25:14.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.938+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=K3W0KR1RA1FZ tag=1XLG0CIMAUPI type=write size=2987170 2024-09-22T08:25:14.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.940+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=1YQKJ1CO8S91 type=write size=168826 2024-09-22T08:25:14.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.941+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=B7FKX1028EHG type=del size=1653508 2024-09-22T08:25:14.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.942+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~MNLP2F2AM2LV.0 size=323094 2024-09-22T08:25:14.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.945+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=MNLP2F2AM2LV tag=SP1BRS5A0SP9 type=write size=1371670 2024-09-22T08:25:14.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.947+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~WB7LCNCMRH4B.0 size=1048576 2024-09-22T08:25:14.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.948+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~WB7LCNCMRH4B.1 size=56334 2024-09-22T08:25:14.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.948+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=WB7LCNCMRH4B tag=OHZRUAMNDN95 type=write size=2153486 2024-09-22T08:25:14.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.950+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=VW2MAWAQJY59 type=write size=496994 2024-09-22T08:25:14.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.952+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=AWM9B0DPQJDA type=del size=2813976 2024-09-22T08:25:14.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.953+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=DG7HP4SQORWW type=del 2024-09-22T08:25:14.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.956+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.0 size=1048576 2024-09-22T08:25:14.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.958+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.1 size=1048576 2024-09-22T08:25:14.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.959+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.2 size=975779 2024-09-22T08:25:14.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.959+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=7B2AHN9HNT8N tag=00HZDLYD607A type=write size=4121507 2024-09-22T08:25:14.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.961+0000 7f8a8d811780 1 < canceled operation key=RL59H41J8ZNF tag=W3RIU5E5239I type=del size=3616964 2024-09-22T08:25:14.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.962+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=WVVFJ5LV21US type=del size=2826279 2024-09-22T08:25:14.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.962+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.0 size=1048576 2024-09-22T08:25:14.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.963+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.1 size=1048576 2024-09-22T08:25:14.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.965+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~C6OWCVPGKOHC.2 size=207780 2024-09-22T08:25:14.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.968+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=C6OWCVPGKOHC tag=NUP6KP4XLKUW type=write size=3353508 2024-09-22T08:25:14.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.969+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=4U55L8ZA6KX2 type=write size=446157 2024-09-22T08:25:14.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.970+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~Q6A1W6C18HDM.0 size=1048576 2024-09-22T08:25:14.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.971+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~Q6A1W6C18HDM.1 size=504478 2024-09-22T08:25:14.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.976+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=Q6A1W6C18HDM tag=2P4N0UXW1J1X type=write size=2601630 2024-09-22T08:25:14.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.977+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=HPPY4774IUQE type=del size=1270992 2024-09-22T08:25:14.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.978+0000 7f8a8d811780 1 < canceled operation key=JWJ9T6XYCUYR tag=5BKMD29V250P type=del size=3939828 2024-09-22T08:25:14.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.979+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=QGK0BPKNMWQU type=del size=3540568 2024-09-22T08:25:14.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.981+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=X66DRJCMJL8G type=del 2024-09-22T08:25:14.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.983+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=0N1YHRAIB4N5 type=del size=1574846 2024-09-22T08:25:14.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.984+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.0 size=1048576 2024-09-22T08:25:14.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.985+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.1 size=1048576 2024-09-22T08:25:14.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.986+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~MOL8GW7IBV9V.2 size=550090 2024-09-22T08:25:14.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.989+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=MOL8GW7IBV9V tag=7AJKW20PJ70H type=write size=3695818 2024-09-22T08:25:14.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.991+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~NWQAUGYBUSME.0 size=995777 2024-09-22T08:25:14.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.991+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=NWQAUGYBUSME tag=HNFCUIACMLVU type=write size=2044353 2024-09-22T08:25:14.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.993+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.0 size=1048576 2024-09-22T08:25:14.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.994+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.1 size=1048576 2024-09-22T08:25:14.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.995+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~6Z4POLBC5LHZ.2 size=446502 2024-09-22T08:25:14.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.998+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=6Z4POLBC5LHZ tag=BVDHI0338NET type=write size=3592230 2024-09-22T08:25:15.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:14.999+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=EK6V9KGVSTV8 type=del size=2605316 2024-09-22T08:25:15.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.001+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~CDPAVSAAO3DR.0 size=478319 2024-09-22T08:25:15.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.003+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=CDPAVSAAO3DR tag=Z139QISAIWT3 type=write size=1526895 2024-09-22T08:25:15.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.007+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.0 size=1048576 2024-09-22T08:25:15.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.008+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.1 size=1048576 2024-09-22T08:25:15.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.009+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.2 size=27829 2024-09-22T08:25:15.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.009+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=S0WJ85WN15CG tag=71SWX2N2ZNEE type=write size=3173557 2024-09-22T08:25:15.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.010+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=8UV6SPZE23S0 type=write size=895752 2024-09-22T08:25:15.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.013+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~1QGPEYNFJV9Z.0 size=886546 2024-09-22T08:25:15.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.013+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=1QGPEYNFJV9Z tag=KHD62V6MIW1C type=write size=1935122 2024-09-22T08:25:15.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.013+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.0 size=1048576 2024-09-22T08:25:15.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.014+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.1 size=1048576 2024-09-22T08:25:15.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.016+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~M2353ZVYUI6J.2 size=437208 2024-09-22T08:25:15.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.019+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=M2353ZVYUI6J tag=41M8SN2ZLSUX type=write size=3582936 2024-09-22T08:25:15.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.019+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=TKSTCN6XCL9A type=write size=755825 2024-09-22T08:25:15.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.021+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=91L2LM3IM8V1 type=write size=992155 2024-09-22T08:25:15.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.023+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.0 size=1048576 2024-09-22T08:25:15.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.025+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.1 size=1048576 2024-09-22T08:25:15.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.027+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.2 size=537683 2024-09-22T08:25:15.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.027+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=6ENM0TQFWTSM tag=2PT3P9XDSUTJ type=write size=3683411 2024-09-22T08:25:15.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.028+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~K3W0KR1RA1FZ.0 size=1048576 2024-09-22T08:25:15.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.029+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~K3W0KR1RA1FZ.1 size=890018 2024-09-22T08:25:15.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.031+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=K3W0KR1RA1FZ tag=1XLG0CIMAUPI type=write size=2987170 2024-09-22T08:25:15.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.033+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=2DXBDYHJ3VYA type=del size=2476367 2024-09-22T08:25:15.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.035+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=B7FKX1028EHG type=del 2024-09-22T08:25:15.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.036+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=R7ORRMP051DA type=write size=639928 2024-09-22T08:25:15.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.038+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~WB7LCNCMRH4B.0 size=1048576 2024-09-22T08:25:15.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.039+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~WB7LCNCMRH4B.1 size=56334 2024-09-22T08:25:15.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.041+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=WB7LCNCMRH4B tag=OHZRUAMNDN95 type=write size=2153486 2024-09-22T08:25:15.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.044+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~2ALMP81EJKB4.0 size=184577 2024-09-22T08:25:15.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.044+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=2ALMP81EJKB4 tag=YID4156DRQFO type=write size=1233153 2024-09-22T08:25:15.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.046+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=AWM9B0DPQJDA type=del 2024-09-22T08:25:15.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.047+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=P24SU1JKSNOY type=del size=311375 2024-09-22T08:25:15.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.049+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.0 size=1048576 2024-09-22T08:25:15.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.050+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.1 size=1048576 2024-09-22T08:25:15.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.051+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~7B2AHN9HNT8N.2 size=975779 2024-09-22T08:25:15.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.054+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=7B2AHN9HNT8N tag=00HZDLYD607A type=write size=4121507 2024-09-22T08:25:15.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.056+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=DQNJVC43PUPU type=write size=540732 2024-09-22T08:25:15.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.057+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=WVVFJ5LV21US type=del 2024-09-22T08:25:15.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.059+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=L25P066F1VQ8 type=del size=297691 2024-09-22T08:25:15.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.061+0000 7f8a8d811780 1 < completed write operation key=T5IAHQ3CUIFR tag=4U55L8ZA6KX2 type=write size=446157 2024-09-22T08:25:15.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.062+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=XIVG1D8R8O72 type=del size=3444499 2024-09-22T08:25:15.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.064+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=HPPY4774IUQE type=del 2024-09-22T08:25:15.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.067+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~YHKGVYKAJHQE.0 size=1048576 2024-09-22T08:25:15.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.068+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~YHKGVYKAJHQE.1 size=63737 2024-09-22T08:25:15.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.068+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=YHKGVYKAJHQE tag=F7W7QW22W9VC type=write size=2160889 2024-09-22T08:25:15.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.070+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=QGK0BPKNMWQU type=del 2024-09-22T08:25:15.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.072+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~3CS434S9M3Z8.0 size=1048576 2024-09-22T08:25:15.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.073+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~3CS434S9M3Z8.1 size=227249 2024-09-22T08:25:15.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.073+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=3CS434S9M3Z8 tag=2DKOWVAR59RT type=write size=2324401 2024-09-22T08:25:15.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.075+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=0N1YHRAIB4N5 type=del 2024-09-22T08:25:15.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.076+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=OGORG6XV1A2I type=write size=580873 2024-09-22T08:25:15.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.077+0000 7f8a8d811780 1 < canceled part key=_multipart_WOSCCX4WX2FN.2~NWQAUGYBUSME.0 size=995777 2024-09-22T08:25:15.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.079+0000 7f8a8d811780 1 < canceled multipart upload key=WOSCCX4WX2FN upload=NWQAUGYBUSME tag=HNFCUIACMLVU type=write size=2044353 2024-09-22T08:25:15.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.081+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~9H2X42DN6JXE.0 size=1048576 2024-09-22T08:25:15.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.082+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~9H2X42DN6JXE.1 size=770472 2024-09-22T08:25:15.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.082+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=9H2X42DN6JXE tag=3NNWLIWVWHXE type=write size=2867624 2024-09-22T08:25:15.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.084+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=EK6V9KGVSTV8 type=del 2024-09-22T08:25:15.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.086+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~IIFAAPK33NRF.0 size=685219 2024-09-22T08:25:15.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.086+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=IIFAAPK33NRF tag=PPUDDWKL3LXJ type=write size=1733795 2024-09-22T08:25:15.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.088+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.0 size=1048576 2024-09-22T08:25:15.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.090+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.1 size=1048576 2024-09-22T08:25:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.091+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~S0WJ85WN15CG.2 size=27829 2024-09-22T08:25:15.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.094+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=S0WJ85WN15CG tag=71SWX2N2ZNEE type=write size=3173557 2024-09-22T08:25:15.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.095+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=KI3UD7P2CHET type=write size=738415 2024-09-22T08:25:15.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.096+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~1QGPEYNFJV9Z.0 size=886546 2024-09-22T08:25:15.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.099+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=1QGPEYNFJV9Z tag=KHD62V6MIW1C type=write size=1935122 2024-09-22T08:25:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.102+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.0 size=1048576 2024-09-22T08:25:15.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.103+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.1 size=1048576 2024-09-22T08:25:15.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.104+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.2 size=204580 2024-09-22T08:25:15.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.104+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=VHB55ROJN1RI tag=BANKD2SFO1LI type=write size=3350308 2024-09-22T08:25:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.105+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=TKSTCN6XCL9A type=write size=755825 2024-09-22T08:25:15.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.106+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=YGAYONRG5EFH type=del size=247102 2024-09-22T08:25:15.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.107+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.0 size=1048576 2024-09-22T08:25:15.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.108+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.1 size=1048576 2024-09-22T08:25:15.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.110+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6ENM0TQFWTSM.2 size=537683 2024-09-22T08:25:15.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.112+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=6ENM0TQFWTSM tag=2PT3P9XDSUTJ type=write size=3683411 2024-09-22T08:25:15.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.114+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.0 size=1048576 2024-09-22T08:25:15.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.115+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.1 size=1048576 2024-09-22T08:25:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.116+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.2 size=811202 2024-09-22T08:25:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.116+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=EXXALXZ1ZCXN tag=4S7XWVE0PW9L type=write size=3956930 2024-09-22T08:25:15.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.118+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=2DXBDYHJ3VYA type=del 2024-09-22T08:25:15.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.119+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=TKPK0Q96CQP2 type=write size=172659 2024-09-22T08:25:15.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.121+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=R7ORRMP051DA type=write size=639928 2024-09-22T08:25:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.123+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~SIU7CB386WL6.0 size=718908 2024-09-22T08:25:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.123+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=SIU7CB386WL6 tag=EWHG5AM6B0C6 type=write size=1767484 2024-09-22T08:25:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.125+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~2ALMP81EJKB4.0 size=184577 2024-09-22T08:25:15.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.127+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=2ALMP81EJKB4 tag=YID4156DRQFO type=write size=1233153 2024-09-22T08:25:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.128+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=8SX45MZ9AF5I type=write size=759767 2024-09-22T08:25:15.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.130+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=P24SU1JKSNOY type=del 2024-09-22T08:25:15.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.131+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=MQCLVIH2DYF6 type=del size=3424500 2024-09-22T08:25:15.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.133+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=DQNJVC43PUPU type=write size=540732 2024-09-22T08:25:15.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.134+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=TFVZHDN2KI0C type=del size=2069320 2024-09-22T08:25:15.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.135+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=L25P066F1VQ8 type=del 2024-09-22T08:25:15.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.137+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=TFKYOJ7QBKTP type=del size=1874675 2024-09-22T08:25:15.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.138+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=XIVG1D8R8O72 type=del 2024-09-22T08:25:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.140+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=F7L41SZFPZ5I type=del size=3240156 2024-09-22T08:25:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.141+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~YHKGVYKAJHQE.0 size=1048576 2024-09-22T08:25:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.142+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~YHKGVYKAJHQE.1 size=63737 2024-09-22T08:25:15.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.144+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=YHKGVYKAJHQE tag=F7W7QW22W9VC type=write size=2160889 2024-09-22T08:25:15.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.146+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=39E82J1K7I8I type=del size=301866 2024-09-22T08:25:15.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.148+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~3CS434S9M3Z8.0 size=1048576 2024-09-22T08:25:15.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.149+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~3CS434S9M3Z8.1 size=227249 2024-09-22T08:25:15.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.152+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=3CS434S9M3Z8 tag=2DKOWVAR59RT type=write size=2324401 2024-09-22T08:25:15.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.152+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=CXKQLBHBSQQI type=del size=62187 2024-09-22T08:25:15.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.154+0000 7f8a8d811780 1 < completed write operation key=3T2TX83CSE2D tag=OGORG6XV1A2I type=write size=580873 2024-09-22T08:25:15.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.157+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.0 size=1048576 2024-09-22T08:25:15.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.158+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.1 size=1048576 2024-09-22T08:25:15.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.159+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.2 size=122769 2024-09-22T08:25:15.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.159+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=RTCCLXAXQ8ZX tag=0ZM3FL6NJ07Y type=write size=3268497 2024-09-22T08:25:15.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.160+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~9H2X42DN6JXE.0 size=1048576 2024-09-22T08:25:15.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.160+0000 7f8a8d811780 1 < canceled part key=_multipart_QE6XEMOZMCF1.2~9H2X42DN6JXE.1 size=770472 2024-09-22T08:25:15.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.163+0000 7f8a8d811780 1 < canceled multipart upload key=QE6XEMOZMCF1 upload=9H2X42DN6JXE tag=3NNWLIWVWHXE type=write size=2867624 2024-09-22T08:25:15.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.166+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~K0Z0B24H1RBX.0 size=176658 2024-09-22T08:25:15.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.166+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=K0Z0B24H1RBX tag=NI0Q2FA5MCB3 type=write size=1225234 2024-09-22T08:25:15.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.166+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~IIFAAPK33NRF.0 size=685219 2024-09-22T08:25:15.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.168+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=IIFAAPK33NRF tag=PPUDDWKL3LXJ type=write size=1733795 2024-09-22T08:25:15.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.170+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=41VE8CJ7VN60 type=write size=432200 2024-09-22T08:25:15.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.171+0000 7f8a8d811780 1 < completed write operation key=2EB57FFNN986 tag=KI3UD7P2CHET type=write size=738415 2024-09-22T08:25:15.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.173+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=HPVO9AO923CH type=del size=1052983 2024-09-22T08:25:15.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.174+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.0 size=1048576 2024-09-22T08:25:15.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.175+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.1 size=1048576 2024-09-22T08:25:15.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.176+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~VHB55ROJN1RI.2 size=204580 2024-09-22T08:25:15.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.179+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=VHB55ROJN1RI tag=BANKD2SFO1LI type=write size=3350308 2024-09-22T08:25:15.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.180+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=ZY299ZA441R5 type=del size=1644105 2024-09-22T08:25:15.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.183+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=YGAYONRG5EFH type=del 2024-09-22T08:25:15.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.184+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=9FY740O8NG7S type=del size=4033582 2024-09-22T08:25:15.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.186+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.0 size=1048576 2024-09-22T08:25:15.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.187+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.1 size=1048576 2024-09-22T08:25:15.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.187+0000 7f8a8d811780 1 < canceled part key=_multipart_RRTLTMWJIWSW.2~EXXALXZ1ZCXN.2 size=811202 2024-09-22T08:25:15.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.191+0000 7f8a8d811780 1 < canceled multipart upload key=RRTLTMWJIWSW upload=EXXALXZ1ZCXN tag=4S7XWVE0PW9L type=write size=3956930 2024-09-22T08:25:15.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.192+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=LFXNWR63LXQ9 type=del size=3544122 2024-09-22T08:25:15.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.193+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=TKPK0Q96CQP2 type=write size=172659 2024-09-22T08:25:15.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.197+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~VGLHIZK9KRH8.0 size=1048576 2024-09-22T08:25:15.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.197+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~VGLHIZK9KRH8.1 size=86122 2024-09-22T08:25:15.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.197+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=VGLHIZK9KRH8 tag=V0839DIPYDDK type=write size=2183274 2024-09-22T08:25:15.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.200+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~SIU7CB386WL6.0 size=718908 2024-09-22T08:25:15.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.202+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=SIU7CB386WL6 tag=EWHG5AM6B0C6 type=write size=1767484 2024-09-22T08:25:15.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.204+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.0 size=1048576 2024-09-22T08:25:15.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.206+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.1 size=1048576 2024-09-22T08:25:15.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.207+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.2 size=705620 2024-09-22T08:25:15.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.207+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=7BI27IFWU4JQ tag=EBEB5MWQA4DQ type=write size=3851348 2024-09-22T08:25:15.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.209+0000 7f8a8d811780 1 < completed write operation key=RCHUCAL6CQ4F tag=8SX45MZ9AF5I type=write size=759767 2024-09-22T08:25:15.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.210+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=ESCPVOVV4L22 type=write size=293592 2024-09-22T08:25:15.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.213+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=MQCLVIH2DYF6 type=del size=3424500 2024-09-22T08:25:15.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.215+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=9ER693NO7Y0J type=del size=3689044 2024-09-22T08:25:15.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.217+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=TFVZHDN2KI0C type=del 2024-09-22T08:25:15.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.218+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=ZX1AUW7WVVGP type=del size=3070568 2024-09-22T08:25:15.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.220+0000 7f8a8d811780 1 < canceled operation key=WOSCCX4WX2FN tag=TFKYOJ7QBKTP type=del size=1874675 2024-09-22T08:25:15.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.221+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=NKN9ARLS0L05 type=del size=2287398 2024-09-22T08:25:15.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.223+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=F7L41SZFPZ5I type=del 2024-09-22T08:25:15.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.226+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.0 size=1048576 2024-09-22T08:25:15.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.227+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.1 size=1048576 2024-09-22T08:25:15.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.229+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.2 size=948720 2024-09-22T08:25:15.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.229+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=O8O32GR3MRNN tag=5DUNOI1UZNOF type=write size=4094448 2024-09-22T08:25:15.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.231+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=39E82J1K7I8I type=del 2024-09-22T08:25:15.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.232+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=07WTUS43I8QH type=del size=2610365 2024-09-22T08:25:15.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.234+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=CXKQLBHBSQQI type=del 2024-09-22T08:25:15.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.235+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=CQ0RQNTMMX0S type=write size=367506 2024-09-22T08:25:15.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.236+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.0 size=1048576 2024-09-22T08:25:15.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.237+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.1 size=1048576 2024-09-22T08:25:15.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.239+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~RTCCLXAXQ8ZX.2 size=122769 2024-09-22T08:25:15.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.242+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=RTCCLXAXQ8ZX tag=0ZM3FL6NJ07Y type=write size=3268497 2024-09-22T08:25:15.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.244+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~02B9SUPKWLAI.0 size=1048576 2024-09-22T08:25:15.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.245+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~02B9SUPKWLAI.1 size=51852 2024-09-22T08:25:15.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.245+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=02B9SUPKWLAI tag=3O9MTG68HFEA type=write size=2149004 2024-09-22T08:25:15.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.247+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~K0Z0B24H1RBX.0 size=176658 2024-09-22T08:25:15.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.248+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=K0Z0B24H1RBX tag=NI0Q2FA5MCB3 type=write size=1225234 2024-09-22T08:25:15.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.251+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.0 size=1048576 2024-09-22T08:25:15.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.252+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.1 size=1048576 2024-09-22T08:25:15.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.253+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.2 size=204474 2024-09-22T08:25:15.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.253+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=S4TW67U01TVN tag=XKPNSEOM28ZP type=write size=3350202 2024-09-22T08:25:15.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.254+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=41VE8CJ7VN60 type=write size=432200 2024-09-22T08:25:15.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.257+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.0 size=1048576 2024-09-22T08:25:15.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.258+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.1 size=1048576 2024-09-22T08:25:15.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.259+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.2 size=1007564 2024-09-22T08:25:15.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.259+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=9BIMDOA82F5Z tag=46SQNZVDV6HC type=write size=4153292 2024-09-22T08:25:15.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.263+0000 7f8a8d811780 1 < suggested update operation key=2EB57FFNN986 tag=HPVO9AO923CH type=del size=1052983 2024-09-22T08:25:15.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.265+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~4JL5VIRMNSC8.0 size=1048576 2024-09-22T08:25:15.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.266+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~4JL5VIRMNSC8.1 size=664064 2024-09-22T08:25:15.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.266+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=4JL5VIRMNSC8 tag=B7ZYM6BXHMFN type=write size=2761216 2024-09-22T08:25:15.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.268+0000 7f8a8d811780 -1 < failed to complete operation key=2EB57FFNN986 tag=ZY299ZA441R5 type=del size=1644105: (22) Invalid argument 2024-09-22T08:25:15.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.269+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=ELC3KJ6XNKRC type=del size=3705705 2024-09-22T08:25:15.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.274+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=9FY740O8NG7S type=del size=4033582 2024-09-22T08:25:15.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.276+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=YHPAGF34PWKI type=del size=27743 2024-09-22T08:25:15.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.277+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=LFXNWR63LXQ9 type=del 2024-09-22T08:25:15.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.281+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~VPKO8GU6PEZN.0 size=1048576 2024-09-22T08:25:15.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.281+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~VPKO8GU6PEZN.1 size=20809 2024-09-22T08:25:15.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.281+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=VPKO8GU6PEZN tag=Z252RQF9538A type=write size=2117961 2024-09-22T08:25:15.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.283+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~VGLHIZK9KRH8.0 size=1048576 2024-09-22T08:25:15.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.284+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~VGLHIZK9KRH8.1 size=86122 2024-09-22T08:25:15.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.286+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=VGLHIZK9KRH8 tag=V0839DIPYDDK type=write size=2183274 2024-09-22T08:25:15.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.290+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.0 size=1048576 2024-09-22T08:25:15.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.291+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.1 size=1048576 2024-09-22T08:25:15.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.293+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.2 size=468340 2024-09-22T08:25:15.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.293+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=2SONX7E57T50 tag=R1IM247LILJO type=write size=3614068 2024-09-22T08:25:15.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.295+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.0 size=1048576 2024-09-22T08:25:15.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.295+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.1 size=1048576 2024-09-22T08:25:15.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.296+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~7BI27IFWU4JQ.2 size=705620 2024-09-22T08:25:15.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.300+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=7BI27IFWU4JQ tag=EBEB5MWQA4DQ type=write size=3851348 2024-09-22T08:25:15.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.301+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=V8CJR9U2HKJ3 type=del size=1984670 2024-09-22T08:25:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.306+0000 7f8a8d811780 1 < suggested remove operation key=WR1JR0APSOKN tag=ESCPVOVV4L22 type=write 2024-09-22T08:25:15.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.308+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~6BC9QZZYWLBA.0 size=1048576 2024-09-22T08:25:15.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.309+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~6BC9QZZYWLBA.1 size=210949 2024-09-22T08:25:15.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.309+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=6BC9QZZYWLBA tag=3E16UTW40LTF type=write size=2308101 2024-09-22T08:25:15.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.311+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=9ER693NO7Y0J type=del 2024-09-22T08:25:15.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.313+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=R2TNUYI9XK2G type=del size=3161074 2024-09-22T08:25:15.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.315+0000 7f8a8d811780 1 < canceled operation key=KIJ2DW4NSZKG tag=ZX1AUW7WVVGP type=del size=3070568 2024-09-22T08:25:15.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.318+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.0 size=1048576 2024-09-22T08:25:15.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.318+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.1 size=1048576 2024-09-22T08:25:15.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.320+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.2 size=165583 2024-09-22T08:25:15.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.320+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=7ZL1AN7E5T51 tag=28LT90QKQXGY type=write size=3311311 2024-09-22T08:25:15.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.321+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=NKN9ARLS0L05 type=del 2024-09-22T08:25:15.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.323+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=XBJLFX519B00 type=del size=340561 2024-09-22T08:25:15.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.325+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.0 size=1048576 2024-09-22T08:25:15.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.326+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.1 size=1048576 2024-09-22T08:25:15.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.326+0000 7f8a8d811780 1 < canceled part key=_multipart_7XNMR51803Y6.2~O8O32GR3MRNN.2 size=948720 2024-09-22T08:25:15.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.328+0000 7f8a8d811780 1 < canceled multipart upload key=7XNMR51803Y6 upload=O8O32GR3MRNN tag=5DUNOI1UZNOF type=write size=4094448 2024-09-22T08:25:15.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.330+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=Y5L78VMB58L0 type=del size=1923701 2024-09-22T08:25:15.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.331+0000 7f8a8d811780 -1 < failed to complete operation key=2EB57FFNN986 tag=07WTUS43I8QH type=del size=2610365: (22) Invalid argument 2024-09-22T08:25:15.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.334+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~PLKG7QRPOEBY.0 size=1048576 2024-09-22T08:25:15.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.335+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~PLKG7QRPOEBY.1 size=485356 2024-09-22T08:25:15.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.335+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=PLKG7QRPOEBY tag=MUE5SIWZ0IK0 type=write size=2582508 2024-09-22T08:25:15.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.336+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=WR1JR0APSOKN tag=CQ0RQNTMMX0S type=write size=367506: (2) No such file or directory 2024-09-22T08:25:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.339+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2SL0IU9C0B9Q.0 size=790630 2024-09-22T08:25:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.339+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=2SL0IU9C0B9Q tag=3K3VOJAH9SJA type=write size=1839206 2024-09-22T08:25:15.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.340+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~02B9SUPKWLAI.0 size=1048576 2024-09-22T08:25:15.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.341+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~02B9SUPKWLAI.1 size=51852 2024-09-22T08:25:15.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.344+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=02B9SUPKWLAI tag=3O9MTG68HFEA type=write size=2149004 2024-09-22T08:25:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.346+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~1UUMBJWTGKVX.0 size=1048576 2024-09-22T08:25:15.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.347+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~1UUMBJWTGKVX.1 size=448427 2024-09-22T08:25:15.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.347+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=1UUMBJWTGKVX tag=MPX24J7AD00T type=write size=2545579 2024-09-22T08:25:15.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.349+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.0 size=1048576 2024-09-22T08:25:15.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.350+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.1 size=1048576 2024-09-22T08:25:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.351+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~S4TW67U01TVN.2 size=204474 2024-09-22T08:25:15.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.353+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=S4TW67U01TVN tag=XKPNSEOM28ZP type=write size=3350202 2024-09-22T08:25:15.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.354+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=JVH7VWWT7229 type=del size=1565925 2024-09-22T08:25:15.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.356+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.0 size=1048576 2024-09-22T08:25:15.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.357+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.1 size=1048576 2024-09-22T08:25:15.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.358+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~9BIMDOA82F5Z.2 size=1007564 2024-09-22T08:25:15.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.361+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=9BIMDOA82F5Z tag=46SQNZVDV6HC type=write size=4153292 2024-09-22T08:25:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.363+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~Z010S6XEJSJ9.0 size=1048576 2024-09-22T08:25:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.365+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~Z010S6XEJSJ9.1 size=66073 2024-09-22T08:25:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.365+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=Z010S6XEJSJ9 tag=MCB2CYRU4083 type=write size=2163225 2024-09-22T08:25:15.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.367+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~4JL5VIRMNSC8.0 size=1048576 2024-09-22T08:25:15.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.369+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~4JL5VIRMNSC8.1 size=664064 2024-09-22T08:25:15.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.371+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=4JL5VIRMNSC8 tag=B7ZYM6BXHMFN type=write size=2761216 2024-09-22T08:25:15.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.373+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.0 size=1048576 2024-09-22T08:25:15.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.375+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.1 size=1048576 2024-09-22T08:25:15.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.376+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.2 size=876190 2024-09-22T08:25:15.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.376+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=V9QGQV8F4YAJ tag=LLP18LDA9EQ9 type=write size=4021918 2024-09-22T08:25:15.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.377+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=ELC3KJ6XNKRC type=del 2024-09-22T08:25:15.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.379+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=1ZS4AB4IBVCW type=del size=3890088 2024-09-22T08:25:15.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.380+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=YHPAGF34PWKI type=del 2024-09-22T08:25:15.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.382+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=FD2V753IQJEF type=del size=1510644 2024-09-22T08:25:15.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.383+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~VPKO8GU6PEZN.0 size=1048576 2024-09-22T08:25:15.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.384+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~VPKO8GU6PEZN.1 size=20809 2024-09-22T08:25:15.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.387+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=VPKO8GU6PEZN tag=Z252RQF9538A type=write size=2117961 2024-09-22T08:25:15.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.388+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=G0GIE53VAQMZ type=del size=3942602 2024-09-22T08:25:15.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.390+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.0 size=1048576 2024-09-22T08:25:15.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.391+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.1 size=1048576 2024-09-22T08:25:15.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.392+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~2SONX7E57T50.2 size=468340 2024-09-22T08:25:15.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.394+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=2SONX7E57T50 tag=R1IM247LILJO type=write size=3614068 2024-09-22T08:25:15.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.397+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.0 size=1048576 2024-09-22T08:25:15.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.398+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.1 size=1048576 2024-09-22T08:25:15.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.399+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.2 size=868699 2024-09-22T08:25:15.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.399+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=378UF6ZT1ZJP tag=48LST9VYT9T0 type=write size=4014427 2024-09-22T08:25:15.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.400+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=V8CJR9U2HKJ3 type=del 2024-09-22T08:25:15.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.402+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=ID6PAJN6RPOG type=del size=328068 2024-09-22T08:25:15.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.402+0000 7f8a8d811780 1 < canceled part key=_multipart_WR1JR0APSOKN.2~6BC9QZZYWLBA.0 size=1048576 2024-09-22T08:25:15.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.403+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~6BC9QZZYWLBA.1 size=210949 2024-09-22T08:25:15.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.405+0000 7f8a8d811780 1 < canceled multipart upload key=WR1JR0APSOKN upload=6BC9QZZYWLBA tag=3E16UTW40LTF type=write size=2308101 2024-09-22T08:25:15.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.407+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=1FTGYM4RIDNS type=del size=1941589 2024-09-22T08:25:15.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.408+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=R2TNUYI9XK2G type=del 2024-09-22T08:25:15.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.411+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~RCO7GEBUIJH4.0 size=1048576 2024-09-22T08:25:15.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.412+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~RCO7GEBUIJH4.1 size=1040451 2024-09-22T08:25:15.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.412+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=RCO7GEBUIJH4 tag=5INXJ1SA1ZR0 type=write size=3137603 2024-09-22T08:25:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.413+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.0 size=1048576 2024-09-22T08:25:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.413+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.1 size=1048576 2024-09-22T08:25:15.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.415+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~7ZL1AN7E5T51.2 size=165583 2024-09-22T08:25:15.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.417+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=7ZL1AN7E5T51 tag=28LT90QKQXGY type=write size=3311311 2024-09-22T08:25:15.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.420+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.0 size=1048576 2024-09-22T08:25:15.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.422+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.1 size=1048576 2024-09-22T08:25:15.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.423+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.2 size=988469 2024-09-22T08:25:15.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.423+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=DIAWVHMN3RZX tag=NN60P1XRWH5E type=write size=4134197 2024-09-22T08:25:15.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.424+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=XBJLFX519B00 type=del 2024-09-22T08:25:15.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.427+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~VG3MJKNHCKH4.0 size=8077 2024-09-22T08:25:15.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.427+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=VG3MJKNHCKH4 tag=XXCAWYQFR037 type=write size=1056653 2024-09-22T08:25:15.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.428+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=Y5L78VMB58L0 type=del 2024-09-22T08:25:15.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.430+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=3XRKEDY4CUJ6 type=write size=859499 2024-09-22T08:25:15.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.431+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~PLKG7QRPOEBY.0 size=1048576 2024-09-22T08:25:15.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.431+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~PLKG7QRPOEBY.1 size=485356 2024-09-22T08:25:15.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.433+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=PLKG7QRPOEBY tag=MUE5SIWZ0IK0 type=write size=2582508 2024-09-22T08:25:15.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.437+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~I78WQB9RCP32.0 size=1048576 2024-09-22T08:25:15.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.437+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~I78WQB9RCP32.1 size=330794 2024-09-22T08:25:15.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.437+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=I78WQB9RCP32 tag=O7G6O9RSRG9U type=write size=2427946 2024-09-22T08:25:15.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.438+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~2SL0IU9C0B9Q.0 size=790630 2024-09-22T08:25:15.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.440+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=2SL0IU9C0B9Q tag=3K3VOJAH9SJA type=write size=1839206 2024-09-22T08:25:15.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.443+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.0 size=1048576 2024-09-22T08:25:15.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.444+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.1 size=1048576 2024-09-22T08:25:15.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.446+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.2 size=197373 2024-09-22T08:25:15.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.446+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=HXWTPVTYKQ0E tag=23DBK0TX2JV0 type=write size=3343101 2024-09-22T08:25:15.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.446+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~1UUMBJWTGKVX.0 size=1048576 2024-09-22T08:25:15.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.448+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~1UUMBJWTGKVX.1 size=448427 2024-09-22T08:25:15.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.451+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=1UUMBJWTGKVX tag=MPX24J7AD00T type=write size=2545579 2024-09-22T08:25:15.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.453+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.0 size=1048576 2024-09-22T08:25:15.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.454+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.1 size=1048576 2024-09-22T08:25:15.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.455+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.2 size=848104 2024-09-22T08:25:15.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.455+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=3EB51S6AY8CV tag=UK0AJQX2IK22 type=write size=3993832 2024-09-22T08:25:15.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.456+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=JVH7VWWT7229 type=del 2024-09-22T08:25:15.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.457+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=WOMNA5ZY6YPK type=del size=2809802 2024-09-22T08:25:15.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.459+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~Z010S6XEJSJ9.0 size=1048576 2024-09-22T08:25:15.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.460+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~Z010S6XEJSJ9.1 size=66073 2024-09-22T08:25:15.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.462+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=Z010S6XEJSJ9 tag=MCB2CYRU4083 type=write size=2163225 2024-09-22T08:25:15.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.466+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~K2L4BS94LVAC.0 size=1048576 2024-09-22T08:25:15.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.466+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~K2L4BS94LVAC.1 size=326993 2024-09-22T08:25:15.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.466+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=K2L4BS94LVAC tag=89ONP1LP3PYT type=write size=2424145 2024-09-22T08:25:15.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.468+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.0 size=1048576 2024-09-22T08:25:15.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.470+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.1 size=1048576 2024-09-22T08:25:15.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.470+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~V9QGQV8F4YAJ.2 size=876190 2024-09-22T08:25:15.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.472+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=V9QGQV8F4YAJ tag=LLP18LDA9EQ9 type=write size=4021918 2024-09-22T08:25:15.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.473+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=WEZJ5J1DELDP type=del size=295945 2024-09-22T08:25:15.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.475+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=1ZS4AB4IBVCW type=del 2024-09-22T08:25:15.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.477+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=N0RE9STH9XGX type=del size=1291771 2024-09-22T08:25:15.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.479+0000 7f8a8d811780 1 < suggested update operation key=ER5UY1ML3R2H tag=FD2V753IQJEF type=del size=1510644 2024-09-22T08:25:15.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.482+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.0 size=1048576 2024-09-22T08:25:15.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.483+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.1 size=1048576 2024-09-22T08:25:15.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.484+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.2 size=284932 2024-09-22T08:25:15.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.484+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=JGWM1DAEJVWX tag=2EE1HHWEUIIL type=write size=3430660 2024-09-22T08:25:15.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.487+0000 7f8a8d811780 1 < suggested update operation key=KIJ2DW4NSZKG tag=G0GIE53VAQMZ type=del size=3942602 2024-09-22T08:25:15.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.489+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~E431TDTM85TJ.0 size=660499 2024-09-22T08:25:15.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.489+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=E431TDTM85TJ tag=MYHZHS6F89U3 type=write size=1709075 2024-09-22T08:25:15.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.490+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.0 size=1048576 2024-09-22T08:25:15.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.491+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.1 size=1048576 2024-09-22T08:25:15.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.493+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~378UF6ZT1ZJP.2 size=868699 2024-09-22T08:25:15.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.495+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=378UF6ZT1ZJP tag=48LST9VYT9T0 type=write size=4014427 2024-09-22T08:25:15.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.496+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=XS76FA024Q7X type=del size=172609 2024-09-22T08:25:15.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.498+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=ID6PAJN6RPOG type=del 2024-09-22T08:25:15.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.501+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.0 size=1048576 2024-09-22T08:25:15.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.504+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.1 size=1048576 2024-09-22T08:25:15.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.505+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.2 size=357804 2024-09-22T08:25:15.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.505+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=UT4CNC4GN7E8 tag=199Y8Z4CNTVR type=write size=3503532 2024-09-22T08:25:15.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.506+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=1FTGYM4RIDNS type=del 2024-09-22T08:25:15.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.508+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=JHMY2ITZK32X type=del size=1091564 2024-09-22T08:25:15.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.509+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~RCO7GEBUIJH4.0 size=1048576 2024-09-22T08:25:15.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.510+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~RCO7GEBUIJH4.1 size=1040451 2024-09-22T08:25:15.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.513+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=RCO7GEBUIJH4 tag=5INXJ1SA1ZR0 type=write size=3137603 2024-09-22T08:25:15.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.515+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.0 size=1048576 2024-09-22T08:25:15.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.516+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.1 size=1048576 2024-09-22T08:25:15.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.518+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.2 size=716238 2024-09-22T08:25:15.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.518+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=0ZIAWZNEQQ1L tag=HP4W3R0IY5FG type=write size=3861966 2024-09-22T08:25:15.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.518+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.0 size=1048576 2024-09-22T08:25:15.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.519+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.1 size=1048576 2024-09-22T08:25:15.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.520+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~DIAWVHMN3RZX.2 size=988469 2024-09-22T08:25:15.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.523+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=DIAWVHMN3RZX tag=NN60P1XRWH5E type=write size=4134197 2024-09-22T08:25:15.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.526+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~F3DF02P931LI.0 size=417086 2024-09-22T08:25:15.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.526+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=F3DF02P931LI tag=2030PNXKYHBD type=write size=1465662 2024-09-22T08:25:15.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.527+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~VG3MJKNHCKH4.0 size=8077 2024-09-22T08:25:15.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.530+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=VG3MJKNHCKH4 tag=XXCAWYQFR037 type=write size=1056653 2024-09-22T08:25:15.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.532+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.0 size=1048576 2024-09-22T08:25:15.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.533+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.1 size=1048576 2024-09-22T08:25:15.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.535+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.2 size=897709 2024-09-22T08:25:15.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.535+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=T7O2UNCSLKUF tag=8NTI9Z7U7RFP type=write size=4043437 2024-09-22T08:25:15.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.536+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=3XRKEDY4CUJ6 type=write size=859499 2024-09-22T08:25:15.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.538+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=TVFVNM2G8UCT type=del size=2001948 2024-09-22T08:25:15.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.539+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~I78WQB9RCP32.0 size=1048576 2024-09-22T08:25:15.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.540+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~I78WQB9RCP32.1 size=330794 2024-09-22T08:25:15.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.543+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=I78WQB9RCP32 tag=O7G6O9RSRG9U type=write size=2427946 2024-09-22T08:25:15.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.544+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=7UB34WY0K2QV type=del size=3147051 2024-09-22T08:25:15.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.546+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.0 size=1048576 2024-09-22T08:25:15.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.547+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.1 size=1048576 2024-09-22T08:25:15.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.548+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~HXWTPVTYKQ0E.2 size=197373 2024-09-22T08:25:15.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.551+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=HXWTPVTYKQ0E tag=23DBK0TX2JV0 type=write size=3343101 2024-09-22T08:25:15.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.553+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=0T4FQAX7CBM4 type=del size=3997916 2024-09-22T08:25:15.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.554+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.0 size=1048576 2024-09-22T08:25:15.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.555+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.1 size=1048576 2024-09-22T08:25:15.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.557+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~3EB51S6AY8CV.2 size=848104 2024-09-22T08:25:15.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.560+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=3EB51S6AY8CV tag=UK0AJQX2IK22 type=write size=3993832 2024-09-22T08:25:15.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.561+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=XSDD9B4J07AG type=del size=4188332 2024-09-22T08:25:15.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.564+0000 7f8a8d811780 1 < suggested remove operation key=RRTLTMWJIWSW tag=WOMNA5ZY6YPK type=del 2024-09-22T08:25:15.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.568+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.0 size=1048576 2024-09-22T08:25:15.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.568+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.1 size=1048576 2024-09-22T08:25:15.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.570+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.2 size=583772 2024-09-22T08:25:15.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.570+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=VH4X330TN729 tag=S41B3VC9QC99 type=write size=3729500 2024-09-22T08:25:15.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.572+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~K2L4BS94LVAC.0 size=1048576 2024-09-22T08:25:15.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.573+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~K2L4BS94LVAC.1 size=326993 2024-09-22T08:25:15.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.576+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=K2L4BS94LVAC tag=89ONP1LP3PYT type=write size=2424145 2024-09-22T08:25:15.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.578+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~IE9Y71Y2A8RZ.0 size=309377 2024-09-22T08:25:15.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.578+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=IE9Y71Y2A8RZ tag=IKLD4OB1Q3TH type=write size=1357953 2024-09-22T08:25:15.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.580+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=WEZJ5J1DELDP type=del 2024-09-22T08:25:15.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.581+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=F5U9XQ5GI86F type=write size=453500 2024-09-22T08:25:15.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.583+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=N0RE9STH9XGX type=del 2024-09-22T08:25:15.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.585+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=LJE0BHHAE6KZ type=del size=4019919 2024-09-22T08:25:15.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.586+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.0 size=1048576 2024-09-22T08:25:15.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.588+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.1 size=1048576 2024-09-22T08:25:15.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.589+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~JGWM1DAEJVWX.2 size=284932 2024-09-22T08:25:15.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.592+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=JGWM1DAEJVWX tag=2EE1HHWEUIIL type=write size=3430660 2024-09-22T08:25:15.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.594+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=7QB7Y19N2GUF type=del size=4103723 2024-09-22T08:25:15.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.596+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~E431TDTM85TJ.0 size=660499 2024-09-22T08:25:15.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.598+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=E431TDTM85TJ tag=MYHZHS6F89U3 type=write size=1709075 2024-09-22T08:25:15.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.602+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~E4JIM433MUXL.0 size=143012 2024-09-22T08:25:15.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.602+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=E4JIM433MUXL tag=9XURYJKC8R1M type=write size=1191588 2024-09-22T08:25:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.604+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=XS76FA024Q7X type=del 2024-09-22T08:25:15.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.605+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=2QQBCHH114C5 type=del size=3072693 2024-09-22T08:25:15.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.606+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.0 size=1048576 2024-09-22T08:25:15.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.606+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.1 size=1048576 2024-09-22T08:25:15.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.608+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~UT4CNC4GN7E8.2 size=357804 2024-09-22T08:25:15.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.611+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=UT4CNC4GN7E8 tag=199Y8Z4CNTVR type=write size=3503532 2024-09-22T08:25:15.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.613+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=S0TMOQAUSZ92 type=del size=1125154 2024-09-22T08:25:15.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.614+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=JHMY2ITZK32X type=del 2024-09-22T08:25:15.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.615+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=94ZXEMGKSJ1K type=write size=318954 2024-09-22T08:25:15.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.617+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.0 size=1048576 2024-09-22T08:25:15.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.618+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.1 size=1048576 2024-09-22T08:25:15.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.619+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~0ZIAWZNEQQ1L.2 size=716238 2024-09-22T08:25:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.622+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=0ZIAWZNEQQ1L tag=HP4W3R0IY5FG type=write size=3861966 2024-09-22T08:25:15.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.624+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~1JTO3DQI4N4E.0 size=835739 2024-09-22T08:25:15.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.624+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=1JTO3DQI4N4E tag=5BSRL5QMSNR6 type=write size=1884315 2024-09-22T08:25:15.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.626+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~F3DF02P931LI.0 size=417086 2024-09-22T08:25:15.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.628+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=F3DF02P931LI tag=2030PNXKYHBD type=write size=1465662 2024-09-22T08:25:15.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.629+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=KJVGNVUPFI7D type=write size=651357 2024-09-22T08:25:15.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.631+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.0 size=1048576 2024-09-22T08:25:15.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.632+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.1 size=1048576 2024-09-22T08:25:15.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.633+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~T7O2UNCSLKUF.2 size=897709 2024-09-22T08:25:15.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.635+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=T7O2UNCSLKUF tag=8NTI9Z7U7RFP type=write size=4043437 2024-09-22T08:25:15.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.636+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=IOFNNNPIAD3Y type=del size=3663568 2024-09-22T08:25:15.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.638+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=TVFVNM2G8UCT type=del 2024-09-22T08:25:15.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.641+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=9M3FXJQ8NZX6 type=del size=3242043 2024-09-22T08:25:15.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.643+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=7UB34WY0K2QV type=del 2024-09-22T08:25:15.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.645+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=J8PYRUOYPU3S type=del size=209951 2024-09-22T08:25:15.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.646+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=0T4FQAX7CBM4 type=del 2024-09-22T08:25:15.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.647+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=369CIGQFEXEQ type=del size=335125 2024-09-22T08:25:15.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.651+0000 7f8a8d811780 1 < suggested remove operation key=ER5UY1ML3R2H tag=XSDD9B4J07AG type=del 2024-09-22T08:25:15.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.651+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=G0VRTJYYZN2O type=del size=2453768 2024-09-22T08:25:15.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.653+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.0 size=1048576 2024-09-22T08:25:15.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.654+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.1 size=1048576 2024-09-22T08:25:15.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.655+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~VH4X330TN729.2 size=583772 2024-09-22T08:25:15.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.657+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=VH4X330TN729 tag=S41B3VC9QC99 type=write size=3729500 2024-09-22T08:25:15.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.660+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LM20KCSUF119.0 size=574248 2024-09-22T08:25:15.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.660+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=LM20KCSUF119 tag=QUUDWQR4FY2Y type=write size=1622824 2024-09-22T08:25:15.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.661+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~IE9Y71Y2A8RZ.0 size=309377 2024-09-22T08:25:15.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.663+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=IE9Y71Y2A8RZ tag=IKLD4OB1Q3TH type=write size=1357953 2024-09-22T08:25:15.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.665+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=6ECAOI6742CI type=del size=546941 2024-09-22T08:25:15.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.666+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=F5U9XQ5GI86F type=write size=453500 2024-09-22T08:25:15.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.668+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=YZHZVXB8UV80 type=del size=342723 2024-09-22T08:25:15.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.669+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=LJE0BHHAE6KZ type=del 2024-09-22T08:25:15.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.672+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~5SFDRD3EFIWX.0 size=1048576 2024-09-22T08:25:15.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.673+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~5SFDRD3EFIWX.1 size=775373 2024-09-22T08:25:15.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.673+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=5SFDRD3EFIWX tag=3UA8MEJSPNFV type=write size=2872525 2024-09-22T08:25:15.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.674+0000 7f8a8d811780 1 < canceled operation key=3T2TX83CSE2D tag=7QB7Y19N2GUF type=del size=4103723 2024-09-22T08:25:15.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.676+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=O3J7G8SG7P6J type=del size=440169 2024-09-22T08:25:15.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.677+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~E4JIM433MUXL.0 size=143012 2024-09-22T08:25:15.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.680+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=E4JIM433MUXL tag=9XURYJKC8R1M type=write size=1191588 2024-09-22T08:25:15.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.681+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=OENUKFH5H9ZA type=del size=2350088 2024-09-22T08:25:15.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.683+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=2QQBCHH114C5 type=del 2024-09-22T08:25:15.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.684+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=4RE30YRD79XX type=del size=2470402 2024-09-22T08:25:15.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.685+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=S0TMOQAUSZ92 type=del 2024-09-22T08:25:15.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.687+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=9H8H6NWZITBD type=del size=919944 2024-09-22T08:25:15.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.690+0000 7f8a8d811780 1 < suggested update operation key=RCHUCAL6CQ4F tag=94ZXEMGKSJ1K type=write size=318954 2024-09-22T08:25:15.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.693+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~53HOG56MCN6X.0 size=1048576 2024-09-22T08:25:15.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.694+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~53HOG56MCN6X.1 size=470048 2024-09-22T08:25:15.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.694+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=53HOG56MCN6X tag=Q4A10GHV7TAP type=write size=2567200 2024-09-22T08:25:15.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.695+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~1JTO3DQI4N4E.0 size=835739 2024-09-22T08:25:15.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.697+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=1JTO3DQI4N4E tag=5BSRL5QMSNR6 type=write size=1884315 2024-09-22T08:25:15.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.701+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~RMZ8WWSFUAPA.0 size=1048576 2024-09-22T08:25:15.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.702+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~RMZ8WWSFUAPA.1 size=330746 2024-09-22T08:25:15.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.702+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=RMZ8WWSFUAPA tag=1DTLTBO96ZZH type=write size=2427898 2024-09-22T08:25:15.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.703+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=KJVGNVUPFI7D type=write size=651357 2024-09-22T08:25:15.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.705+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~VP18Y53ALDQ0.0 size=1048576 2024-09-22T08:25:15.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.706+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~VP18Y53ALDQ0.1 size=409058 2024-09-22T08:25:15.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.706+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=VP18Y53ALDQ0 tag=0131WC2SR35K type=write size=2506210 2024-09-22T08:25:15.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.707+0000 7f8a8d811780 1 < canceled operation key=226G7R10IR1B tag=IOFNNNPIAD3Y type=del size=3663568 2024-09-22T08:25:15.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.709+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=WEGI3L8P13T5 type=write size=166369 2024-09-22T08:25:15.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.710+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=9M3FXJQ8NZX6 type=del 2024-09-22T08:25:15.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.712+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=4B9H22YGELYP type=del size=3386408 2024-09-22T08:25:15.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.715+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=J8PYRUOYPU3S type=del size=209951 2024-09-22T08:25:15.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.717+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.0 size=1048576 2024-09-22T08:25:15.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.718+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.1 size=1048576 2024-09-22T08:25:15.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.720+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.2 size=34493 2024-09-22T08:25:15.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.720+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=ONSUMZKNGPO5 tag=BVEGWADR0Y3W type=write size=3180221 2024-09-22T08:25:15.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.722+0000 7f8a8d811780 -1 < failed to complete operation key=ER5UY1ML3R2H tag=369CIGQFEXEQ type=del size=335125: (22) Invalid argument 2024-09-22T08:25:15.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.723+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=QU2CWP96P2R4 type=del size=359339 2024-09-22T08:25:15.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.724+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=G0VRTJYYZN2O type=del size=2453768 2024-09-22T08:25:15.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.726+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=GR7Z3OFOMKNC type=del size=4065895 2024-09-22T08:25:15.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.727+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~LM20KCSUF119.0 size=574248 2024-09-22T08:25:15.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.730+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=LM20KCSUF119 tag=QUUDWQR4FY2Y type=write size=1622824 2024-09-22T08:25:15.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.731+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=VSBTVKK6ZHC7 type=write size=563779 2024-09-22T08:25:15.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.733+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=6ECAOI6742CI type=del 2024-09-22T08:25:15.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.735+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LXCKQ2F05Z56.0 size=1048576 2024-09-22T08:25:15.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.736+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LXCKQ2F05Z56.1 size=673533 2024-09-22T08:25:15.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.736+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=LXCKQ2F05Z56 tag=N74B8U8ADTU1 type=write size=2770685 2024-09-22T08:25:15.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.738+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=YZHZVXB8UV80 type=del 2024-09-22T08:25:15.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.739+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=8BHO0Q3KAA12 type=del size=19669 2024-09-22T08:25:15.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.741+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~5SFDRD3EFIWX.0 size=1048576 2024-09-22T08:25:15.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.742+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~5SFDRD3EFIWX.1 size=775373 2024-09-22T08:25:15.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.744+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=5SFDRD3EFIWX tag=3UA8MEJSPNFV type=write size=2872525 2024-09-22T08:25:15.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.748+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.0 size=1048576 2024-09-22T08:25:15.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.748+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.1 size=1048576 2024-09-22T08:25:15.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.749+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.2 size=972947 2024-09-22T08:25:15.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.749+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=ND0WUUTZN3RI tag=X5AO6PXQ6E3Y type=write size=4118675 2024-09-22T08:25:15.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.752+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=O3J7G8SG7P6J type=del 2024-09-22T08:25:15.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.752+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=AP401QPH89MV type=write size=976140 2024-09-22T08:25:15.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.754+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=OENUKFH5H9ZA type=del 2024-09-22T08:25:15.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.757+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~6MHFI2LX9P5C.0 size=536400 2024-09-22T08:25:15.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.757+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=6MHFI2LX9P5C tag=IKUO1SFSJ1S1 type=write size=1584976 2024-09-22T08:25:15.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.758+0000 7f8a8d811780 -1 < failed to complete operation key=EILTWP17M0NL tag=4RE30YRD79XX type=del size=2470402: (22) Invalid argument 2024-09-22T08:25:15.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.761+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~A9H54I6B80RQ.0 size=1048576 2024-09-22T08:25:15.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.762+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~A9H54I6B80RQ.1 size=866440 2024-09-22T08:25:15.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.762+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=A9H54I6B80RQ tag=CFA28IR9JJSW type=write size=2963592 2024-09-22T08:25:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.765+0000 7f8a8d811780 1 < suggested remove operation key=GMNVYF2BY872 tag=9H8H6NWZITBD type=del 2024-09-22T08:25:15.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.767+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~1UDMWA9XTYIQ.0 size=1048576 2024-09-22T08:25:15.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.769+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~1UDMWA9XTYIQ.1 size=844939 2024-09-22T08:25:15.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.769+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=1UDMWA9XTYIQ tag=1ZUJIW6NOMAC type=write size=2942091 2024-09-22T08:25:15.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.770+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~53HOG56MCN6X.0 size=1048576 2024-09-22T08:25:15.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.771+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~53HOG56MCN6X.1 size=470048 2024-09-22T08:25:15.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.774+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=53HOG56MCN6X tag=Q4A10GHV7TAP type=write size=2567200 2024-09-22T08:25:15.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.777+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=1OM3I91YNOVP type=write size=614293 2024-09-22T08:25:15.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.779+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~RMZ8WWSFUAPA.0 size=1048576 2024-09-22T08:25:15.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.780+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~RMZ8WWSFUAPA.1 size=330746 2024-09-22T08:25:15.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.783+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=RMZ8WWSFUAPA tag=1DTLTBO96ZZH type=write size=2427898 2024-09-22T08:25:15.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.785+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=JGWQATGFF4JC type=del size=3286521 2024-09-22T08:25:15.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.786+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~VP18Y53ALDQ0.0 size=1048576 2024-09-22T08:25:15.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.787+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~VP18Y53ALDQ0.1 size=409058 2024-09-22T08:25:15.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.789+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=VP18Y53ALDQ0 tag=0131WC2SR35K type=write size=2506210 2024-09-22T08:25:15.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.790+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=S2KN6T90Y4LN type=del size=3721653 2024-09-22T08:25:15.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.793+0000 7f8a8d811780 1 < completed write operation key=KIJ2DW4NSZKG tag=WEGI3L8P13T5 type=write size=166369 2024-09-22T08:25:15.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.794+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=HA1K5SQJLGPU type=write size=156144 2024-09-22T08:25:15.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.795+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=4B9H22YGELYP type=del 2024-09-22T08:25:15.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.798+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~5C1IQD0WYM8E.0 size=1048576 2024-09-22T08:25:15.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.799+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~5C1IQD0WYM8E.1 size=433874 2024-09-22T08:25:15.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.799+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=5C1IQD0WYM8E tag=7HMPNDWIVVZ3 type=write size=2531026 2024-09-22T08:25:15.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.801+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.0 size=1048576 2024-09-22T08:25:15.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.801+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.1 size=1048576 2024-09-22T08:25:15.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.803+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~ONSUMZKNGPO5.2 size=34493 2024-09-22T08:25:15.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.805+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=ONSUMZKNGPO5 tag=BVEGWADR0Y3W type=write size=3180221 2024-09-22T08:25:15.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.807+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=9PJ76WDUSE5K type=del size=825740 2024-09-22T08:25:15.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.808+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=QU2CWP96P2R4 type=del 2024-09-22T08:25:15.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.811+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~SOBH4RGFTUCL.0 size=1048576 2024-09-22T08:25:15.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.813+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~SOBH4RGFTUCL.1 size=535438 2024-09-22T08:25:15.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.813+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=SOBH4RGFTUCL tag=2N4TT39H81M8 type=write size=2632590 2024-09-22T08:25:15.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.814+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=GR7Z3OFOMKNC type=del 2024-09-22T08:25:15.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.815+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=QGEAFSWF32UD type=write size=112881 2024-09-22T08:25:15.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.816+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=VSBTVKK6ZHC7 type=write size=563779 2024-09-22T08:25:15.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.818+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=42J83DHWYWAE type=del size=251317 2024-09-22T08:25:15.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.818+0000 7f8a8d811780 1 < canceled part key=_multipart_JWJ9T6XYCUYR.2~LXCKQ2F05Z56.0 size=1048576 2024-09-22T08:25:15.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.820+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~LXCKQ2F05Z56.1 size=673533 2024-09-22T08:25:15.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.822+0000 7f8a8d811780 1 < canceled multipart upload key=JWJ9T6XYCUYR upload=LXCKQ2F05Z56 tag=N74B8U8ADTU1 type=write size=2770685 2024-09-22T08:25:15.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.824+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.0 size=1048576 2024-09-22T08:25:15.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.825+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.1 size=1048576 2024-09-22T08:25:15.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.827+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.2 size=880507 2024-09-22T08:25:15.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.827+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=76JV1NEPH73R tag=5LCC91AV1C3J type=write size=4026235 2024-09-22T08:25:15.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.828+0000 7f8a8d811780 1 < canceled operation key=JP7IZ0CMXTSX tag=8BHO0Q3KAA12 type=del size=19669 2024-09-22T08:25:15.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.831+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.0 size=1048576 2024-09-22T08:25:15.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.832+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.1 size=1048576 2024-09-22T08:25:15.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.833+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.2 size=570367 2024-09-22T08:25:15.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.833+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=AJGJ9P5ZHWSG tag=1DKMNOE5U6ID type=write size=3716095 2024-09-22T08:25:15.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.834+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.0 size=1048576 2024-09-22T08:25:15.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.835+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.1 size=1048576 2024-09-22T08:25:15.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.835+0000 7f8a8d811780 1 < canceled part key=_multipart_MJJPUJP2NSOK.2~ND0WUUTZN3RI.2 size=972947 2024-09-22T08:25:15.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.838+0000 7f8a8d811780 1 < canceled multipart upload key=MJJPUJP2NSOK upload=ND0WUUTZN3RI tag=X5AO6PXQ6E3Y type=write size=4118675 2024-09-22T08:25:15.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.840+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~7YPWKJG267ZH.0 size=1048576 2024-09-22T08:25:15.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.841+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~7YPWKJG267ZH.1 size=547195 2024-09-22T08:25:15.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.841+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=7YPWKJG267ZH tag=CED445GOPC8T type=write size=2644347 2024-09-22T08:25:15.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.843+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=AP401QPH89MV type=write size=976140 2024-09-22T08:25:15.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.844+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=34O5EP3JGB91 type=del size=363443 2024-09-22T08:25:15.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.846+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~6MHFI2LX9P5C.0 size=536400 2024-09-22T08:25:15.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.848+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=6MHFI2LX9P5C tag=IKUO1SFSJ1S1 type=write size=1584976 2024-09-22T08:25:15.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.850+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=K90V7MLO6L9P type=write size=195431 2024-09-22T08:25:15.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.851+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~A9H54I6B80RQ.0 size=1048576 2024-09-22T08:25:15.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.853+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~A9H54I6B80RQ.1 size=866440 2024-09-22T08:25:15.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.855+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=A9H54I6B80RQ tag=CFA28IR9JJSW type=write size=2963592 2024-09-22T08:25:15.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.857+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=XKPR1GS6DKKD type=del size=2903260 2024-09-22T08:25:15.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.858+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~1UDMWA9XTYIQ.0 size=1048576 2024-09-22T08:25:15.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.859+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~1UDMWA9XTYIQ.1 size=844939 2024-09-22T08:25:15.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.862+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=1UDMWA9XTYIQ tag=1ZUJIW6NOMAC type=write size=2942091 2024-09-22T08:25:15.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.863+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=B1KK4GOW6JUH type=del size=4100323 2024-09-22T08:25:15.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.865+0000 7f8a8d811780 1 < completed write operation key=RCHUCAL6CQ4F tag=1OM3I91YNOVP type=write size=614293 2024-09-22T08:25:15.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.867+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=YHLP57TQHJ3D type=write size=643746 2024-09-22T08:25:15.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.868+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=JGWQATGFF4JC type=del 2024-09-22T08:25:15.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.871+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~3IBPSRC1B6UH.0 size=1048576 2024-09-22T08:25:15.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.872+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~3IBPSRC1B6UH.1 size=214098 2024-09-22T08:25:15.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.872+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=3IBPSRC1B6UH tag=V5MTZGISEL03 type=write size=2311250 2024-09-22T08:25:15.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.874+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=S2KN6T90Y4LN type=del 2024-09-22T08:25:15.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.875+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=X6N279H4CC9P type=del size=512595 2024-09-22T08:25:15.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.877+0000 7f8a8d811780 1 < canceled operation key=7XBR6QIHD8TJ tag=HA1K5SQJLGPU type=write size=156144 2024-09-22T08:25:15.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.878+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=LGJ2J0ZBJ8VK type=del size=2181913 2024-09-22T08:25:15.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.879+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~5C1IQD0WYM8E.0 size=1048576 2024-09-22T08:25:15.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.880+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~5C1IQD0WYM8E.1 size=433874 2024-09-22T08:25:15.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.882+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=5C1IQD0WYM8E tag=7HMPNDWIVVZ3 type=write size=2531026 2024-09-22T08:25:15.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.883+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=PC02TN2ZF2DD type=write size=1020546 2024-09-22T08:25:15.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.885+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=9PJ76WDUSE5K type=del 2024-09-22T08:25:15.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.886+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=3FHCKWEACF8H type=del size=1594590 2024-09-22T08:25:15.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.888+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~SOBH4RGFTUCL.0 size=1048576 2024-09-22T08:25:15.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.889+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~SOBH4RGFTUCL.1 size=535438 2024-09-22T08:25:15.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.891+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=SOBH4RGFTUCL tag=2N4TT39H81M8 type=write size=2632590 2024-09-22T08:25:15.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.894+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~1SJUAZ6GCWAW.0 size=1048576 2024-09-22T08:25:15.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.896+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~1SJUAZ6GCWAW.1 size=534107 2024-09-22T08:25:15.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.896+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=1SJUAZ6GCWAW tag=TG6FX33T8BYU type=write size=2631259 2024-09-22T08:25:15.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.899+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=QGEAFSWF32UD type=write size=112881 2024-09-22T08:25:15.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.902+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1YUTXYZMZHZL.0 size=1048576 2024-09-22T08:25:15.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.902+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1YUTXYZMZHZL.1 size=445161 2024-09-22T08:25:15.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.902+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=1YUTXYZMZHZL tag=8VMWGKO0701K type=write size=2542313 2024-09-22T08:25:15.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.905+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=42J83DHWYWAE type=del 2024-09-22T08:25:15.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.907+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~FU0473VBUXSA.0 size=1048576 2024-09-22T08:25:15.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.908+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~FU0473VBUXSA.1 size=492549 2024-09-22T08:25:15.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.908+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=FU0473VBUXSA tag=IUS64DLRBRD4 type=write size=2589701 2024-09-22T08:25:15.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.910+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.0 size=1048576 2024-09-22T08:25:15.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.911+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.1 size=1048576 2024-09-22T08:25:15.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.913+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~76JV1NEPH73R.2 size=880507 2024-09-22T08:25:15.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.916+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=76JV1NEPH73R tag=5LCC91AV1C3J type=write size=4026235 2024-09-22T08:25:15.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.917+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=WDYH2PC968A0 type=del size=1961625 2024-09-22T08:25:15.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.917+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.0 size=1048576 2024-09-22T08:25:15.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.918+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.1 size=1048576 2024-09-22T08:25:15.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.919+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~AJGJ9P5ZHWSG.2 size=570367 2024-09-22T08:25:15.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.922+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=AJGJ9P5ZHWSG tag=1DKMNOE5U6ID type=write size=3716095 2024-09-22T08:25:15.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.923+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=NX25YGY31OZZ type=del size=633409 2024-09-22T08:25:15.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.925+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~7YPWKJG267ZH.0 size=1048576 2024-09-22T08:25:15.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.927+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~7YPWKJG267ZH.1 size=547195 2024-09-22T08:25:15.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.928+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=7YPWKJG267ZH tag=CED445GOPC8T type=write size=2644347 2024-09-22T08:25:15.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.930+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=721GEAYOW71U type=del size=3919282 2024-09-22T08:25:15.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.933+0000 7f8a8d811780 1 < suggested remove operation key=9EY50PUC6AJJ tag=34O5EP3JGB91 type=del 2024-09-22T08:25:15.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.935+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=5V6VGI5YKHLU type=del size=1509669 2024-09-22T08:25:15.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.936+0000 7f8a8d811780 1 < completed write operation key=WOSCCX4WX2FN tag=K90V7MLO6L9P type=write size=195431 2024-09-22T08:25:15.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.937+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=T3EVZ682WUHZ type=del size=2584964 2024-09-22T08:25:15.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.939+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=XKPR1GS6DKKD type=del 2024-09-22T08:25:15.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.943+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~E78P8MVBUP81.0 size=401869 2024-09-22T08:25:15.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.943+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=E78P8MVBUP81 tag=9O6UWE1RM5NG type=write size=1450445 2024-09-22T08:25:15.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.943+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=B1KK4GOW6JUH type=del 2024-09-22T08:25:15.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.947+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.0 size=1048576 2024-09-22T08:25:15.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.948+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.1 size=1048576 2024-09-22T08:25:15.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.948+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.2 size=809976 2024-09-22T08:25:15.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.948+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=1NLH68FRH4PI tag=UM3AQ6OUH4M3 type=write size=3955704 2024-09-22T08:25:15.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.950+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=YHLP57TQHJ3D type=write size=643746 2024-09-22T08:25:15.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.951+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=7VOSBHPYB0GY type=del size=3272018 2024-09-22T08:25:15.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.953+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~3IBPSRC1B6UH.0 size=1048576 2024-09-22T08:25:15.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.953+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~3IBPSRC1B6UH.1 size=214098 2024-09-22T08:25:15.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.955+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=3IBPSRC1B6UH tag=V5MTZGISEL03 type=write size=2311250 2024-09-22T08:25:15.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.957+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.0 size=1048576 2024-09-22T08:25:15.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.958+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.1 size=1048576 2024-09-22T08:25:15.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.959+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.2 size=753684 2024-09-22T08:25:15.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.959+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=FP92LUL6UGSI tag=ZJJ5HTH385EW type=write size=3899412 2024-09-22T08:25:15.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.961+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=X6N279H4CC9P type=del 2024-09-22T08:25:15.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.962+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=B4YWOSGXD98D type=del size=3645227 2024-09-22T08:25:15.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.965+0000 7f8a8d811780 1 < suggested remove operation key=226G7R10IR1B tag=LGJ2J0ZBJ8VK type=del 2024-09-22T08:25:15.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.968+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.0 size=1048576 2024-09-22T08:25:15.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.969+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.1 size=1048576 2024-09-22T08:25:15.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.970+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.2 size=253100 2024-09-22T08:25:15.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.970+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=GTD9T6ABBWI0 tag=WB2KCURSMCWI type=write size=3398828 2024-09-22T08:25:15.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.972+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=PC02TN2ZF2DD type=write size=1020546 2024-09-22T08:25:15.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.973+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=QG5TJSBC24EN type=del size=1706069 2024-09-22T08:25:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.975+0000 7f8a8d811780 1 < canceled operation key=GMNVYF2BY872 tag=3FHCKWEACF8H type=del size=1594590 2024-09-22T08:25:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.977+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=G8ICYDUMESBO type=write size=373036 2024-09-22T08:25:15.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.979+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~1SJUAZ6GCWAW.0 size=1048576 2024-09-22T08:25:15.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.980+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~1SJUAZ6GCWAW.1 size=534107 2024-09-22T08:25:15.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.982+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=1SJUAZ6GCWAW tag=TG6FX33T8BYU type=write size=2631259 2024-09-22T08:25:15.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.984+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=BWH5TORBC1F4 type=write size=105836 2024-09-22T08:25:15.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.986+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1YUTXYZMZHZL.0 size=1048576 2024-09-22T08:25:15.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.987+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1YUTXYZMZHZL.1 size=445161 2024-09-22T08:25:15.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.990+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=1YUTXYZMZHZL tag=8VMWGKO0701K type=write size=2542313 2024-09-22T08:25:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.993+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~2ZGHXSZ4OS2L.0 size=1048576 2024-09-22T08:25:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.994+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~2ZGHXSZ4OS2L.1 size=624018 2024-09-22T08:25:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.994+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=2ZGHXSZ4OS2L tag=9YIH65UGS41R type=write size=2721170 2024-09-22T08:25:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.995+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~FU0473VBUXSA.0 size=1048576 2024-09-22T08:25:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.996+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~FU0473VBUXSA.1 size=492549 2024-09-22T08:25:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:15.999+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=FU0473VBUXSA tag=IUS64DLRBRD4 type=write size=2589701 2024-09-22T08:25:16.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.000+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=1C6Z58ONUPYQ type=del size=1365816 2024-09-22T08:25:16.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.003+0000 7f8a8d811780 1 < suggested remove operation key=3T2TX83CSE2D tag=WDYH2PC968A0 type=del 2024-09-22T08:25:16.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.004+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=FZZ3SWZ4C70T type=del size=3919061 2024-09-22T08:25:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.006+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=NX25YGY31OZZ type=del 2024-09-22T08:25:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.008+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.0 size=1048576 2024-09-22T08:25:16.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.009+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.1 size=1048576 2024-09-22T08:25:16.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.011+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.2 size=45391 2024-09-22T08:25:16.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.011+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=TMDFBWNNP8DF tag=FC4OCHPY0W7E type=write size=3191119 2024-09-22T08:25:16.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.014+0000 7f8a8d811780 1 < suggested update operation key=RL59H41J8ZNF tag=721GEAYOW71U type=del size=3919282 2024-09-22T08:25:16.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.014+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=U0E1JXR79NRM type=del size=3313955 2024-09-22T08:25:16.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.016+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=5V6VGI5YKHLU type=del 2024-09-22T08:25:16.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.017+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=Z5P6IEE54QDB type=del size=994865 2024-09-22T08:25:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.019+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=T3EVZ682WUHZ type=del 2024-09-22T08:25:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.020+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=TKEEJ2A9O7TB type=del size=3317647 2024-09-22T08:25:16.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.021+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~E78P8MVBUP81.0 size=401869 2024-09-22T08:25:16.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.024+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=E78P8MVBUP81 tag=9O6UWE1RM5NG type=write size=1450445 2024-09-22T08:25:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.026+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~K2BHEL8HXHPO.0 size=170028 2024-09-22T08:25:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.026+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=K2BHEL8HXHPO tag=VDRYFTUVEUMM type=write size=1218604 2024-09-22T08:25:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.028+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.0 size=1048576 2024-09-22T08:25:16.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.029+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.1 size=1048576 2024-09-22T08:25:16.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.030+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~1NLH68FRH4PI.2 size=809976 2024-09-22T08:25:16.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.033+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=1NLH68FRH4PI tag=UM3AQ6OUH4M3 type=write size=3955704 2024-09-22T08:25:16.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.034+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=ZS53D5EHZJI7 type=del size=2341264 2024-09-22T08:25:16.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.035+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=7VOSBHPYB0GY type=del 2024-09-22T08:25:16.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.037+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=B8UNUM1WF4CF type=del size=3543044 2024-09-22T08:25:16.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.038+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.0 size=1048576 2024-09-22T08:25:16.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.039+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.1 size=1048576 2024-09-22T08:25:16.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.040+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~FP92LUL6UGSI.2 size=753684 2024-09-22T08:25:16.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.043+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=FP92LUL6UGSI tag=ZJJ5HTH385EW type=write size=3899412 2024-09-22T08:25:16.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.044+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=IAKZHRLS7VD8 type=del size=3873581 2024-09-22T08:25:16.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.045+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=B4YWOSGXD98D type=del 2024-09-22T08:25:16.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.049+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~UETZHGCXADXM.0 size=972891 2024-09-22T08:25:16.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.049+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=UETZHGCXADXM tag=4C33LTDRFLIG type=write size=2021467 2024-09-22T08:25:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.050+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.0 size=1048576 2024-09-22T08:25:16.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.052+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.1 size=1048576 2024-09-22T08:25:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.053+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~GTD9T6ABBWI0.2 size=253100 2024-09-22T08:25:16.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.054+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=GTD9T6ABBWI0 tag=WB2KCURSMCWI type=write size=3398828 2024-09-22T08:25:16.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.056+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=XA3IB00PYI8X type=del size=3315778 2024-09-22T08:25:16.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.057+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=QG5TJSBC24EN type=del 2024-09-22T08:25:16.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.060+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~E5F03GZ2B36E.0 size=625325 2024-09-22T08:25:16.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.060+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=E5F03GZ2B36E tag=NYDNUA10FEME type=write size=1673901 2024-09-22T08:25:16.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.061+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=G8ICYDUMESBO type=write size=373036 2024-09-22T08:25:16.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.063+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=2ORKYUPMDNK7 type=del size=771557 2024-09-22T08:25:16.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.064+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=BWH5TORBC1F4 type=write size=105836 2024-09-22T08:25:16.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.067+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~XM2O8K4HHAO6.0 size=786815 2024-09-22T08:25:16.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.067+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=XM2O8K4HHAO6 tag=BQKD1LHJE4NA type=write size=1835391 2024-09-22T08:25:16.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.068+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~2ZGHXSZ4OS2L.0 size=1048576 2024-09-22T08:25:16.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.069+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~2ZGHXSZ4OS2L.1 size=624018 2024-09-22T08:25:16.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.072+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=2ZGHXSZ4OS2L tag=9YIH65UGS41R type=write size=2721170 2024-09-22T08:25:16.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.073+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=FDQBX3O0G09K type=del size=3050789 2024-09-22T08:25:16.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.075+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=1C6Z58ONUPYQ type=del 2024-09-22T08:25:16.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.077+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.0 size=1048576 2024-09-22T08:25:16.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.080+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.1 size=1048576 2024-09-22T08:25:16.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.081+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.2 size=388925 2024-09-22T08:25:16.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.081+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=RP5YGJA8SQJZ tag=GI32H4GW7AHP type=write size=3534653 2024-09-22T08:25:16.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.082+0000 7f8a8d811780 1 < canceled operation key=7XNMR51803Y6 tag=FZZ3SWZ4C70T type=del size=3919061 2024-09-22T08:25:16.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.085+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.0 size=1048576 2024-09-22T08:25:16.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.086+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.1 size=1048576 2024-09-22T08:25:16.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.087+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.2 size=476576 2024-09-22T08:25:16.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.087+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=IONP3E8G3HZ6 tag=X29PG6H5HPOL type=write size=3622304 2024-09-22T08:25:16.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.089+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.0 size=1048576 2024-09-22T08:25:16.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.090+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.1 size=1048576 2024-09-22T08:25:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.091+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~TMDFBWNNP8DF.2 size=45391 2024-09-22T08:25:16.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.093+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=TMDFBWNNP8DF tag=FC4OCHPY0W7E type=write size=3191119 2024-09-22T08:25:16.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.095+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=527OVWAFZK1T type=del size=2283089 2024-09-22T08:25:16.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.096+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=U0E1JXR79NRM type=del 2024-09-22T08:25:16.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.100+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.0 size=1048576 2024-09-22T08:25:16.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.100+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.1 size=1048576 2024-09-22T08:25:16.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.102+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.2 size=873924 2024-09-22T08:25:16.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.102+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=DUOL0ULUTKIO tag=3RPL7949VFO9 type=write size=4019652 2024-09-22T08:25:16.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.103+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=Z5P6IEE54QDB type=del 2024-09-22T08:25:16.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.106+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~KBWKZS0EFH27.0 size=1048576 2024-09-22T08:25:16.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.106+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~KBWKZS0EFH27.1 size=360320 2024-09-22T08:25:16.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.106+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=KBWKZS0EFH27 tag=CMW4V5FPGW5D type=write size=2457472 2024-09-22T08:25:16.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.109+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=TKEEJ2A9O7TB type=del size=3317647 2024-09-22T08:25:16.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.112+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~X7MM11F2Q0ZN.0 size=1048576 2024-09-22T08:25:16.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.113+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~X7MM11F2Q0ZN.1 size=1035677 2024-09-22T08:25:16.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.113+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=X7MM11F2Q0ZN tag=CF0UI106J3WF type=write size=3132829 2024-09-22T08:25:16.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.113+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~K2BHEL8HXHPO.0 size=170028 2024-09-22T08:25:16.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.115+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=K2BHEL8HXHPO tag=VDRYFTUVEUMM type=write size=1218604 2024-09-22T08:25:16.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.117+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=QF50CBFSJN4R type=del size=1026562 2024-09-22T08:25:16.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.118+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=ZS53D5EHZJI7 type=del 2024-09-22T08:25:16.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.120+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=CI117F9HHRFV type=del size=2490637 2024-09-22T08:25:16.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.121+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=B8UNUM1WF4CF type=del 2024-09-22T08:25:16.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.124+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.0 size=1048576 2024-09-22T08:25:16.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.125+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.1 size=1048576 2024-09-22T08:25:16.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.126+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.2 size=131135 2024-09-22T08:25:16.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.126+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=IPT7NJ1C50OP tag=UJ5WBYEELZ9U type=write size=3276863 2024-09-22T08:25:16.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.128+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=IAKZHRLS7VD8 type=del size=3873581 2024-09-22T08:25:16.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.129+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=CD4O3ZB40F4D type=del size=3432863 2024-09-22T08:25:16.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.131+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~UETZHGCXADXM.0 size=972891 2024-09-22T08:25:16.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.133+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=UETZHGCXADXM tag=4C33LTDRFLIG type=write size=2021467 2024-09-22T08:25:16.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.135+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.0 size=1048576 2024-09-22T08:25:16.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.136+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.1 size=1048576 2024-09-22T08:25:16.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.137+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.2 size=283393 2024-09-22T08:25:16.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.137+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=895EDS80P168 tag=XMUYXZ8XAFGM type=write size=3429121 2024-09-22T08:25:16.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.139+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=XA3IB00PYI8X type=del 2024-09-22T08:25:16.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.140+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=17DGTYYCWRZL type=del size=958655 2024-09-22T08:25:16.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.142+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~E5F03GZ2B36E.0 size=625325 2024-09-22T08:25:16.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.145+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=E5F03GZ2B36E tag=NYDNUA10FEME type=write size=1673901 2024-09-22T08:25:16.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.147+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~9CYYZ2YK03PY.0 size=1048576 2024-09-22T08:25:16.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.149+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~9CYYZ2YK03PY.1 size=865833 2024-09-22T08:25:16.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.149+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=9CYYZ2YK03PY tag=016YI32SWVDL type=write size=2962985 2024-09-22T08:25:16.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.149+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=2ORKYUPMDNK7 type=del 2024-09-22T08:25:16.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.151+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=UPQW0WLG5Y2O type=del size=1082384 2024-09-22T08:25:16.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.153+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~XM2O8K4HHAO6.0 size=786815 2024-09-22T08:25:16.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.155+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=XM2O8K4HHAO6 tag=BQKD1LHJE4NA type=write size=1835391 2024-09-22T08:25:16.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.158+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.0 size=1048576 2024-09-22T08:25:16.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.159+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.1 size=1048576 2024-09-22T08:25:16.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.160+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.2 size=762195 2024-09-22T08:25:16.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.160+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=CBV4EECNEW5R tag=7OYTJZH3WSMI type=write size=3907923 2024-09-22T08:25:16.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.162+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=FDQBX3O0G09K type=del 2024-09-22T08:25:16.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.165+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~RTGYCJ049DQE.0 size=1048576 2024-09-22T08:25:16.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.166+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~RTGYCJ049DQE.1 size=772120 2024-09-22T08:25:16.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.166+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=RTGYCJ049DQE tag=I91PRU1R63S1 type=write size=2869272 2024-09-22T08:25:16.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.166+0000 7f8a8d811780 1 < canceled part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.0 size=1048576 2024-09-22T08:25:16.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.167+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.1 size=1048576 2024-09-22T08:25:16.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.168+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~RP5YGJA8SQJZ.2 size=388925 2024-09-22T08:25:16.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.171+0000 7f8a8d811780 1 < canceled multipart upload key=9EY50PUC6AJJ upload=RP5YGJA8SQJZ tag=GI32H4GW7AHP type=write size=3534653 2024-09-22T08:25:16.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.172+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=DCV1JNTGIDKD type=del size=2691905 2024-09-22T08:25:16.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.174+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.0 size=1048576 2024-09-22T08:25:16.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.176+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.1 size=1048576 2024-09-22T08:25:16.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.176+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IONP3E8G3HZ6.2 size=476576 2024-09-22T08:25:16.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.180+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=IONP3E8G3HZ6 tag=X29PG6H5HPOL type=write size=3622304 2024-09-22T08:25:16.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.181+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=0PF9OT57375H type=del size=2918288 2024-09-22T08:25:16.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.183+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=527OVWAFZK1T type=del size=2283089 2024-09-22T08:25:16.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.185+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=SBEUGXB06XW2 type=del size=1846172 2024-09-22T08:25:16.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.186+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.0 size=1048576 2024-09-22T08:25:16.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.187+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.1 size=1048576 2024-09-22T08:25:16.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.187+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~DUOL0ULUTKIO.2 size=873924 2024-09-22T08:25:16.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.189+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=DUOL0ULUTKIO tag=3RPL7949VFO9 type=write size=4019652 2024-09-22T08:25:16.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.191+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=7KKC8K2ZGKZO type=del size=3597887 2024-09-22T08:25:16.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.193+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~KBWKZS0EFH27.0 size=1048576 2024-09-22T08:25:16.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.193+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~KBWKZS0EFH27.1 size=360320 2024-09-22T08:25:16.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.196+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=KBWKZS0EFH27 tag=CMW4V5FPGW5D type=write size=2457472 2024-09-22T08:25:16.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.198+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=S9NL19WJ8UTW type=del size=486786 2024-09-22T08:25:16.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.199+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~X7MM11F2Q0ZN.0 size=1048576 2024-09-22T08:25:16.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.201+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~X7MM11F2Q0ZN.1 size=1035677 2024-09-22T08:25:16.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.203+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=X7MM11F2Q0ZN tag=CF0UI106J3WF type=write size=3132829 2024-09-22T08:25:16.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.205+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~5M0NB3N2EJ4B.0 size=822495 2024-09-22T08:25:16.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.205+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=5M0NB3N2EJ4B tag=36YIR37LJQLP type=write size=1871071 2024-09-22T08:25:16.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.207+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=QF50CBFSJN4R type=del 2024-09-22T08:25:16.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.209+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=RPE73FMXNL7X type=del size=1087953 2024-09-22T08:25:16.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.211+0000 7f8a8d811780 1 < canceled operation key=5VU70RE1GJS2 tag=CI117F9HHRFV type=del size=2490637 2024-09-22T08:25:16.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.212+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=LURTM1R5KH38 type=del size=2347089 2024-09-22T08:25:16.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.213+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.0 size=1048576 2024-09-22T08:25:16.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.215+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.1 size=1048576 2024-09-22T08:25:16.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.216+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~IPT7NJ1C50OP.2 size=131135 2024-09-22T08:25:16.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.219+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=IPT7NJ1C50OP tag=UJ5WBYEELZ9U type=write size=3276863 2024-09-22T08:25:16.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.219+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=PW1IZ5781X0I type=del size=437983 2024-09-22T08:25:16.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.222+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=CD4O3ZB40F4D type=del 2024-09-22T08:25:16.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.223+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=M8J3PWO61E18 type=del size=2024065 2024-09-22T08:25:16.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.224+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.0 size=1048576 2024-09-22T08:25:16.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.225+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.1 size=1048576 2024-09-22T08:25:16.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.225+0000 7f8a8d811780 1 < canceled part key=_multipart_QE6XEMOZMCF1.2~895EDS80P168.2 size=283393 2024-09-22T08:25:16.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.228+0000 7f8a8d811780 1 < canceled multipart upload key=QE6XEMOZMCF1 upload=895EDS80P168 tag=XMUYXZ8XAFGM type=write size=3429121 2024-09-22T08:25:16.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.229+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=BCR1RLJ27T0L type=write size=379397 2024-09-22T08:25:16.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.231+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=17DGTYYCWRZL type=del 2024-09-22T08:25:16.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.232+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=RRRFIWIHKDGZ type=del size=2114617 2024-09-22T08:25:16.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.234+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~9CYYZ2YK03PY.0 size=1048576 2024-09-22T08:25:16.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.234+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~9CYYZ2YK03PY.1 size=865833 2024-09-22T08:25:16.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.236+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=9CYYZ2YK03PY tag=016YI32SWVDL type=write size=2962985 2024-09-22T08:25:16.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.238+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=POYUUMBEFLF4 type=del size=895889 2024-09-22T08:25:16.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.240+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=UPQW0WLG5Y2O type=del 2024-09-22T08:25:16.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.241+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=BZSEM2XCIC9E type=write size=98350 2024-09-22T08:25:16.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.242+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.0 size=1048576 2024-09-22T08:25:16.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.243+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.1 size=1048576 2024-09-22T08:25:16.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.245+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~CBV4EECNEW5R.2 size=762195 2024-09-22T08:25:16.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.247+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=CBV4EECNEW5R tag=7OYTJZH3WSMI type=write size=3907923 2024-09-22T08:25:16.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.249+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=W8B17RJYJ7SH type=del size=2123659 2024-09-22T08:25:16.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.249+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~RTGYCJ049DQE.0 size=1048576 2024-09-22T08:25:16.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.250+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~RTGYCJ049DQE.1 size=772120 2024-09-22T08:25:16.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.253+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=RTGYCJ049DQE tag=I91PRU1R63S1 type=write size=2869272 2024-09-22T08:25:16.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.256+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.0 size=1048576 2024-09-22T08:25:16.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.257+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.1 size=1048576 2024-09-22T08:25:16.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.258+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.2 size=988255 2024-09-22T08:25:16.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.258+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=01IO90WE6HEQ tag=XOSXBEF01BDF type=write size=4133983 2024-09-22T08:25:16.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.261+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=DCV1JNTGIDKD type=del 2024-09-22T08:25:16.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.261+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=6PVZ98HDUPFV type=del size=6852 2024-09-22T08:25:16.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.263+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=0PF9OT57375H type=del 2024-09-22T08:25:16.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.266+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~SG8Q7PGYVW91.0 size=905613 2024-09-22T08:25:16.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.266+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=SG8Q7PGYVW91 tag=KGG0JWEE8XPQ type=write size=1954189 2024-09-22T08:25:16.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.268+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=SBEUGXB06XW2 type=del 2024-09-22T08:25:16.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.270+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=Q3QI2WY439G8 type=del size=2236117 2024-09-22T08:25:16.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.271+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=7KKC8K2ZGKZO type=del 2024-09-22T08:25:16.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.274+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.0 size=1048576 2024-09-22T08:25:16.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.275+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.1 size=1048576 2024-09-22T08:25:16.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.277+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.2 size=547777 2024-09-22T08:25:16.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.277+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=7WXG87HLHTZM tag=02ATCR8DBFJ1 type=write size=3693505 2024-09-22T08:25:16.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.278+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=S9NL19WJ8UTW type=del 2024-09-22T08:25:16.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.281+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.0 size=1048576 2024-09-22T08:25:16.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.282+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.1 size=1048576 2024-09-22T08:25:16.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.283+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.2 size=332074 2024-09-22T08:25:16.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.283+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=BOTS3X6HR955 tag=I3EGSXXDMQNA type=write size=3477802 2024-09-22T08:25:16.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.285+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~5M0NB3N2EJ4B.0 size=822495 2024-09-22T08:25:16.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.287+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=5M0NB3N2EJ4B tag=36YIR37LJQLP type=write size=1871071 2024-09-22T08:25:16.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.288+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=WD03URFKY7XQ type=del size=258195 2024-09-22T08:25:16.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.291+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=RPE73FMXNL7X type=del 2024-09-22T08:25:16.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.291+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=ORI0NYR9EU0M type=del size=4067713 2024-09-22T08:25:16.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.293+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=LURTM1R5KH38 type=del 2024-09-22T08:25:16.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.294+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=YV8N93GX24N0 type=del size=700139 2024-09-22T08:25:16.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.296+0000 7f8a8d811780 1 < canceled operation key=7XNMR51803Y6 tag=PW1IZ5781X0I type=del size=437983 2024-09-22T08:25:16.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.299+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~SZ7PZ6AYPM45.0 size=1048576 2024-09-22T08:25:16.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.299+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~SZ7PZ6AYPM45.1 size=1034872 2024-09-22T08:25:16.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.299+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=SZ7PZ6AYPM45 tag=2L4Y53GS1IYB type=write size=3132024 2024-09-22T08:25:16.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.301+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=M8J3PWO61E18 type=del 2024-09-22T08:25:16.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.303+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=NYGYN87F81PI type=del size=1586532 2024-09-22T08:25:16.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.304+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=BCR1RLJ27T0L type=write size=379397 2024-09-22T08:25:16.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.306+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=VLUOPIU810HP type=del size=2008138 2024-09-22T08:25:16.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.307+0000 7f8a8d811780 1 < canceled operation key=9EY50PUC6AJJ tag=RRRFIWIHKDGZ type=del size=2114617 2024-09-22T08:25:16.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.310+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.0 size=1048576 2024-09-22T08:25:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.311+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.1 size=1048576 2024-09-22T08:25:16.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.313+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.2 size=202523 2024-09-22T08:25:16.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.313+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=4GHLYYFJPIOC tag=XFYRVV2FAMEV type=write size=3348251 2024-09-22T08:25:16.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.314+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=POYUUMBEFLF4 type=del 2024-09-22T08:25:16.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.316+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=96XRV6DQ4259 type=del size=2573411 2024-09-22T08:25:16.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.316+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=BZSEM2XCIC9E type=write size=98350 2024-09-22T08:25:16.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.321+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.0 size=1048576 2024-09-22T08:25:16.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.322+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.1 size=1048576 2024-09-22T08:25:16.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.322+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.2 size=828965 2024-09-22T08:25:16.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.322+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=A0KT5DGOA069 tag=SJPOE32OVYJQ type=write size=3974693 2024-09-22T08:25:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.324+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=W8B17RJYJ7SH type=del 2024-09-22T08:25:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.326+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=C4BFRIDS1X38 type=del size=923115 2024-09-22T08:25:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.327+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.0 size=1048576 2024-09-22T08:25:16.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.328+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.1 size=1048576 2024-09-22T08:25:16.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.330+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~01IO90WE6HEQ.2 size=988255 2024-09-22T08:25:16.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.332+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=01IO90WE6HEQ tag=XOSXBEF01BDF type=write size=4133983 2024-09-22T08:25:16.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.335+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.0 size=1048576 2024-09-22T08:25:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.335+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.1 size=1048576 2024-09-22T08:25:16.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.337+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.2 size=394550 2024-09-22T08:25:16.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.337+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=PX4XRQ40DG1O tag=1VUASPRBSNKN type=write size=3540278 2024-09-22T08:25:16.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.338+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=6PVZ98HDUPFV type=del 2024-09-22T08:25:16.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.340+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=0Q8YGBAB8SBJ type=del size=1217610 2024-09-22T08:25:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.341+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~SG8Q7PGYVW91.0 size=905613 2024-09-22T08:25:16.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.344+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=SG8Q7PGYVW91 tag=KGG0JWEE8XPQ type=write size=1954189 2024-09-22T08:25:16.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.346+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~172RLR0IWZ6N.0 size=731745 2024-09-22T08:25:16.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.346+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=172RLR0IWZ6N tag=YL5Q8BEO39ES type=write size=1780321 2024-09-22T08:25:16.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.347+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=Q3QI2WY439G8 type=del 2024-09-22T08:25:16.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.350+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.0 size=1048576 2024-09-22T08:25:16.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.351+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.1 size=1048576 2024-09-22T08:25:16.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.352+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.2 size=262409 2024-09-22T08:25:16.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.352+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=3C4H8S6C4ZQS tag=ONFH0U9FVR1B type=write size=3408137 2024-09-22T08:25:16.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.352+0000 7f8a8d811780 1 < canceled part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.0 size=1048576 2024-09-22T08:25:16.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.353+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.1 size=1048576 2024-09-22T08:25:16.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.355+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~7WXG87HLHTZM.2 size=547777 2024-09-22T08:25:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.358+0000 7f8a8d811780 1 < canceled multipart upload key=ER5UY1ML3R2H upload=7WXG87HLHTZM tag=02ATCR8DBFJ1 type=write size=3693505 2024-09-22T08:25:16.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.359+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=M7VJXTEAQ3RF type=del size=4093555 2024-09-22T08:25:16.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.361+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.0 size=1048576 2024-09-22T08:25:16.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.361+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.1 size=1048576 2024-09-22T08:25:16.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.363+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~BOTS3X6HR955.2 size=332074 2024-09-22T08:25:16.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.366+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=BOTS3X6HR955 tag=I3EGSXXDMQNA type=write size=3477802 2024-09-22T08:25:16.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.367+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=EREEAQ2F8QW1 type=write size=283858 2024-09-22T08:25:16.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.369+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=WD03URFKY7XQ type=del 2024-09-22T08:25:16.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.371+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=QAGW980E0RGS type=write size=35802 2024-09-22T08:25:16.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.374+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=ORI0NYR9EU0M type=del size=4067713 2024-09-22T08:25:16.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.376+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.0 size=1048576 2024-09-22T08:25:16.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.377+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.1 size=1048576 2024-09-22T08:25:16.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.379+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.2 size=282110 2024-09-22T08:25:16.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.379+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=1ICBXUIF0G97 tag=4LEKWZWLV0OM type=write size=3427838 2024-09-22T08:25:16.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.380+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=YV8N93GX24N0 type=del 2024-09-22T08:25:16.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.383+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~ZMIRDMNQHS56.0 size=1048576 2024-09-22T08:25:16.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.384+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~ZMIRDMNQHS56.1 size=779417 2024-09-22T08:25:16.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.384+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=ZMIRDMNQHS56 tag=6EA4E7EBWYGT type=write size=2876569 2024-09-22T08:25:16.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.386+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~SZ7PZ6AYPM45.0 size=1048576 2024-09-22T08:25:16.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.387+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~SZ7PZ6AYPM45.1 size=1034872 2024-09-22T08:25:16.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.389+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=SZ7PZ6AYPM45 tag=2L4Y53GS1IYB type=write size=3132024 2024-09-22T08:25:16.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.392+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~61MHM6RE7ND7.0 size=1048576 2024-09-22T08:25:16.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.393+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~61MHM6RE7ND7.1 size=823375 2024-09-22T08:25:16.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.393+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=61MHM6RE7ND7 tag=Y7M5MR4MORMH type=write size=2920527 2024-09-22T08:25:16.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.395+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=NYGYN87F81PI type=del 2024-09-22T08:25:16.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.396+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=AS68IWFWJN27 type=write size=354043 2024-09-22T08:25:16.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.398+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=VLUOPIU810HP type=del 2024-09-22T08:25:16.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.399+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=CWE5AL1HLUDH type=del size=423312 2024-09-22T08:25:16.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.401+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.0 size=1048576 2024-09-22T08:25:16.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.402+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.1 size=1048576 2024-09-22T08:25:16.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.404+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~4GHLYYFJPIOC.2 size=202523 2024-09-22T08:25:16.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.406+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=4GHLYYFJPIOC tag=XFYRVV2FAMEV type=write size=3348251 2024-09-22T08:25:16.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.407+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=Y8GVMHO3H8M2 type=del size=304649 2024-09-22T08:25:16.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.409+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=96XRV6DQ4259 type=del 2024-09-22T08:25:16.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.410+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=PXLGDF8P9RFP type=del size=3741469 2024-09-22T08:25:16.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.412+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.0 size=1048576 2024-09-22T08:25:16.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.413+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.1 size=1048576 2024-09-22T08:25:16.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.414+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~A0KT5DGOA069.2 size=828965 2024-09-22T08:25:16.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.416+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=A0KT5DGOA069 tag=SJPOE32OVYJQ type=write size=3974693 2024-09-22T08:25:16.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.420+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~EV3CLLQPKJKM.0 size=1048576 2024-09-22T08:25:16.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.421+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~EV3CLLQPKJKM.1 size=971698 2024-09-22T08:25:16.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.421+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=EV3CLLQPKJKM tag=ZHJXYAM8NG88 type=write size=3068850 2024-09-22T08:25:16.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.424+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=C4BFRIDS1X38 type=del size=923115 2024-09-22T08:25:16.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.425+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=JXIRFU4CVVL7 type=write size=444698 2024-09-22T08:25:16.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.427+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.0 size=1048576 2024-09-22T08:25:16.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.428+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.1 size=1048576 2024-09-22T08:25:16.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.428+0000 7f8a8d811780 1 < canceled part key=_multipart_T5IAHQ3CUIFR.2~PX4XRQ40DG1O.2 size=394550 2024-09-22T08:25:16.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.431+0000 7f8a8d811780 1 < canceled multipart upload key=T5IAHQ3CUIFR upload=PX4XRQ40DG1O tag=1VUASPRBSNKN type=write size=3540278 2024-09-22T08:25:16.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.432+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=HYONO3ZDFRQQ type=del size=3667132 2024-09-22T08:25:16.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.434+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=0Q8YGBAB8SBJ type=del 2024-09-22T08:25:16.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.437+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~Y0R6PMQDORMU.0 size=1048576 2024-09-22T08:25:16.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.438+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~Y0R6PMQDORMU.1 size=114344 2024-09-22T08:25:16.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.438+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=Y0R6PMQDORMU tag=7R4XX2AWNW1R type=write size=2211496 2024-09-22T08:25:16.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.439+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~172RLR0IWZ6N.0 size=731745 2024-09-22T08:25:16.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.442+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=172RLR0IWZ6N tag=YL5Q8BEO39ES type=write size=1780321 2024-09-22T08:25:16.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.445+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~UBLVLANVWW17.0 size=198898 2024-09-22T08:25:16.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.445+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=UBLVLANVWW17 tag=8C6NVWUS0JWZ type=write size=1247474 2024-09-22T08:25:16.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.446+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.0 size=1048576 2024-09-22T08:25:16.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.447+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.1 size=1048576 2024-09-22T08:25:16.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.449+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~3C4H8S6C4ZQS.2 size=262409 2024-09-22T08:25:16.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.451+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=3C4H8S6C4ZQS tag=ONFH0U9FVR1B type=write size=3408137 2024-09-22T08:25:16.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.453+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=UCFLEJDNO10O type=del size=3625601 2024-09-22T08:25:16.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.456+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=M7VJXTEAQ3RF type=del 2024-09-22T08:25:16.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.458+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=07QOM903GUMU type=write size=336536 2024-09-22T08:25:16.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.459+0000 7f8a8d811780 1 < completed write operation key=1719KI1YP1FT tag=EREEAQ2F8QW1 type=write size=283858 2024-09-22T08:25:16.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.463+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.0 size=1048576 2024-09-22T08:25:16.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.464+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.1 size=1048576 2024-09-22T08:25:16.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.465+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.2 size=350193 2024-09-22T08:25:16.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.465+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=6RFR51ZH1GGQ tag=I6ROUROS6CZN type=write size=3495921 2024-09-22T08:25:16.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.468+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=QAGW980E0RGS type=write size=35802 2024-09-22T08:25:16.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.470+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=GM4FWF1KAO5E type=del size=191135 2024-09-22T08:25:16.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.471+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.0 size=1048576 2024-09-22T08:25:16.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.473+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.1 size=1048576 2024-09-22T08:25:16.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.474+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~1ICBXUIF0G97.2 size=282110 2024-09-22T08:25:16.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.477+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=1ICBXUIF0G97 tag=4LEKWZWLV0OM type=write size=3427838 2024-09-22T08:25:16.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.478+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=8P6SJRBEDKRN type=del size=3532297 2024-09-22T08:25:16.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.480+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~ZMIRDMNQHS56.0 size=1048576 2024-09-22T08:25:16.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.481+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~ZMIRDMNQHS56.1 size=779417 2024-09-22T08:25:16.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.484+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=ZMIRDMNQHS56 tag=6EA4E7EBWYGT type=write size=2876569 2024-09-22T08:25:16.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.485+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=RQ5BCAMGB76K type=del size=3945625 2024-09-22T08:25:16.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.488+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~61MHM6RE7ND7.0 size=1048576 2024-09-22T08:25:16.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.489+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~61MHM6RE7ND7.1 size=823375 2024-09-22T08:25:16.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.491+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=61MHM6RE7ND7 tag=Y7M5MR4MORMH type=write size=2920527 2024-09-22T08:25:16.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.493+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=O2QRHNY2YK5I type=del size=866754 2024-09-22T08:25:16.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.495+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=AS68IWFWJN27 type=write size=354043 2024-09-22T08:25:16.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.496+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=TN50FKX7NF6Q type=del size=765087 2024-09-22T08:25:16.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.499+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=CWE5AL1HLUDH type=del 2024-09-22T08:25:16.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.500+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=CHCANL76RUGB type=del size=4147954 2024-09-22T08:25:16.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.501+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=Y8GVMHO3H8M2 type=del 2024-09-22T08:25:16.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.502+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=SRU06XZ0G9WS type=del size=3761835 2024-09-22T08:25:16.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.504+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=PXLGDF8P9RFP type=del 2024-09-22T08:25:16.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.506+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=08YH5UVU9ECT type=write size=222235 2024-09-22T08:25:16.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.507+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~EV3CLLQPKJKM.0 size=1048576 2024-09-22T08:25:16.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.508+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~EV3CLLQPKJKM.1 size=971698 2024-09-22T08:25:16.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.510+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=EV3CLLQPKJKM tag=ZHJXYAM8NG88 type=write size=3068850 2024-09-22T08:25:16.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.514+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~PUEGL204LW1A.0 size=1048576 2024-09-22T08:25:16.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.514+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~PUEGL204LW1A.1 size=623001 2024-09-22T08:25:16.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.514+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=PUEGL204LW1A tag=53W0S9160Z8X type=write size=2720153 2024-09-22T08:25:16.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.516+0000 7f8a8d811780 1 < completed write operation key=QE6XEMOZMCF1 tag=JXIRFU4CVVL7 type=write size=444698 2024-09-22T08:25:16.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.518+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~OQCC5CUTC7VR.0 size=1048576 2024-09-22T08:25:16.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.520+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~OQCC5CUTC7VR.1 size=927490 2024-09-22T08:25:16.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.520+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=OQCC5CUTC7VR tag=BS0CC853WIBG type=write size=3024642 2024-09-22T08:25:16.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.522+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=HYONO3ZDFRQQ type=del 2024-09-22T08:25:16.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.526+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~D2C3DJQUC3VD.0 size=86892 2024-09-22T08:25:16.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.526+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=D2C3DJQUC3VD tag=3LTJXBZ2N3WE type=write size=1135468 2024-09-22T08:25:16.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.526+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~Y0R6PMQDORMU.0 size=1048576 2024-09-22T08:25:16.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.528+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~Y0R6PMQDORMU.1 size=114344 2024-09-22T08:25:16.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.530+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=Y0R6PMQDORMU tag=7R4XX2AWNW1R type=write size=2211496 2024-09-22T08:25:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.533+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.0 size=1048576 2024-09-22T08:25:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.534+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.1 size=1048576 2024-09-22T08:25:16.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.535+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.2 size=988341 2024-09-22T08:25:16.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.535+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=Z7KK18OSPB8D tag=CQM0QS21S304 type=write size=4134069 2024-09-22T08:25:16.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.537+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~UBLVLANVWW17.0 size=198898 2024-09-22T08:25:16.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.540+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=UBLVLANVWW17 tag=8C6NVWUS0JWZ type=write size=1247474 2024-09-22T08:25:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.542+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~XCQ1372IAK60.0 size=1048576 2024-09-22T08:25:16.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.544+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~XCQ1372IAK60.1 size=487553 2024-09-22T08:25:16.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.544+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=XCQ1372IAK60 tag=LJCF2IPV6B0W type=write size=2584705 2024-09-22T08:25:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.546+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=UCFLEJDNO10O type=del 2024-09-22T08:25:16.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.548+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.0 size=1048576 2024-09-22T08:25:16.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.550+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.1 size=1048576 2024-09-22T08:25:16.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.550+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.2 size=238557 2024-09-22T08:25:16.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.550+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=FMNMX65LNU0J tag=9D02LDNR6DEV type=write size=3384285 2024-09-22T08:25:16.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.553+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=07QOM903GUMU type=write size=336536 2024-09-22T08:25:16.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.556+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8JMN0PH4JAF0.0 size=289733 2024-09-22T08:25:16.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.556+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=8JMN0PH4JAF0 tag=35JKHLXORD6M type=write size=1338309 2024-09-22T08:25:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.558+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.0 size=1048576 2024-09-22T08:25:16.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.559+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.1 size=1048576 2024-09-22T08:25:16.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.560+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6RFR51ZH1GGQ.2 size=350193 2024-09-22T08:25:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.563+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=6RFR51ZH1GGQ tag=I6ROUROS6CZN type=write size=3495921 2024-09-22T08:25:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.566+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~NE9GUCVZ6C1S.0 size=962036 2024-09-22T08:25:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.566+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=NE9GUCVZ6C1S tag=DZIXLPQN5QR4 type=write size=2010612 2024-09-22T08:25:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.567+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=GM4FWF1KAO5E type=del 2024-09-22T08:25:16.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.569+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~82WLXG95Z9NJ.0 size=214865 2024-09-22T08:25:16.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.569+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=82WLXG95Z9NJ tag=3CNPEHX29690 type=write size=1263441 2024-09-22T08:25:16.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.571+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=8P6SJRBEDKRN type=del 2024-09-22T08:25:16.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.574+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~TGWJ81UIZFFJ.0 size=595285 2024-09-22T08:25:16.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.574+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=TGWJ81UIZFFJ tag=5V7ULMAGYRO2 type=write size=1643861 2024-09-22T08:25:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.577+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=RQ5BCAMGB76K type=del 2024-09-22T08:25:16.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.578+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=CMM3O4FWQXPX type=del size=2130562 2024-09-22T08:25:16.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.580+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=O2QRHNY2YK5I type=del 2024-09-22T08:25:16.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.582+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~JS36TMW0MG5Q.0 size=912951 2024-09-22T08:25:16.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.582+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=JS36TMW0MG5Q tag=9XZU7AIWYFOC type=write size=1961527 2024-09-22T08:25:16.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.585+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=TN50FKX7NF6Q type=del 2024-09-22T08:25:16.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.585+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=JNETT66WDPEX type=write size=851734 2024-09-22T08:25:16.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.587+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=CHCANL76RUGB type=del 2024-09-22T08:25:16.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.589+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=VJ5YRYSM3Z2O type=del size=2995520 2024-09-22T08:25:16.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.591+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=SRU06XZ0G9WS type=del 2024-09-22T08:25:16.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.593+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=GSOYPIYVCJKT type=del size=2855090 2024-09-22T08:25:16.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.596+0000 7f8a8d811780 1 < suggested remove operation key=0AOI0OB2YFVV tag=08YH5UVU9ECT type=write 2024-09-22T08:25:16.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.598+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.0 size=1048576 2024-09-22T08:25:16.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.600+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.1 size=1048576 2024-09-22T08:25:16.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.602+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.2 size=370093 2024-09-22T08:25:16.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.602+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=W1JYX9TCDWVV tag=GKR5V8D37LAU type=write size=3515821 2024-09-22T08:25:16.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.604+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~PUEGL204LW1A.0 size=1048576 2024-09-22T08:25:16.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.606+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~PUEGL204LW1A.1 size=623001 2024-09-22T08:25:16.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.608+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=PUEGL204LW1A tag=53W0S9160Z8X type=write size=2720153 2024-09-22T08:25:16.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.610+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=52CXS11DMEIU type=del size=2566281 2024-09-22T08:25:16.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.612+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~OQCC5CUTC7VR.0 size=1048576 2024-09-22T08:25:16.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.614+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~OQCC5CUTC7VR.1 size=927490 2024-09-22T08:25:16.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.616+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=OQCC5CUTC7VR tag=BS0CC853WIBG type=write size=3024642 2024-09-22T08:25:16.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.617+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=3W9TBOF7RLM6 type=del size=2116443 2024-09-22T08:25:16.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.620+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~D2C3DJQUC3VD.0 size=86892 2024-09-22T08:25:16.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.622+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=D2C3DJQUC3VD tag=3LTJXBZ2N3WE type=write size=1135468 2024-09-22T08:25:16.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.626+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~38ZCUJPAG8U6.0 size=1048576 2024-09-22T08:25:16.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.626+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~38ZCUJPAG8U6.1 size=584082 2024-09-22T08:25:16.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.626+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=38ZCUJPAG8U6 tag=JG2LKW589J8D type=write size=2681234 2024-09-22T08:25:16.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.629+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.0 size=1048576 2024-09-22T08:25:16.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.630+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.1 size=1048576 2024-09-22T08:25:16.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.630+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~Z7KK18OSPB8D.2 size=988341 2024-09-22T08:25:16.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.633+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=Z7KK18OSPB8D tag=CQM0QS21S304 type=write size=4134069 2024-09-22T08:25:16.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.635+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=D956UCUPKFZP type=write size=79936 2024-09-22T08:25:16.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.636+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~XCQ1372IAK60.0 size=1048576 2024-09-22T08:25:16.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.636+0000 7f8a8d811780 1 < canceled part key=_multipart_0HCXP53D9NMP.2~XCQ1372IAK60.1 size=487553 2024-09-22T08:25:16.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.638+0000 7f8a8d811780 1 < canceled multipart upload key=0HCXP53D9NMP upload=XCQ1372IAK60 tag=LJCF2IPV6B0W type=write size=2584705 2024-09-22T08:25:16.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.641+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~CLO8WOCF3QL3.0 size=1048576 2024-09-22T08:25:16.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.643+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~CLO8WOCF3QL3.1 size=379527 2024-09-22T08:25:16.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.643+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=CLO8WOCF3QL3 tag=SJC5IZ0RDE3S type=write size=2476679 2024-09-22T08:25:16.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.644+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.0 size=1048576 2024-09-22T08:25:16.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.645+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.1 size=1048576 2024-09-22T08:25:16.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.646+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~FMNMX65LNU0J.2 size=238557 2024-09-22T08:25:16.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.648+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=FMNMX65LNU0J tag=9D02LDNR6DEV type=write size=3384285 2024-09-22T08:25:16.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.651+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YUGNSGQK8HSP.0 size=1048576 2024-09-22T08:25:16.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.652+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YUGNSGQK8HSP.1 size=926811 2024-09-22T08:25:16.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.652+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=YUGNSGQK8HSP tag=QK75NPJRBL83 type=write size=3023963 2024-09-22T08:25:16.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.654+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8JMN0PH4JAF0.0 size=289733 2024-09-22T08:25:16.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.657+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=8JMN0PH4JAF0 tag=35JKHLXORD6M type=write size=1338309 2024-09-22T08:25:16.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.658+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=IDAY8RPB8YN4 type=del size=4036620 2024-09-22T08:25:16.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.659+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~NE9GUCVZ6C1S.0 size=962036 2024-09-22T08:25:16.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.661+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=NE9GUCVZ6C1S tag=DZIXLPQN5QR4 type=write size=2010612 2024-09-22T08:25:16.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.665+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~T6UTAY73IZT6.0 size=770647 2024-09-22T08:25:16.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.665+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=T6UTAY73IZT6 tag=13G9ZOQCCLZE type=write size=1819223 2024-09-22T08:25:16.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.666+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~82WLXG95Z9NJ.0 size=214865 2024-09-22T08:25:16.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.668+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=82WLXG95Z9NJ tag=3CNPEHX29690 type=write size=1263441 2024-09-22T08:25:16.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.669+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=MJEXMZ8HKW19 type=del size=701970 2024-09-22T08:25:16.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.671+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~TGWJ81UIZFFJ.0 size=595285 2024-09-22T08:25:16.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.673+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=TGWJ81UIZFFJ tag=5V7ULMAGYRO2 type=write size=1643861 2024-09-22T08:25:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.676+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~DAL4TYEIIPMV.0 size=1048576 2024-09-22T08:25:16.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.677+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~DAL4TYEIIPMV.1 size=454431 2024-09-22T08:25:16.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.677+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=DAL4TYEIIPMV tag=0ILTN4LCWF10 type=write size=2551583 2024-09-22T08:25:16.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.679+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=CMM3O4FWQXPX type=del 2024-09-22T08:25:16.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.681+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~OKKRY9TGVZMX.0 size=1048576 2024-09-22T08:25:16.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.682+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~OKKRY9TGVZMX.1 size=484636 2024-09-22T08:25:16.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.682+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=OKKRY9TGVZMX tag=WPAKMTT63ZOX type=write size=2581788 2024-09-22T08:25:16.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.683+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~JS36TMW0MG5Q.0 size=912951 2024-09-22T08:25:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.686+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=JS36TMW0MG5Q tag=9XZU7AIWYFOC type=write size=1961527 2024-09-22T08:25:16.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.687+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=M0BTW82XO40M type=del size=2154879 2024-09-22T08:25:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.688+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=JNETT66WDPEX type=write size=851734 2024-09-22T08:25:16.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.691+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~YR9WG5B8TKPX.0 size=1048576 2024-09-22T08:25:16.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.692+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~YR9WG5B8TKPX.1 size=646630 2024-09-22T08:25:16.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.692+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=YR9WG5B8TKPX tag=HTKLDBQPXQ9V type=write size=2743782 2024-09-22T08:25:16.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.693+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=0AOI0OB2YFVV tag=VJ5YRYSM3Z2O type=del size=2995520: (2) No such file or directory 2024-09-22T08:25:16.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.694+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=QEQ4T9TRLDKR type=del size=67845 2024-09-22T08:25:16.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.696+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=GSOYPIYVCJKT type=del 2024-09-22T08:25:16.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.697+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=5EWKPBT91W4N type=del size=1646708 2024-09-22T08:25:16.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.699+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.0 size=1048576 2024-09-22T08:25:16.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.700+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.1 size=1048576 2024-09-22T08:25:16.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.701+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~W1JYX9TCDWVV.2 size=370093 2024-09-22T08:25:16.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.704+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=W1JYX9TCDWVV tag=GKR5V8D37LAU type=write size=3515821 2024-09-22T08:25:16.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.705+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=6KESLK2Y7PPX type=del size=1413680 2024-09-22T08:25:16.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.707+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=52CXS11DMEIU type=del 2024-09-22T08:25:16.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.709+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~YP3UL1AJ0MKL.0 size=576460 2024-09-22T08:25:16.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.709+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=YP3UL1AJ0MKL tag=AD3G7DWQUT9A type=write size=1625036 2024-09-22T08:25:16.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.711+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=3W9TBOF7RLM6 type=del 2024-09-22T08:25:16.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.712+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=E7RX5VQ9Y1BX type=del size=2551564 2024-09-22T08:25:16.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.714+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~38ZCUJPAG8U6.0 size=1048576 2024-09-22T08:25:16.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.716+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~38ZCUJPAG8U6.1 size=584082 2024-09-22T08:25:16.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.717+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=38ZCUJPAG8U6 tag=JG2LKW589J8D type=write size=2681234 2024-09-22T08:25:16.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.720+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~EYJUX0GZRQUF.0 size=1048576 2024-09-22T08:25:16.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.721+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~EYJUX0GZRQUF.1 size=793190 2024-09-22T08:25:16.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.721+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=EYJUX0GZRQUF tag=4JJLPNKRTNGM type=write size=2890342 2024-09-22T08:25:16.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.725+0000 7f8a8d811780 1 < suggested remove operation key=PIRW8N555T52 tag=D956UCUPKFZP type=write 2024-09-22T08:25:16.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.726+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=QUMW83P97BCH type=del size=1155914 2024-09-22T08:25:16.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.727+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~CLO8WOCF3QL3.0 size=1048576 2024-09-22T08:25:16.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.728+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~CLO8WOCF3QL3.1 size=379527 2024-09-22T08:25:16.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.731+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=CLO8WOCF3QL3 tag=SJC5IZ0RDE3S type=write size=2476679 2024-09-22T08:25:16.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.733+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~O3IC60QVUB6E.0 size=1048576 2024-09-22T08:25:16.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.735+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~O3IC60QVUB6E.1 size=213498 2024-09-22T08:25:16.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.735+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=O3IC60QVUB6E tag=EYCV7YQ06TGZ type=write size=2310650 2024-09-22T08:25:16.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.736+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~YUGNSGQK8HSP.0 size=1048576 2024-09-22T08:25:16.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.737+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~YUGNSGQK8HSP.1 size=926811 2024-09-22T08:25:16.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.740+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=YUGNSGQK8HSP tag=QK75NPJRBL83 type=write size=3023963 2024-09-22T08:25:16.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.742+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=B5H7H32IECL9 type=del size=1487699 2024-09-22T08:25:16.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.744+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=IDAY8RPB8YN4 type=del 2024-09-22T08:25:16.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.745+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=ZC8OUBVA1GJ4 type=del size=3532769 2024-09-22T08:25:16.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.746+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~T6UTAY73IZT6.0 size=770647 2024-09-22T08:25:16.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.749+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=T6UTAY73IZT6 tag=13G9ZOQCCLZE type=write size=1819223 2024-09-22T08:25:16.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.751+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=UX1E7PO9Q7WO type=del size=4061461 2024-09-22T08:25:16.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.752+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=MJEXMZ8HKW19 type=del 2024-09-22T08:25:16.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.755+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=EJKVL32B1K0C type=del size=3556645 2024-09-22T08:25:16.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.756+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~DAL4TYEIIPMV.0 size=1048576 2024-09-22T08:25:16.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.756+0000 7f8a8d811780 1 < canceled part key=_multipart_0HCXP53D9NMP.2~DAL4TYEIIPMV.1 size=454431 2024-09-22T08:25:16.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.758+0000 7f8a8d811780 1 < canceled multipart upload key=0HCXP53D9NMP upload=DAL4TYEIIPMV tag=0ILTN4LCWF10 type=write size=2551583 2024-09-22T08:25:16.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.759+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=TY283X7X22V1 type=write size=704311 2024-09-22T08:25:16.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.761+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~OKKRY9TGVZMX.0 size=1048576 2024-09-22T08:25:16.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.762+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~OKKRY9TGVZMX.1 size=484636 2024-09-22T08:25:16.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.765+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=OKKRY9TGVZMX tag=WPAKMTT63ZOX type=write size=2581788 2024-09-22T08:25:16.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.767+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~TA6442D0CHVU.0 size=1048576 2024-09-22T08:25:16.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.768+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~TA6442D0CHVU.1 size=499492 2024-09-22T08:25:16.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.768+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=TA6442D0CHVU tag=WQSLATHZACCE type=write size=2596644 2024-09-22T08:25:16.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.770+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=M0BTW82XO40M type=del 2024-09-22T08:25:16.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.773+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~6QI9YXGL6ZVR.0 size=1048576 2024-09-22T08:25:16.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.774+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~6QI9YXGL6ZVR.1 size=100776 2024-09-22T08:25:16.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.774+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=6QI9YXGL6ZVR tag=4I1SQ1KYQO5L type=write size=2197928 2024-09-22T08:25:16.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.775+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~YR9WG5B8TKPX.0 size=1048576 2024-09-22T08:25:16.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.777+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~YR9WG5B8TKPX.1 size=646630 2024-09-22T08:25:16.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.780+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=YR9WG5B8TKPX tag=HTKLDBQPXQ9V type=write size=2743782 2024-09-22T08:25:16.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.782+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.0 size=1048576 2024-09-22T08:25:16.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.783+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.1 size=1048576 2024-09-22T08:25:16.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.784+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.2 size=299557 2024-09-22T08:25:16.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.784+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=XT0ZF4S55JEB tag=Y3M8BY50UGX6 type=write size=3445285 2024-09-22T08:25:16.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.785+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=QEQ4T9TRLDKR type=del 2024-09-22T08:25:16.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.788+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.0 size=1048576 2024-09-22T08:25:16.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.789+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.1 size=1048576 2024-09-22T08:25:16.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.790+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.2 size=970214 2024-09-22T08:25:16.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.790+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=1T0F9PJEXJNP tag=M53XAX42EOS8 type=write size=4115942 2024-09-22T08:25:16.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.791+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=5EWKPBT91W4N type=del 2024-09-22T08:25:16.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.794+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~XCJ1ZD2HESU1.0 size=651541 2024-09-22T08:25:16.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.794+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=XCJ1ZD2HESU1 tag=3CTQP0D2COA6 type=write size=1700117 2024-09-22T08:25:16.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.797+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=6KESLK2Y7PPX type=del 2024-09-22T08:25:16.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.798+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=F3UQE241JIEX type=write size=757191 2024-09-22T08:25:16.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.799+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~YP3UL1AJ0MKL.0 size=576460 2024-09-22T08:25:16.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.802+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=YP3UL1AJ0MKL tag=AD3G7DWQUT9A type=write size=1625036 2024-09-22T08:25:16.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.802+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=NEOFH9KMU2B4 type=write size=217047 2024-09-22T08:25:16.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.804+0000 7f8a8d811780 1 < canceled operation key=EILTWP17M0NL tag=E7RX5VQ9Y1BX type=del size=2551564 2024-09-22T08:25:16.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.806+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~FKP0IH0DOZY7.0 size=1032421 2024-09-22T08:25:16.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.806+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=FKP0IH0DOZY7 tag=P1RA2KJFN4K5 type=write size=2080997 2024-09-22T08:25:16.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.807+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~EYJUX0GZRQUF.0 size=1048576 2024-09-22T08:25:16.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.808+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~EYJUX0GZRQUF.1 size=793190 2024-09-22T08:25:16.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.810+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=EYJUX0GZRQUF tag=4JJLPNKRTNGM type=write size=2890342 2024-09-22T08:25:16.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.812+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=1E169XOVGY1J type=del size=3704650 2024-09-22T08:25:16.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.813+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=QUMW83P97BCH type=del 2024-09-22T08:25:16.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.815+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=LKG48E788W3P type=del size=1068397 2024-09-22T08:25:16.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.816+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~O3IC60QVUB6E.0 size=1048576 2024-09-22T08:25:16.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.817+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~O3IC60QVUB6E.1 size=213498 2024-09-22T08:25:16.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.819+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=O3IC60QVUB6E tag=EYCV7YQ06TGZ type=write size=2310650 2024-09-22T08:25:16.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.821+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=LHP18Q881ZKU type=del size=2645114 2024-09-22T08:25:16.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.822+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=B5H7H32IECL9 type=del 2024-09-22T08:25:16.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.825+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=K8BWDZ4TBABQ type=del size=2806249 2024-09-22T08:25:16.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.826+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=ZC8OUBVA1GJ4 type=del 2024-09-22T08:25:16.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.827+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=Y4LEU05IC6ER type=del size=2098952 2024-09-22T08:25:16.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.830+0000 7f8a8d811780 1 < suggested remove operation key=S9JCKGZS5QLY tag=UX1E7PO9Q7WO type=del 2024-09-22T08:25:16.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.831+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=9XA4BY1RO1C3 type=del size=3472826 2024-09-22T08:25:16.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.832+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=EJKVL32B1K0C type=del 2024-09-22T08:25:16.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.835+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.0 size=1048576 2024-09-22T08:25:16.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.836+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.1 size=1048576 2024-09-22T08:25:16.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.837+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.2 size=872273 2024-09-22T08:25:16.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.837+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=1LX2ZDFH40PK tag=TBA026F33871 type=write size=4018001 2024-09-22T08:25:16.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.838+0000 7f8a8d811780 1 < canceled operation key=3T2TX83CSE2D tag=TY283X7X22V1 type=write size=704311 2024-09-22T08:25:16.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.839+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=ZPTBJPWSGWR3 type=del size=2412108 2024-09-22T08:25:16.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.841+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~TA6442D0CHVU.0 size=1048576 2024-09-22T08:25:16.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.841+0000 7f8a8d811780 1 < canceled part key=_multipart_ER5UY1ML3R2H.2~TA6442D0CHVU.1 size=499492 2024-09-22T08:25:16.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.843+0000 7f8a8d811780 1 < canceled multipart upload key=ER5UY1ML3R2H upload=TA6442D0CHVU tag=WQSLATHZACCE type=write size=2596644 2024-09-22T08:25:16.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.844+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=U6A0ALD2RKM5 type=write size=896397 2024-09-22T08:25:16.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.846+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~6QI9YXGL6ZVR.0 size=1048576 2024-09-22T08:25:16.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.847+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~6QI9YXGL6ZVR.1 size=100776 2024-09-22T08:25:16.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.849+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=6QI9YXGL6ZVR tag=4I1SQ1KYQO5L type=write size=2197928 2024-09-22T08:25:16.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.851+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.0 size=1048576 2024-09-22T08:25:16.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.852+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.1 size=1048576 2024-09-22T08:25:16.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.854+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.2 size=278334 2024-09-22T08:25:16.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.854+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=Y64WVOT9SYVP tag=UDA8EWA5ZBTA type=write size=3424062 2024-09-22T08:25:16.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.855+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.0 size=1048576 2024-09-22T08:25:16.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.857+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.1 size=1048576 2024-09-22T08:25:16.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.858+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~XT0ZF4S55JEB.2 size=299557 2024-09-22T08:25:16.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.860+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=XT0ZF4S55JEB tag=Y3M8BY50UGX6 type=write size=3445285 2024-09-22T08:25:16.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.863+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~K727DHHNGEGT.0 size=1048576 2024-09-22T08:25:16.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.864+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~K727DHHNGEGT.1 size=688699 2024-09-22T08:25:16.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.864+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=K727DHHNGEGT tag=569AN8T52MA7 type=write size=2785851 2024-09-22T08:25:16.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.866+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.0 size=1048576 2024-09-22T08:25:16.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.867+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.1 size=1048576 2024-09-22T08:25:16.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.869+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1T0F9PJEXJNP.2 size=970214 2024-09-22T08:25:16.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.872+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=1T0F9PJEXJNP tag=M53XAX42EOS8 type=write size=4115942 2024-09-22T08:25:16.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.873+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=0V6NLFYSBQI4 type=write size=728051 2024-09-22T08:25:16.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.874+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~XCJ1ZD2HESU1.0 size=651541 2024-09-22T08:25:16.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.877+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=XCJ1ZD2HESU1 tag=3CTQP0D2COA6 type=write size=1700117 2024-09-22T08:25:16.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.879+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1617RIDKJNLB.0 size=1048576 2024-09-22T08:25:16.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.880+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~1617RIDKJNLB.1 size=996306 2024-09-22T08:25:16.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.880+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=1617RIDKJNLB tag=II43CKPRQ2LE type=write size=3093458 2024-09-22T08:25:16.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.882+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=F3UQE241JIEX type=write size=757191 2024-09-22T08:25:16.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.883+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=3H383EQPD1I8 type=del size=2912436 2024-09-22T08:25:16.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.885+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=NEOFH9KMU2B4 type=write size=217047 2024-09-22T08:25:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.886+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=L11D3QQC8HXQ type=del size=3765962 2024-09-22T08:25:16.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.887+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~FKP0IH0DOZY7.0 size=1032421 2024-09-22T08:25:16.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.890+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=FKP0IH0DOZY7 tag=P1RA2KJFN4K5 type=write size=2080997 2024-09-22T08:25:16.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.891+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=79E9UNMSW2VG type=write size=727192 2024-09-22T08:25:16.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.894+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=1E169XOVGY1J type=del 2024-09-22T08:25:16.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.895+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=S1XRB9RU92BX type=write size=1027716 2024-09-22T08:25:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.898+0000 7f8a8d811780 1 < suggested update operation key=A8TGVQ273MNF tag=LKG48E788W3P type=del size=1068397 2024-09-22T08:25:16.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.899+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=9ZJMBPHB484U type=del size=3622701 2024-09-22T08:25:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.903+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=LHP18Q881ZKU type=del size=2645114 2024-09-22T08:25:16.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.904+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.0 size=1048576 2024-09-22T08:25:16.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.906+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.1 size=1048576 2024-09-22T08:25:16.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.908+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.2 size=984759 2024-09-22T08:25:16.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.908+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=OYX4FH8WZ2VH tag=AAOFP0R2YG6U type=write size=4130487 2024-09-22T08:25:16.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.908+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=K8BWDZ4TBABQ type=del 2024-09-22T08:25:16.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.910+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=MQT1X9LF8CWP type=del size=3981091 2024-09-22T08:25:16.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.911+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=Y4LEU05IC6ER type=del 2024-09-22T08:25:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.912+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=VEUWSBEIRBC2 type=del size=3597042 2024-09-22T08:25:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.914+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=9XA4BY1RO1C3 type=del 2024-09-22T08:25:16.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.916+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~K6BAA584Q2ZI.0 size=1048576 2024-09-22T08:25:16.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.917+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~K6BAA584Q2ZI.1 size=447940 2024-09-22T08:25:16.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.918+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=K6BAA584Q2ZI tag=0BMJNEFS4YEM type=write size=2545092 2024-09-22T08:25:16.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.919+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.0 size=1048576 2024-09-22T08:25:16.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.920+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.1 size=1048576 2024-09-22T08:25:16.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.921+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~1LX2ZDFH40PK.2 size=872273 2024-09-22T08:25:16.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.924+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=1LX2ZDFH40PK tag=TBA026F33871 type=write size=4018001 2024-09-22T08:25:16.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.926+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~L1XOXW3UDBMP.0 size=1048576 2024-09-22T08:25:16.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.927+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~L1XOXW3UDBMP.1 size=113098 2024-09-22T08:25:16.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.927+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=L1XOXW3UDBMP tag=6V0XJ33ZHV1I type=write size=2210250 2024-09-22T08:25:16.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.929+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=ZPTBJPWSGWR3 type=del 2024-09-22T08:25:16.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.931+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~OM59528JA87C.0 size=458516 2024-09-22T08:25:16.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.931+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=OM59528JA87C tag=19JJMEC13S3Q type=write size=1507092 2024-09-22T08:25:16.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.934+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=U6A0ALD2RKM5 type=write 2024-09-22T08:25:16.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.936+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.0 size=1048576 2024-09-22T08:25:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.938+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.1 size=1048576 2024-09-22T08:25:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.939+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.2 size=146723 2024-09-22T08:25:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.939+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=YSVRAX394FTB tag=Q3YMEI4XM396 type=write size=3292451 2024-09-22T08:25:16.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.940+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.0 size=1048576 2024-09-22T08:25:16.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.942+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.1 size=1048576 2024-09-22T08:25:16.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.943+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~Y64WVOT9SYVP.2 size=278334 2024-09-22T08:25:16.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.946+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=Y64WVOT9SYVP tag=UDA8EWA5ZBTA type=write size=3424062 2024-09-22T08:25:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.947+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=HRFA1B0VBZC1 type=del size=3472569 2024-09-22T08:25:16.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.949+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~K727DHHNGEGT.0 size=1048576 2024-09-22T08:25:16.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.951+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~K727DHHNGEGT.1 size=688699 2024-09-22T08:25:16.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.953+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=K727DHHNGEGT tag=569AN8T52MA7 type=write size=2785851 2024-09-22T08:25:16.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.954+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=A1G4CD9YUUEZ type=del size=2736882 2024-09-22T08:25:16.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.956+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=0V6NLFYSBQI4 type=write size=728051 2024-09-22T08:25:16.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.959+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~7CEKR187E988.0 size=892303 2024-09-22T08:25:16.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.959+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=7CEKR187E988 tag=M651JW3GY5VY type=write size=1940879 2024-09-22T08:25:16.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.960+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1617RIDKJNLB.0 size=1048576 2024-09-22T08:25:16.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.961+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~1617RIDKJNLB.1 size=996306 2024-09-22T08:25:16.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.964+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=1617RIDKJNLB tag=II43CKPRQ2LE type=write size=3093458 2024-09-22T08:25:16.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.966+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=ACVSY5DOL6G7 type=del size=2614301 2024-09-22T08:25:16.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.968+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=3H383EQPD1I8 type=del 2024-09-22T08:25:16.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.971+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~4QRPHPEFA1UP.0 size=1008179 2024-09-22T08:25:16.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.971+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=4QRPHPEFA1UP tag=9STQKTZ1N8Q2 type=write size=2056755 2024-09-22T08:25:16.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.972+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=L11D3QQC8HXQ type=del 2024-09-22T08:25:16.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.975+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~T2Q8VF1A1ATF.0 size=482705 2024-09-22T08:25:16.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.975+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=T2Q8VF1A1ATF tag=3H02ZAX2FOUB type=write size=1531281 2024-09-22T08:25:16.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.976+0000 7f8a8d811780 1 < canceled operation key=MJJPUJP2NSOK tag=79E9UNMSW2VG type=write size=727192 2024-09-22T08:25:16.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.979+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=MF406BOVF3HW type=del size=3325764 2024-09-22T08:25:16.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.980+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=S1XRB9RU92BX type=write size=1027716 2024-09-22T08:25:16.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.981+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=2AUYBX9H04RW type=del size=2173732 2024-09-22T08:25:16.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.982+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=9ZJMBPHB484U type=del 2024-09-22T08:25:16.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.985+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=8N87LZRIDIMU type=del size=1674236 2024-09-22T08:25:16.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.987+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.0 size=1048576 2024-09-22T08:25:16.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.988+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.1 size=1048576 2024-09-22T08:25:16.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.989+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~OYX4FH8WZ2VH.2 size=984759 2024-09-22T08:25:16.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.992+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=OYX4FH8WZ2VH tag=AAOFP0R2YG6U type=write size=4130487 2024-09-22T08:25:16.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.993+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=LXPKYQNKKOZF type=del size=2887284 2024-09-22T08:25:16.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.995+0000 7f8a8d811780 1 < canceled operation key=H504PU8223G9 tag=MQT1X9LF8CWP type=del size=3981091 2024-09-22T08:25:16.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.996+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=VFX5JML13F9F type=del size=2808443 2024-09-22T08:25:16.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:16.998+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=VEUWSBEIRBC2 type=del 2024-09-22T08:25:17.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.000+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~W4X5MSQVJGEC.0 size=1048576 2024-09-22T08:25:17.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.001+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~W4X5MSQVJGEC.1 size=482626 2024-09-22T08:25:17.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.001+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=W4X5MSQVJGEC tag=TYEXHPQ25JSP type=write size=2579778 2024-09-22T08:25:17.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.003+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~K6BAA584Q2ZI.0 size=1048576 2024-09-22T08:25:17.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.004+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~K6BAA584Q2ZI.1 size=447940 2024-09-22T08:25:17.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.007+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=K6BAA584Q2ZI tag=0BMJNEFS4YEM type=write size=2545092 2024-09-22T08:25:17.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.009+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=807101PM48EC type=del size=2960172 2024-09-22T08:25:17.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.010+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~L1XOXW3UDBMP.0 size=1048576 2024-09-22T08:25:17.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.011+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~L1XOXW3UDBMP.1 size=113098 2024-09-22T08:25:17.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.013+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=L1XOXW3UDBMP tag=6V0XJ33ZHV1I type=write size=2210250 2024-09-22T08:25:17.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.015+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=TQF0SOZ28LW0 type=del size=3263257 2024-09-22T08:25:17.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.016+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~OM59528JA87C.0 size=458516 2024-09-22T08:25:17.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.018+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=OM59528JA87C tag=19JJMEC13S3Q type=write size=1507092 2024-09-22T08:25:17.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.021+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~VMMZP08WZN4S.0 size=437265 2024-09-22T08:25:17.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.021+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=VMMZP08WZN4S tag=66DC6PE3G0N7 type=write size=1485841 2024-09-22T08:25:17.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.022+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.0 size=1048576 2024-09-22T08:25:17.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.023+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.1 size=1048576 2024-09-22T08:25:17.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.024+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~YSVRAX394FTB.2 size=146723 2024-09-22T08:25:17.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.027+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=YSVRAX394FTB tag=Q3YMEI4XM396 type=write size=3292451 2024-09-22T08:25:17.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.030+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~L2YDLXHW0KL0.0 size=1048576 2024-09-22T08:25:17.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.031+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~L2YDLXHW0KL0.1 size=897388 2024-09-22T08:25:17.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.031+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=L2YDLXHW0KL0 tag=E1IV3S3SLSPJ type=write size=2994540 2024-09-22T08:25:17.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.032+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=HRFA1B0VBZC1 type=del 2024-09-22T08:25:17.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.034+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=N22LPA5N0WKH type=del size=412981 2024-09-22T08:25:17.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.035+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=A1G4CD9YUUEZ type=del 2024-09-22T08:25:17.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.037+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~ZZ2DS7X095LW.0 size=1048576 2024-09-22T08:25:17.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.039+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~ZZ2DS7X095LW.1 size=957978 2024-09-22T08:25:17.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.039+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=ZZ2DS7X095LW tag=B8698H1JWWPU type=write size=3055130 2024-09-22T08:25:17.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.040+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~7CEKR187E988.0 size=892303 2024-09-22T08:25:17.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.042+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=7CEKR187E988 tag=M651JW3GY5VY type=write size=1940879 2024-09-22T08:25:17.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.044+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=D58MHJKHJD3P type=del size=729102 2024-09-22T08:25:17.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.045+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=ACVSY5DOL6G7 type=del 2024-09-22T08:25:17.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.047+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=DICJMX83JGUR type=del size=2239138 2024-09-22T08:25:17.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.049+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~4QRPHPEFA1UP.0 size=1008179 2024-09-22T08:25:17.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.051+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=4QRPHPEFA1UP tag=9STQKTZ1N8Q2 type=write size=2056755 2024-09-22T08:25:17.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.052+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=29J1VJJHMXFI type=del size=805358 2024-09-22T08:25:17.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.054+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~T2Q8VF1A1ATF.0 size=482705 2024-09-22T08:25:17.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.056+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=T2Q8VF1A1ATF tag=3H02ZAX2FOUB type=write size=1531281 2024-09-22T08:25:17.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.059+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=GAMY6ICURKCH type=del size=3969235 2024-09-22T08:25:17.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.060+0000 7f8a8d811780 1 < canceled operation key=ER5UY1ML3R2H tag=MF406BOVF3HW type=del size=3325764 2024-09-22T08:25:17.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.061+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=F3UQESSP8GHN type=del size=954025 2024-09-22T08:25:17.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.062+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=2AUYBX9H04RW type=del 2024-09-22T08:25:17.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.064+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=KISP689ZVUPW type=del size=3719273 2024-09-22T08:25:17.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.065+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=8N87LZRIDIMU type=del 2024-09-22T08:25:17.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.068+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~E0OJL5O2A4O0.0 size=1048576 2024-09-22T08:25:17.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.069+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~E0OJL5O2A4O0.1 size=161956 2024-09-22T08:25:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.069+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=E0OJL5O2A4O0 tag=QO2BTAKCUF5A type=write size=2259108 2024-09-22T08:25:17.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.070+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=LXPKYQNKKOZF type=del 2024-09-22T08:25:17.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.073+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=007AZ9PLFXEN type=del size=1885158 2024-09-22T08:25:17.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.075+0000 7f8a8d811780 1 < suggested remove operation key=0AOI0OB2YFVV tag=VFX5JML13F9F type=del 2024-09-22T08:25:17.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.077+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=56PC0D2SAN2L type=del size=3951546 2024-09-22T08:25:17.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.078+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~W4X5MSQVJGEC.0 size=1048576 2024-09-22T08:25:17.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.079+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~W4X5MSQVJGEC.1 size=482626 2024-09-22T08:25:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.082+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=W4X5MSQVJGEC tag=TYEXHPQ25JSP type=write size=2579778 2024-09-22T08:25:17.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.084+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=TW2DG17WK4D7 type=del size=1815857 2024-09-22T08:25:17.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.087+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=807101PM48EC type=del size=2960172 2024-09-22T08:25:17.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.090+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=1R37H519VAQC type=del size=2498771 2024-09-22T08:25:17.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.093+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=TQF0SOZ28LW0 type=del 2024-09-22T08:25:17.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.094+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=A5N0MAZBKN3S type=del size=1801036 2024-09-22T08:25:17.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.096+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~VMMZP08WZN4S.0 size=437265 2024-09-22T08:25:17.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.098+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=VMMZP08WZN4S tag=66DC6PE3G0N7 type=write size=1485841 2024-09-22T08:25:17.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.101+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.0 size=1048576 2024-09-22T08:25:17.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.102+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.1 size=1048576 2024-09-22T08:25:17.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.103+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.2 size=48643 2024-09-22T08:25:17.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.103+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=CT9CQV3UCOES tag=DO7YVBN53QJU type=write size=3194371 2024-09-22T08:25:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.105+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~L2YDLXHW0KL0.0 size=1048576 2024-09-22T08:25:17.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.106+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~L2YDLXHW0KL0.1 size=897388 2024-09-22T08:25:17.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.109+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=L2YDLXHW0KL0 tag=E1IV3S3SLSPJ type=write size=2994540 2024-09-22T08:25:17.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.111+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~V9TN7O8J2NRG.0 size=752161 2024-09-22T08:25:17.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.111+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=V9TN7O8J2NRG tag=0R89M6SFZ3QB type=write size=1800737 2024-09-22T08:25:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.113+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=N22LPA5N0WKH type=del 2024-09-22T08:25:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.114+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=HL9U2YBDIH3A type=write size=367490 2024-09-22T08:25:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.117+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~ZZ2DS7X095LW.0 size=1048576 2024-09-22T08:25:17.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.117+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~ZZ2DS7X095LW.1 size=957978 2024-09-22T08:25:17.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.119+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=ZZ2DS7X095LW tag=B8698H1JWWPU type=write size=3055130 2024-09-22T08:25:17.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.121+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=31V4GN7UEM3C type=del size=4088450 2024-09-22T08:25:17.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.122+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=D58MHJKHJD3P type=del 2024-09-22T08:25:17.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.124+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=2ZR1SK1617FB type=write size=144113 2024-09-22T08:25:17.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.125+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=DICJMX83JGUR type=del 2024-09-22T08:25:17.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.128+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.0 size=1048576 2024-09-22T08:25:17.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.129+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.1 size=1048576 2024-09-22T08:25:17.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.131+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.2 size=161698 2024-09-22T08:25:17.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.131+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=YAII12M5DYCZ tag=6N9HWI8TZIOF type=write size=3307426 2024-09-22T08:25:17.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.132+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=29J1VJJHMXFI type=del 2024-09-22T08:25:17.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.134+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=C5AGMUN3YS7E type=del size=2929238 2024-09-22T08:25:17.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.135+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=GAMY6ICURKCH type=del 2024-09-22T08:25:17.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.137+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=PBBFDUYA0UOA type=del size=2067806 2024-09-22T08:25:17.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.138+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=F3UQESSP8GHN type=del 2024-09-22T08:25:17.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.141+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~IUOD29KNBRB1.0 size=16546 2024-09-22T08:25:17.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.141+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=IUOD29KNBRB1 tag=EJH92F0ZZLI5 type=write size=1065122 2024-09-22T08:25:17.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.142+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=KISP689ZVUPW type=del 2024-09-22T08:25:17.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.146+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.0 size=1048576 2024-09-22T08:25:17.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.148+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.1 size=1048576 2024-09-22T08:25:17.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.149+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.2 size=758116 2024-09-22T08:25:17.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.149+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=SF117J6ZPP3F tag=C31N5ABJF36N type=write size=3903844 2024-09-22T08:25:17.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.150+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~E0OJL5O2A4O0.0 size=1048576 2024-09-22T08:25:17.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.152+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~E0OJL5O2A4O0.1 size=161956 2024-09-22T08:25:17.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.155+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=E0OJL5O2A4O0 tag=QO2BTAKCUF5A type=write size=2259108 2024-09-22T08:25:17.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.157+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.0 size=1048576 2024-09-22T08:25:17.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.158+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.1 size=1048576 2024-09-22T08:25:17.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.159+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.2 size=681379 2024-09-22T08:25:17.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.159+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=00B1FC9OZ9H1 tag=W3DUJP5YVKKJ type=write size=3827107 2024-09-22T08:25:17.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.161+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=007AZ9PLFXEN type=del 2024-09-22T08:25:17.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.162+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=85GTGSDUM1ZC type=write size=494565 2024-09-22T08:25:17.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.164+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=56PC0D2SAN2L type=del 2024-09-22T08:25:17.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.166+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~T9F1MDFM62KP.0 size=604110 2024-09-22T08:25:17.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.166+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=T9F1MDFM62KP tag=CIP3R549ZMMF type=write size=1652686 2024-09-22T08:25:17.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.168+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=TW2DG17WK4D7 type=del 2024-09-22T08:25:17.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.168+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=OQARGR2ZKMZY type=del size=3852047 2024-09-22T08:25:17.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.170+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=1R37H519VAQC type=del 2024-09-22T08:25:17.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.173+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~6ZQFXL3FCXX1.0 size=1048576 2024-09-22T08:25:17.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.175+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~6ZQFXL3FCXX1.1 size=1035352 2024-09-22T08:25:17.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.175+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=6ZQFXL3FCXX1 tag=M0THBSWTNY5F type=write size=3132504 2024-09-22T08:25:17.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.175+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=A5N0MAZBKN3S type=del 2024-09-22T08:25:17.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.177+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=9IVK1B0MP8AG type=del size=3314216 2024-09-22T08:25:17.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.178+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.0 size=1048576 2024-09-22T08:25:17.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.179+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.1 size=1048576 2024-09-22T08:25:17.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.181+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CT9CQV3UCOES.2 size=48643 2024-09-22T08:25:17.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.183+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=CT9CQV3UCOES tag=DO7YVBN53QJU type=write size=3194371 2024-09-22T08:25:17.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.184+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=IPWAKQCF5NXV type=del size=2337092 2024-09-22T08:25:17.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.186+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~V9TN7O8J2NRG.0 size=752161 2024-09-22T08:25:17.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.188+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=V9TN7O8J2NRG tag=0R89M6SFZ3QB type=write size=1800737 2024-09-22T08:25:17.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.190+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=RCQQ0922M2I2 type=del size=3930555 2024-09-22T08:25:17.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.191+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=HL9U2YBDIH3A type=write size=367490 2024-09-22T08:25:17.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.193+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=2AMV6D46YDE1 type=del size=1644950 2024-09-22T08:25:17.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.194+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=31V4GN7UEM3C type=del 2024-09-22T08:25:17.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.196+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=WN9DATCBTZWY type=del size=236831 2024-09-22T08:25:17.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.199+0000 7f8a8d811780 1 < suggested update operation key=WOSCCX4WX2FN tag=2ZR1SK1617FB type=write size=144113 2024-09-22T08:25:17.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.200+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=BCH0MKHIKMBV type=write size=743265 2024-09-22T08:25:17.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.202+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.0 size=1048576 2024-09-22T08:25:17.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.203+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.1 size=1048576 2024-09-22T08:25:17.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.204+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~YAII12M5DYCZ.2 size=161698 2024-09-22T08:25:17.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.206+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=YAII12M5DYCZ tag=6N9HWI8TZIOF type=write size=3307426 2024-09-22T08:25:17.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.209+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~JNDUEFPDGDAL.0 size=791787 2024-09-22T08:25:17.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.209+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=JNDUEFPDGDAL tag=PRP0IFVN3Z8X type=write size=1840363 2024-09-22T08:25:17.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.212+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=C5AGMUN3YS7E type=del size=2929238 2024-09-22T08:25:17.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.214+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~UTAEDNBE8LKE.0 size=19785 2024-09-22T08:25:17.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.214+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=UTAEDNBE8LKE tag=8HW43CS3J1VT type=write size=1068361 2024-09-22T08:25:17.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.216+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=PBBFDUYA0UOA type=del 2024-09-22T08:25:17.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.218+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=ZZKIN6M3TOU8 type=del size=2508387 2024-09-22T08:25:17.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.220+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~IUOD29KNBRB1.0 size=16546 2024-09-22T08:25:17.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.222+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=IUOD29KNBRB1 tag=EJH92F0ZZLI5 type=write size=1065122 2024-09-22T08:25:17.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.223+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=9EQOWKZH9N62 type=del size=583384 2024-09-22T08:25:17.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.224+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.0 size=1048576 2024-09-22T08:25:17.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.225+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.1 size=1048576 2024-09-22T08:25:17.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.225+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~SF117J6ZPP3F.2 size=758116 2024-09-22T08:25:17.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.228+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=SF117J6ZPP3F tag=C31N5ABJF36N type=write size=3903844 2024-09-22T08:25:17.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.230+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~UVW6HH8HBJKU.0 size=368865 2024-09-22T08:25:17.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.230+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=UVW6HH8HBJKU tag=180R5DYCBS8K type=write size=1417441 2024-09-22T08:25:17.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.232+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.0 size=1048576 2024-09-22T08:25:17.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.233+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.1 size=1048576 2024-09-22T08:25:17.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.234+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~00B1FC9OZ9H1.2 size=681379 2024-09-22T08:25:17.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.237+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=00B1FC9OZ9H1 tag=W3DUJP5YVKKJ type=write size=3827107 2024-09-22T08:25:17.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.238+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=2MJI6DOMJMYX type=del size=1709216 2024-09-22T08:25:17.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.240+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=85GTGSDUM1ZC type=write size=494565 2024-09-22T08:25:17.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.242+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~RQ2WNXTBFPOH.0 size=1048576 2024-09-22T08:25:17.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.243+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~RQ2WNXTBFPOH.1 size=45725 2024-09-22T08:25:17.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.243+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=RQ2WNXTBFPOH tag=A8VYEKYXSH7X type=write size=2142877 2024-09-22T08:25:17.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.245+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~T9F1MDFM62KP.0 size=604110 2024-09-22T08:25:17.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.248+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=T9F1MDFM62KP tag=CIP3R549ZMMF type=write size=1652686 2024-09-22T08:25:17.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.250+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.0 size=1048576 2024-09-22T08:25:17.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.251+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.1 size=1048576 2024-09-22T08:25:17.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.252+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.2 size=526685 2024-09-22T08:25:17.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.252+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=1NYD2RZG9ODA tag=72OCVNUDBSOQ type=write size=3672413 2024-09-22T08:25:17.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.253+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=OQARGR2ZKMZY type=del 2024-09-22T08:25:17.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.255+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=AY4QMRO03RR9 type=del size=1671309 2024-09-22T08:25:17.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.255+0000 7f8a8d811780 1 < canceled part key=_multipart_MJJPUJP2NSOK.2~6ZQFXL3FCXX1.0 size=1048576 2024-09-22T08:25:17.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.256+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~6ZQFXL3FCXX1.1 size=1035352 2024-09-22T08:25:17.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.258+0000 7f8a8d811780 1 < canceled multipart upload key=MJJPUJP2NSOK upload=6ZQFXL3FCXX1 tag=M0THBSWTNY5F type=write size=3132504 2024-09-22T08:25:17.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.261+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~N6B2C06BVXAY.0 size=93037 2024-09-22T08:25:17.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.261+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=N6B2C06BVXAY tag=0EXJJSOQ1NS0 type=write size=1141613 2024-09-22T08:25:17.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.262+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=9IVK1B0MP8AG type=del 2024-09-22T08:25:17.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.264+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=0RO3HHQ02NJX type=del size=3677130 2024-09-22T08:25:17.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.265+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=IPWAKQCF5NXV type=del 2024-09-22T08:25:17.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.267+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=6BR4LUYO3EXI type=del size=2835628 2024-09-22T08:25:17.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.268+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=RCQQ0922M2I2 type=del 2024-09-22T08:25:17.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.271+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~UH8FR6VF9U0M.0 size=580879 2024-09-22T08:25:17.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.271+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=UH8FR6VF9U0M tag=43M2HFK4B8X7 type=write size=1629455 2024-09-22T08:25:17.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.273+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=2AMV6D46YDE1 type=del 2024-09-22T08:25:17.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.275+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.0 size=1048576 2024-09-22T08:25:17.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.276+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.1 size=1048576 2024-09-22T08:25:17.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.280+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.2 size=727152 2024-09-22T08:25:17.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.280+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=39QP6V7E7WZS tag=I8XAA1A7LB0B type=write size=3872880 2024-09-22T08:25:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.281+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=WN9DATCBTZWY type=del 2024-09-22T08:25:17.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.284+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~SB7VPAJH986Z.0 size=231563 2024-09-22T08:25:17.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.284+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=SB7VPAJH986Z tag=W3845AR23QTV type=write size=1280139 2024-09-22T08:25:17.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.285+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=BCH0MKHIKMBV type=write size=743265 2024-09-22T08:25:17.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.287+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=RFGQRLHVAMWO type=write size=865540 2024-09-22T08:25:17.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.288+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~JNDUEFPDGDAL.0 size=791787 2024-09-22T08:25:17.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.290+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=JNDUEFPDGDAL tag=PRP0IFVN3Z8X type=write size=1840363 2024-09-22T08:25:17.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.293+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.0 size=1048576 2024-09-22T08:25:17.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.294+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.1 size=1048576 2024-09-22T08:25:17.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.295+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.2 size=649339 2024-09-22T08:25:17.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.295+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=36X5CNVGDUY9 tag=JC2J26W4T06T type=write size=3795067 2024-09-22T08:25:17.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.297+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~UTAEDNBE8LKE.0 size=19785 2024-09-22T08:25:17.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.299+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=UTAEDNBE8LKE tag=8HW43CS3J1VT type=write size=1068361 2024-09-22T08:25:17.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.301+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=ATJW0RL7ODB6 type=del size=2269287 2024-09-22T08:25:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.302+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=ZZKIN6M3TOU8 type=del 2024-09-22T08:25:17.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.305+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~I438BH289BFD.0 size=1048576 2024-09-22T08:25:17.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.306+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~I438BH289BFD.1 size=890913 2024-09-22T08:25:17.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.306+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=I438BH289BFD tag=8MAKGANXKNJ5 type=write size=2988065 2024-09-22T08:25:17.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.307+0000 7f8a8d811780 1 < canceled operation key=7XNMR51803Y6 tag=9EQOWKZH9N62 type=del size=583384 2024-09-22T08:25:17.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.309+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=H25TZBFB6M2B type=del size=3573055 2024-09-22T08:25:17.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.310+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~UVW6HH8HBJKU.0 size=368865 2024-09-22T08:25:17.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.313+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=UVW6HH8HBJKU tag=180R5DYCBS8K type=write size=1417441 2024-09-22T08:25:17.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.314+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=VCOF35EEJV23 type=del size=553190 2024-09-22T08:25:17.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.316+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=2MJI6DOMJMYX type=del 2024-09-22T08:25:17.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.318+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.0 size=1048576 2024-09-22T08:25:17.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.320+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.1 size=1048576 2024-09-22T08:25:17.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.321+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.2 size=261085 2024-09-22T08:25:17.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.321+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=16OXDH8FJ60U tag=U7MOGVAEG0SC type=write size=3406813 2024-09-22T08:25:17.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.323+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~RQ2WNXTBFPOH.0 size=1048576 2024-09-22T08:25:17.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.323+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~RQ2WNXTBFPOH.1 size=45725 2024-09-22T08:25:17.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.327+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=RQ2WNXTBFPOH tag=A8VYEKYXSH7X type=write size=2142877 2024-09-22T08:25:17.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.328+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=T99IR0SSIJC6 type=del size=1736713 2024-09-22T08:25:17.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.330+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.0 size=1048576 2024-09-22T08:25:17.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.330+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.1 size=1048576 2024-09-22T08:25:17.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.332+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~1NYD2RZG9ODA.2 size=526685 2024-09-22T08:25:17.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.334+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=1NYD2RZG9ODA tag=72OCVNUDBSOQ type=write size=3672413 2024-09-22T08:25:17.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.335+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=K3CN0HXCO5S1 type=del size=385316 2024-09-22T08:25:17.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.337+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=AY4QMRO03RR9 type=del 2024-09-22T08:25:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.338+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=LBZYYH4XIAL2 type=del size=697833 2024-09-22T08:25:17.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.340+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~N6B2C06BVXAY.0 size=93037 2024-09-22T08:25:17.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.342+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=N6B2C06BVXAY tag=0EXJJSOQ1NS0 type=write size=1141613 2024-09-22T08:25:17.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.346+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~RUREUMS5V00N.0 size=663837 2024-09-22T08:25:17.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.346+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=RUREUMS5V00N tag=CIZ4MIG0WMKD type=write size=1712413 2024-09-22T08:25:17.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.347+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=0RO3HHQ02NJX type=del 2024-09-22T08:25:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.349+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~OAEX0LGFRORL.0 size=1048576 2024-09-22T08:25:17.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.352+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~OAEX0LGFRORL.1 size=449192 2024-09-22T08:25:17.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.352+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=OAEX0LGFRORL tag=LR4FWHOFT565 type=write size=2546344 2024-09-22T08:25:17.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.353+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=6BR4LUYO3EXI type=del 2024-09-22T08:25:17.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.355+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.0 size=1048576 2024-09-22T08:25:17.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.356+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.1 size=1048576 2024-09-22T08:25:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.358+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.2 size=676020 2024-09-22T08:25:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.358+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=IWZVEKKL7Y14 tag=213Y501RUJ75 type=write size=3821748 2024-09-22T08:25:17.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.359+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~UH8FR6VF9U0M.0 size=580879 2024-09-22T08:25:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.361+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=UH8FR6VF9U0M tag=43M2HFK4B8X7 type=write size=1629455 2024-09-22T08:25:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.364+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~89GK41IEFR2Q.0 size=635000 2024-09-22T08:25:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.364+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=89GK41IEFR2Q tag=8PXVM6256OSG type=write size=1683576 2024-09-22T08:25:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.364+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.0 size=1048576 2024-09-22T08:25:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.365+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.1 size=1048576 2024-09-22T08:25:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.366+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~39QP6V7E7WZS.2 size=727152 2024-09-22T08:25:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.368+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=39QP6V7E7WZS tag=I8XAA1A7LB0B type=write size=3872880 2024-09-22T08:25:17.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.370+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=70ZJJGU1FLC6 type=del size=620658 2024-09-22T08:25:17.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.371+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~SB7VPAJH986Z.0 size=231563 2024-09-22T08:25:17.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.373+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=SB7VPAJH986Z tag=W3845AR23QTV type=write size=1280139 2024-09-22T08:25:17.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.375+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=Z65MWAD635K8 type=write size=632387 2024-09-22T08:25:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.376+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=RFGQRLHVAMWO type=write size=865540 2024-09-22T08:25:17.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.377+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=THLZEG21Z10K type=del size=2088952 2024-09-22T08:25:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.378+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.0 size=1048576 2024-09-22T08:25:17.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.379+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.1 size=1048576 2024-09-22T08:25:17.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.381+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~36X5CNVGDUY9.2 size=649339 2024-09-22T08:25:17.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.383+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=36X5CNVGDUY9 tag=JC2J26W4T06T type=write size=3795067 2024-09-22T08:25:17.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.384+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=K5VZ6VIECDPX type=del size=520910 2024-09-22T08:25:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.386+0000 7f8a8d811780 1 < suggested remove operation key=911851NVIUQS tag=ATJW0RL7ODB6 type=del 2024-09-22T08:25:17.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.388+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=20TY5DEC8NGN type=del size=3364033 2024-09-22T08:25:17.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.389+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~I438BH289BFD.0 size=1048576 2024-09-22T08:25:17.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.390+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~I438BH289BFD.1 size=890913 2024-09-22T08:25:17.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.392+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=I438BH289BFD tag=8MAKGANXKNJ5 type=write size=2988065 2024-09-22T08:25:17.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.393+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=C5WTR05LC1TR type=del size=2178196 2024-09-22T08:25:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.396+0000 7f8a8d811780 1 < suggested remove operation key=0HCXP53D9NMP tag=H25TZBFB6M2B type=del 2024-09-22T08:25:17.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.397+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=3KZO6547ILIP type=del size=425326 2024-09-22T08:25:17.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.398+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=VCOF35EEJV23 type=del 2024-09-22T08:25:17.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.400+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~QGCBEOFQLE5T.0 size=465969 2024-09-22T08:25:17.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.400+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=QGCBEOFQLE5T tag=GCSDCW0YD4KW type=write size=1514545 2024-09-22T08:25:17.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.401+0000 7f8a8d811780 1 < canceled part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.0 size=1048576 2024-09-22T08:25:17.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.402+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.1 size=1048576 2024-09-22T08:25:17.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.403+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~16OXDH8FJ60U.2 size=261085 2024-09-22T08:25:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.405+0000 7f8a8d811780 1 < canceled multipart upload key=0HCXP53D9NMP upload=16OXDH8FJ60U tag=U7MOGVAEG0SC type=write size=3406813 2024-09-22T08:25:17.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.406+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=C416N9WZSJCO type=del size=3613417 2024-09-22T08:25:17.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.409+0000 7f8a8d811780 -1 < failed to complete operation key=911851NVIUQS tag=T99IR0SSIJC6 type=del size=1736713: (22) Invalid argument 2024-09-22T08:25:17.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.410+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=MCFN8X3IZ5XE type=write size=936330 2024-09-22T08:25:17.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.412+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=K3CN0HXCO5S1 type=del 2024-09-22T08:25:17.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.413+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=ELDK1JWYKHDO type=del size=1736055 2024-09-22T08:25:17.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.414+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=LBZYYH4XIAL2 type=del 2024-09-22T08:25:17.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.417+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~H6INFN3KV2F4.0 size=1010101 2024-09-22T08:25:17.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.417+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=H6INFN3KV2F4 tag=JGSZLZCXT2TF type=write size=2058677 2024-09-22T08:25:17.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.418+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~RUREUMS5V00N.0 size=663837 2024-09-22T08:25:17.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.420+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=RUREUMS5V00N tag=CIZ4MIG0WMKD type=write size=1712413 2024-09-22T08:25:17.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.422+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=HALIU82Q0Y8B type=del size=2861109 2024-09-22T08:25:17.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.423+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~OAEX0LGFRORL.0 size=1048576 2024-09-22T08:25:17.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.424+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~OAEX0LGFRORL.1 size=449192 2024-09-22T08:25:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.427+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=OAEX0LGFRORL tag=LR4FWHOFT565 type=write size=2546344 2024-09-22T08:25:17.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.429+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.0 size=1048576 2024-09-22T08:25:17.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.430+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.1 size=1048576 2024-09-22T08:25:17.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.431+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.2 size=459828 2024-09-22T08:25:17.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.431+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=CS1T0R4DPU12 tag=8GI9JSPGLGJG type=write size=3605556 2024-09-22T08:25:17.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.433+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.0 size=1048576 2024-09-22T08:25:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.434+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.1 size=1048576 2024-09-22T08:25:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.435+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IWZVEKKL7Y14.2 size=676020 2024-09-22T08:25:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.437+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=IWZVEKKL7Y14 tag=213Y501RUJ75 type=write size=3821748 2024-09-22T08:25:17.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.439+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.0 size=1048576 2024-09-22T08:25:17.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.440+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.1 size=1048576 2024-09-22T08:25:17.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.441+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.2 size=636007 2024-09-22T08:25:17.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.441+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=VGJ1I3WTS8W9 tag=ETVJH3H5JQ1M type=write size=3781735 2024-09-22T08:25:17.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.443+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~89GK41IEFR2Q.0 size=635000 2024-09-22T08:25:17.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.445+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=89GK41IEFR2Q tag=8PXVM6256OSG type=write size=1683576 2024-09-22T08:25:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.447+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=EXXFQHEZZ0CX type=del size=335977 2024-09-22T08:25:17.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.448+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=70ZJJGU1FLC6 type=del 2024-09-22T08:25:17.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.449+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=6O7ZL0WL7YON type=del size=3100365 2024-09-22T08:25:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.452+0000 7f8a8d811780 1 < suggested remove operation key=ER5UY1ML3R2H tag=Z65MWAD635K8 type=write 2024-09-22T08:25:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.454+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~CR1JXVYZ8QV1.0 size=1048576 2024-09-22T08:25:17.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.456+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~CR1JXVYZ8QV1.1 size=473486 2024-09-22T08:25:17.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.456+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=CR1JXVYZ8QV1 tag=LZI2IW8J0W7E type=write size=2570638 2024-09-22T08:25:17.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.457+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=THLZEG21Z10K type=del 2024-09-22T08:25:17.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.459+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=LX970PW47EGQ type=del size=3038943 2024-09-22T08:25:17.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.460+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=K5VZ6VIECDPX type=del 2024-09-22T08:25:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.463+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.0 size=1048576 2024-09-22T08:25:17.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.464+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.1 size=1048576 2024-09-22T08:25:17.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.465+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.2 size=734650 2024-09-22T08:25:17.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.465+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=HLSZN8S9MQWU tag=Z1C76JWWFC6A type=write size=3880378 2024-09-22T08:25:17.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.466+0000 7f8a8d811780 -1 < failed to complete operation key=ER5UY1ML3R2H tag=20TY5DEC8NGN type=del size=3364033: (22) Invalid argument 2024-09-22T08:25:17.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.468+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=FS9JAP771FNT type=del size=1259981 2024-09-22T08:25:17.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.469+0000 7f8a8d811780 1 < canceled operation key=0AOI0OB2YFVV tag=C5WTR05LC1TR type=del size=2178196 2024-09-22T08:25:17.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.471+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=PFR0HZCLNIIV type=del size=2795249 2024-09-22T08:25:17.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.472+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=3KZO6547ILIP type=del 2024-09-22T08:25:17.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.474+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=VG6YGMGPL0YO type=del size=2446846 2024-09-22T08:25:17.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.475+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~QGCBEOFQLE5T.0 size=465969 2024-09-22T08:25:17.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.478+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=QGCBEOFQLE5T tag=GCSDCW0YD4KW type=write size=1514545 2024-09-22T08:25:17.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.479+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=AT6NFRG3JJ1I type=del size=3388194 2024-09-22T08:25:17.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.480+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=C416N9WZSJCO type=del 2024-09-22T08:25:17.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.482+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=BBB9TVFNZZ15 type=del size=262577 2024-09-22T08:25:17.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.484+0000 7f8a8d811780 1 < suggested update operation key=0AOI0OB2YFVV tag=MCFN8X3IZ5XE type=write size=936330 2024-09-22T08:25:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.486+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=LIJPJ9DVYRJR type=del size=809683 2024-09-22T08:25:17.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.489+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=ELDK1JWYKHDO type=del size=1736055 2024-09-22T08:25:17.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.491+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=WF3EEW0MPXM8 type=write size=220924 2024-09-22T08:25:17.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.493+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~H6INFN3KV2F4.0 size=1010101 2024-09-22T08:25:17.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.495+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=H6INFN3KV2F4 tag=JGSZLZCXT2TF type=write size=2058677 2024-09-22T08:25:17.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.498+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.0 size=1048576 2024-09-22T08:25:17.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.498+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.1 size=1048576 2024-09-22T08:25:17.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.500+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.2 size=270421 2024-09-22T08:25:17.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.500+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=PVVETBT1122J tag=F1W2QLQWPF35 type=write size=3416149 2024-09-22T08:25:17.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.503+0000 7f8a8d811780 1 < suggested update operation key=IOZ7IXVOB70S tag=HALIU82Q0Y8B type=del size=2861109 2024-09-22T08:25:17.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.504+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=L54M79JCDXBT type=del size=608189 2024-09-22T08:25:17.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.505+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.0 size=1048576 2024-09-22T08:25:17.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.505+0000 7f8a8d811780 1 < canceled part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.1 size=1048576 2024-09-22T08:25:17.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.507+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~CS1T0R4DPU12.2 size=459828 2024-09-22T08:25:17.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.509+0000 7f8a8d811780 1 < canceled multipart upload key=7XBR6QIHD8TJ upload=CS1T0R4DPU12 tag=8GI9JSPGLGJG type=write size=3605556 2024-09-22T08:25:17.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.511+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=GT8L7HIT3OEV type=del size=2458444 2024-09-22T08:25:17.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.513+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.0 size=1048576 2024-09-22T08:25:17.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.514+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.1 size=1048576 2024-09-22T08:25:17.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.516+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~VGJ1I3WTS8W9.2 size=636007 2024-09-22T08:25:17.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.518+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=VGJ1I3WTS8W9 tag=ETVJH3H5JQ1M type=write size=3781735 2024-09-22T08:25:17.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.520+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=SB6G7X51L6S6 type=del size=4140711 2024-09-22T08:25:17.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.521+0000 7f8a8d811780 -1 < failed to complete operation key=ER5UY1ML3R2H tag=EXXFQHEZZ0CX type=del size=335977: (22) Invalid argument 2024-09-22T08:25:17.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.522+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=K48EE2YZWBMI type=del size=244638 2024-09-22T08:25:17.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.524+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=6O7ZL0WL7YON type=del 2024-09-22T08:25:17.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.526+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=9OZ4FUSGJ7VM type=del size=2991499 2024-09-22T08:25:17.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.527+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~CR1JXVYZ8QV1.0 size=1048576 2024-09-22T08:25:17.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.529+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~CR1JXVYZ8QV1.1 size=473486 2024-09-22T08:25:17.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.532+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=CR1JXVYZ8QV1 tag=LZI2IW8J0W7E type=write size=2570638 2024-09-22T08:25:17.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.534+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~H285EMIB0FDG.0 size=1048576 2024-09-22T08:25:17.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.535+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~H285EMIB0FDG.1 size=78457 2024-09-22T08:25:17.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.535+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=H285EMIB0FDG tag=SO8UAC5P6V6Q type=write size=2175609 2024-09-22T08:25:17.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.537+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=LX970PW47EGQ type=del 2024-09-22T08:25:17.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.538+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=XKLH3KLATEQ2 type=del size=2418347 2024-09-22T08:25:17.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.540+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.0 size=1048576 2024-09-22T08:25:17.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.541+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.1 size=1048576 2024-09-22T08:25:17.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.543+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~HLSZN8S9MQWU.2 size=734650 2024-09-22T08:25:17.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.546+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=HLSZN8S9MQWU tag=Z1C76JWWFC6A type=write size=3880378 2024-09-22T08:25:17.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.547+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=2OSH5E02CE5B type=write size=44615 2024-09-22T08:25:17.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.549+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=FS9JAP771FNT type=del 2024-09-22T08:25:17.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.550+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=CLPC2QBRZ6E8 type=del size=478893 2024-09-22T08:25:17.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.553+0000 7f8a8d811780 1 < suggested remove operation key=RCHUCAL6CQ4F tag=PFR0HZCLNIIV type=del 2024-09-22T08:25:17.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.555+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=C4D67Q6J5HVL type=del size=95696 2024-09-22T08:25:17.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.556+0000 7f8a8d811780 -1 < failed to complete operation key=H504PU8223G9 tag=VG6YGMGPL0YO type=del size=2446846: (22) Invalid argument 2024-09-22T08:25:17.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.559+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.0 size=1048576 2024-09-22T08:25:17.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.561+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.1 size=1048576 2024-09-22T08:25:17.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.562+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.2 size=521494 2024-09-22T08:25:17.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.562+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=EZ8JS6NJWKT1 tag=77EDANGI63I2 type=write size=3667222 2024-09-22T08:25:17.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.565+0000 7f8a8d811780 1 < suggested remove operation key=RRTLTMWJIWSW tag=AT6NFRG3JJ1I type=del 2024-09-22T08:25:17.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.566+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=XYY010BIUF0F type=del size=1882617 2024-09-22T08:25:17.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.569+0000 7f8a8d811780 1 < suggested update operation key=IOZ7IXVOB70S tag=BBB9TVFNZZ15 type=del size=262577 2024-09-22T08:25:17.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.571+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=U35HSLCIIICG type=del size=3985367 2024-09-22T08:25:17.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.573+0000 7f8a8d811780 -1 < failed to complete operation key=RCHUCAL6CQ4F tag=LIJPJ9DVYRJR type=del size=809683: (22) Invalid argument 2024-09-22T08:25:17.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.574+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=E3JAN0FZCXN5 type=del size=1344879 2024-09-22T08:25:17.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.577+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=WF3EEW0MPXM8 type=write size=220924 2024-09-22T08:25:17.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.577+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=S51DLVV4D8ZN type=del size=1010564 2024-09-22T08:25:17.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.580+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.0 size=1048576 2024-09-22T08:25:17.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.581+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.1 size=1048576 2024-09-22T08:25:17.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.582+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~PVVETBT1122J.2 size=270421 2024-09-22T08:25:17.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.584+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=PVVETBT1122J tag=F1W2QLQWPF35 type=write size=3416149 2024-09-22T08:25:17.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.587+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~95JOCLXOMRDJ.0 size=1048576 2024-09-22T08:25:17.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.590+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~95JOCLXOMRDJ.1 size=771038 2024-09-22T08:25:17.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.590+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=95JOCLXOMRDJ tag=Z0JSBQXUGGE0 type=write size=2868190 2024-09-22T08:25:17.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.591+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=L54M79JCDXBT type=del 2024-09-22T08:25:17.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.592+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=LDQR4VAUXF8N type=del size=602467 2024-09-22T08:25:17.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.594+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=GT8L7HIT3OEV type=del 2024-09-22T08:25:17.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.596+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=K4KAVBAB3T34 type=del size=2931622 2024-09-22T08:25:17.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.597+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=SB6G7X51L6S6 type=del 2024-09-22T08:25:17.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.598+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=VG0TXYIWOHNI type=del size=4014937 2024-09-22T08:25:17.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.600+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=K48EE2YZWBMI type=del 2024-09-22T08:25:17.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.601+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=DXASRHJYWZY2 type=del size=1810286 2024-09-22T08:25:17.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.602+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=9OZ4FUSGJ7VM type=del 2024-09-22T08:25:17.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.605+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~VJ7DZAJKHXDU.0 size=468591 2024-09-22T08:25:17.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.605+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=VJ7DZAJKHXDU tag=AJ41E9708X5Z type=write size=1517167 2024-09-22T08:25:17.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.607+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~H285EMIB0FDG.0 size=1048576 2024-09-22T08:25:17.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.608+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~H285EMIB0FDG.1 size=78457 2024-09-22T08:25:17.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.610+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=H285EMIB0FDG tag=SO8UAC5P6V6Q type=write size=2175609 2024-09-22T08:25:17.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.611+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=FIDK6W1O8DA8 type=del size=1314873 2024-09-22T08:25:17.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.613+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=XKLH3KLATEQ2 type=del 2024-09-22T08:25:17.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.614+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=0XYYV06BYPLM type=del size=1260873 2024-09-22T08:25:17.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.615+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=2OSH5E02CE5B type=write size=44615 2024-09-22T08:25:17.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.618+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.0 size=1048576 2024-09-22T08:25:17.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.619+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.1 size=1048576 2024-09-22T08:25:17.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.620+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.2 size=317030 2024-09-22T08:25:17.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.620+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=DMGS01V1PA3I tag=8Z3KOR8Q7ER4 type=write size=3462758 2024-09-22T08:25:17.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.622+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=CLPC2QBRZ6E8 type=del 2024-09-22T08:25:17.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.623+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=B3O9M2YJ3LCK type=del size=3853879 2024-09-22T08:25:17.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.625+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=C4D67Q6J5HVL type=del 2024-09-22T08:25:17.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.626+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=XQL02EDJPIQ2 type=del size=2212376 2024-09-22T08:25:17.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.627+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.0 size=1048576 2024-09-22T08:25:17.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.628+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.1 size=1048576 2024-09-22T08:25:17.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.629+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~EZ8JS6NJWKT1.2 size=521494 2024-09-22T08:25:17.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.632+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=EZ8JS6NJWKT1 tag=77EDANGI63I2 type=write size=3667222 2024-09-22T08:25:17.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.634+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=2YWKEWIQS48E type=del size=3215395 2024-09-22T08:25:17.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.636+0000 7f8a8d811780 1 < suggested remove operation key=GMNVYF2BY872 tag=XYY010BIUF0F type=del 2024-09-22T08:25:17.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.638+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=YHC8ZHAKSKY8 type=write size=278342 2024-09-22T08:25:17.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.641+0000 7f8a8d811780 1 < suggested update operation key=JWJ9T6XYCUYR tag=U35HSLCIIICG type=del size=3985367 2024-09-22T08:25:17.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.642+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=GBS8WSWKWX6U type=del size=2822336 2024-09-22T08:25:17.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.646+0000 7f8a8d811780 1 < suggested remove operation key=H504PU8223G9 tag=E3JAN0FZCXN5 type=del 2024-09-22T08:25:17.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.648+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~2HO5EV07MAMB.0 size=528130 2024-09-22T08:25:17.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.648+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=2HO5EV07MAMB tag=RDACEDT26QR1 type=write size=1576706 2024-09-22T08:25:17.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.650+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=S51DLVV4D8ZN type=del 2024-09-22T08:25:17.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.651+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=1WNZHW1N2807 type=write size=853122 2024-09-22T08:25:17.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.653+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~95JOCLXOMRDJ.0 size=1048576 2024-09-22T08:25:17.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.654+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~95JOCLXOMRDJ.1 size=771038 2024-09-22T08:25:17.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.657+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=95JOCLXOMRDJ tag=Z0JSBQXUGGE0 type=write size=2868190 2024-09-22T08:25:17.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.659+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~DWA6OWBT8MU0.0 size=1014318 2024-09-22T08:25:17.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.659+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=DWA6OWBT8MU0 tag=K4MRCKQU25YH type=write size=2062894 2024-09-22T08:25:17.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.660+0000 7f8a8d811780 -1 < failed to complete operation key=GMNVYF2BY872 tag=LDQR4VAUXF8N type=del size=602467: (22) Invalid argument 2024-09-22T08:25:17.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.663+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.0 size=1048576 2024-09-22T08:25:17.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.664+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.1 size=1048576 2024-09-22T08:25:17.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.665+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.2 size=936063 2024-09-22T08:25:17.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.665+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=TQCUVK2WS0N9 tag=OAR91FMMA8M5 type=write size=4081791 2024-09-22T08:25:17.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.668+0000 7f8a8d811780 1 < suggested remove operation key=KIJ2DW4NSZKG tag=K4KAVBAB3T34 type=del 2024-09-22T08:25:17.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.669+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=NIHVSHYGSLDH type=write size=434876 2024-09-22T08:25:17.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.673+0000 7f8a8d811780 1 < suggested update operation key=226G7R10IR1B tag=VG0TXYIWOHNI type=del size=4014937 2024-09-22T08:25:17.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.675+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~OXZ420TABI4E.0 size=141391 2024-09-22T08:25:17.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.675+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=OXZ420TABI4E tag=8TZZNBT3BTB1 type=write size=1189967 2024-09-22T08:25:17.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.676+0000 7f8a8d811780 1 < canceled operation key=S9JCKGZS5QLY tag=DXASRHJYWZY2 type=del size=1810286 2024-09-22T08:25:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.677+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=UM5OKS47BXNJ type=del size=410975 2024-09-22T08:25:17.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.678+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~VJ7DZAJKHXDU.0 size=468591 2024-09-22T08:25:17.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.681+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=VJ7DZAJKHXDU tag=AJ41E9708X5Z type=write size=1517167 2024-09-22T08:25:17.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.684+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=LWZKFGPQ36AO type=del size=3265893 2024-09-22T08:25:17.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.687+0000 7f8a8d811780 1 < suggested update operation key=JP7IZ0CMXTSX tag=FIDK6W1O8DA8 type=del size=1314873 2024-09-22T08:25:17.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.689+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~RHXJK43MION2.0 size=423562 2024-09-22T08:25:17.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.689+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=RHXJK43MION2 tag=MI7TPP44UCE5 type=write size=1472138 2024-09-22T08:25:17.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.690+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=0XYYV06BYPLM type=del 2024-09-22T08:25:17.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.692+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=W2ZWZV1XT9XF type=del size=3322085 2024-09-22T08:25:17.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.693+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.0 size=1048576 2024-09-22T08:25:17.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.695+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.1 size=1048576 2024-09-22T08:25:17.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.696+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~DMGS01V1PA3I.2 size=317030 2024-09-22T08:25:17.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.699+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=DMGS01V1PA3I tag=8Z3KOR8Q7ER4 type=write size=3462758 2024-09-22T08:25:17.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.700+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=Z61URN73R43N type=del size=2607857 2024-09-22T08:25:17.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.701+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=B3O9M2YJ3LCK type=del 2024-09-22T08:25:17.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.703+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=1EBIFTX996NZ type=del size=2506583 2024-09-22T08:25:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.704+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=XQL02EDJPIQ2 type=del 2024-09-22T08:25:17.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.706+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=9WP4BLKIWF31 type=del size=4122486 2024-09-22T08:25:17.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.707+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=2YWKEWIQS48E type=del 2024-09-22T08:25:17.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.709+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=9KA6OIZS5YVH type=write size=199231 2024-09-22T08:25:17.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.710+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=YHC8ZHAKSKY8 type=write size=278342 2024-09-22T08:25:17.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.712+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=UL2M446VMTGV type=del size=704076 2024-09-22T08:25:17.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.713+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=GBS8WSWKWX6U type=del 2024-09-22T08:25:17.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.714+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=8TN933JCSKTB type=del size=2210487 2024-09-22T08:25:17.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.716+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~2HO5EV07MAMB.0 size=528130 2024-09-22T08:25:17.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.718+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=2HO5EV07MAMB tag=RDACEDT26QR1 type=write size=1576706 2024-09-22T08:25:17.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.721+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~4HPO02EUMH6K.0 size=1048576 2024-09-22T08:25:17.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.722+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~4HPO02EUMH6K.1 size=694590 2024-09-22T08:25:17.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.722+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=4HPO02EUMH6K tag=QKVX8T9GH4LC type=write size=2791742 2024-09-22T08:25:17.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.723+0000 7f8a8d811780 1 < completed write operation key=7LLAS815MLFH tag=1WNZHW1N2807 type=write size=853122 2024-09-22T08:25:17.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.725+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=AY8RAFR8C3I7 type=del size=1059491 2024-09-22T08:25:17.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.726+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~DWA6OWBT8MU0.0 size=1014318 2024-09-22T08:25:17.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.729+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=DWA6OWBT8MU0 tag=K4MRCKQU25YH type=write size=2062894 2024-09-22T08:25:17.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.731+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~BBJDRAWZRX6Q.0 size=1048576 2024-09-22T08:25:17.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.732+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~BBJDRAWZRX6Q.1 size=215371 2024-09-22T08:25:17.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.732+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=BBJDRAWZRX6Q tag=7DVK9HJY1IB7 type=write size=2312523 2024-09-22T08:25:17.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.733+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.0 size=1048576 2024-09-22T08:25:17.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.735+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.1 size=1048576 2024-09-22T08:25:17.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.736+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~TQCUVK2WS0N9.2 size=936063 2024-09-22T08:25:17.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.738+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=TQCUVK2WS0N9 tag=OAR91FMMA8M5 type=write size=4081791 2024-09-22T08:25:17.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.739+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=YCZJ0HHEC6BT type=del size=2716041 2024-09-22T08:25:17.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.742+0000 7f8a8d811780 1 < suggested update operation key=RRTLTMWJIWSW tag=NIHVSHYGSLDH type=write size=434876 2024-09-22T08:25:17.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.743+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=T7ZBAZM8C2ZJ type=del size=3170944 2024-09-22T08:25:17.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.744+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~OXZ420TABI4E.0 size=141391 2024-09-22T08:25:17.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.746+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=OXZ420TABI4E tag=8TZZNBT3BTB1 type=write size=1189967 2024-09-22T08:25:17.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.748+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=JRC9MJDNYP6E type=write size=152473 2024-09-22T08:25:17.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.750+0000 7f8a8d811780 -1 < failed to complete operation key=JP7IZ0CMXTSX tag=UM5OKS47BXNJ type=del size=410975: (22) Invalid argument 2024-09-22T08:25:17.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.753+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.0 size=1048576 2024-09-22T08:25:17.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.754+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.1 size=1048576 2024-09-22T08:25:17.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.755+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.2 size=936532 2024-09-22T08:25:17.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.755+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=FM38W9BKTSWN tag=5FFEPTG1N9LE type=write size=4082260 2024-09-22T08:25:17.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.756+0000 7f8a8d811780 1 < canceled operation key=RCHUCAL6CQ4F tag=LWZKFGPQ36AO type=del size=3265893 2024-09-22T08:25:17.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.759+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.0 size=1048576 2024-09-22T08:25:17.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.760+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.1 size=1048576 2024-09-22T08:25:17.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.761+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.2 size=66910 2024-09-22T08:25:17.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.761+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=MEO2YIBFR6W3 tag=DN3GGCYPAMT3 type=write size=3212638 2024-09-22T08:25:17.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.762+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~RHXJK43MION2.0 size=423562 2024-09-22T08:25:17.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.765+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=RHXJK43MION2 tag=MI7TPP44UCE5 type=write size=1472138 2024-09-22T08:25:17.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.766+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=NGMZ2MP75PCS type=del size=2632146 2024-09-22T08:25:17.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.767+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=W2ZWZV1XT9XF type=del 2024-09-22T08:25:17.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.770+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~HOJ3CB80OB4L.0 size=1048576 2024-09-22T08:25:17.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.771+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~HOJ3CB80OB4L.1 size=100532 2024-09-22T08:25:17.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.771+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=HOJ3CB80OB4L tag=WZPYB0BCM499 type=write size=2197684 2024-09-22T08:25:17.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.774+0000 7f8a8d811780 1 < suggested update operation key=LRFF14FU7C5I tag=Z61URN73R43N type=del size=2607857 2024-09-22T08:25:17.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.777+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~110IS2DCE4JY.0 size=1048576 2024-09-22T08:25:17.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.777+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~110IS2DCE4JY.1 size=830337 2024-09-22T08:25:17.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.777+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=110IS2DCE4JY tag=SX5NG3I4ACEW type=write size=2927489 2024-09-22T08:25:17.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.779+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=1EBIFTX996NZ type=del 2024-09-22T08:25:17.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.782+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~XRGL9S4GMX7A.0 size=804325 2024-09-22T08:25:17.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.782+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=XRGL9S4GMX7A tag=BMGWMUGRU42M type=write size=1852901 2024-09-22T08:25:17.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.784+0000 7f8a8d811780 1 < suggested remove operation key=JWJ9T6XYCUYR tag=9WP4BLKIWF31 type=del 2024-09-22T08:25:17.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.786+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=KKK04Q6M1B03 type=del size=1463028 2024-09-22T08:25:17.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.787+0000 7f8a8d811780 1 < canceled operation key=T5IAHQ3CUIFR tag=9KA6OIZS5YVH type=write size=199231 2024-09-22T08:25:17.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.788+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=39YDLXCQ9URA type=del size=3621595 2024-09-22T08:25:17.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.790+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=UL2M446VMTGV type=del 2024-09-22T08:25:17.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.792+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~5AMR5U3ZTB30.0 size=1048576 2024-09-22T08:25:17.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.794+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~5AMR5U3ZTB30.1 size=799240 2024-09-22T08:25:17.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.794+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=5AMR5U3ZTB30 tag=EPEWH96Q4HTO type=write size=2896392 2024-09-22T08:25:17.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.796+0000 7f8a8d811780 -1 < failed to complete operation key=LRFF14FU7C5I tag=8TN933JCSKTB type=del size=2210487: (22) Invalid argument 2024-09-22T08:25:17.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.798+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.0 size=1048576 2024-09-22T08:25:17.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.799+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.1 size=1048576 2024-09-22T08:25:17.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.800+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.2 size=394055 2024-09-22T08:25:17.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.800+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=MGNS6S8TQ1YH tag=NCG4IGWMNAQT type=write size=3539783 2024-09-22T08:25:17.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.801+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~4HPO02EUMH6K.0 size=1048576 2024-09-22T08:25:17.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.803+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~4HPO02EUMH6K.1 size=694590 2024-09-22T08:25:17.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.805+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=4HPO02EUMH6K tag=QKVX8T9GH4LC type=write size=2791742 2024-09-22T08:25:17.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.806+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=U03E04KQ7Z1V type=del size=1803166 2024-09-22T08:25:17.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.808+0000 7f8a8d811780 -1 < failed to complete operation key=LRFF14FU7C5I tag=AY8RAFR8C3I7 type=del size=1059491: (22) Invalid argument 2024-09-22T08:25:17.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.810+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.0 size=1048576 2024-09-22T08:25:17.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.811+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.1 size=1048576 2024-09-22T08:25:17.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.813+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.2 size=263883 2024-09-22T08:25:17.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.813+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=26V86NE7UV9I tag=SJGV5SF9XWCC type=write size=3409611 2024-09-22T08:25:17.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.815+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~BBJDRAWZRX6Q.0 size=1048576 2024-09-22T08:25:17.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.816+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~BBJDRAWZRX6Q.1 size=215371 2024-09-22T08:25:17.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.818+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=BBJDRAWZRX6Q tag=7DVK9HJY1IB7 type=write size=2312523 2024-09-22T08:25:17.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.820+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=2WY9242UQ0V1 type=write size=901030 2024-09-22T08:25:17.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.821+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=YCZJ0HHEC6BT type=del 2024-09-22T08:25:17.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.823+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=06D3HVL1IID0 type=del size=1117746 2024-09-22T08:25:17.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.825+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=T7ZBAZM8C2ZJ type=del size=3170944 2024-09-22T08:25:17.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.827+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=KSXQ8QG5YVYJ type=del size=2816663 2024-09-22T08:25:17.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.828+0000 7f8a8d811780 1 < completed write operation key=T5IAHQ3CUIFR tag=JRC9MJDNYP6E type=write size=152473 2024-09-22T08:25:17.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.830+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=CW8EVYZZRN23 type=write size=555850 2024-09-22T08:25:17.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.831+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.0 size=1048576 2024-09-22T08:25:17.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.832+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.1 size=1048576 2024-09-22T08:25:17.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.833+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~FM38W9BKTSWN.2 size=936532 2024-09-22T08:25:17.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.836+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=FM38W9BKTSWN tag=5FFEPTG1N9LE type=write size=4082260 2024-09-22T08:25:17.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.837+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=8D4EYE7SR5P8 type=del size=458397 2024-09-22T08:25:17.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.840+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.0 size=1048576 2024-09-22T08:25:17.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.841+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.1 size=1048576 2024-09-22T08:25:17.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.841+0000 7f8a8d811780 1 < canceled part key=_multipart_QE6XEMOZMCF1.2~MEO2YIBFR6W3.2 size=66910 2024-09-22T08:25:17.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.843+0000 7f8a8d811780 1 < canceled multipart upload key=QE6XEMOZMCF1 upload=MEO2YIBFR6W3 tag=DN3GGCYPAMT3 type=write size=3212638 2024-09-22T08:25:17.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.844+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=4Z6RJL23ORYS type=del size=951241 2024-09-22T08:25:17.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.847+0000 7f8a8d811780 1 < suggested remove operation key=7XBR6QIHD8TJ tag=NGMZ2MP75PCS type=del 2024-09-22T08:25:17.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.848+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=HEFWHT4GP0ZY type=del size=487910 2024-09-22T08:25:17.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.851+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~HOJ3CB80OB4L.0 size=1048576 2024-09-22T08:25:17.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.851+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~HOJ3CB80OB4L.1 size=100532 2024-09-22T08:25:17.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.855+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=HOJ3CB80OB4L tag=WZPYB0BCM499 type=write size=2197684 2024-09-22T08:25:17.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.855+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=LFIDRD2AKX6Q type=write size=361234 2024-09-22T08:25:17.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.857+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~110IS2DCE4JY.0 size=1048576 2024-09-22T08:25:17.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.858+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~110IS2DCE4JY.1 size=830337 2024-09-22T08:25:17.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.860+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=110IS2DCE4JY tag=SX5NG3I4ACEW type=write size=2927489 2024-09-22T08:25:17.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.861+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=KSVV2S3FXZIF type=del size=1431489 2024-09-22T08:25:17.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.863+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~XRGL9S4GMX7A.0 size=804325 2024-09-22T08:25:17.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.865+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=XRGL9S4GMX7A tag=BMGWMUGRU42M type=write size=1852901 2024-09-22T08:25:17.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.866+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=N0N0SQ6C15SW type=del size=2064062 2024-09-22T08:25:17.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.868+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=KKK04Q6M1B03 type=del 2024-09-22T08:25:17.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.869+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=PKCVZNIND8Y7 type=del size=1928559 2024-09-22T08:25:17.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.871+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=39YDLXCQ9URA type=del 2024-09-22T08:25:17.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.872+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=FX09XOSUNJAQ type=del size=2666531 2024-09-22T08:25:17.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.874+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~5AMR5U3ZTB30.0 size=1048576 2024-09-22T08:25:17.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.875+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~5AMR5U3ZTB30.1 size=799240 2024-09-22T08:25:17.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.877+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=5AMR5U3ZTB30 tag=EPEWH96Q4HTO type=write size=2896392 2024-09-22T08:25:17.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.879+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.0 size=1048576 2024-09-22T08:25:17.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.880+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.1 size=1048576 2024-09-22T08:25:17.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.881+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.2 size=421182 2024-09-22T08:25:17.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.881+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=6IAD089Y7FEE tag=ISF67X4HXPLY type=write size=3566910 2024-09-22T08:25:17.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.882+0000 7f8a8d811780 1 < canceled part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.0 size=1048576 2024-09-22T08:25:17.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.883+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.1 size=1048576 2024-09-22T08:25:17.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.884+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~MGNS6S8TQ1YH.2 size=394055 2024-09-22T08:25:17.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.886+0000 7f8a8d811780 1 < canceled multipart upload key=1719KI1YP1FT upload=MGNS6S8TQ1YH tag=NCG4IGWMNAQT type=write size=3539783 2024-09-22T08:25:17.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.890+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~UEM2A9H4M6C5.0 size=1048576 2024-09-22T08:25:17.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.890+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~UEM2A9H4M6C5.1 size=490574 2024-09-22T08:25:17.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.890+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=UEM2A9H4M6C5 tag=11OUFZNW8CR2 type=write size=2587726 2024-09-22T08:25:17.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.891+0000 7f8a8d811780 1 < canceled operation key=S9JCKGZS5QLY tag=U03E04KQ7Z1V type=del size=1803166 2024-09-22T08:25:17.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.893+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=G49BAEH76M24 type=del size=2331692 2024-09-22T08:25:17.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.893+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.0 size=1048576 2024-09-22T08:25:17.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.894+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.1 size=1048576 2024-09-22T08:25:17.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.895+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~26V86NE7UV9I.2 size=263883 2024-09-22T08:25:17.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.897+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=26V86NE7UV9I tag=SJGV5SF9XWCC type=write size=3409611 2024-09-22T08:25:17.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.901+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~5AI7ZJGN22R0.0 size=1048576 2024-09-22T08:25:17.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.902+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~5AI7ZJGN22R0.1 size=54907 2024-09-22T08:25:17.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.902+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=5AI7ZJGN22R0 tag=9570CPBJV8SQ type=write size=2152059 2024-09-22T08:25:17.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.903+0000 7f8a8d811780 -1 < failed to complete operation key=0HCXP53D9NMP tag=2WY9242UQ0V1 type=write size=901030: (22) Invalid argument 2024-09-22T08:25:17.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.904+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=155ZGCLH6H0U type=del size=3415757 2024-09-22T08:25:17.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.905+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=06D3HVL1IID0 type=del 2024-09-22T08:25:17.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.908+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.0 size=1048576 2024-09-22T08:25:17.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.909+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.1 size=1048576 2024-09-22T08:25:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.910+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.2 size=885055 2024-09-22T08:25:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.910+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=6BV0VX201PVD tag=HL6URNHQ274H type=write size=4030783 2024-09-22T08:25:17.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.913+0000 7f8a8d811780 1 < suggested remove operation key=226G7R10IR1B tag=KSXQ8QG5YVYJ type=del 2024-09-22T08:25:17.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.915+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~TEA5CRZNTXS7.0 size=631122 2024-09-22T08:25:17.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.915+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=TEA5CRZNTXS7 tag=F0G8WJUUNPO8 type=write size=1679698 2024-09-22T08:25:17.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.916+0000 7f8a8d811780 -1 < failed to complete operation key=7XBR6QIHD8TJ tag=CW8EVYZZRN23 type=write size=555850: (22) Invalid argument 2024-09-22T08:25:17.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.918+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.0 size=1048576 2024-09-22T08:25:17.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.919+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.1 size=1048576 2024-09-22T08:25:17.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.920+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.2 size=436817 2024-09-22T08:25:17.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.920+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=PESUXL0NFUWF tag=BP5N7ESMWQZ3 type=write size=3582545 2024-09-22T08:25:17.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.922+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=8D4EYE7SR5P8 type=del 2024-09-22T08:25:17.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.923+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=BQZULBKLT90W type=del size=1798068 2024-09-22T08:25:17.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.924+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=4Z6RJL23ORYS type=del 2024-09-22T08:25:17.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.926+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=88PXMRGS468Y type=del size=3413442 2024-09-22T08:25:17.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.928+0000 7f8a8d811780 1 < suggested remove operation key=226G7R10IR1B tag=HEFWHT4GP0ZY type=del 2024-09-22T08:25:17.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.929+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=0SJOEQFJ2TMW type=del size=928549 2024-09-22T08:25:17.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.931+0000 7f8a8d811780 1 < completed write operation key=QE6XEMOZMCF1 tag=LFIDRD2AKX6Q type=write size=361234 2024-09-22T08:25:17.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.934+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.0 size=1048576 2024-09-22T08:25:17.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.935+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.1 size=1048576 2024-09-22T08:25:17.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.936+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.2 size=613282 2024-09-22T08:25:17.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.936+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=YZCXS7D6HC2L tag=RX5VM0BTJYA7 type=write size=3759010 2024-09-22T08:25:17.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.938+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=KSVV2S3FXZIF type=del 2024-09-22T08:25:17.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.940+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~KNDDLPKW8ZER.0 size=187800 2024-09-22T08:25:17.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.940+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=KNDDLPKW8ZER tag=6Z2NMP8WES6P type=write size=1236376 2024-09-22T08:25:17.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.941+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=N0N0SQ6C15SW type=del 2024-09-22T08:25:17.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.947+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~9XDLPHDLBXHQ.0 size=1048576 2024-09-22T08:25:17.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.947+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~9XDLPHDLBXHQ.1 size=110471 2024-09-22T08:25:17.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.947+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=9XDLPHDLBXHQ tag=0L34GPZBZKMY type=write size=2207623 2024-09-22T08:25:17.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.951+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=PKCVZNIND8Y7 type=del 2024-09-22T08:25:17.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.952+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=T4SY18KK4WHJ type=del size=636888 2024-09-22T08:25:17.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.953+0000 7f8a8d811780 1 < canceled operation key=0AOI0OB2YFVV tag=FX09XOSUNJAQ type=del size=2666531 2024-09-22T08:25:17.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.954+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=ZEYD2ANF3AA2 type=del size=2355372 2024-09-22T08:25:17.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.956+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.0 size=1048576 2024-09-22T08:25:17.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.957+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.1 size=1048576 2024-09-22T08:25:17.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.958+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6IAD089Y7FEE.2 size=421182 2024-09-22T08:25:17.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.960+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=6IAD089Y7FEE tag=ISF67X4HXPLY type=write size=3566910 2024-09-22T08:25:17.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.962+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=QFHKG37QUNB3 type=write size=586494 2024-09-22T08:25:17.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.963+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~UEM2A9H4M6C5.0 size=1048576 2024-09-22T08:25:17.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.964+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~UEM2A9H4M6C5.1 size=490574 2024-09-22T08:25:17.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.966+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=UEM2A9H4M6C5 tag=11OUFZNW8CR2 type=write size=2587726 2024-09-22T08:25:17.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.968+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=PZYOXYSJO07F type=write size=692598 2024-09-22T08:25:17.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.969+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=G49BAEH76M24 type=del 2024-09-22T08:25:17.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.971+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=QE7QKBFBH6LK type=del size=49570 2024-09-22T08:25:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.972+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~5AI7ZJGN22R0.0 size=1048576 2024-09-22T08:25:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.972+0000 7f8a8d811780 1 < canceled part key=_multipart_7XNMR51803Y6.2~5AI7ZJGN22R0.1 size=54907 2024-09-22T08:25:17.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.974+0000 7f8a8d811780 1 < canceled multipart upload key=7XNMR51803Y6 upload=5AI7ZJGN22R0 tag=9570CPBJV8SQ type=write size=2152059 2024-09-22T08:25:17.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.977+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~I8X6ID6DHCFG.0 size=1048576 2024-09-22T08:25:17.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.978+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~I8X6ID6DHCFG.1 size=386041 2024-09-22T08:25:17.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.978+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=I8X6ID6DHCFG tag=JF35VK4A3ZBJ type=write size=2483193 2024-09-22T08:25:17.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.979+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=155ZGCLH6H0U type=del 2024-09-22T08:25:17.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.981+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=Z8E603JALJ8D type=del size=1178994 2024-09-22T08:25:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.982+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.0 size=1048576 2024-09-22T08:25:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.983+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.1 size=1048576 2024-09-22T08:25:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.984+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6BV0VX201PVD.2 size=885055 2024-09-22T08:25:17.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.987+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=6BV0VX201PVD tag=HL6URNHQ274H type=write size=4030783 2024-09-22T08:25:17.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.988+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=H2IYE46HY0C5 type=del size=681716 2024-09-22T08:25:17.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.990+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~TEA5CRZNTXS7.0 size=631122 2024-09-22T08:25:17.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.992+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=TEA5CRZNTXS7 tag=F0G8WJUUNPO8 type=write size=1679698 2024-09-22T08:25:17.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.993+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=5KCPL2TUHH72 type=write size=210991 2024-09-22T08:25:17.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.994+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.0 size=1048576 2024-09-22T08:25:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.996+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.1 size=1048576 2024-09-22T08:25:17.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.997+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~PESUXL0NFUWF.2 size=436817 2024-09-22T08:25:18.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:17.999+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=PESUXL0NFUWF tag=BP5N7ESMWQZ3 type=write size=3582545 2024-09-22T08:25:18.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.002+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~24SZADKB0YKX.0 size=1012401 2024-09-22T08:25:18.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.002+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=24SZADKB0YKX tag=SXE272FUHIWU type=write size=2060977 2024-09-22T08:25:18.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.003+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=BQZULBKLT90W type=del 2024-09-22T08:25:18.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.005+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=9Y6BDG33NMDB type=del size=1231488 2024-09-22T08:25:18.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.006+0000 7f8a8d811780 -1 < failed to complete operation key=226G7R10IR1B tag=88PXMRGS468Y type=del size=3413442: (22) Invalid argument 2024-09-22T08:25:18.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.009+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=777WZ38XF327 type=del size=281823 2024-09-22T08:25:18.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.009+0000 7f8a8d811780 1 < canceled operation key=RL59H41J8ZNF tag=0SJOEQFJ2TMW type=del size=928549 2024-09-22T08:25:18.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.011+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=TII3404FBS01 type=del size=1226936 2024-09-22T08:25:18.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.013+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.0 size=1048576 2024-09-22T08:25:18.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.014+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.1 size=1048576 2024-09-22T08:25:18.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.015+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~YZCXS7D6HC2L.2 size=613282 2024-09-22T08:25:18.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.017+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=YZCXS7D6HC2L tag=RX5VM0BTJYA7 type=write size=3759010 2024-09-22T08:25:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.019+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=S60542I6SCAO type=del size=962312 2024-09-22T08:25:18.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.020+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~KNDDLPKW8ZER.0 size=187800 2024-09-22T08:25:18.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.023+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=KNDDLPKW8ZER tag=6Z2NMP8WES6P type=write size=1236376 2024-09-22T08:25:18.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.025+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.0 size=1048576 2024-09-22T08:25:18.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.026+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.1 size=1048576 2024-09-22T08:25:18.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.028+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.2 size=123286 2024-09-22T08:25:18.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.028+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=X4V9MHWPLTE3 tag=CE1GHFA8C9D2 type=write size=3269014 2024-09-22T08:25:18.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.028+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~9XDLPHDLBXHQ.0 size=1048576 2024-09-22T08:25:18.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.030+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~9XDLPHDLBXHQ.1 size=110471 2024-09-22T08:25:18.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.033+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=9XDLPHDLBXHQ tag=0L34GPZBZKMY type=write size=2207623 2024-09-22T08:25:18.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.033+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=804NBMYW2J4N type=del size=545641 2024-09-22T08:25:18.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.036+0000 7f8a8d811780 1 < suggested update operation key=RRTLTMWJIWSW tag=T4SY18KK4WHJ type=del size=636888 2024-09-22T08:25:18.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.038+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=E78W04UUZ3QI type=del size=924624 2024-09-22T08:25:18.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.039+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=ZEYD2ANF3AA2 type=del 2024-09-22T08:25:18.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.042+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~2EMSLTY4MN4F.0 size=448427 2024-09-22T08:25:18.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.042+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=2EMSLTY4MN4F tag=D3XHTD8E5MGK type=write size=1497003 2024-09-22T08:25:18.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.043+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=QFHKG37QUNB3 type=write size=586494 2024-09-22T08:25:18.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.045+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=JKF1WIGMCRV9 type=del size=338740 2024-09-22T08:25:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.046+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=PZYOXYSJO07F type=write size=692598 2024-09-22T08:25:18.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.047+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=S9RC56G3WSWV type=write size=573981 2024-09-22T08:25:18.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.048+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=QE7QKBFBH6LK type=del 2024-09-22T08:25:18.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.050+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=Y1ND72M1981R type=write size=946603 2024-09-22T08:25:18.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.051+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~I8X6ID6DHCFG.0 size=1048576 2024-09-22T08:25:18.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.052+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~I8X6ID6DHCFG.1 size=386041 2024-09-22T08:25:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.055+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=I8X6ID6DHCFG tag=JF35VK4A3ZBJ type=write size=2483193 2024-09-22T08:25:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.057+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~13JEL98SDOSZ.0 size=167959 2024-09-22T08:25:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.057+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=13JEL98SDOSZ tag=WT4QIB2K37Q1 type=write size=1216535 2024-09-22T08:25:18.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.060+0000 7f8a8d811780 1 < suggested remove operation key=3T2TX83CSE2D tag=Z8E603JALJ8D type=del 2024-09-22T08:25:18.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.062+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~1R2QX0JB12VH.0 size=580430 2024-09-22T08:25:18.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.062+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=1R2QX0JB12VH tag=XTSNEO55JVQB type=write size=1629006 2024-09-22T08:25:18.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.063+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=H2IYE46HY0C5 type=del 2024-09-22T08:25:18.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.066+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.0 size=1048576 2024-09-22T08:25:18.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.067+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.1 size=1048576 2024-09-22T08:25:18.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.068+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.2 size=969055 2024-09-22T08:25:18.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.068+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=GGDQTSUH677K tag=8PKGKJ1Z5M1Q type=write size=4114783 2024-09-22T08:25:18.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.071+0000 7f8a8d811780 1 < suggested update operation key=RL59H41J8ZNF tag=5KCPL2TUHH72 type=write size=210991 2024-09-22T08:25:18.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.072+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=JAUUZ23OW902 type=write size=316879 2024-09-22T08:25:18.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.074+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~24SZADKB0YKX.0 size=1012401 2024-09-22T08:25:18.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.077+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=24SZADKB0YKX tag=SXE272FUHIWU type=write size=2060977 2024-09-22T08:25:18.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.078+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=B72PD96RA1S6 type=del size=3705263 2024-09-22T08:25:18.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.080+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=9Y6BDG33NMDB type=del 2024-09-22T08:25:18.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.082+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~UODUVPBSX0GY.0 size=1048576 2024-09-22T08:25:18.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.083+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~UODUVPBSX0GY.1 size=29148 2024-09-22T08:25:18.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.083+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=UODUVPBSX0GY tag=KRRW66K0HOB2 type=write size=2126300 2024-09-22T08:25:18.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.085+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=777WZ38XF327 type=del 2024-09-22T08:25:18.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.086+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=OLVKH6KKNUFQ type=write size=688494 2024-09-22T08:25:18.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.088+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=TII3404FBS01 type=del 2024-09-22T08:25:18.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.089+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=1GXL3U7AZM1N type=del size=3638357 2024-09-22T08:25:18.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.090+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=S60542I6SCAO type=del 2024-09-22T08:25:18.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.092+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=LZBTQDU4PXYZ type=del size=3957697 2024-09-22T08:25:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.093+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.0 size=1048576 2024-09-22T08:25:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.093+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.1 size=1048576 2024-09-22T08:25:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.093+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~X4V9MHWPLTE3.2 size=123286 2024-09-22T08:25:18.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.095+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=X4V9MHWPLTE3 tag=CE1GHFA8C9D2 type=write size=3269014 2024-09-22T08:25:18.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.097+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=7MO1XN7PMGLL type=del size=3886841 2024-09-22T08:25:18.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.098+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=804NBMYW2J4N type=del 2024-09-22T08:25:18.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.099+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=D3GCVDWSXCH3 type=del size=3224688 2024-09-22T08:25:18.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.101+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=E78W04UUZ3QI type=del 2024-09-22T08:25:18.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.102+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=BG08PFWQ3SV2 type=del size=3736914 2024-09-22T08:25:18.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.104+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~2EMSLTY4MN4F.0 size=448427 2024-09-22T08:25:18.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.107+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=2EMSLTY4MN4F tag=D3XHTD8E5MGK type=write size=1497003 2024-09-22T08:25:18.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.109+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=NBCAU3A31PKO type=del size=2755111 2024-09-22T08:25:18.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.109+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=JKF1WIGMCRV9 type=del 2024-09-22T08:25:18.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.112+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~2A4AEKZVLU1I.0 size=1048576 2024-09-22T08:25:18.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.113+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~2A4AEKZVLU1I.1 size=362010 2024-09-22T08:25:18.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.113+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=2A4AEKZVLU1I tag=QBM2NDH71XMD type=write size=2459162 2024-09-22T08:25:18.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.114+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=S9RC56G3WSWV type=write size=573981 2024-09-22T08:25:18.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.116+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=3S7NRSINJGCW type=del size=249146 2024-09-22T08:25:18.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.117+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=Y1ND72M1981R type=write size=946603 2024-09-22T08:25:18.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.119+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=287HG1KDF3XG type=del size=2428093 2024-09-22T08:25:18.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.120+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~13JEL98SDOSZ.0 size=167959 2024-09-22T08:25:18.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.122+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=13JEL98SDOSZ tag=WT4QIB2K37Q1 type=write size=1216535 2024-09-22T08:25:18.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.124+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=FJ3SRP1R1IVC type=del size=566333 2024-09-22T08:25:18.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.125+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~1R2QX0JB12VH.0 size=580430 2024-09-22T08:25:18.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.128+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=1R2QX0JB12VH tag=XTSNEO55JVQB type=write size=1629006 2024-09-22T08:25:18.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.129+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=5F9GH4DN4ANF type=del size=2811014 2024-09-22T08:25:18.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.130+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.0 size=1048576 2024-09-22T08:25:18.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.131+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.1 size=1048576 2024-09-22T08:25:18.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.131+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~GGDQTSUH677K.2 size=969055 2024-09-22T08:25:18.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.134+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=GGDQTSUH677K tag=8PKGKJ1Z5M1Q type=write size=4114783 2024-09-22T08:25:18.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.135+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=2OPG95EY0LVY type=del size=803061 2024-09-22T08:25:18.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.136+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=JAUUZ23OW902 type=write size=316879 2024-09-22T08:25:18.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.138+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.0 size=1048576 2024-09-22T08:25:18.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.140+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.1 size=1048576 2024-09-22T08:25:18.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.141+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.2 size=455331 2024-09-22T08:25:18.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.141+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=6ZGWOW6DUS2I tag=48I7OYEDQW40 type=write size=3601059 2024-09-22T08:25:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.142+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=B72PD96RA1S6 type=del 2024-09-22T08:25:18.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.144+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~GQ9WEXWKHZWD.0 size=1010572 2024-09-22T08:25:18.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.144+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=GQ9WEXWKHZWD tag=GE7WY4C3GGJU type=write size=2059148 2024-09-22T08:25:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.145+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~UODUVPBSX0GY.0 size=1048576 2024-09-22T08:25:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.146+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~UODUVPBSX0GY.1 size=29148 2024-09-22T08:25:18.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.149+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=UODUVPBSX0GY tag=KRRW66K0HOB2 type=write size=2126300 2024-09-22T08:25:18.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.151+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.0 size=1048576 2024-09-22T08:25:18.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.152+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.1 size=1048576 2024-09-22T08:25:18.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.154+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.2 size=332165 2024-09-22T08:25:18.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.154+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=Q2583YVYZJ2I tag=UJFQFMX391HU type=write size=3477893 2024-09-22T08:25:18.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.155+0000 7f8a8d811780 1 < canceled operation key=RL59H41J8ZNF tag=OLVKH6KKNUFQ type=write size=688494 2024-09-22T08:25:18.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.158+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.0 size=1048576 2024-09-22T08:25:18.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.158+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.1 size=1048576 2024-09-22T08:25:18.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.160+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.2 size=133210 2024-09-22T08:25:18.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.160+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=E6512H1YA3ER tag=A49JIQZKD0X3 type=write size=3278938 2024-09-22T08:25:18.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.162+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=1GXL3U7AZM1N type=del 2024-09-22T08:25:18.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.163+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=WOQ95Z7GK82A type=del size=672881 2024-09-22T08:25:18.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.164+0000 7f8a8d811780 1 < canceled operation key=9EY50PUC6AJJ tag=LZBTQDU4PXYZ type=del size=3957697 2024-09-22T08:25:18.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.166+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=95NSFYPGL3N2 type=del size=689871 2024-09-22T08:25:18.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.167+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=7MO1XN7PMGLL type=del 2024-09-22T08:25:18.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.170+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.0 size=1048576 2024-09-22T08:25:18.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.172+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.1 size=1048576 2024-09-22T08:25:18.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.172+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.2 size=362554 2024-09-22T08:25:18.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.172+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=2QN805D93QYZ tag=53HQTDN5SPD6 type=write size=3508282 2024-09-22T08:25:18.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.174+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=D3GCVDWSXCH3 type=del 2024-09-22T08:25:18.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.175+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=I30QC93T3FHK type=del size=1492769 2024-09-22T08:25:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.177+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=BG08PFWQ3SV2 type=del 2024-09-22T08:25:18.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.181+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.0 size=1048576 2024-09-22T08:25:18.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.181+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.1 size=1048576 2024-09-22T08:25:18.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.182+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.2 size=144947 2024-09-22T08:25:18.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.182+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=AVPAGS86GJBE tag=TLEF25KMC6UA type=write size=3290675 2024-09-22T08:25:18.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.184+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=NBCAU3A31PKO type=del 2024-09-22T08:25:18.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.185+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=KWW1ZHNIGW9H type=del size=2290144 2024-09-22T08:25:18.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.187+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~2A4AEKZVLU1I.0 size=1048576 2024-09-22T08:25:18.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.188+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~2A4AEKZVLU1I.1 size=362010 2024-09-22T08:25:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.191+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=2A4AEKZVLU1I tag=QBM2NDH71XMD type=write size=2459162 2024-09-22T08:25:18.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.192+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=XVDFQM1WQXAH type=del size=2437689 2024-09-22T08:25:18.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.193+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=3S7NRSINJGCW type=del 2024-09-22T08:25:18.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.195+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=IUJFTVRS3S2K type=del size=2195531 2024-09-22T08:25:18.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.196+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=287HG1KDF3XG type=del 2024-09-22T08:25:18.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.199+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~MEEP72YBZFP5.0 size=1013443 2024-09-22T08:25:18.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.199+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=MEEP72YBZFP5 tag=NQYF8HE3OHX8 type=write size=2062019 2024-09-22T08:25:18.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.201+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=FJ3SRP1R1IVC type=del 2024-09-22T08:25:18.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.204+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.0 size=1048576 2024-09-22T08:25:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.205+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.1 size=1048576 2024-09-22T08:25:18.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.205+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.2 size=679912 2024-09-22T08:25:18.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.205+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=CIPKQBCK3OXA tag=45GU45VFRKSQ type=write size=3825640 2024-09-22T08:25:18.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.207+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=5F9GH4DN4ANF type=del 2024-09-22T08:25:18.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.210+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~CIYFHIFQI4BB.0 size=1048576 2024-09-22T08:25:18.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.213+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~CIYFHIFQI4BB.1 size=470220 2024-09-22T08:25:18.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.213+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=CIYFHIFQI4BB tag=XYY8Q7B9TYBR type=write size=2567372 2024-09-22T08:25:18.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.213+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=2OPG95EY0LVY type=del 2024-09-22T08:25:18.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.215+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=JCD2IR7Y67FU type=del size=3978364 2024-09-22T08:25:18.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.216+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.0 size=1048576 2024-09-22T08:25:18.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.218+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.1 size=1048576 2024-09-22T08:25:18.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.219+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~6ZGWOW6DUS2I.2 size=455331 2024-09-22T08:25:18.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.221+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=6ZGWOW6DUS2I tag=48I7OYEDQW40 type=write size=3601059 2024-09-22T08:25:18.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.223+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=6O3N3N0O0SXB type=del size=2809944 2024-09-22T08:25:18.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.225+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~GQ9WEXWKHZWD.0 size=1010572 2024-09-22T08:25:18.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.227+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=GQ9WEXWKHZWD tag=GE7WY4C3GGJU type=write size=2059148 2024-09-22T08:25:18.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.228+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=W5DUUQNPQ0F0 type=del size=2284329 2024-09-22T08:25:18.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.230+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.0 size=1048576 2024-09-22T08:25:18.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.231+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.1 size=1048576 2024-09-22T08:25:18.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.232+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~Q2583YVYZJ2I.2 size=332165 2024-09-22T08:25:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.234+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=Q2583YVYZJ2I tag=UJFQFMX391HU type=write size=3477893 2024-09-22T08:25:18.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.235+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=8MKW9BOAYDRO type=write size=470868 2024-09-22T08:25:18.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.237+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.0 size=1048576 2024-09-22T08:25:18.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.238+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.1 size=1048576 2024-09-22T08:25:18.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.239+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~E6512H1YA3ER.2 size=133210 2024-09-22T08:25:18.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.242+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=E6512H1YA3ER tag=A49JIQZKD0X3 type=write size=3278938 2024-09-22T08:25:18.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.243+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=8DP6NOAU5960 type=del size=1887108 2024-09-22T08:25:18.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.245+0000 7f8a8d811780 1 < canceled operation key=0HCXP53D9NMP tag=WOQ95Z7GK82A type=del size=672881 2024-09-22T08:25:18.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.246+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=GD0E0WVM37KP type=del size=1266975 2024-09-22T08:25:18.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.247+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=95NSFYPGL3N2 type=del 2024-09-22T08:25:18.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.249+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=VOULBJM1B2KL type=write size=1022472 2024-09-22T08:25:18.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.250+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.0 size=1048576 2024-09-22T08:25:18.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.251+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.1 size=1048576 2024-09-22T08:25:18.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.251+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~2QN805D93QYZ.2 size=362554 2024-09-22T08:25:18.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.254+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=2QN805D93QYZ tag=53HQTDN5SPD6 type=write size=3508282 2024-09-22T08:25:18.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.255+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=TVCK83TYP37U type=del size=4152830 2024-09-22T08:25:18.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.256+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=I30QC93T3FHK type=del 2024-09-22T08:25:18.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.258+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=6KV5QZES5N2T type=write size=921348 2024-09-22T08:25:18.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.259+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.0 size=1048576 2024-09-22T08:25:18.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.261+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.1 size=1048576 2024-09-22T08:25:18.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.262+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~AVPAGS86GJBE.2 size=144947 2024-09-22T08:25:18.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.264+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=AVPAGS86GJBE tag=TLEF25KMC6UA type=write size=3290675 2024-09-22T08:25:18.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.266+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=632ZFVOOK8TO type=del size=730129 2024-09-22T08:25:18.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.268+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=KWW1ZHNIGW9H type=del 2024-09-22T08:25:18.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.270+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.0 size=1048576 2024-09-22T08:25:18.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.271+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.1 size=1048576 2024-09-22T08:25:18.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.272+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.2 size=716780 2024-09-22T08:25:18.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.272+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=ZV3IDBNYDI21 tag=ZMTKGNLC8FCF type=write size=3862508 2024-09-22T08:25:18.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.275+0000 7f8a8d811780 1 < suggested remove operation key=WOSCCX4WX2FN tag=XVDFQM1WQXAH type=del 2024-09-22T08:25:18.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.278+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.0 size=1048576 2024-09-22T08:25:18.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.278+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.1 size=1048576 2024-09-22T08:25:18.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.279+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.2 size=786772 2024-09-22T08:25:18.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.279+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=Q3DKPWX7CTUY tag=WQ82601JW0S1 type=write size=3932500 2024-09-22T08:25:18.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.282+0000 7f8a8d811780 1 < suggested update operation key=7XNMR51803Y6 tag=IUJFTVRS3S2K type=del size=2195531 2024-09-22T08:25:18.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.284+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~IQQXP9I5YQ95.0 size=996495 2024-09-22T08:25:18.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.284+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=IQQXP9I5YQ95 tag=LVTPLFXN9NZQ type=write size=2045071 2024-09-22T08:25:18.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.286+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~MEEP72YBZFP5.0 size=1013443 2024-09-22T08:25:18.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.288+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=MEEP72YBZFP5 tag=NQYF8HE3OHX8 type=write size=2062019 2024-09-22T08:25:18.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.291+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.0 size=1048576 2024-09-22T08:25:18.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.292+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.1 size=1048576 2024-09-22T08:25:18.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.293+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.2 size=608707 2024-09-22T08:25:18.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.293+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=WBS83P1RTJCJ tag=28HN2TAAQ3NM type=write size=3754435 2024-09-22T08:25:18.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.293+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.0 size=1048576 2024-09-22T08:25:18.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.294+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.1 size=1048576 2024-09-22T08:25:18.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.295+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~CIPKQBCK3OXA.2 size=679912 2024-09-22T08:25:18.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.298+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=CIPKQBCK3OXA tag=45GU45VFRKSQ type=write size=3825640 2024-09-22T08:25:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.300+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~KQ8Q18SK31J6.0 size=818085 2024-09-22T08:25:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.300+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=KQ8Q18SK31J6 tag=4FXM3IIK2B0O type=write size=1866661 2024-09-22T08:25:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.302+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~CIYFHIFQI4BB.0 size=1048576 2024-09-22T08:25:18.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.303+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~CIYFHIFQI4BB.1 size=470220 2024-09-22T08:25:18.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.305+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=CIYFHIFQI4BB tag=XYY8Q7B9TYBR type=write size=2567372 2024-09-22T08:25:18.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.308+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~F722O49VJHDM.0 size=1048576 2024-09-22T08:25:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.309+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~F722O49VJHDM.1 size=524133 2024-09-22T08:25:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.309+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=F722O49VJHDM tag=913FTOK5KXBI type=write size=2621285 2024-09-22T08:25:18.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.311+0000 7f8a8d811780 1 < suggested remove operation key=3T2TX83CSE2D tag=JCD2IR7Y67FU type=del 2024-09-22T08:25:18.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.314+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~950U99C567JG.0 size=1048576 2024-09-22T08:25:18.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.315+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~950U99C567JG.1 size=764725 2024-09-22T08:25:18.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.315+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=950U99C567JG tag=TP7NPFFVWWDW type=write size=2861877 2024-09-22T08:25:18.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.316+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=6O3N3N0O0SXB type=del 2024-09-22T08:25:18.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.319+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~DGJM3Q57ZTAV.0 size=1048576 2024-09-22T08:25:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.320+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~DGJM3Q57ZTAV.1 size=264959 2024-09-22T08:25:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.320+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=DGJM3Q57ZTAV tag=HTW95XCKQGX2 type=write size=2362111 2024-09-22T08:25:18.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.321+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=W5DUUQNPQ0F0 type=del 2024-09-22T08:25:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.324+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.0 size=1048576 2024-09-22T08:25:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.325+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.1 size=1048576 2024-09-22T08:25:18.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.326+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.2 size=642441 2024-09-22T08:25:18.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.326+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=ASNGVI36ZQDN tag=X91MVCKRX1RE type=write size=3788169 2024-09-22T08:25:18.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.327+0000 7f8a8d811780 -1 < failed to complete operation key=3T2TX83CSE2D tag=8MKW9BOAYDRO type=write size=470868: (22) Invalid argument 2024-09-22T08:25:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.331+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~GMCC2NC5YKTJ.0 size=588639 2024-09-22T08:25:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.331+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=GMCC2NC5YKTJ tag=1EYXIX93XGQR type=write size=1637215 2024-09-22T08:25:18.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.332+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=8DP6NOAU5960 type=del 2024-09-22T08:25:18.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.333+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=FP39MWWORIMB type=del size=304515 2024-09-22T08:25:18.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.335+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=GD0E0WVM37KP type=del 2024-09-22T08:25:18.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.337+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=SSAASHVUG0JL type=write size=418651 2024-09-22T08:25:18.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.340+0000 7f8a8d811780 1 < suggested remove operation key=IOZ7IXVOB70S tag=VOULBJM1B2KL type=write 2024-09-22T08:25:18.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.342+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=QTB716NRYM70 type=write size=37681 2024-09-22T08:25:18.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.343+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=TVCK83TYP37U type=del 2024-09-22T08:25:18.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.346+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~VTW7IWXB81OY.0 size=1048576 2024-09-22T08:25:18.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.347+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~VTW7IWXB81OY.1 size=252996 2024-09-22T08:25:18.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.347+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=VTW7IWXB81OY tag=IC8RKKD66N12 type=write size=2350148 2024-09-22T08:25:18.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.348+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=6KV5QZES5N2T type=write size=921348 2024-09-22T08:25:18.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.350+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.0 size=1048576 2024-09-22T08:25:18.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.352+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.1 size=1048576 2024-09-22T08:25:18.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.353+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.2 size=100047 2024-09-22T08:25:18.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.353+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=X915IFMNG400 tag=HG82VSLYT5L1 type=write size=3245775 2024-09-22T08:25:18.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.354+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=632ZFVOOK8TO type=del 2024-09-22T08:25:18.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.356+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=2S7KOS06LQ1S type=del size=824277 2024-09-22T08:25:18.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.356+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.0 size=1048576 2024-09-22T08:25:18.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.358+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.1 size=1048576 2024-09-22T08:25:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.359+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~ZV3IDBNYDI21.2 size=716780 2024-09-22T08:25:18.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.362+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=ZV3IDBNYDI21 tag=ZMTKGNLC8FCF type=write size=3862508 2024-09-22T08:25:18.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.362+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=4WFOY3TS7UNF type=del size=4152674 2024-09-22T08:25:18.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.364+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.0 size=1048576 2024-09-22T08:25:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.365+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.1 size=1048576 2024-09-22T08:25:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.366+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~Q3DKPWX7CTUY.2 size=786772 2024-09-22T08:25:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.369+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=Q3DKPWX7CTUY tag=WQ82601JW0S1 type=write size=3932500 2024-09-22T08:25:18.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.371+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=L9W1M14ZVVFQ type=del size=515135 2024-09-22T08:25:18.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.372+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~IQQXP9I5YQ95.0 size=996495 2024-09-22T08:25:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.374+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=IQQXP9I5YQ95 tag=LVTPLFXN9NZQ type=write size=2045071 2024-09-22T08:25:18.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.377+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.0 size=1048576 2024-09-22T08:25:18.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.378+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.1 size=1048576 2024-09-22T08:25:18.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.379+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.2 size=606393 2024-09-22T08:25:18.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.379+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=L3R12LD20H30 tag=IYWADIHP1QHQ type=write size=3752121 2024-09-22T08:25:18.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.381+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.0 size=1048576 2024-09-22T08:25:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.382+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.1 size=1048576 2024-09-22T08:25:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.384+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~WBS83P1RTJCJ.2 size=608707 2024-09-22T08:25:18.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.385+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=WBS83P1RTJCJ tag=28HN2TAAQ3NM type=write size=3754435 2024-09-22T08:25:18.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.387+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=RHYXQRBMZV4W type=write size=390740 2024-09-22T08:25:18.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.388+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~KQ8Q18SK31J6.0 size=818085 2024-09-22T08:25:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.390+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=KQ8Q18SK31J6 tag=4FXM3IIK2B0O type=write size=1866661 2024-09-22T08:25:18.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.392+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=FF160YWA61CW type=del size=1763829 2024-09-22T08:25:18.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.392+0000 7f8a8d811780 1 < canceled part key=_multipart_T5IAHQ3CUIFR.2~F722O49VJHDM.0 size=1048576 2024-09-22T08:25:18.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.393+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~F722O49VJHDM.1 size=524133 2024-09-22T08:25:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.396+0000 7f8a8d811780 1 < canceled multipart upload key=T5IAHQ3CUIFR upload=F722O49VJHDM tag=913FTOK5KXBI type=write size=2621285 2024-09-22T08:25:18.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.397+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=RZS512CIKGUC type=del size=1080831 2024-09-22T08:25:18.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.398+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~950U99C567JG.0 size=1048576 2024-09-22T08:25:18.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.400+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~950U99C567JG.1 size=764725 2024-09-22T08:25:18.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.402+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=950U99C567JG tag=TP7NPFFVWWDW type=write size=2861877 2024-09-22T08:25:18.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.404+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~B8YR7DTK86W6.0 size=998878 2024-09-22T08:25:18.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.404+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=B8YR7DTK86W6 tag=NHACKRQGTICN type=write size=2047454 2024-09-22T08:25:18.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.405+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~DGJM3Q57ZTAV.0 size=1048576 2024-09-22T08:25:18.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.406+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~DGJM3Q57ZTAV.1 size=264959 2024-09-22T08:25:18.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.408+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=DGJM3Q57ZTAV tag=HTW95XCKQGX2 type=write size=2362111 2024-09-22T08:25:18.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.410+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=MKWC7E5ECEOD type=del size=3856226 2024-09-22T08:25:18.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.411+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.0 size=1048576 2024-09-22T08:25:18.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.412+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.1 size=1048576 2024-09-22T08:25:18.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.413+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~ASNGVI36ZQDN.2 size=642441 2024-09-22T08:25:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.415+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=ASNGVI36ZQDN tag=X91MVCKRX1RE type=write size=3788169 2024-09-22T08:25:18.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.418+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ZXV1P67K76KD.0 size=238134 2024-09-22T08:25:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.418+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=ZXV1P67K76KD tag=7JQE3IW5SOW3 type=write size=1286710 2024-09-22T08:25:18.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.419+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~GMCC2NC5YKTJ.0 size=588639 2024-09-22T08:25:18.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.422+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=GMCC2NC5YKTJ tag=1EYXIX93XGQR type=write size=1637215 2024-09-22T08:25:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.423+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=YKB0DGBCJZO1 type=write size=705532 2024-09-22T08:25:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.425+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=FP39MWWORIMB type=del 2024-09-22T08:25:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.426+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=I0W7ORDLJVEN type=del size=1946756 2024-09-22T08:25:18.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.427+0000 7f8a8d811780 1 < completed write operation key=WOSCCX4WX2FN tag=SSAASHVUG0JL type=write size=418651 2024-09-22T08:25:18.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.431+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.0 size=1048576 2024-09-22T08:25:18.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.432+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.1 size=1048576 2024-09-22T08:25:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.432+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.2 size=135130 2024-09-22T08:25:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.432+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=F9KBYAHVROJG tag=85U8EKIG9C96 type=write size=3280858 2024-09-22T08:25:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.434+0000 7f8a8d811780 1 < canceled operation key=1719KI1YP1FT tag=QTB716NRYM70 type=write size=37681 2024-09-22T08:25:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.435+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=E7NTR0R9QIGF type=write size=854387 2024-09-22T08:25:18.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.437+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~VTW7IWXB81OY.0 size=1048576 2024-09-22T08:25:18.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.438+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~VTW7IWXB81OY.1 size=252996 2024-09-22T08:25:18.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.440+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=VTW7IWXB81OY tag=IC8RKKD66N12 type=write size=2350148 2024-09-22T08:25:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.442+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~VG0VL8N3QNZV.0 size=1048576 2024-09-22T08:25:18.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.443+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~VG0VL8N3QNZV.1 size=560669 2024-09-22T08:25:18.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.443+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=VG0VL8N3QNZV tag=2ZMDQ0WP45B8 type=write size=2657821 2024-09-22T08:25:18.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.445+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.0 size=1048576 2024-09-22T08:25:18.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.446+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.1 size=1048576 2024-09-22T08:25:18.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.447+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~X915IFMNG400.2 size=100047 2024-09-22T08:25:18.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.450+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=X915IFMNG400 tag=HG82VSLYT5L1 type=write size=3245775 2024-09-22T08:25:18.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.450+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=WTEO7EH54JBW type=del size=606346 2024-09-22T08:25:18.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.452+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=2S7KOS06LQ1S type=del 2024-09-22T08:25:18.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.460+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=KHUTSUJ7K5Y1 type=del size=3779115 2024-09-22T08:25:18.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.462+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=4WFOY3TS7UNF type=del 2024-09-22T08:25:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.464+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.0 size=1048576 2024-09-22T08:25:18.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.465+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.1 size=1048576 2024-09-22T08:25:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.466+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.2 size=851390 2024-09-22T08:25:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.466+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=B27EZM3LBAO4 tag=D12VBR16E61P type=write size=3997118 2024-09-22T08:25:18.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.467+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=L9W1M14ZVVFQ type=del 2024-09-22T08:25:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.469+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=HALEBXOKNCHB type=write size=919061 2024-09-22T08:25:18.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.470+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.0 size=1048576 2024-09-22T08:25:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.471+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.1 size=1048576 2024-09-22T08:25:18.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.474+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~L3R12LD20H30.2 size=606393 2024-09-22T08:25:18.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.477+0000 7f8a8d811780 1 < completed multipart upload key=3T2TX83CSE2D upload=L3R12LD20H30 tag=IYWADIHP1QHQ type=write size=3752121 2024-09-22T08:25:18.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.480+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.0 size=1048576 2024-09-22T08:25:18.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.481+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.1 size=1048576 2024-09-22T08:25:18.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.482+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.2 size=378043 2024-09-22T08:25:18.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.482+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=YEMPK3Z0D52U tag=AP85G6LP1OOR type=write size=3523771 2024-09-22T08:25:18.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.484+0000 7f8a8d811780 1 < completed write operation key=3T2TX83CSE2D tag=RHYXQRBMZV4W type=write size=390740 2024-09-22T08:25:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.488+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~AKAAM3WHMFDR.0 size=1048576 2024-09-22T08:25:18.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.489+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~AKAAM3WHMFDR.1 size=581994 2024-09-22T08:25:18.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.489+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=AKAAM3WHMFDR tag=LYIR7I1QBKL6 type=write size=2679146 2024-09-22T08:25:18.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.490+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=FF160YWA61CW type=del 2024-09-22T08:25:18.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.492+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~U97FJ548H26C.0 size=165535 2024-09-22T08:25:18.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.492+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=U97FJ548H26C tag=RJB1XIQ49QIC type=write size=1214111 2024-09-22T08:25:18.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.494+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=RZS512CIKGUC type=del 2024-09-22T08:25:18.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.495+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=OQM14LGZFAJU type=del size=1464565 2024-09-22T08:25:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.497+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~B8YR7DTK86W6.0 size=998878 2024-09-22T08:25:18.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.499+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=B8YR7DTK86W6 tag=NHACKRQGTICN type=write size=2047454 2024-09-22T08:25:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.500+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=3SN4O6LJLXH5 type=write size=623246 2024-09-22T08:25:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.501+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=MKWC7E5ECEOD type=del 2024-09-22T08:25:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.503+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=27UGY9JFS1KE type=del size=3043416 2024-09-22T08:25:18.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.505+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~ZXV1P67K76KD.0 size=238134 2024-09-22T08:25:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.506+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=ZXV1P67K76KD tag=7JQE3IW5SOW3 type=write size=1286710 2024-09-22T08:25:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.511+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~98OX0QJ6MOU5.0 size=1048576 2024-09-22T08:25:18.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.512+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~98OX0QJ6MOU5.1 size=1044525 2024-09-22T08:25:18.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.512+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=98OX0QJ6MOU5 tag=F3C0UVBO5DPF type=write size=3141677 2024-09-22T08:25:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.514+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=YKB0DGBCJZO1 type=write size=705532 2024-09-22T08:25:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.514+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=026FFZGCUO8U type=del size=583985 2024-09-22T08:25:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.516+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=I0W7ORDLJVEN type=del 2024-09-22T08:25:18.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.519+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IOY33INQUQG1.0 size=1048576 2024-09-22T08:25:18.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.520+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~IOY33INQUQG1.1 size=787047 2024-09-22T08:25:18.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.520+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=IOY33INQUQG1 tag=WNCK7CLEMFDO type=write size=2884199 2024-09-22T08:25:18.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.521+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.0 size=1048576 2024-09-22T08:25:18.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.522+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.1 size=1048576 2024-09-22T08:25:18.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.524+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~F9KBYAHVROJG.2 size=135130 2024-09-22T08:25:18.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.527+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=F9KBYAHVROJG tag=85U8EKIG9C96 type=write size=3280858 2024-09-22T08:25:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.529+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~S5HXEBUDP02A.0 size=1048576 2024-09-22T08:25:18.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.530+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~S5HXEBUDP02A.1 size=982341 2024-09-22T08:25:18.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.530+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=S5HXEBUDP02A tag=RR4IJ23W8KUE type=write size=3079493 2024-09-22T08:25:18.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.531+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=E7NTR0R9QIGF type=write size=854387 2024-09-22T08:25:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.533+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=ZQ0ZXHGXR5JQ type=write size=842556 2024-09-22T08:25:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.534+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~VG0VL8N3QNZV.0 size=1048576 2024-09-22T08:25:18.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.536+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~VG0VL8N3QNZV.1 size=560669 2024-09-22T08:25:18.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.538+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=VG0VL8N3QNZV tag=2ZMDQ0WP45B8 type=write size=2657821 2024-09-22T08:25:18.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.539+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=Z6Y53GE233JW type=del size=2483967 2024-09-22T08:25:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.542+0000 7f8a8d811780 1 < canceled operation key=JWJ9T6XYCUYR tag=WTEO7EH54JBW type=del size=606346 2024-09-22T08:25:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.543+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=4C2BZ88NEFIQ type=del size=2943876 2024-09-22T08:25:18.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.544+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=KHUTSUJ7K5Y1 type=del 2024-09-22T08:25:18.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.547+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~THV6NSUJRTMA.0 size=997621 2024-09-22T08:25:18.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.547+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=THV6NSUJRTMA tag=YB9Y90XNLDX9 type=write size=2046197 2024-09-22T08:25:18.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.548+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.0 size=1048576 2024-09-22T08:25:18.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.549+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.1 size=1048576 2024-09-22T08:25:18.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.550+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~B27EZM3LBAO4.2 size=851390 2024-09-22T08:25:18.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.554+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=B27EZM3LBAO4 tag=D12VBR16E61P type=write size=3997118 2024-09-22T08:25:18.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.556+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.0 size=1048576 2024-09-22T08:25:18.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.557+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.1 size=1048576 2024-09-22T08:25:18.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.558+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.2 size=614215 2024-09-22T08:25:18.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.558+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=79LPQVGU5X9N tag=ANOBUNN1BZVO type=write size=3759943 2024-09-22T08:25:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.560+0000 7f8a8d811780 1 < canceled operation key=S9JCKGZS5QLY tag=HALEBXOKNCHB type=write size=919061 2024-09-22T08:25:18.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.562+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=T4SBU7OIGFXS type=del size=1772895 2024-09-22T08:25:18.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.563+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.0 size=1048576 2024-09-22T08:25:18.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.563+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.1 size=1048576 2024-09-22T08:25:18.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.565+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~YEMPK3Z0D52U.2 size=378043 2024-09-22T08:25:18.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.568+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=YEMPK3Z0D52U tag=AP85G6LP1OOR type=write size=3523771 2024-09-22T08:25:18.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.569+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=ERL1HZYE77BA type=del size=3491572 2024-09-22T08:25:18.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.571+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~AKAAM3WHMFDR.0 size=1048576 2024-09-22T08:25:18.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.572+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~AKAAM3WHMFDR.1 size=581994 2024-09-22T08:25:18.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.575+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=AKAAM3WHMFDR tag=LYIR7I1QBKL6 type=write size=2679146 2024-09-22T08:25:18.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.578+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8PNQPLKUELWE.0 size=1048576 2024-09-22T08:25:18.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.579+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8PNQPLKUELWE.1 size=350674 2024-09-22T08:25:18.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.579+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=8PNQPLKUELWE tag=Q3FHEILPJ5AQ type=write size=2447826 2024-09-22T08:25:18.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.581+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~U97FJ548H26C.0 size=165535 2024-09-22T08:25:18.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.583+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=U97FJ548H26C tag=RJB1XIQ49QIC type=write size=1214111 2024-09-22T08:25:18.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.585+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~GCN3SZA13L0E.0 size=707024 2024-09-22T08:25:18.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.585+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=GCN3SZA13L0E tag=FFGF1V5IUWCT type=write size=1755600 2024-09-22T08:25:18.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.588+0000 7f8a8d811780 1 < suggested update operation key=QE6XEMOZMCF1 tag=OQM14LGZFAJU type=del size=1464565 2024-09-22T08:25:18.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.591+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~9CQ7OWSOP0OH.0 size=393375 2024-09-22T08:25:18.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.591+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=9CQ7OWSOP0OH tag=5MD2D9HRIOO8 type=write size=1441951 2024-09-22T08:25:18.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.593+0000 7f8a8d811780 1 < completed write operation key=9EY50PUC6AJJ tag=3SN4O6LJLXH5 type=write size=623246 2024-09-22T08:25:18.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.593+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=SYTV4GB0RGHO type=del size=2524371 2024-09-22T08:25:18.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.595+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=27UGY9JFS1KE type=del 2024-09-22T08:25:18.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.596+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=UU5T74XRBNQU type=del size=2818492 2024-09-22T08:25:18.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.598+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~98OX0QJ6MOU5.0 size=1048576 2024-09-22T08:25:18.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.600+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~98OX0QJ6MOU5.1 size=1044525 2024-09-22T08:25:18.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.602+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=98OX0QJ6MOU5 tag=F3C0UVBO5DPF type=write size=3141677 2024-09-22T08:25:18.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.603+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=BAXP4QD2NT2Q type=del size=1751766 2024-09-22T08:25:18.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.604+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=026FFZGCUO8U type=del 2024-09-22T08:25:18.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.609+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.0 size=1048576 2024-09-22T08:25:18.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.610+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.1 size=1048576 2024-09-22T08:25:18.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.610+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.2 size=101529 2024-09-22T08:25:18.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.610+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=QBWCRIAKQMWT tag=7NTL0HMUM2NK type=write size=3247257 2024-09-22T08:25:18.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.614+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IOY33INQUQG1.0 size=1048576 2024-09-22T08:25:18.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.615+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~IOY33INQUQG1.1 size=787047 2024-09-22T08:25:18.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.617+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=IOY33INQUQG1 tag=WNCK7CLEMFDO type=write size=2884199 2024-09-22T08:25:18.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.619+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~EXE6B4ZD5D14.0 size=1048576 2024-09-22T08:25:18.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.620+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~EXE6B4ZD5D14.1 size=30022 2024-09-22T08:25:18.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.620+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=EXE6B4ZD5D14 tag=S4222QDG30BY type=write size=2127174 2024-09-22T08:25:18.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.622+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~S5HXEBUDP02A.0 size=1048576 2024-09-22T08:25:18.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.623+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~S5HXEBUDP02A.1 size=982341 2024-09-22T08:25:18.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.625+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=S5HXEBUDP02A tag=RR4IJ23W8KUE type=write size=3079493 2024-09-22T08:25:18.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.627+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=H6VAFSHUVES2 type=del size=822566 2024-09-22T08:25:18.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.628+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=ZQ0ZXHGXR5JQ type=write size=842556 2024-09-22T08:25:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.631+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.0 size=1048576 2024-09-22T08:25:18.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.631+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.1 size=1048576 2024-09-22T08:25:18.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.632+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.2 size=932097 2024-09-22T08:25:18.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.632+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=9W4PJLCBYCXG tag=X828OFKWT9IQ type=write size=4077825 2024-09-22T08:25:18.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.634+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=Z6Y53GE233JW type=del 2024-09-22T08:25:18.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.635+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=75L1F1BE6F3F type=del size=1423919 2024-09-22T08:25:18.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.637+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=4C2BZ88NEFIQ type=del 2024-09-22T08:25:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.638+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=PGST0N5Q5U5W type=del size=1102442 2024-09-22T08:25:18.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.640+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~THV6NSUJRTMA.0 size=997621 2024-09-22T08:25:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.642+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=THV6NSUJRTMA tag=YB9Y90XNLDX9 type=write size=2046197 2024-09-22T08:25:18.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.644+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=FLHI6S111HI7 type=del size=1223704 2024-09-22T08:25:18.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.645+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.0 size=1048576 2024-09-22T08:25:18.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.646+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.1 size=1048576 2024-09-22T08:25:18.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.648+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~79LPQVGU5X9N.2 size=614215 2024-09-22T08:25:18.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.650+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=79LPQVGU5X9N tag=ANOBUNN1BZVO type=write size=3759943 2024-09-22T08:25:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.652+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=8HBR6LG7GWVV type=del size=3688728 2024-09-22T08:25:18.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.655+0000 7f8a8d811780 1 < suggested remove operation key=WR1JR0APSOKN tag=T4SBU7OIGFXS type=del 2024-09-22T08:25:18.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.657+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=3T4GE0HMMQRU type=write size=115971 2024-09-22T08:25:18.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.658+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=ERL1HZYE77BA type=del 2024-09-22T08:25:18.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.661+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~YHQ7QQ9SOITL.0 size=156882 2024-09-22T08:25:18.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.661+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=YHQ7QQ9SOITL tag=67WK1944M2YR type=write size=1205458 2024-09-22T08:25:18.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.662+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8PNQPLKUELWE.0 size=1048576 2024-09-22T08:25:18.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.664+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8PNQPLKUELWE.1 size=350674 2024-09-22T08:25:18.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.667+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=8PNQPLKUELWE tag=Q3FHEILPJ5AQ type=write size=2447826 2024-09-22T08:25:18.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.668+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=QB5W6X6ZZGNW type=del size=297621 2024-09-22T08:25:18.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.670+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~GCN3SZA13L0E.0 size=707024 2024-09-22T08:25:18.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.672+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=GCN3SZA13L0E tag=FFGF1V5IUWCT type=write size=1755600 2024-09-22T08:25:18.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.673+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=SEWKJ15EU0WH type=del size=1240156 2024-09-22T08:25:18.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.675+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~9CQ7OWSOP0OH.0 size=393375 2024-09-22T08:25:18.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.677+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=9CQ7OWSOP0OH tag=5MD2D9HRIOO8 type=write size=1441951 2024-09-22T08:25:18.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.680+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.0 size=1048576 2024-09-22T08:25:18.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.681+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.1 size=1048576 2024-09-22T08:25:18.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.682+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.2 size=453138 2024-09-22T08:25:18.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.682+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=ADVL1RD4KVDX tag=X0AKMMDRYH5M type=write size=3598866 2024-09-22T08:25:18.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.683+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=SYTV4GB0RGHO type=del 2024-09-22T08:25:18.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.686+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~SS9F8MB9X0BA.0 size=789295 2024-09-22T08:25:18.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.686+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=SS9F8MB9X0BA tag=KKO6F96FA5L6 type=write size=1837871 2024-09-22T08:25:18.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.689+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=UU5T74XRBNQU type=del size=2818492 2024-09-22T08:25:18.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.692+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~PX74Q8Y44YCD.0 size=325179 2024-09-22T08:25:18.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.692+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=PX74Q8Y44YCD tag=RUV52R3R4WEF type=write size=1373755 2024-09-22T08:25:18.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.693+0000 7f8a8d811780 1 < canceled operation key=MJJPUJP2NSOK tag=BAXP4QD2NT2Q type=del size=1751766 2024-09-22T08:25:18.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.695+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=JYRBY8XJ62QS type=del size=1069371 2024-09-22T08:25:18.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.696+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.0 size=1048576 2024-09-22T08:25:18.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.697+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.1 size=1048576 2024-09-22T08:25:18.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.698+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~QBWCRIAKQMWT.2 size=101529 2024-09-22T08:25:18.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.701+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=QBWCRIAKQMWT tag=7NTL0HMUM2NK type=write size=3247257 2024-09-22T08:25:18.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.704+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~66X975H8EEPE.0 size=110979 2024-09-22T08:25:18.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.704+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=66X975H8EEPE tag=JVDZDCDR97ZV type=write size=1159555 2024-09-22T08:25:18.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.705+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~EXE6B4ZD5D14.0 size=1048576 2024-09-22T08:25:18.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.707+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~EXE6B4ZD5D14.1 size=30022 2024-09-22T08:25:18.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.710+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=EXE6B4ZD5D14 tag=S4222QDG30BY type=write size=2127174 2024-09-22T08:25:18.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.712+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8N629JAKYX4O.0 size=216072 2024-09-22T08:25:18.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.712+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=8N629JAKYX4O tag=OS6ZH3ME5PWV type=write size=1264648 2024-09-22T08:25:18.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.715+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=H6VAFSHUVES2 type=del 2024-09-22T08:25:18.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.717+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.0 size=1048576 2024-09-22T08:25:18.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.718+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.1 size=1048576 2024-09-22T08:25:18.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.719+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.2 size=186862 2024-09-22T08:25:18.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.719+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=JC11FJ4ZG8AZ tag=4RPX70HNGJF5 type=write size=3332590 2024-09-22T08:25:18.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.721+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.0 size=1048576 2024-09-22T08:25:18.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.722+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.1 size=1048576 2024-09-22T08:25:18.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.723+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~9W4PJLCBYCXG.2 size=932097 2024-09-22T08:25:18.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.726+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=9W4PJLCBYCXG tag=X828OFKWT9IQ type=write size=4077825 2024-09-22T08:25:18.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.728+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=4VR5AQGO17K5 type=write size=275141 2024-09-22T08:25:18.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.730+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=75L1F1BE6F3F type=del 2024-09-22T08:25:18.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.731+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=4P1JV6WF7FT0 type=del size=2541298 2024-09-22T08:25:18.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.732+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=PGST0N5Q5U5W type=del 2024-09-22T08:25:18.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.733+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=PIQEBHK0Z6SS type=del size=1312334 2024-09-22T08:25:18.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.735+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=FLHI6S111HI7 type=del 2024-09-22T08:25:18.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.736+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=A29NKHQL5VB2 type=del size=4054904 2024-09-22T08:25:18.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.737+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=8HBR6LG7GWVV type=del 2024-09-22T08:25:18.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.739+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=6R68OM32GMJ8 type=del size=3760816 2024-09-22T08:25:18.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.740+0000 7f8a8d811780 1 < completed write operation key=2EB57FFNN986 tag=3T4GE0HMMQRU type=write size=115971 2024-09-22T08:25:18.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.742+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.0 size=1048576 2024-09-22T08:25:18.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.743+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.1 size=1048576 2024-09-22T08:25:18.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.745+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.2 size=605332 2024-09-22T08:25:18.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.745+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=5GQQ1J3LK6Q1 tag=RVVJ1W0XTR3U type=write size=3751060 2024-09-22T08:25:18.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.746+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~YHQ7QQ9SOITL.0 size=156882 2024-09-22T08:25:18.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.749+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=YHQ7QQ9SOITL tag=67WK1944M2YR type=write size=1205458 2024-09-22T08:25:18.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.750+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=3VU13PFGUT7L type=del size=2872905 2024-09-22T08:25:18.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.752+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=QB5W6X6ZZGNW type=del 2024-09-22T08:25:18.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.753+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=5LVHZLD9X3WK type=write size=394798 2024-09-22T08:25:18.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.756+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=SEWKJ15EU0WH type=del 2024-09-22T08:25:18.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.757+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=26QJXNLPERVU type=del size=1402514 2024-09-22T08:25:18.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.757+0000 7f8a8d811780 1 < canceled part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.0 size=1048576 2024-09-22T08:25:18.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.758+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.1 size=1048576 2024-09-22T08:25:18.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.759+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~ADVL1RD4KVDX.2 size=453138 2024-09-22T08:25:18.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.761+0000 7f8a8d811780 1 < canceled multipart upload key=2EB57FFNN986 upload=ADVL1RD4KVDX tag=X0AKMMDRYH5M type=write size=3598866 2024-09-22T08:25:18.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.763+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=TS4SQQAXXDQY type=del size=176398 2024-09-22T08:25:18.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.764+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~SS9F8MB9X0BA.0 size=789295 2024-09-22T08:25:18.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.766+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=SS9F8MB9X0BA tag=KKO6F96FA5L6 type=write size=1837871 2024-09-22T08:25:18.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.769+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.0 size=1048576 2024-09-22T08:25:18.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.770+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.1 size=1048576 2024-09-22T08:25:18.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.772+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.2 size=273764 2024-09-22T08:25:18.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.772+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=A8L6G1CHXAOE tag=F4O1PIVODAS3 type=write size=3419492 2024-09-22T08:25:18.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.773+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~PX74Q8Y44YCD.0 size=325179 2024-09-22T08:25:18.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.775+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=PX74Q8Y44YCD tag=RUV52R3R4WEF type=write size=1373755 2024-09-22T08:25:18.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.778+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~LAMGB4VFLKZS.0 size=1031453 2024-09-22T08:25:18.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.778+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=LAMGB4VFLKZS tag=D5LKSVIVU68N type=write size=2080029 2024-09-22T08:25:18.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.779+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=JYRBY8XJ62QS type=del 2024-09-22T08:25:18.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.781+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.0 size=1048576 2024-09-22T08:25:18.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.783+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.1 size=1048576 2024-09-22T08:25:18.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.784+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.2 size=169072 2024-09-22T08:25:18.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.784+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=G7I64EDQAS6N tag=0U722OIP385R type=write size=3314800 2024-09-22T08:25:18.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.786+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~66X975H8EEPE.0 size=110979 2024-09-22T08:25:18.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.788+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=66X975H8EEPE tag=JVDZDCDR97ZV type=write size=1159555 2024-09-22T08:25:18.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.789+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=HCEDIW3P3U33 type=del size=2095719 2024-09-22T08:25:18.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.790+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8N629JAKYX4O.0 size=216072 2024-09-22T08:25:18.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.793+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=8N629JAKYX4O tag=OS6ZH3ME5PWV type=write size=1264648 2024-09-22T08:25:18.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.794+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=QN0EY0Y8X2B5 type=del size=2890134 2024-09-22T08:25:18.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.795+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.0 size=1048576 2024-09-22T08:25:18.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.797+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.1 size=1048576 2024-09-22T08:25:18.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.798+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~JC11FJ4ZG8AZ.2 size=186862 2024-09-22T08:25:18.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.801+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=JC11FJ4ZG8AZ tag=4RPX70HNGJF5 type=write size=3332590 2024-09-22T08:25:18.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.802+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=ODW6RVSE3MNN type=write size=935484 2024-09-22T08:25:18.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.805+0000 7f8a8d811780 1 < suggested remove operation key=T5IAHQ3CUIFR tag=4VR5AQGO17K5 type=write 2024-09-22T08:25:18.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.806+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=JGRND69SPGZ2 type=del size=3631382 2024-09-22T08:25:18.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.808+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=4P1JV6WF7FT0 type=del 2024-09-22T08:25:18.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.811+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~8UAW5ME185RO.0 size=1048576 2024-09-22T08:25:18.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.812+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~8UAW5ME185RO.1 size=521029 2024-09-22T08:25:18.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.812+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=8UAW5ME185RO tag=91H2D56GX6PN type=write size=2618181 2024-09-22T08:25:18.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.813+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=PIQEBHK0Z6SS type=del 2024-09-22T08:25:18.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.816+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~7JI4EARFGO70.0 size=22081 2024-09-22T08:25:18.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.816+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=7JI4EARFGO70 tag=XVVP7POBTYVR type=write size=1070657 2024-09-22T08:25:18.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.817+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=A29NKHQL5VB2 type=del 2024-09-22T08:25:18.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.820+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~87JETQ3M7NH4.0 size=88289 2024-09-22T08:25:18.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.820+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=87JETQ3M7NH4 tag=LU58YGJ9SZV9 type=write size=1136865 2024-09-22T08:25:18.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.822+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=6R68OM32GMJ8 type=del 2024-09-22T08:25:18.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.824+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~2P92DSOHJPNE.0 size=529428 2024-09-22T08:25:18.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.824+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=2P92DSOHJPNE tag=3BP63Z7T8OAZ type=write size=1578004 2024-09-22T08:25:18.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.825+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.0 size=1048576 2024-09-22T08:25:18.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.826+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.1 size=1048576 2024-09-22T08:25:18.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.827+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~5GQQ1J3LK6Q1.2 size=605332 2024-09-22T08:25:18.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.831+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=5GQQ1J3LK6Q1 tag=RVVJ1W0XTR3U type=write size=3751060 2024-09-22T08:25:18.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.832+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=PHQIYNLPE2YH type=del size=2053345 2024-09-22T08:25:18.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.833+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=3VU13PFGUT7L type=del 2024-09-22T08:25:18.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.835+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=PDL1P7UI2U1X type=del size=2109211 2024-09-22T08:25:18.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.836+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=5LVHZLD9X3WK type=write size=394798 2024-09-22T08:25:18.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.839+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~KEOHU8ZM7LEP.0 size=1048576 2024-09-22T08:25:18.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.840+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~KEOHU8ZM7LEP.1 size=968492 2024-09-22T08:25:18.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.840+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=KEOHU8ZM7LEP tag=Q3DNF1V81FCA type=write size=3065644 2024-09-22T08:25:18.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.841+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=26QJXNLPERVU type=del 2024-09-22T08:25:18.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.843+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=UM97QE5HWL7W type=write size=96340 2024-09-22T08:25:18.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.846+0000 7f8a8d811780 1 < suggested remove operation key=0AOI0OB2YFVV tag=TS4SQQAXXDQY type=del 2024-09-22T08:25:18.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.848+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=0ME4DAYQBSDR type=write size=414780 2024-09-22T08:25:18.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.849+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.0 size=1048576 2024-09-22T08:25:18.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.851+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.1 size=1048576 2024-09-22T08:25:18.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.851+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~A8L6G1CHXAOE.2 size=273764 2024-09-22T08:25:18.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.853+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=A8L6G1CHXAOE tag=F4O1PIVODAS3 type=write size=3419492 2024-09-22T08:25:18.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.855+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=R8BWKWYCNECA type=del size=3165350 2024-09-22T08:25:18.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.856+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~LAMGB4VFLKZS.0 size=1031453 2024-09-22T08:25:18.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.859+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=LAMGB4VFLKZS tag=D5LKSVIVU68N type=write size=2080029 2024-09-22T08:25:18.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.860+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=9JSJH7NLA1JG type=del size=2635154 2024-09-22T08:25:18.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.862+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.0 size=1048576 2024-09-22T08:25:18.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.863+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.1 size=1048576 2024-09-22T08:25:18.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.864+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~G7I64EDQAS6N.2 size=169072 2024-09-22T08:25:18.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.868+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=G7I64EDQAS6N tag=0U722OIP385R type=write size=3314800 2024-09-22T08:25:18.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.870+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~FP8W5UW3R8ES.0 size=472493 2024-09-22T08:25:18.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.870+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=FP8W5UW3R8ES tag=YSEQ2NJZORN1 type=write size=1521069 2024-09-22T08:25:18.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.873+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=HCEDIW3P3U33 type=del size=2095719 2024-09-22T08:25:18.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.876+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~VK82Y9END5AM.0 size=1048576 2024-09-22T08:25:18.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.878+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~VK82Y9END5AM.1 size=95904 2024-09-22T08:25:18.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.878+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=VK82Y9END5AM tag=H7FK2ACORGV6 type=write size=2193056 2024-09-22T08:25:18.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.879+0000 7f8a8d811780 -1 < failed to complete operation key=T5IAHQ3CUIFR tag=QN0EY0Y8X2B5 type=del size=2890134: (22) Invalid argument 2024-09-22T08:25:18.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.883+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~S936WKP7T30A.0 size=525828 2024-09-22T08:25:18.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.883+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=S936WKP7T30A tag=U58FEPX0QEKV type=write size=1574404 2024-09-22T08:25:18.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.884+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=ODW6RVSE3MNN type=write size=935484 2024-09-22T08:25:18.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.885+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=ZUTMUWCYXT95 type=del size=3070190 2024-09-22T08:25:18.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.886+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=JGRND69SPGZ2 type=del 2024-09-22T08:25:18.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.889+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.0 size=1048576 2024-09-22T08:25:18.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.890+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.1 size=1048576 2024-09-22T08:25:18.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.891+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.2 size=902646 2024-09-22T08:25:18.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.891+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=JW1RK5S6QFF3 tag=S98K5ERAXDU6 type=write size=4048374 2024-09-22T08:25:18.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.893+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~8UAW5ME185RO.0 size=1048576 2024-09-22T08:25:18.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.895+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~8UAW5ME185RO.1 size=521029 2024-09-22T08:25:18.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.897+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=8UAW5ME185RO tag=91H2D56GX6PN type=write size=2618181 2024-09-22T08:25:18.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.898+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=6A34OFJETILE type=del size=261881 2024-09-22T08:25:18.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.900+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~7JI4EARFGO70.0 size=22081 2024-09-22T08:25:18.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.902+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=7JI4EARFGO70 tag=XVVP7POBTYVR type=write size=1070657 2024-09-22T08:25:18.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.903+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=JJ74XSCJLIIL type=del size=359342 2024-09-22T08:25:18.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.904+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~87JETQ3M7NH4.0 size=88289 2024-09-22T08:25:18.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.907+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=87JETQ3M7NH4 tag=LU58YGJ9SZV9 type=write size=1136865 2024-09-22T08:25:18.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.908+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=12GR1AULTGVF type=del size=3959699 2024-09-22T08:25:18.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.910+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~2P92DSOHJPNE.0 size=529428 2024-09-22T08:25:18.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.912+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=2P92DSOHJPNE tag=3BP63Z7T8OAZ type=write size=1578004 2024-09-22T08:25:18.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.913+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=EG7M7B8CGELN type=del size=597685 2024-09-22T08:25:18.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.914+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=PHQIYNLPE2YH type=del 2024-09-22T08:25:18.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.916+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=3M4O9SWDKR8S type=del size=2947950 2024-09-22T08:25:18.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.917+0000 7f8a8d811780 -1 < failed to complete operation key=0HCXP53D9NMP tag=PDL1P7UI2U1X type=del size=2109211: (22) Invalid argument 2024-09-22T08:25:18.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.918+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=6BI3RSXT6XHJ type=del size=440610 2024-09-22T08:25:18.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.920+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~KEOHU8ZM7LEP.0 size=1048576 2024-09-22T08:25:18.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.921+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~KEOHU8ZM7LEP.1 size=968492 2024-09-22T08:25:18.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.924+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=KEOHU8ZM7LEP tag=Q3DNF1V81FCA type=write size=3065644 2024-09-22T08:25:18.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.924+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=Z751O4GDOUH3 type=del size=2871904 2024-09-22T08:25:18.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.926+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=UM97QE5HWL7W type=write size=96340 2024-09-22T08:25:18.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.929+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~E42ZLNLAZQ67.0 size=1048576 2024-09-22T08:25:18.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.929+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~E42ZLNLAZQ67.1 size=883525 2024-09-22T08:25:18.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.929+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=E42ZLNLAZQ67 tag=FKIP72KS5123 type=write size=2980677 2024-09-22T08:25:18.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.931+0000 7f8a8d811780 1 < completed write operation key=0AOI0OB2YFVV tag=0ME4DAYQBSDR type=write size=414780 2024-09-22T08:25:18.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.932+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=IKJMBO7BQ6N6 type=del size=95994 2024-09-22T08:25:18.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.934+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=R8BWKWYCNECA type=del 2024-09-22T08:25:18.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.935+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=C9ZH7Q76NJCU type=del size=170429 2024-09-22T08:25:18.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.937+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=9JSJH7NLA1JG type=del 2024-09-22T08:25:18.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.938+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=W1NKGW2D2YH6 type=write size=821828 2024-09-22T08:25:18.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.939+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~FP8W5UW3R8ES.0 size=472493 2024-09-22T08:25:18.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.942+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=FP8W5UW3R8ES tag=YSEQ2NJZORN1 type=write size=1521069 2024-09-22T08:25:18.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.944+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=0617AFPR5BHO type=del size=1441667 2024-09-22T08:25:18.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.944+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~VK82Y9END5AM.0 size=1048576 2024-09-22T08:25:18.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.944+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~VK82Y9END5AM.1 size=95904 2024-09-22T08:25:18.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.946+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=VK82Y9END5AM tag=H7FK2ACORGV6 type=write size=2193056 2024-09-22T08:25:18.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.948+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=LDXUQSQIZNUT type=del size=605852 2024-09-22T08:25:18.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.949+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~S936WKP7T30A.0 size=525828 2024-09-22T08:25:18.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.951+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=S936WKP7T30A tag=U58FEPX0QEKV type=write size=1574404 2024-09-22T08:25:18.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.952+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=8K1WDAJE83C0 type=write size=804866 2024-09-22T08:25:18.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.954+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=ZUTMUWCYXT95 type=del 2024-09-22T08:25:18.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.955+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=95CISOUDC937 type=del size=2972104 2024-09-22T08:25:18.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.957+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.0 size=1048576 2024-09-22T08:25:18.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.958+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.1 size=1048576 2024-09-22T08:25:18.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.959+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~JW1RK5S6QFF3.2 size=902646 2024-09-22T08:25:18.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.961+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=JW1RK5S6QFF3 tag=S98K5ERAXDU6 type=write size=4048374 2024-09-22T08:25:18.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.964+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.0 size=1048576 2024-09-22T08:25:18.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.966+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.1 size=1048576 2024-09-22T08:25:18.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.966+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.2 size=627522 2024-09-22T08:25:18.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.966+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=SX3705XGCGMH tag=YHQL1KHK6GS6 type=write size=3773250 2024-09-22T08:25:18.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.970+0000 7f8a8d811780 1 < suggested remove operation key=JP7IZ0CMXTSX tag=6A34OFJETILE type=del 2024-09-22T08:25:18.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.972+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.0 size=1048576 2024-09-22T08:25:18.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.973+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.1 size=1048576 2024-09-22T08:25:18.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.974+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.2 size=407732 2024-09-22T08:25:18.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.974+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=GVKYZGQVBANM tag=NI8QXM7WTFAJ type=write size=3553460 2024-09-22T08:25:18.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.976+0000 7f8a8d811780 1 < suggested remove operation key=RRTLTMWJIWSW tag=JJ74XSCJLIIL type=del 2024-09-22T08:25:18.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.979+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~2ZPDTBI9C02U.0 size=595011 2024-09-22T08:25:18.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.979+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=2ZPDTBI9C02U tag=YDABX3AX3PGO type=write size=1643587 2024-09-22T08:25:18.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.982+0000 7f8a8d811780 1 < suggested update operation key=0HCXP53D9NMP tag=12GR1AULTGVF type=del size=3959699 2024-09-22T08:25:18.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.985+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2LD1AN55WHRV.0 size=1048576 2024-09-22T08:25:18.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.986+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~2LD1AN55WHRV.1 size=305304 2024-09-22T08:25:18.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.986+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=2LD1AN55WHRV tag=6QLLIULMMJY1 type=write size=2402456 2024-09-22T08:25:18.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.987+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=EG7M7B8CGELN type=del size=597685 2024-09-22T08:25:18.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.989+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~0SYDPWHPJC1K.0 size=370476 2024-09-22T08:25:18.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.989+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=0SYDPWHPJC1K tag=U2R3L0SG81E5 type=write size=1419052 2024-09-22T08:25:18.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.992+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=3M4O9SWDKR8S type=del size=2947950 2024-09-22T08:25:18.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.995+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.0 size=1048576 2024-09-22T08:25:18.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.996+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.1 size=1048576 2024-09-22T08:25:18.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.997+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.2 size=864006 2024-09-22T08:25:18.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.997+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=ITO13RCTWICY tag=I2BPZ04SAWND type=write size=4009734 2024-09-22T08:25:18.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:18.999+0000 7f8a8d811780 1 < canceled operation key=S9JCKGZS5QLY tag=6BI3RSXT6XHJ type=del size=440610 2024-09-22T08:25:19.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.000+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=85F3NASD9EEQ type=del size=321287 2024-09-22T08:25:19.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.001+0000 7f8a8d811780 -1 < failed to complete operation key=PIRW8N555T52 tag=Z751O4GDOUH3 type=del size=2871904: (22) Invalid argument 2024-09-22T08:25:19.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.002+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=ULREKU57TCRS type=del size=2195634 2024-09-22T08:25:19.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.004+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~E42ZLNLAZQ67.0 size=1048576 2024-09-22T08:25:19.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.005+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~E42ZLNLAZQ67.1 size=883525 2024-09-22T08:25:19.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.007+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=E42ZLNLAZQ67 tag=FKIP72KS5123 type=write size=2980677 2024-09-22T08:25:19.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.009+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=KTRWQ32NTR87 type=del size=901733 2024-09-22T08:25:19.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.013+0000 7f8a8d811780 1 < suggested remove operation key=WOSCCX4WX2FN tag=IKJMBO7BQ6N6 type=del 2024-09-22T08:25:19.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.014+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=I1GQ5MLW9UZ8 type=del size=826258 2024-09-22T08:25:19.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.016+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=C9ZH7Q76NJCU type=del 2024-09-22T08:25:19.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.018+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.0 size=1048576 2024-09-22T08:25:19.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.019+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.1 size=1048576 2024-09-22T08:25:19.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.020+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.2 size=396837 2024-09-22T08:25:19.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.020+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=SXW60EBQXUBJ tag=9N77K97RPEIH type=write size=3542565 2024-09-22T08:25:19.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.021+0000 7f8a8d811780 -1 < failed to complete operation key=JP7IZ0CMXTSX tag=W1NKGW2D2YH6 type=write size=821828: (22) Invalid argument 2024-09-22T08:25:19.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.024+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~1KYZWW7VUVMX.0 size=1048576 2024-09-22T08:25:19.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.025+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~1KYZWW7VUVMX.1 size=180826 2024-09-22T08:25:19.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.025+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=1KYZWW7VUVMX tag=45L1QHHI7B4G type=write size=2277978 2024-09-22T08:25:19.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.027+0000 7f8a8d811780 1 < suggested remove operation key=7LLAS815MLFH tag=0617AFPR5BHO type=del 2024-09-22T08:25:19.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.029+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=DX2XFH56EH9Z type=write size=859259 2024-09-22T08:25:19.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.030+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=LDXUQSQIZNUT type=del 2024-09-22T08:25:19.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.031+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=776PIAXEGPX2 type=del size=1821475 2024-09-22T08:25:19.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.033+0000 7f8a8d811780 1 < completed write operation key=KIJ2DW4NSZKG tag=8K1WDAJE83C0 type=write size=804866 2024-09-22T08:25:19.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.035+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.0 size=1048576 2024-09-22T08:25:19.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.036+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.1 size=1048576 2024-09-22T08:25:19.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.037+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.2 size=716345 2024-09-22T08:25:19.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.037+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=5E1HRIP8MK4M tag=L1WEHI4NIJAB type=write size=3862073 2024-09-22T08:25:19.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.038+0000 7f8a8d811780 -1 < failed to complete operation key=RRTLTMWJIWSW tag=95CISOUDC937 type=del size=2972104: (22) Invalid argument 2024-09-22T08:25:19.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.040+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=D8U1YLG9IV4T type=del size=2960119 2024-09-22T08:25:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.041+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.0 size=1048576 2024-09-22T08:25:19.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.042+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.1 size=1048576 2024-09-22T08:25:19.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.043+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~SX3705XGCGMH.2 size=627522 2024-09-22T08:25:19.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.045+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=SX3705XGCGMH tag=YHQL1KHK6GS6 type=write size=3773250 2024-09-22T08:25:19.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.047+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.0 size=1048576 2024-09-22T08:25:19.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.049+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.1 size=1048576 2024-09-22T08:25:19.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.050+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.2 size=773352 2024-09-22T08:25:19.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.050+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=VQ6FDAGNA3AM tag=FVRS033LDV4I type=write size=3919080 2024-09-22T08:25:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.051+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.0 size=1048576 2024-09-22T08:25:19.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.052+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.1 size=1048576 2024-09-22T08:25:19.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.053+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~GVKYZGQVBANM.2 size=407732 2024-09-22T08:25:19.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.056+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=GVKYZGQVBANM tag=NI8QXM7WTFAJ type=write size=3553460 2024-09-22T08:25:19.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.057+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=KKW0GZMG0PR0 type=del size=3155533 2024-09-22T08:25:19.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.058+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~2ZPDTBI9C02U.0 size=595011 2024-09-22T08:25:19.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.061+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=2ZPDTBI9C02U tag=YDABX3AX3PGO type=write size=1643587 2024-09-22T08:25:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.062+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=8CL7AZJKFRG3 type=del size=2208120 2024-09-22T08:25:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.063+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~2LD1AN55WHRV.0 size=1048576 2024-09-22T08:25:19.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.064+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~2LD1AN55WHRV.1 size=305304 2024-09-22T08:25:19.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.067+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=2LD1AN55WHRV tag=6QLLIULMMJY1 type=write size=2402456 2024-09-22T08:25:19.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.069+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~OG76JL5LMFJU.0 size=1048576 2024-09-22T08:25:19.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.070+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~OG76JL5LMFJU.1 size=718453 2024-09-22T08:25:19.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.070+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=OG76JL5LMFJU tag=8VMVAAAE9JWN type=write size=2815605 2024-09-22T08:25:19.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.072+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~0SYDPWHPJC1K.0 size=370476 2024-09-22T08:25:19.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.074+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=0SYDPWHPJC1K tag=U2R3L0SG81E5 type=write size=1419052 2024-09-22T08:25:19.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.077+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~6GDVIED80HB0.0 size=586290 2024-09-22T08:25:19.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.077+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=6GDVIED80HB0 tag=GNYXZFD51LCG type=write size=1634866 2024-09-22T08:25:19.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.078+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.0 size=1048576 2024-09-22T08:25:19.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.079+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.1 size=1048576 2024-09-22T08:25:19.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.080+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~ITO13RCTWICY.2 size=864006 2024-09-22T08:25:19.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.083+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=ITO13RCTWICY tag=I2BPZ04SAWND type=write size=4009734 2024-09-22T08:25:19.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.085+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CFN5QCW6YSZG.0 size=1048576 2024-09-22T08:25:19.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.086+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CFN5QCW6YSZG.1 size=352050 2024-09-22T08:25:19.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.086+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=CFN5QCW6YSZG tag=DN0QZ5IYDB52 type=write size=2449202 2024-09-22T08:25:19.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.088+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=85F3NASD9EEQ type=del size=321287 2024-09-22T08:25:19.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.090+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~QU5UBKFW6N22.0 size=1048576 2024-09-22T08:25:19.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.091+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~QU5UBKFW6N22.1 size=750938 2024-09-22T08:25:19.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.091+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=QU5UBKFW6N22 tag=6657XAWHP7VC type=write size=2848090 2024-09-22T08:25:19.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.094+0000 7f8a8d811780 1 < suggested remove operation key=2EB57FFNN986 tag=ULREKU57TCRS type=del 2024-09-22T08:25:19.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.095+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=6GJRLOH6EAXR type=del size=2966412 2024-09-22T08:25:19.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.097+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=KTRWQ32NTR87 type=del 2024-09-22T08:25:19.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.098+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=EQHQFE2GJML1 type=write size=1039692 2024-09-22T08:25:19.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.099+0000 7f8a8d811780 1 < canceled operation key=1719KI1YP1FT tag=I1GQ5MLW9UZ8 type=del size=826258 2024-09-22T08:25:19.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.101+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=MJAA62ZUD0IK type=del size=1794630 2024-09-22T08:25:19.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.102+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.0 size=1048576 2024-09-22T08:25:19.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.103+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.1 size=1048576 2024-09-22T08:25:19.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.104+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~SXW60EBQXUBJ.2 size=396837 2024-09-22T08:25:19.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.107+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=SXW60EBQXUBJ tag=9N77K97RPEIH type=write size=3542565 2024-09-22T08:25:19.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.108+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=S093QZ0ZJBUX type=del size=2599412 2024-09-22T08:25:19.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.109+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~1KYZWW7VUVMX.0 size=1048576 2024-09-22T08:25:19.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.110+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~1KYZWW7VUVMX.1 size=180826 2024-09-22T08:25:19.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.113+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=1KYZWW7VUVMX tag=45L1QHHI7B4G type=write size=2277978 2024-09-22T08:25:19.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.114+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=SUWQ8ZFZUKGI type=del size=3847481 2024-09-22T08:25:19.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.117+0000 7f8a8d811780 1 < suggested update operation key=WOSCCX4WX2FN tag=DX2XFH56EH9Z type=write size=859259 2024-09-22T08:25:19.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.118+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=EFC4VLDWJ0UD type=del size=3229722 2024-09-22T08:25:19.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.119+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=776PIAXEGPX2 type=del 2024-09-22T08:25:19.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.121+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=DUB98KIBSI98 type=del size=3283644 2024-09-22T08:25:19.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.122+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.0 size=1048576 2024-09-22T08:25:19.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.122+0000 7f8a8d811780 1 < canceled part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.1 size=1048576 2024-09-22T08:25:19.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.123+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~5E1HRIP8MK4M.2 size=716345 2024-09-22T08:25:19.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.125+0000 7f8a8d811780 1 < canceled multipart upload key=GMNVYF2BY872 upload=5E1HRIP8MK4M tag=L1WEHI4NIJAB type=write size=3862073 2024-09-22T08:25:19.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.127+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=FFEC3ZRGF0HR type=del size=2329623 2024-09-22T08:25:19.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.128+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=D8U1YLG9IV4T type=del 2024-09-22T08:25:19.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.129+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=UCRZ82D73QR6 type=del size=3280040 2024-09-22T08:25:19.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.131+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.0 size=1048576 2024-09-22T08:25:19.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.131+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.1 size=1048576 2024-09-22T08:25:19.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.132+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~VQ6FDAGNA3AM.2 size=773352 2024-09-22T08:25:19.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.135+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=VQ6FDAGNA3AM tag=FVRS033LDV4I type=write size=3919080 2024-09-22T08:25:19.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.138+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~YB92JEFF5309.0 size=1048576 2024-09-22T08:25:19.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.138+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~YB92JEFF5309.1 size=1048576 2024-09-22T08:25:19.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.140+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~YB92JEFF5309.2 size=1030553 2024-09-22T08:25:19.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.140+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=YB92JEFF5309 tag=3IBAVXR0VIZ1 type=write size=4176281 2024-09-22T08:25:19.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.141+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=KKW0GZMG0PR0 type=del size=3155533 2024-09-22T08:25:19.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.142+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=51V7L5GJ3FX5 type=del size=3689500 2024-09-22T08:25:19.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.143+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=8CL7AZJKFRG3 type=del 2024-09-22T08:25:19.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.145+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=DOZCCCEXVSDN type=del size=444960 2024-09-22T08:25:19.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.146+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~OG76JL5LMFJU.0 size=1048576 2024-09-22T08:25:19.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.147+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~OG76JL5LMFJU.1 size=718453 2024-09-22T08:25:19.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.150+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=OG76JL5LMFJU tag=8VMVAAAE9JWN type=write size=2815605 2024-09-22T08:25:19.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.151+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=GM24XC12Z313 type=del size=1854794 2024-09-22T08:25:19.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.153+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~6GDVIED80HB0.0 size=586290 2024-09-22T08:25:19.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.155+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=6GDVIED80HB0 tag=GNYXZFD51LCG type=write size=1634866 2024-09-22T08:25:19.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.156+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=LYT0YRNZLZQN type=del size=2426783 2024-09-22T08:25:19.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.157+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CFN5QCW6YSZG.0 size=1048576 2024-09-22T08:25:19.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.159+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CFN5QCW6YSZG.1 size=352050 2024-09-22T08:25:19.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.161+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=CFN5QCW6YSZG tag=DN0QZ5IYDB52 type=write size=2449202 2024-09-22T08:25:19.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.162+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=EXGBHQV3VT7T type=write size=335364 2024-09-22T08:25:19.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.163+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~QU5UBKFW6N22.0 size=1048576 2024-09-22T08:25:19.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.164+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~QU5UBKFW6N22.1 size=750938 2024-09-22T08:25:19.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.167+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=QU5UBKFW6N22 tag=6657XAWHP7VC type=write size=2848090 2024-09-22T08:25:19.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.168+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=ACPGHPN47NB2 type=write size=534453 2024-09-22T08:25:19.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.169+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=6GJRLOH6EAXR type=del 2024-09-22T08:25:19.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.172+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.0 size=1048576 2024-09-22T08:25:19.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.173+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.1 size=1048576 2024-09-22T08:25:19.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.174+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.2 size=365513 2024-09-22T08:25:19.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.174+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=LBY5AMRL01F9 tag=1QYQS1P9LV2R type=write size=3511241 2024-09-22T08:25:19.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.175+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=EQHQFE2GJML1 type=write size=1039692 2024-09-22T08:25:19.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.178+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~QAFID3HY92JD.0 size=661695 2024-09-22T08:25:19.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.178+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=QAFID3HY92JD tag=8R7JZJL0Y1EA type=write size=1710271 2024-09-22T08:25:19.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.179+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=MJAA62ZUD0IK type=del 2024-09-22T08:25:19.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.181+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=K0LQCJA3TOSS type=del size=2967765 2024-09-22T08:25:19.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.182+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=S093QZ0ZJBUX type=del 2024-09-22T08:25:19.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.183+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=HILK1BZMCCME type=write size=826671 2024-09-22T08:25:19.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.185+0000 7f8a8d811780 1 < canceled operation key=RL59H41J8ZNF tag=SUWQ8ZFZUKGI type=del size=3847481 2024-09-22T08:25:19.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.187+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~Y0KB27MQUX2V.0 size=712663 2024-09-22T08:25:19.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.187+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=Y0KB27MQUX2V tag=Y6GS3T22DGKO type=write size=1761239 2024-09-22T08:25:19.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.189+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=EFC4VLDWJ0UD type=del 2024-09-22T08:25:19.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.190+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=PIHQALUB9AR4 type=del size=2618826 2024-09-22T08:25:19.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.191+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=DUB98KIBSI98 type=del 2024-09-22T08:25:19.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.193+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=ONKKM6KRNMCN type=del size=3920188 2024-09-22T08:25:19.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.194+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=FFEC3ZRGF0HR type=del 2024-09-22T08:25:19.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.197+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~N7DRNV6P9K2V.0 size=849311 2024-09-22T08:25:19.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.197+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=N7DRNV6P9K2V tag=VG4WQXAB4BA9 type=write size=1897887 2024-09-22T08:25:19.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.200+0000 7f8a8d811780 1 < suggested update operation key=RRTLTMWJIWSW tag=UCRZ82D73QR6 type=del size=3280040 2024-09-22T08:25:19.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.201+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=GAV1GQMW4GNZ type=del size=3169780 2024-09-22T08:25:19.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.203+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~YB92JEFF5309.0 size=1048576 2024-09-22T08:25:19.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.203+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~YB92JEFF5309.1 size=1048576 2024-09-22T08:25:19.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.204+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~YB92JEFF5309.2 size=1030553 2024-09-22T08:25:19.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.207+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=YB92JEFF5309 tag=3IBAVXR0VIZ1 type=write size=4176281 2024-09-22T08:25:19.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.208+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=MC6ZXEBAPW09 type=write size=405004 2024-09-22T08:25:19.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.209+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=51V7L5GJ3FX5 type=del 2024-09-22T08:25:19.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.211+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=PD5KOJ5WW23K type=del size=2012709 2024-09-22T08:25:19.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.212+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=DOZCCCEXVSDN type=del 2024-09-22T08:25:19.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.215+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~5UCQGHO3N2FY.0 size=849603 2024-09-22T08:25:19.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.215+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=5UCQGHO3N2FY tag=NCUMN8RUC5MM type=write size=1898179 2024-09-22T08:25:19.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.216+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=GM24XC12Z313 type=del 2024-09-22T08:25:19.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.218+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=90FZEP13LCCO type=del size=2276428 2024-09-22T08:25:19.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.219+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=LYT0YRNZLZQN type=del size=2426783 2024-09-22T08:25:19.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.220+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=2AO5RB91RSN3 type=del size=1382584 2024-09-22T08:25:19.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.222+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=EXGBHQV3VT7T type=write size=335364 2024-09-22T08:25:19.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.224+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.0 size=1048576 2024-09-22T08:25:19.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.226+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.1 size=1048576 2024-09-22T08:25:19.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.227+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.2 size=559443 2024-09-22T08:25:19.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.227+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=MLJFO3ET0CVC tag=QDGOEJFFFOMB type=write size=3705171 2024-09-22T08:25:19.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.228+0000 7f8a8d811780 -1 < failed to complete operation key=RRTLTMWJIWSW tag=ACPGHPN47NB2 type=write size=534453: (22) Invalid argument 2024-09-22T08:25:19.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.230+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.0 size=1048576 2024-09-22T08:25:19.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.232+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.1 size=1048576 2024-09-22T08:25:19.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.233+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.2 size=86647 2024-09-22T08:25:19.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.233+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=NCIHRWGDAQM0 tag=ZE6IE6YI6664 type=write size=3232375 2024-09-22T08:25:19.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.234+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.0 size=1048576 2024-09-22T08:25:19.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.235+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.1 size=1048576 2024-09-22T08:25:19.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.235+0000 7f8a8d811780 1 < canceled part key=_multipart_7XNMR51803Y6.2~LBY5AMRL01F9.2 size=365513 2024-09-22T08:25:19.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.238+0000 7f8a8d811780 1 < canceled multipart upload key=7XNMR51803Y6 upload=LBY5AMRL01F9 tag=1QYQS1P9LV2R type=write size=3511241 2024-09-22T08:25:19.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.239+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=QQNYLJ1H2Y9Q type=del size=1639570 2024-09-22T08:25:19.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.240+0000 7f8a8d811780 1 < canceled part key=_multipart_IOZ7IXVOB70S.2~QAFID3HY92JD.0 size=661695 2024-09-22T08:25:19.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.242+0000 7f8a8d811780 1 < canceled multipart upload key=IOZ7IXVOB70S upload=QAFID3HY92JD tag=8R7JZJL0Y1EA type=write size=1710271 2024-09-22T08:25:19.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.243+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=UDOLL3USI7WY type=del size=3581529 2024-09-22T08:25:19.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.245+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=K0LQCJA3TOSS type=del 2024-09-22T08:25:19.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.247+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.0 size=1048576 2024-09-22T08:25:19.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.248+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.1 size=1048576 2024-09-22T08:25:19.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.249+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.2 size=808663 2024-09-22T08:25:19.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.249+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=HBWHOVJ67GWG tag=ATM95RDI6V01 type=write size=3954391 2024-09-22T08:25:19.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.250+0000 7f8a8d811780 1 < completed write operation key=IOZ7IXVOB70S tag=HILK1BZMCCME type=write size=826671 2024-09-22T08:25:19.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.253+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~X0R7U0VRE9QR.0 size=587903 2024-09-22T08:25:19.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.253+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=X0R7U0VRE9QR tag=FHJVVBY41W01 type=write size=1636479 2024-09-22T08:25:19.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.255+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~Y0KB27MQUX2V.0 size=712663 2024-09-22T08:25:19.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.257+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=Y0KB27MQUX2V tag=Y6GS3T22DGKO type=write size=1761239 2024-09-22T08:25:19.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.258+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=GQNJ8YS7J962 type=del size=3907963 2024-09-22T08:25:19.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.260+0000 7f8a8d811780 1 < canceled operation key=5VU70RE1GJS2 tag=PIHQALUB9AR4 type=del size=2618826 2024-09-22T08:25:19.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.261+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=SSCJKEJKX3KG type=write size=331514 2024-09-22T08:25:19.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.264+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=ONKKM6KRNMCN type=del 2024-09-22T08:25:19.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.266+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=2UI12D0RPOTT type=del size=3088863 2024-09-22T08:25:19.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.266+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~N7DRNV6P9K2V.0 size=849311 2024-09-22T08:25:19.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.269+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=N7DRNV6P9K2V tag=VG4WQXAB4BA9 type=write size=1897887 2024-09-22T08:25:19.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.270+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=O6IST2BEY61K type=write size=43134 2024-09-22T08:25:19.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.272+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=GAV1GQMW4GNZ type=del 2024-09-22T08:25:19.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.274+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.0 size=1048576 2024-09-22T08:25:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.276+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.1 size=1048576 2024-09-22T08:25:19.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.277+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.2 size=903898 2024-09-22T08:25:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.277+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=IMORY62OOTJB tag=ZVMDS75LWW04 type=write size=4049626 2024-09-22T08:25:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.278+0000 7f8a8d811780 1 < completed write operation key=7XNMR51803Y6 tag=MC6ZXEBAPW09 type=write size=405004 2024-09-22T08:25:19.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.280+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=4O4HG1J0F378 type=del size=601356 2024-09-22T08:25:19.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.281+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=PD5KOJ5WW23K type=del 2024-09-22T08:25:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.284+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~T6OZPSOMJ2JZ.0 size=1048576 2024-09-22T08:25:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.285+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~T6OZPSOMJ2JZ.1 size=410038 2024-09-22T08:25:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.285+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=T6OZPSOMJ2JZ tag=ANZLEKULW7O3 type=write size=2507190 2024-09-22T08:25:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.286+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~5UCQGHO3N2FY.0 size=849603 2024-09-22T08:25:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.289+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=5UCQGHO3N2FY tag=NCUMN8RUC5MM type=write size=1898179 2024-09-22T08:25:19.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.291+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.0 size=1048576 2024-09-22T08:25:19.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.293+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.1 size=1048576 2024-09-22T08:25:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.294+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.2 size=852936 2024-09-22T08:25:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.294+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=XWW5JNO24KXH tag=9TRVPVIS9KG7 type=write size=3998664 2024-09-22T08:25:19.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.296+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=90FZEP13LCCO type=del 2024-09-22T08:25:19.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.298+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~JVKQDQJGCSVI.0 size=987586 2024-09-22T08:25:19.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.298+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=JVKQDQJGCSVI tag=PUBSS6C1B20U type=write size=2036162 2024-09-22T08:25:19.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.301+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=2AO5RB91RSN3 type=del size=1382584 2024-09-22T08:25:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.302+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=7HTK5WHQ24V8 type=write size=611277 2024-09-22T08:25:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.303+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.0 size=1048576 2024-09-22T08:25:19.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.304+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.1 size=1048576 2024-09-22T08:25:19.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.304+0000 7f8a8d811780 1 < canceled part key=_multipart_1719KI1YP1FT.2~MLJFO3ET0CVC.2 size=559443 2024-09-22T08:25:19.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.307+0000 7f8a8d811780 1 < canceled multipart upload key=1719KI1YP1FT upload=MLJFO3ET0CVC tag=QDGOEJFFFOMB type=write size=3705171 2024-09-22T08:25:19.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.308+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=KG5OHOWDOV4Y type=del size=217158 2024-09-22T08:25:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.310+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.0 size=1048576 2024-09-22T08:25:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.310+0000 7f8a8d811780 1 < canceled part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.1 size=1048576 2024-09-22T08:25:19.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.311+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~NCIHRWGDAQM0.2 size=86647 2024-09-22T08:25:19.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.313+0000 7f8a8d811780 1 < canceled multipart upload key=GMNVYF2BY872 upload=NCIHRWGDAQM0 tag=ZE6IE6YI6664 type=write size=3232375 2024-09-22T08:25:19.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.315+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=80T8B5MQO0BA type=del size=1757360 2024-09-22T08:25:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.318+0000 7f8a8d811780 1 < suggested update operation key=RCHUCAL6CQ4F tag=QQNYLJ1H2Y9Q type=del size=1639570 2024-09-22T08:25:19.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.319+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=1GFYV6MTQTHO type=write size=924338 2024-09-22T08:25:19.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.321+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=UDOLL3USI7WY type=del 2024-09-22T08:25:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.323+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~FH73X7QR87Y7.0 size=400376 2024-09-22T08:25:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.323+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=FH73X7QR87Y7 tag=PMRWV47HP19G type=write size=1448952 2024-09-22T08:25:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.325+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.0 size=1048576 2024-09-22T08:25:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.325+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.1 size=1048576 2024-09-22T08:25:19.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.327+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~HBWHOVJ67GWG.2 size=808663 2024-09-22T08:25:19.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.329+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=HBWHOVJ67GWG tag=ATM95RDI6V01 type=write size=3954391 2024-09-22T08:25:19.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.331+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.0 size=1048576 2024-09-22T08:25:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.332+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.1 size=1048576 2024-09-22T08:25:19.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.334+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.2 size=863334 2024-09-22T08:25:19.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.334+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=ZFR702F6PL7R tag=Y2I29IXSS318 type=write size=4009062 2024-09-22T08:25:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.335+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~X0R7U0VRE9QR.0 size=587903 2024-09-22T08:25:19.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.337+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=X0R7U0VRE9QR tag=FHJVVBY41W01 type=write size=1636479 2024-09-22T08:25:19.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.339+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~WVXWC2COWWR3.0 size=297467 2024-09-22T08:25:19.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.339+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=WVXWC2COWWR3 tag=WUSATEZQFJI9 type=write size=1346043 2024-09-22T08:25:19.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.342+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=GQNJ8YS7J962 type=del size=3907963 2024-09-22T08:25:19.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.345+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~HYSMTH1PBSF7.0 size=1048576 2024-09-22T08:25:19.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.346+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~HYSMTH1PBSF7.1 size=809339 2024-09-22T08:25:19.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.347+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=HYSMTH1PBSF7 tag=OD36RZI5F2BW type=write size=2906491 2024-09-22T08:25:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.348+0000 7f8a8d811780 1 < completed write operation key=KIJ2DW4NSZKG tag=SSCJKEJKX3KG type=write size=331514 2024-09-22T08:25:19.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.351+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.0 size=1048576 2024-09-22T08:25:19.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.352+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.1 size=1048576 2024-09-22T08:25:19.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.354+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.2 size=927665 2024-09-22T08:25:19.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.354+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=LWELSML7F7O5 tag=OCOL30FBLRW6 type=write size=4073393 2024-09-22T08:25:19.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.355+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=2UI12D0RPOTT type=del 2024-09-22T08:25:19.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.358+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~XZSXLWJSK1PR.0 size=289926 2024-09-22T08:25:19.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.358+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=XZSXLWJSK1PR tag=PM72QBHHFRA6 type=write size=1338502 2024-09-22T08:25:19.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.358+0000 7f8a8d811780 -1 < failed to complete operation key=PIRW8N555T52 tag=O6IST2BEY61K type=write size=43134: (22) Invalid argument 2024-09-22T08:25:19.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.361+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=6R4UB1K822CP type=del size=3611168 2024-09-22T08:25:19.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.361+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.0 size=1048576 2024-09-22T08:25:19.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.361+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.1 size=1048576 2024-09-22T08:25:19.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.362+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~IMORY62OOTJB.2 size=903898 2024-09-22T08:25:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.364+0000 7f8a8d811780 1 < canceled multipart upload key=226G7R10IR1B upload=IMORY62OOTJB tag=ZVMDS75LWW04 type=write size=4049626 2024-09-22T08:25:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.368+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~3M86JG16FY2L.0 size=1048576 2024-09-22T08:25:19.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.369+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~3M86JG16FY2L.1 size=578126 2024-09-22T08:25:19.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.369+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=3M86JG16FY2L tag=9IWDWVV0O1C8 type=write size=2675278 2024-09-22T08:25:19.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.372+0000 7f8a8d811780 1 < suggested update operation key=7LLAS815MLFH tag=4O4HG1J0F378 type=del size=601356 2024-09-22T08:25:19.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.373+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=8UHGG7106CW4 type=del size=958417 2024-09-22T08:25:19.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.374+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~T6OZPSOMJ2JZ.0 size=1048576 2024-09-22T08:25:19.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.375+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~T6OZPSOMJ2JZ.1 size=410038 2024-09-22T08:25:19.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.378+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=T6OZPSOMJ2JZ tag=ANZLEKULW7O3 type=write size=2507190 2024-09-22T08:25:19.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.379+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=TRJDHL32KGCE type=del size=2145907 2024-09-22T08:25:19.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.380+0000 7f8a8d811780 1 < canceled part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.0 size=1048576 2024-09-22T08:25:19.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.381+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.1 size=1048576 2024-09-22T08:25:19.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.383+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~XWW5JNO24KXH.2 size=852936 2024-09-22T08:25:19.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.384+0000 7f8a8d811780 1 < canceled multipart upload key=S9JCKGZS5QLY upload=XWW5JNO24KXH tag=9TRVPVIS9KG7 type=write size=3998664 2024-09-22T08:25:19.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.386+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=79EIQQ1Z4LWC type=del size=1626061 2024-09-22T08:25:19.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.386+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~JVKQDQJGCSVI.0 size=987586 2024-09-22T08:25:19.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.389+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=JVKQDQJGCSVI tag=PUBSS6C1B20U type=write size=2036162 2024-09-22T08:25:19.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.391+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~AGCP6GVG0WD1.0 size=525911 2024-09-22T08:25:19.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.391+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=AGCP6GVG0WD1 tag=SRYOIBGV3030 type=write size=1574487 2024-09-22T08:25:19.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.393+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=7HTK5WHQ24V8 type=write size=611277 2024-09-22T08:25:19.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.395+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.0 size=1048576 2024-09-22T08:25:19.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.397+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.1 size=1048576 2024-09-22T08:25:19.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.398+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.2 size=387563 2024-09-22T08:25:19.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.399+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=2H2J8AN7T5OH tag=356BDGOK66VB type=write size=3533291 2024-09-22T08:25:19.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.400+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=KG5OHOWDOV4Y type=del 2024-09-22T08:25:19.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.401+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=WMVNKFJ25YY0 type=del size=482803 2024-09-22T08:25:19.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.403+0000 7f8a8d811780 -1 < failed to complete operation key=PIRW8N555T52 tag=80T8B5MQO0BA type=del size=1757360: (22) Invalid argument 2024-09-22T08:25:19.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.405+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~M1TUE90V9HF1.0 size=410108 2024-09-22T08:25:19.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.405+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=M1TUE90V9HF1 tag=V56WUCGH5OU2 type=write size=1458684 2024-09-22T08:25:19.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.407+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=1GFYV6MTQTHO type=write size=924338 2024-09-22T08:25:19.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.409+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=1MUI83HAU8M5 type=write size=117741 2024-09-22T08:25:19.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.410+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~FH73X7QR87Y7.0 size=400376 2024-09-22T08:25:19.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.412+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=FH73X7QR87Y7 tag=PMRWV47HP19G type=write size=1448952 2024-09-22T08:25:19.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.414+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=UW6CI8X7BJGP type=del size=4142119 2024-09-22T08:25:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.415+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.0 size=1048576 2024-09-22T08:25:19.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.416+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.1 size=1048576 2024-09-22T08:25:19.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.418+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~ZFR702F6PL7R.2 size=863334 2024-09-22T08:25:19.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.420+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=ZFR702F6PL7R tag=Y2I29IXSS318 type=write size=4009062 2024-09-22T08:25:19.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.422+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=02W19F53IZOI type=del size=3851706 2024-09-22T08:25:19.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.422+0000 7f8a8d811780 1 < canceled part key=_multipart_WOSCCX4WX2FN.2~WVXWC2COWWR3.0 size=297467 2024-09-22T08:25:19.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.425+0000 7f8a8d811780 1 < canceled multipart upload key=WOSCCX4WX2FN upload=WVXWC2COWWR3 tag=WUSATEZQFJI9 type=write size=1346043 2024-09-22T08:25:19.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.426+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=S63USLW91ISM type=del size=1730942 2024-09-22T08:25:19.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.427+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~HYSMTH1PBSF7.0 size=1048576 2024-09-22T08:25:19.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.428+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~HYSMTH1PBSF7.1 size=809339 2024-09-22T08:25:19.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.431+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=HYSMTH1PBSF7 tag=OD36RZI5F2BW type=write size=2906491 2024-09-22T08:25:19.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.433+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=NBHW9PXN6IDB type=del size=540355 2024-09-22T08:25:19.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.433+0000 7f8a8d811780 1 < canceled part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.0 size=1048576 2024-09-22T08:25:19.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.434+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.1 size=1048576 2024-09-22T08:25:19.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.435+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~LWELSML7F7O5.2 size=927665 2024-09-22T08:25:19.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.437+0000 7f8a8d811780 1 < canceled multipart upload key=H504PU8223G9 upload=LWELSML7F7O5 tag=OCOL30FBLRW6 type=write size=4073393 2024-09-22T08:25:19.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.438+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=DPMW11LDHUPQ type=del size=4088518 2024-09-22T08:25:19.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.440+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~XZSXLWJSK1PR.0 size=289926 2024-09-22T08:25:19.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.442+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=XZSXLWJSK1PR tag=PM72QBHHFRA6 type=write size=1338502 2024-09-22T08:25:19.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.444+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~NAKMDZ8DPIDQ.0 size=467152 2024-09-22T08:25:19.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.444+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=NAKMDZ8DPIDQ tag=WLH2FH4D0X85 type=write size=1515728 2024-09-22T08:25:19.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.445+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=6R4UB1K822CP type=del 2024-09-22T08:25:19.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.448+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~YRJSTBISBIX1.0 size=1048576 2024-09-22T08:25:19.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.449+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~YRJSTBISBIX1.1 size=190066 2024-09-22T08:25:19.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.449+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=YRJSTBISBIX1 tag=LPCS6WJPXQR2 type=write size=2287218 2024-09-22T08:25:19.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.450+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~3M86JG16FY2L.0 size=1048576 2024-09-22T08:25:19.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.451+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~3M86JG16FY2L.1 size=578126 2024-09-22T08:25:19.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.454+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=3M86JG16FY2L tag=9IWDWVV0O1C8 type=write size=2675278 2024-09-22T08:25:19.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.455+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=K51L0K688IQ7 type=del size=2328316 2024-09-22T08:25:19.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.457+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=8UHGG7106CW4 type=del 2024-09-22T08:25:19.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.459+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~WW4P3WQM4POV.0 size=1048576 2024-09-22T08:25:19.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.460+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~WW4P3WQM4POV.1 size=890800 2024-09-22T08:25:19.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.460+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=WW4P3WQM4POV tag=EQ05KC0BOW32 type=write size=2987952 2024-09-22T08:25:19.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.463+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=TRJDHL32KGCE type=del 2024-09-22T08:25:19.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.464+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~4WS45RVJPFPR.0 size=569111 2024-09-22T08:25:19.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.464+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=4WS45RVJPFPR tag=4JUQ0C6UCYG3 type=write size=1617687 2024-09-22T08:25:19.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.466+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=79EIQQ1Z4LWC type=del 2024-09-22T08:25:19.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.467+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=09CT0ZNV45JJ type=del size=3228129 2024-09-22T08:25:19.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.468+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~AGCP6GVG0WD1.0 size=525911 2024-09-22T08:25:19.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.471+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=AGCP6GVG0WD1 tag=SRYOIBGV3030 type=write size=1574487 2024-09-22T08:25:19.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.472+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=TE502B07OPDY type=del size=1715045 2024-09-22T08:25:19.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.473+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.0 size=1048576 2024-09-22T08:25:19.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.474+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.1 size=1048576 2024-09-22T08:25:19.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.475+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~2H2J8AN7T5OH.2 size=387563 2024-09-22T08:25:19.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.478+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=2H2J8AN7T5OH tag=356BDGOK66VB type=write size=3533291 2024-09-22T08:25:19.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.479+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=7RM2832OP7IM type=del size=4041392 2024-09-22T08:25:19.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.481+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=WMVNKFJ25YY0 type=del 2024-09-22T08:25:19.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.482+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=FQRFGUFBP5X6 type=del size=2617003 2024-09-22T08:25:19.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.483+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~M1TUE90V9HF1.0 size=410108 2024-09-22T08:25:19.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.486+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=M1TUE90V9HF1 tag=V56WUCGH5OU2 type=write size=1458684 2024-09-22T08:25:19.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.487+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=RUPYBZGHUK43 type=del size=1535371 2024-09-22T08:25:19.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.489+0000 7f8a8d811780 1 < completed write operation key=RRTLTMWJIWSW tag=1MUI83HAU8M5 type=write size=117741 2024-09-22T08:25:19.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.490+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=O3ZEL3VQ8CJ8 type=del size=583551 2024-09-22T08:25:19.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.492+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=UW6CI8X7BJGP type=del 2024-09-22T08:25:19.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.495+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~1E94BI4Y9R9T.0 size=76221 2024-09-22T08:25:19.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.495+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=1E94BI4Y9R9T tag=HKNS819ZCWDK type=write size=1124797 2024-09-22T08:25:19.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.496+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=02W19F53IZOI type=del 2024-09-22T08:25:19.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.499+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.0 size=1048576 2024-09-22T08:25:19.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.500+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.1 size=1048576 2024-09-22T08:25:19.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.501+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.2 size=891065 2024-09-22T08:25:19.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.501+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=X6E5F8RNLRQJ tag=33ZHPGARFPJU type=write size=4036793 2024-09-22T08:25:19.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.504+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=S63USLW91ISM type=del 2024-09-22T08:25:19.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.505+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=K7CI9M4Z1N5G type=del size=2494671 2024-09-22T08:25:19.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.507+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=NBHW9PXN6IDB type=del 2024-09-22T08:25:19.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.509+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~9VH62LPFBEQP.0 size=1048576 2024-09-22T08:25:19.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.510+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~9VH62LPFBEQP.1 size=667616 2024-09-22T08:25:19.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.510+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=9VH62LPFBEQP tag=ZTTQ8VOZR6UK type=write size=2764768 2024-09-22T08:25:19.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.512+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=DPMW11LDHUPQ type=del size=4088518 2024-09-22T08:25:19.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.513+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=BNBJRLQUPA6P type=del size=1671909 2024-09-22T08:25:19.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.515+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~NAKMDZ8DPIDQ.0 size=467152 2024-09-22T08:25:19.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.518+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=NAKMDZ8DPIDQ tag=WLH2FH4D0X85 type=write size=1515728 2024-09-22T08:25:19.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.519+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=JC92Q3WH5GAE type=del size=2069122 2024-09-22T08:25:19.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.520+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~YRJSTBISBIX1.0 size=1048576 2024-09-22T08:25:19.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.521+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~YRJSTBISBIX1.1 size=190066 2024-09-22T08:25:19.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.524+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=YRJSTBISBIX1 tag=LPCS6WJPXQR2 type=write size=2287218 2024-09-22T08:25:19.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.525+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=MD4HFFZB9LC1 type=del size=876192 2024-09-22T08:25:19.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.529+0000 7f8a8d811780 1 < suggested update operation key=RRTLTMWJIWSW tag=K51L0K688IQ7 type=del size=2328316 2024-09-22T08:25:19.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.532+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~WFE7AM5EJBRY.0 size=500581 2024-09-22T08:25:19.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.532+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=WFE7AM5EJBRY tag=2UUS2OLPENOA type=write size=1549157 2024-09-22T08:25:19.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.533+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~WW4P3WQM4POV.0 size=1048576 2024-09-22T08:25:19.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.534+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~WW4P3WQM4POV.1 size=890800 2024-09-22T08:25:19.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.536+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=WW4P3WQM4POV tag=EQ05KC0BOW32 type=write size=2987952 2024-09-22T08:25:19.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.539+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~2J3E1607FKCP.0 size=1048576 2024-09-22T08:25:19.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.541+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~2J3E1607FKCP.1 size=970543 2024-09-22T08:25:19.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.541+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=2J3E1607FKCP tag=MHR7TRRCVQ0E type=write size=3067695 2024-09-22T08:25:19.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.542+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~4WS45RVJPFPR.0 size=569111 2024-09-22T08:25:19.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.544+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=4WS45RVJPFPR tag=4JUQ0C6UCYG3 type=write size=1617687 2024-09-22T08:25:19.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.545+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=R3NQ3BJ7BDIN type=del size=475224 2024-09-22T08:25:19.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.546+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=09CT0ZNV45JJ type=del 2024-09-22T08:25:19.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.549+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~FMN47ZUQVL8S.0 size=612107 2024-09-22T08:25:19.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.549+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=FMN47ZUQVL8S tag=9HO2KA4XVFIB type=write size=1660683 2024-09-22T08:25:19.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.551+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=TE502B07OPDY type=del 2024-09-22T08:25:19.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.552+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=X4AJBUY3D333 type=write size=585667 2024-09-22T08:25:19.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.555+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=7RM2832OP7IM type=del 2024-09-22T08:25:19.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.556+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=GVOTRA4I6PYA type=write size=377115 2024-09-22T08:25:19.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.559+0000 7f8a8d811780 1 < suggested update operation key=IOZ7IXVOB70S tag=FQRFGUFBP5X6 type=del size=2617003 2024-09-22T08:25:19.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.560+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=Q05TZHW5FF6E type=del size=1313283 2024-09-22T08:25:19.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.563+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=RUPYBZGHUK43 type=del size=1535371 2024-09-22T08:25:19.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.565+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~BR0Q369QOFR5.0 size=594759 2024-09-22T08:25:19.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.565+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=BR0Q369QOFR5 tag=I6GUNP994G7H type=write size=1643335 2024-09-22T08:25:19.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.568+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=O3ZEL3VQ8CJ8 type=del size=583551 2024-09-22T08:25:19.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.571+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~OOIUNFPTA2QG.0 size=1048576 2024-09-22T08:25:19.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.572+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~OOIUNFPTA2QG.1 size=79106 2024-09-22T08:25:19.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.572+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=OOIUNFPTA2QG tag=UG4ZERUJG9TF type=write size=2176258 2024-09-22T08:25:19.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.572+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~1E94BI4Y9R9T.0 size=76221 2024-09-22T08:25:19.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.576+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=1E94BI4Y9R9T tag=HKNS819ZCWDK type=write size=1124797 2024-09-22T08:25:19.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.578+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~QQ2XLIK1E1AJ.0 size=1024997 2024-09-22T08:25:19.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.578+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=QQ2XLIK1E1AJ tag=OEFI7XCI3FNB type=write size=2073573 2024-09-22T08:25:19.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.579+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.0 size=1048576 2024-09-22T08:25:19.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.580+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.1 size=1048576 2024-09-22T08:25:19.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.581+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~X6E5F8RNLRQJ.2 size=891065 2024-09-22T08:25:19.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.583+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=X6E5F8RNLRQJ tag=33ZHPGARFPJU type=write size=4036793 2024-09-22T08:25:19.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.585+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=E8MKK7S5PC5L type=del size=511627 2024-09-22T08:25:19.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.587+0000 7f8a8d811780 1 < suggested update operation key=7LLAS815MLFH tag=K7CI9M4Z1N5G type=del size=2494671 2024-09-22T08:25:19.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.589+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=A5ABR69GGLOD type=del size=4032700 2024-09-22T08:25:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.590+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~9VH62LPFBEQP.0 size=1048576 2024-09-22T08:25:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.591+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~9VH62LPFBEQP.1 size=667616 2024-09-22T08:25:19.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.594+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=9VH62LPFBEQP tag=ZTTQ8VOZR6UK type=write size=2764768 2024-09-22T08:25:19.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.595+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=PF84B0QT2SIQ type=del size=3148892 2024-09-22T08:25:19.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.596+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=5VU70RE1GJS2 tag=BNBJRLQUPA6P type=del size=1671909: (2) No such file or directory 2024-09-22T08:25:19.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.597+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=HAQ82TOYWTVT type=del size=2061281 2024-09-22T08:25:19.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.599+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=JC92Q3WH5GAE type=del 2024-09-22T08:25:19.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.601+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=ZQ47DOLIJB5Z type=del size=2487742 2024-09-22T08:25:19.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.605+0000 7f8a8d811780 1 < suggested update operation key=PIRW8N555T52 tag=MD4HFFZB9LC1 type=del size=876192 2024-09-22T08:25:19.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.607+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~HDKSMIFMDF2C.0 size=123256 2024-09-22T08:25:19.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.607+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=HDKSMIFMDF2C tag=3N8BWYHEEHE0 type=write size=1171832 2024-09-22T08:25:19.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.609+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~WFE7AM5EJBRY.0 size=500581 2024-09-22T08:25:19.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.612+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=WFE7AM5EJBRY tag=2UUS2OLPENOA type=write size=1549157 2024-09-22T08:25:19.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.612+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=MMPJ2WAEVPX7 type=del size=3320442 2024-09-22T08:25:19.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.614+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~2J3E1607FKCP.0 size=1048576 2024-09-22T08:25:19.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.615+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~2J3E1607FKCP.1 size=970543 2024-09-22T08:25:19.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.619+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=2J3E1607FKCP tag=MHR7TRRCVQ0E type=write size=3067695 2024-09-22T08:25:19.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.619+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=O1DCELFCTDYM type=del size=1470065 2024-09-22T08:25:19.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.622+0000 7f8a8d811780 1 < suggested update operation key=RCHUCAL6CQ4F tag=R3NQ3BJ7BDIN type=del size=475224 2024-09-22T08:25:19.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.624+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=QLD8H8VR0B71 type=del size=3529291 2024-09-22T08:25:19.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.625+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~FMN47ZUQVL8S.0 size=612107 2024-09-22T08:25:19.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.627+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=FMN47ZUQVL8S tag=9HO2KA4XVFIB type=write size=1660683 2024-09-22T08:25:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.628+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=QELEY8UMHWXB type=del size=2418816 2024-09-22T08:25:19.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.630+0000 7f8a8d811780 1 < completed write operation key=JP7IZ0CMXTSX tag=X4AJBUY3D333 type=write size=585667 2024-09-22T08:25:19.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.631+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=Y3U5KFTED3N3 type=write size=613122 2024-09-22T08:25:19.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.633+0000 7f8a8d811780 1 < canceled operation key=T5IAHQ3CUIFR tag=GVOTRA4I6PYA type=write size=377115 2024-09-22T08:25:19.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.636+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~8O3014AYEROW.0 size=1048576 2024-09-22T08:25:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.636+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~8O3014AYEROW.1 size=953037 2024-09-22T08:25:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.636+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=8O3014AYEROW tag=RLYL16ZAXN1P type=write size=3050189 2024-09-22T08:25:19.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.637+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=Q05TZHW5FF6E type=del 2024-09-22T08:25:19.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.639+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=5G9KFX75CJR0 type=write size=431703 2024-09-22T08:25:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.640+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~BR0Q369QOFR5.0 size=594759 2024-09-22T08:25:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.642+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=BR0Q369QOFR5 tag=I6GUNP994G7H type=write size=1643335 2024-09-22T08:25:19.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.644+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=6DIWHH12XVRG type=write size=587769 2024-09-22T08:25:19.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.645+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~OOIUNFPTA2QG.0 size=1048576 2024-09-22T08:25:19.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.646+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~OOIUNFPTA2QG.1 size=79106 2024-09-22T08:25:19.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.649+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=OOIUNFPTA2QG tag=UG4ZERUJG9TF type=write size=2176258 2024-09-22T08:25:19.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.650+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=72UU263Q8EP3 type=del size=1246900 2024-09-22T08:25:19.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.652+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~QQ2XLIK1E1AJ.0 size=1024997 2024-09-22T08:25:19.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.654+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=QQ2XLIK1E1AJ tag=OEFI7XCI3FNB type=write size=2073573 2024-09-22T08:25:19.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.655+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=EM53VW5P0RO4 type=del size=2310703 2024-09-22T08:25:19.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.659+0000 7f8a8d811780 1 < suggested update operation key=KIJ2DW4NSZKG tag=E8MKK7S5PC5L type=del size=511627 2024-09-22T08:25:19.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.660+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=S35MPT8W8XC4 type=del size=1691502 2024-09-22T08:25:19.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.663+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=A5ABR69GGLOD type=del 2024-09-22T08:25:19.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.664+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=S4G2WNVIS1WQ type=del size=2261265 2024-09-22T08:25:19.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.665+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=PF84B0QT2SIQ type=del 2024-09-22T08:25:19.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.666+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=HU64NV3C9G53 type=del size=193407 2024-09-22T08:25:19.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.669+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=HAQ82TOYWTVT type=del 2024-09-22T08:25:19.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.669+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=8TK03BWKVHC8 type=del size=2997799 2024-09-22T08:25:19.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.670+0000 7f8a8d811780 1 < canceled operation key=7LLAS815MLFH tag=ZQ47DOLIJB5Z type=del size=2487742 2024-09-22T08:25:19.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.672+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=NE7U8OGRQVAT type=del size=4162282 2024-09-22T08:25:19.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.673+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~HDKSMIFMDF2C.0 size=123256 2024-09-22T08:25:19.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.675+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=HDKSMIFMDF2C tag=3N8BWYHEEHE0 type=write size=1171832 2024-09-22T08:25:19.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.679+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.0 size=1048576 2024-09-22T08:25:19.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.679+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.1 size=1048576 2024-09-22T08:25:19.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.681+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.2 size=433513 2024-09-22T08:25:19.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.681+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=17TQ21EVLMXH tag=EM6R05X3PSGL type=write size=3579241 2024-09-22T08:25:19.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.682+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=MMPJ2WAEVPX7 type=del 2024-09-22T08:25:19.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.684+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.0 size=1048576 2024-09-22T08:25:19.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.685+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.1 size=1048576 2024-09-22T08:25:19.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.687+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.2 size=854839 2024-09-22T08:25:19.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.687+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=3QYQGG9OXLSU tag=KEJJMPA0QKYX type=write size=4000567 2024-09-22T08:25:19.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.688+0000 7f8a8d811780 -1 < failed to complete operation key=RCHUCAL6CQ4F tag=O1DCELFCTDYM type=del size=1470065: (22) Invalid argument 2024-09-22T08:25:19.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.689+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=DG2K1397P3QG type=write size=508051 2024-09-22T08:25:19.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.691+0000 7f8a8d811780 -1 < failed to complete operation key=KIJ2DW4NSZKG tag=QLD8H8VR0B71 type=del size=3529291: (22) Invalid argument 2024-09-22T08:25:19.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.692+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=IAZJYG28ZCVK type=write size=516698 2024-09-22T08:25:19.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.694+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=QELEY8UMHWXB type=del 2024-09-22T08:25:19.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.696+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.0 size=1048576 2024-09-22T08:25:19.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.700+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.1 size=1048576 2024-09-22T08:25:19.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.700+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.2 size=966367 2024-09-22T08:25:19.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.700+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=MB2VOS3SNC7V tag=GBAUAPII5AU9 type=write size=4112095 2024-09-22T08:25:19.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.702+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=Y3U5KFTED3N3 type=write size=613122 2024-09-22T08:25:19.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.705+0000 7f8a8d811780 1 > prepared part key=_multipart_RRTLTMWJIWSW.2~0RTFAA7GTFE0.0 size=496991 2024-09-22T08:25:19.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.705+0000 7f8a8d811780 1 > prepared multipart upload key=RRTLTMWJIWSW upload=0RTFAA7GTFE0 tag=3OLU7B9QJO1Q type=write size=1545567 2024-09-22T08:25:19.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.706+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~8O3014AYEROW.0 size=1048576 2024-09-22T08:25:19.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.708+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~8O3014AYEROW.1 size=953037 2024-09-22T08:25:19.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.709+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=8O3014AYEROW tag=RLYL16ZAXN1P type=write size=3050189 2024-09-22T08:25:19.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.711+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=1Z6V1XF45ZGD type=write size=91384 2024-09-22T08:25:19.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.712+0000 7f8a8d811780 1 < completed write operation key=2EB57FFNN986 tag=5G9KFX75CJR0 type=write size=431703 2024-09-22T08:25:19.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.715+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~0OEC06E1CIAD.0 size=151350 2024-09-22T08:25:19.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.715+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=0OEC06E1CIAD tag=83CSALQWIDIU type=write size=1199926 2024-09-22T08:25:19.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.718+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=6DIWHH12XVRG type=write size=587769 2024-09-22T08:25:19.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.719+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=WBZ5UKZ3OS6U type=write size=139176 2024-09-22T08:25:19.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.720+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=72UU263Q8EP3 type=del 2024-09-22T08:25:19.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.723+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=P7J9BTDDSZ8T type=del size=3452917 2024-09-22T08:25:19.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.725+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=EM53VW5P0RO4 type=del size=2310703 2024-09-22T08:25:19.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.726+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=6R3V8IUUQ9CY type=del size=655454 2024-09-22T08:25:19.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.727+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=S35MPT8W8XC4 type=del 2024-09-22T08:25:19.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.729+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=1G6EAU25EES3 type=del size=956098 2024-09-22T08:25:19.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.730+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=S4G2WNVIS1WQ type=del 2024-09-22T08:25:19.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.732+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=UHM81EIPTSGX type=del size=3374434 2024-09-22T08:25:19.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.735+0000 7f8a8d811780 1 < suggested remove operation key=RRTLTMWJIWSW tag=HU64NV3C9G53 type=del 2024-09-22T08:25:19.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.738+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.0 size=1048576 2024-09-22T08:25:19.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.739+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.1 size=1048576 2024-09-22T08:25:19.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.740+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.2 size=134655 2024-09-22T08:25:19.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.740+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=P8X5WBOY8VSF tag=RS7JMLA1JD15 type=write size=3280383 2024-09-22T08:25:19.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.743+0000 7f8a8d811780 1 < suggested update operation key=S9JCKGZS5QLY tag=8TK03BWKVHC8 type=del size=2997799 2024-09-22T08:25:19.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.744+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=JN2HFXDLA0QU type=write size=176688 2024-09-22T08:25:19.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.746+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=NE7U8OGRQVAT type=del 2024-09-22T08:25:19.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.747+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=073NVB3SU3UT type=del size=519034 2024-09-22T08:25:19.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.750+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.0 size=1048576 2024-09-22T08:25:19.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.750+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.1 size=1048576 2024-09-22T08:25:19.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.750+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~17TQ21EVLMXH.2 size=433513 2024-09-22T08:25:19.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.752+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=17TQ21EVLMXH tag=EM6R05X3PSGL type=write size=3579241 2024-09-22T08:25:19.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.754+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=HACKRSSEZWBN type=write size=710366 2024-09-22T08:25:19.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.755+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.0 size=1048576 2024-09-22T08:25:19.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.756+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.1 size=1048576 2024-09-22T08:25:19.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.757+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~3QYQGG9OXLSU.2 size=854839 2024-09-22T08:25:19.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.760+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=3QYQGG9OXLSU tag=KEJJMPA0QKYX type=write size=4000567 2024-09-22T08:25:19.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.762+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.0 size=1048576 2024-09-22T08:25:19.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.764+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.1 size=1048576 2024-09-22T08:25:19.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.765+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.2 size=135174 2024-09-22T08:25:19.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.765+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=1B8IVI54E6VY tag=JPK21VJW851W type=write size=3280902 2024-09-22T08:25:19.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.769+0000 7f8a8d811780 1 < suggested remove operation key=JWJ9T6XYCUYR tag=DG2K1397P3QG type=write 2024-09-22T08:25:19.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.769+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=0UV3FLZAOEOW type=del size=3401504 2024-09-22T08:25:19.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.771+0000 7f8a8d811780 1 < completed write operation key=MJJPUJP2NSOK tag=IAZJYG28ZCVK type=write size=516698 2024-09-22T08:25:19.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.773+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~HJNV7BUF7KSG.0 size=668632 2024-09-22T08:25:19.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.773+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=HJNV7BUF7KSG tag=SMZLDJNEUJGL type=write size=1717208 2024-09-22T08:25:19.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.776+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.0 size=1048576 2024-09-22T08:25:19.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.777+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.1 size=1048576 2024-09-22T08:25:19.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.777+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~MB2VOS3SNC7V.2 size=966367 2024-09-22T08:25:19.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.779+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=MB2VOS3SNC7V tag=GBAUAPII5AU9 type=write size=4112095 2024-09-22T08:25:19.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.780+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=00AODL48ZFDV type=del size=2093981 2024-09-22T08:25:19.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.781+0000 7f8a8d811780 1 < completed part key=_multipart_RRTLTMWJIWSW.2~0RTFAA7GTFE0.0 size=496991 2024-09-22T08:25:19.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.784+0000 7f8a8d811780 1 < completed multipart upload key=RRTLTMWJIWSW upload=0RTFAA7GTFE0 tag=3OLU7B9QJO1Q type=write size=1545567 2024-09-22T08:25:19.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.786+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~SA9CNB0UIM25.0 size=696524 2024-09-22T08:25:19.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.786+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=SA9CNB0UIM25 tag=L8RM5B8W0O2T type=write size=1745100 2024-09-22T08:25:19.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.789+0000 7f8a8d811780 1 < suggested update operation key=IOZ7IXVOB70S tag=1Z6V1XF45ZGD type=write size=91384 2024-09-22T08:25:19.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.790+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=OHO29DDU8W07 type=del size=2722041 2024-09-22T08:25:19.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.792+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~0OEC06E1CIAD.0 size=151350 2024-09-22T08:25:19.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.793+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=0OEC06E1CIAD tag=83CSALQWIDIU type=write size=1199926 2024-09-22T08:25:19.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.795+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=IGRQUSBFMX8O type=del size=1382569 2024-09-22T08:25:19.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.798+0000 7f8a8d811780 1 < suggested remove operation key=LRFF14FU7C5I tag=WBZ5UKZ3OS6U type=write 2024-09-22T08:25:19.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.801+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~F86MXGIF6JJM.0 size=990720 2024-09-22T08:25:19.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.801+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=F86MXGIF6JJM tag=5MM48RQ0JEXK type=write size=2039296 2024-09-22T08:25:19.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.802+0000 7f8a8d811780 -1 < failed to complete operation key=IOZ7IXVOB70S tag=P7J9BTDDSZ8T type=del size=3452917: (22) Invalid argument 2024-09-22T08:25:19.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.804+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=DL9MYY174M7U type=del size=2878181 2024-09-22T08:25:19.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.805+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=6R3V8IUUQ9CY type=del 2024-09-22T08:25:19.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.807+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=FJS37PLX4A3K type=del size=2593722 2024-09-22T08:25:19.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.808+0000 7f8a8d811780 -1 < failed to complete operation key=JWJ9T6XYCUYR tag=1G6EAU25EES3 type=del size=956098: (22) Invalid argument 2024-09-22T08:25:19.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.809+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=N3V0Y60SSZ51 type=del size=2345470 2024-09-22T08:25:19.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.812+0000 7f8a8d811780 1 < suggested update operation key=2EB57FFNN986 tag=UHM81EIPTSGX type=del size=3374434 2024-09-22T08:25:19.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.814+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=Q960OG3HS5D7 type=del size=3061454 2024-09-22T08:25:19.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.815+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.0 size=1048576 2024-09-22T08:25:19.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.816+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.1 size=1048576 2024-09-22T08:25:19.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.816+0000 7f8a8d811780 1 < canceled part key=_multipart_LRFF14FU7C5I.2~P8X5WBOY8VSF.2 size=134655 2024-09-22T08:25:19.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.819+0000 7f8a8d811780 1 < canceled multipart upload key=LRFF14FU7C5I upload=P8X5WBOY8VSF tag=RS7JMLA1JD15 type=write size=3280383 2024-09-22T08:25:19.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.820+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=9AJQEWYLTVVZ type=del size=2367124 2024-09-22T08:25:19.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.821+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=JN2HFXDLA0QU type=write size=176688 2024-09-22T08:25:19.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.823+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=KUOMS4AIVUPH type=del size=647061 2024-09-22T08:25:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.824+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=073NVB3SU3UT type=del 2024-09-22T08:25:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.828+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~LIQ7BLWNMHPW.0 size=249244 2024-09-22T08:25:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.828+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=LIQ7BLWNMHPW tag=0I9KYFD61OPR type=write size=1297820 2024-09-22T08:25:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.828+0000 7f8a8d811780 -1 < failed to complete operation key=LRFF14FU7C5I tag=HACKRSSEZWBN type=write size=710366: (22) Invalid argument 2024-09-22T08:25:19.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.830+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=WIEFILLRGDC2 type=del size=1949740 2024-09-22T08:25:19.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.831+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.0 size=1048576 2024-09-22T08:25:19.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.831+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.1 size=1048576 2024-09-22T08:25:19.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.832+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~1B8IVI54E6VY.2 size=135174 2024-09-22T08:25:19.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.835+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=1B8IVI54E6VY tag=JPK21VJW851W type=write size=3280902 2024-09-22T08:25:19.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.836+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=53FJQJ3YT9B6 type=del size=4022175 2024-09-22T08:25:19.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.837+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=0UV3FLZAOEOW type=del 2024-09-22T08:25:19.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.840+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~78D5T7N88MT1.0 size=1048576 2024-09-22T08:25:19.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.841+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~78D5T7N88MT1.1 size=412626 2024-09-22T08:25:19.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.841+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=78D5T7N88MT1 tag=Y8U1EWO8VUOW type=write size=2509778 2024-09-22T08:25:19.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.842+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~HJNV7BUF7KSG.0 size=668632 2024-09-22T08:25:19.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.845+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=HJNV7BUF7KSG tag=SMZLDJNEUJGL type=write size=1717208 2024-09-22T08:25:19.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.846+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=CKY7JTPI9OHZ type=write size=305757 2024-09-22T08:25:19.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.847+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=00AODL48ZFDV type=del 2024-09-22T08:25:19.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.850+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=7LV8IZIID35H type=del size=2025090 2024-09-22T08:25:19.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.851+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~SA9CNB0UIM25.0 size=696524 2024-09-22T08:25:19.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.853+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=SA9CNB0UIM25 tag=L8RM5B8W0O2T type=write size=1745100 2024-09-22T08:25:19.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.856+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~RM2YVLULRWJR.0 size=754549 2024-09-22T08:25:19.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.856+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=RM2YVLULRWJR tag=9ZCXXS8616US type=write size=1803125 2024-09-22T08:25:19.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.858+0000 7f8a8d811780 1 < suggested update operation key=RCHUCAL6CQ4F tag=OHO29DDU8W07 type=del size=2722041 2024-09-22T08:25:19.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.861+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.0 size=1048576 2024-09-22T08:25:19.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.862+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.1 size=1048576 2024-09-22T08:25:19.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.863+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.2 size=299016 2024-09-22T08:25:19.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.863+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=TAUZ536I530P tag=YWCSB2YZKWAH type=write size=3444744 2024-09-22T08:25:19.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.865+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=IGRQUSBFMX8O type=del 2024-09-22T08:25:19.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.866+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=W1IFLW85TVFN type=write size=538292 2024-09-22T08:25:19.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.868+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~F86MXGIF6JJM.0 size=990720 2024-09-22T08:25:19.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.870+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=F86MXGIF6JJM tag=5MM48RQ0JEXK type=write size=2039296 2024-09-22T08:25:19.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.872+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=E1ITOPBGKSPJ type=del size=2791802 2024-09-22T08:25:19.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.874+0000 7f8a8d811780 1 < suggested update operation key=S9JCKGZS5QLY tag=DL9MYY174M7U type=del size=2878181 2024-09-22T08:25:19.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.876+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=F2FXZ3AL1ZKL type=write size=876292 2024-09-22T08:25:19.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.878+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=FJS37PLX4A3K type=del 2024-09-22T08:25:19.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.880+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~0KL4UYIQNONU.0 size=1048576 2024-09-22T08:25:19.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.881+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~0KL4UYIQNONU.1 size=1033346 2024-09-22T08:25:19.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.881+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=0KL4UYIQNONU tag=FM9OF78EFBDG type=write size=3130498 2024-09-22T08:25:19.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.883+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=N3V0Y60SSZ51 type=del 2024-09-22T08:25:19.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.884+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=Z4GXA6QSD7TZ type=write size=151264 2024-09-22T08:25:19.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.885+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=Q960OG3HS5D7 type=del 2024-09-22T08:25:19.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.888+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~2UT7AGQKU301.0 size=1048576 2024-09-22T08:25:19.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.889+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~2UT7AGQKU301.1 size=90910 2024-09-22T08:25:19.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.889+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=2UT7AGQKU301 tag=2F3K47V72GFM type=write size=2188062 2024-09-22T08:25:19.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.890+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=9AJQEWYLTVVZ type=del 2024-09-22T08:25:19.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.893+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.0 size=1048576 2024-09-22T08:25:19.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.894+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.1 size=1048576 2024-09-22T08:25:19.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.895+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.2 size=798390 2024-09-22T08:25:19.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.895+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=J67PGZGDRQJR tag=DNEC6O3CROZY type=write size=3944118 2024-09-22T08:25:19.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.896+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=KUOMS4AIVUPH type=del 2024-09-22T08:25:19.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.898+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=BVZXMP82Z6S3 type=del size=643228 2024-09-22T08:25:19.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.899+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~LIQ7BLWNMHPW.0 size=249244 2024-09-22T08:25:19.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.902+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=LIQ7BLWNMHPW tag=0I9KYFD61OPR type=write size=1297820 2024-09-22T08:25:19.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.903+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=N5AGGBPPEX66 type=del size=2378045 2024-09-22T08:25:19.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.905+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=WIEFILLRGDC2 type=del 2024-09-22T08:25:19.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.907+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~NU62D3B5ALGW.0 size=1048576 2024-09-22T08:25:19.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.909+0000 7f8a8d811780 1 > prepared part key=_multipart_7XBR6QIHD8TJ.2~NU62D3B5ALGW.1 size=672641 2024-09-22T08:25:19.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.909+0000 7f8a8d811780 1 > prepared multipart upload key=7XBR6QIHD8TJ upload=NU62D3B5ALGW tag=K9MWQVUMB00W type=write size=2769793 2024-09-22T08:25:19.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.912+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=53FJQJ3YT9B6 type=del size=4022175 2024-09-22T08:25:19.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.913+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=YOEJJZ0K3LXC type=del size=1024023 2024-09-22T08:25:19.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.915+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~78D5T7N88MT1.0 size=1048576 2024-09-22T08:25:19.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.916+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~78D5T7N88MT1.1 size=412626 2024-09-22T08:25:19.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.918+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=78D5T7N88MT1 tag=Y8U1EWO8VUOW type=write size=2509778 2024-09-22T08:25:19.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.919+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=1WQCHMZN7QQA type=write size=501753 2024-09-22T08:25:19.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.920+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=CKY7JTPI9OHZ type=write size=305757 2024-09-22T08:25:19.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.922+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~6R4VM0BGONLF.0 size=1048576 2024-09-22T08:25:19.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.923+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~6R4VM0BGONLF.1 size=858471 2024-09-22T08:25:19.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.923+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=6R4VM0BGONLF tag=8P2MT33KGMBW type=write size=2955623 2024-09-22T08:25:19.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.924+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=7LV8IZIID35H type=del 2024-09-22T08:25:19.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.927+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.0 size=1048576 2024-09-22T08:25:19.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.928+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.1 size=1048576 2024-09-22T08:25:19.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.930+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.2 size=87054 2024-09-22T08:25:19.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.930+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=IUUVDBMYFS7Q tag=WY021AU3ZV6X type=write size=3232782 2024-09-22T08:25:19.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.932+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~RM2YVLULRWJR.0 size=754549 2024-09-22T08:25:19.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.934+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=RM2YVLULRWJR tag=9ZCXXS8616US type=write size=1803125 2024-09-22T08:25:19.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.935+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=HXJ23LBFD9MG type=del size=2336032 2024-09-22T08:25:19.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.937+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.0 size=1048576 2024-09-22T08:25:19.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.938+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.1 size=1048576 2024-09-22T08:25:19.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.938+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~TAUZ536I530P.2 size=299016 2024-09-22T08:25:19.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.941+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=TAUZ536I530P tag=YWCSB2YZKWAH type=write size=3444744 2024-09-22T08:25:19.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.943+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=DP670WXLBMN1 type=del size=2397989 2024-09-22T08:25:19.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.945+0000 7f8a8d811780 1 < suggested remove operation key=WOSCCX4WX2FN tag=W1IFLW85TVFN type=write 2024-09-22T08:25:19.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.949+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~NT6O1KTNP2WQ.0 size=834844 2024-09-22T08:25:19.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.949+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=NT6O1KTNP2WQ tag=050P2PCXLG44 type=write size=1883420 2024-09-22T08:25:19.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.950+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=E1ITOPBGKSPJ type=del 2024-09-22T08:25:19.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.951+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=53K134ZCYRHT type=del size=3507501 2024-09-22T08:25:19.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.953+0000 7f8a8d811780 1 < completed write operation key=JWJ9T6XYCUYR tag=F2FXZ3AL1ZKL type=write size=876292 2024-09-22T08:25:19.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.955+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~JCLJL2BDVZ9C.0 size=170313 2024-09-22T08:25:19.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.955+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=JCLJL2BDVZ9C tag=E73WVS8PO114 type=write size=1218889 2024-09-22T08:25:19.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.957+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~0KL4UYIQNONU.0 size=1048576 2024-09-22T08:25:19.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.958+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~0KL4UYIQNONU.1 size=1033346 2024-09-22T08:25:19.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.961+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=0KL4UYIQNONU tag=FM9OF78EFBDG type=write size=3130498 2024-09-22T08:25:19.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.962+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=DCQT4PMZ1HIW type=write size=927837 2024-09-22T08:25:19.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.965+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=Z4GXA6QSD7TZ type=write size=151264 2024-09-22T08:25:19.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.965+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=LNSV10A9R1HG type=del size=3987476 2024-09-22T08:25:19.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.966+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~2UT7AGQKU301.0 size=1048576 2024-09-22T08:25:19.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.968+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~2UT7AGQKU301.1 size=90910 2024-09-22T08:25:19.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.969+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=2UT7AGQKU301 tag=2F3K47V72GFM type=write size=2188062 2024-09-22T08:25:19.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.971+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=2VMQRVL6DYWQ type=write size=594845 2024-09-22T08:25:19.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.972+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.0 size=1048576 2024-09-22T08:25:19.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.973+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.1 size=1048576 2024-09-22T08:25:19.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.974+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~J67PGZGDRQJR.2 size=798390 2024-09-22T08:25:19.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.977+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=J67PGZGDRQJR tag=DNEC6O3CROZY type=write size=3944118 2024-09-22T08:25:19.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.979+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~Z7684QC7VIVS.0 size=462765 2024-09-22T08:25:19.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.979+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=Z7684QC7VIVS tag=VFHJYYLA4MXM type=write size=1511341 2024-09-22T08:25:19.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.982+0000 7f8a8d811780 1 < suggested remove operation key=JP7IZ0CMXTSX tag=BVZXMP82Z6S3 type=del 2024-09-22T08:25:19.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.984+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=OSM0SM3G9ERG type=del size=702238 2024-09-22T08:25:19.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.985+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=N5AGGBPPEX66 type=del 2024-09-22T08:25:19.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.987+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~GOJ6MH3UWK0R.0 size=15472 2024-09-22T08:25:19.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.987+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=GOJ6MH3UWK0R tag=A5M3U0AJMFKR type=write size=1064048 2024-09-22T08:25:19.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.989+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~NU62D3B5ALGW.0 size=1048576 2024-09-22T08:25:19.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.990+0000 7f8a8d811780 1 < completed part key=_multipart_7XBR6QIHD8TJ.2~NU62D3B5ALGW.1 size=672641 2024-09-22T08:25:19.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.993+0000 7f8a8d811780 1 < completed multipart upload key=7XBR6QIHD8TJ upload=NU62D3B5ALGW tag=K9MWQVUMB00W type=write size=2769793 2024-09-22T08:25:19.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.994+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=F65VXDV9W8XJ type=del size=2871681 2024-09-22T08:25:19.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.995+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=YOEJJZ0K3LXC type=del 2024-09-22T08:25:19.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.998+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~DIML5TJV8M8M.0 size=1048576 2024-09-22T08:25:19.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.999+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~DIML5TJV8M8M.1 size=148382 2024-09-22T08:25:19.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:19.999+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=DIML5TJV8M8M tag=CWQNHLTMYA1K type=write size=2245534 2024-09-22T08:25:20.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.000+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=1WQCHMZN7QQA type=write size=501753 2024-09-22T08:25:20.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.003+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~8K0VKJXJFVCD.0 size=1048576 2024-09-22T08:25:20.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.004+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~8K0VKJXJFVCD.1 size=765213 2024-09-22T08:25:20.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.004+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=8K0VKJXJFVCD tag=7XCDT2CUMMJY type=write size=2862365 2024-09-22T08:25:20.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.005+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~6R4VM0BGONLF.0 size=1048576 2024-09-22T08:25:20.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.006+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~6R4VM0BGONLF.1 size=858471 2024-09-22T08:25:20.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.009+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=6R4VM0BGONLF tag=8P2MT33KGMBW type=write size=2955623 2024-09-22T08:25:20.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.010+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=YS7JVRGKG83X type=write size=130969 2024-09-22T08:25:20.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.012+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.0 size=1048576 2024-09-22T08:25:20.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.013+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.1 size=1048576 2024-09-22T08:25:20.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.014+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~IUUVDBMYFS7Q.2 size=87054 2024-09-22T08:25:20.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.016+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=IUUVDBMYFS7Q tag=WY021AU3ZV6X type=write size=3232782 2024-09-22T08:25:20.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.017+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=M4U722NYVC5S type=del size=2654300 2024-09-22T08:25:20.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.020+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=HXJ23LBFD9MG type=del 2024-09-22T08:25:20.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.022+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=4YMEOYOFAN71 type=del size=3396074 2024-09-22T08:25:20.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.023+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=DP670WXLBMN1 type=del 2024-09-22T08:25:20.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.026+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.0 size=1048576 2024-09-22T08:25:20.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.027+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.1 size=1048576 2024-09-22T08:25:20.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.029+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.2 size=991803 2024-09-22T08:25:20.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.029+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=I5RXX5EILC2T tag=CDIFOQ0ZRSRY type=write size=4137531 2024-09-22T08:25:20.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.030+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~NT6O1KTNP2WQ.0 size=834844 2024-09-22T08:25:20.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.033+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=NT6O1KTNP2WQ tag=050P2PCXLG44 type=write size=1883420 2024-09-22T08:25:20.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.035+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~O0EQYL77KVER.0 size=1048576 2024-09-22T08:25:20.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.036+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~O0EQYL77KVER.1 size=208704 2024-09-22T08:25:20.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.036+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=O0EQYL77KVER tag=G8NKVINY6FVT type=write size=2305856 2024-09-22T08:25:20.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.037+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=53K134ZCYRHT type=del 2024-09-22T08:25:20.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.039+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=35H3VTYKA1XH type=del size=333735 2024-09-22T08:25:20.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.040+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~JCLJL2BDVZ9C.0 size=170313 2024-09-22T08:25:20.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.044+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=JCLJL2BDVZ9C tag=E73WVS8PO114 type=write size=1218889 2024-09-22T08:25:20.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.046+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.0 size=1048576 2024-09-22T08:25:20.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.047+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.1 size=1048576 2024-09-22T08:25:20.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.048+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.2 size=941936 2024-09-22T08:25:20.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.048+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=4KBPTWR2PZTM tag=2PG8QR4C043C type=write size=4087664 2024-09-22T08:25:20.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.050+0000 7f8a8d811780 1 < completed write operation key=2EB57FFNN986 tag=DCQT4PMZ1HIW type=write size=927837 2024-09-22T08:25:20.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.051+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=596CVYC31N9N type=write size=154389 2024-09-22T08:25:20.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.052+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=LNSV10A9R1HG type=del 2024-09-22T08:25:20.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.055+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.0 size=1048576 2024-09-22T08:25:20.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.056+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.1 size=1048576 2024-09-22T08:25:20.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.057+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.2 size=107865 2024-09-22T08:25:20.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.057+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=ZB9249552JMS tag=T5UP8DDJKOEF type=write size=3253593 2024-09-22T08:25:20.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.059+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=2VMQRVL6DYWQ type=write size=594845 2024-09-22T08:25:20.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.062+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.0 size=1048576 2024-09-22T08:25:20.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.064+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.1 size=1048576 2024-09-22T08:25:20.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.065+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.2 size=584452 2024-09-22T08:25:20.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.065+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=NVJEU6FURCJL tag=02TNMF14FOVZ type=write size=3730180 2024-09-22T08:25:20.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.065+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~Z7684QC7VIVS.0 size=462765 2024-09-22T08:25:20.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.068+0000 7f8a8d811780 1 < canceled multipart upload key=226G7R10IR1B upload=Z7684QC7VIVS tag=VFHJYYLA4MXM type=write size=1511341 2024-09-22T08:25:20.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.070+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~EJN7KY38FL4J.0 size=1048576 2024-09-22T08:25:20.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.072+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~EJN7KY38FL4J.1 size=910313 2024-09-22T08:25:20.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.072+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=EJN7KY38FL4J tag=5CU14NZ8XQXZ type=write size=3007465 2024-09-22T08:25:20.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.072+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=OSM0SM3G9ERG type=del 2024-09-22T08:25:20.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.074+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=ZZ66GP8MKJWB type=del size=2151434 2024-09-22T08:25:20.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.075+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~GOJ6MH3UWK0R.0 size=15472 2024-09-22T08:25:20.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.077+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=GOJ6MH3UWK0R tag=A5M3U0AJMFKR type=write size=1064048 2024-09-22T08:25:20.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.079+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=MRJ2V2C5DXIY type=del size=3221657 2024-09-22T08:25:20.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.082+0000 7f8a8d811780 1 < suggested remove operation key=ER5UY1ML3R2H tag=F65VXDV9W8XJ type=del 2024-09-22T08:25:20.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.083+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=9Q78L1NOMO4P type=del size=440566 2024-09-22T08:25:20.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.084+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~DIML5TJV8M8M.0 size=1048576 2024-09-22T08:25:20.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.085+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~DIML5TJV8M8M.1 size=148382 2024-09-22T08:25:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.088+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=DIML5TJV8M8M tag=CWQNHLTMYA1K type=write size=2245534 2024-09-22T08:25:20.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.090+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~C6RD1HXWMOMO.0 size=856009 2024-09-22T08:25:20.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.090+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=C6RD1HXWMOMO tag=J0Q3UVUCTXJ8 type=write size=1904585 2024-09-22T08:25:20.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.092+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~8K0VKJXJFVCD.0 size=1048576 2024-09-22T08:25:20.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.093+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~8K0VKJXJFVCD.1 size=765213 2024-09-22T08:25:20.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.095+0000 7f8a8d811780 1 < completed multipart upload key=LRFF14FU7C5I upload=8K0VKJXJFVCD tag=7XCDT2CUMMJY type=write size=2862365 2024-09-22T08:25:20.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.098+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.0 size=1048576 2024-09-22T08:25:20.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.099+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.1 size=1048576 2024-09-22T08:25:20.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.101+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.2 size=195165 2024-09-22T08:25:20.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.101+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=DNHB18NZPPZU tag=RF42XQS8EDG0 type=write size=3340893 2024-09-22T08:25:20.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.105+0000 7f8a8d811780 1 < suggested update operation key=911851NVIUQS tag=YS7JVRGKG83X type=write size=130969 2024-09-22T08:25:20.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.105+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=63EF1XJGXORJ type=del size=3458953 2024-09-22T08:25:20.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.107+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=M4U722NYVC5S type=del 2024-09-22T08:25:20.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.109+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=EN3LMERCDL18 type=write size=907916 2024-09-22T08:25:20.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.110+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=4YMEOYOFAN71 type=del size=3396074 2024-09-22T08:25:20.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.112+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=W9ITKJ1R3X1Q type=write size=267282 2024-09-22T08:25:20.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.113+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.0 size=1048576 2024-09-22T08:25:20.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.114+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.1 size=1048576 2024-09-22T08:25:20.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.116+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~I5RXX5EILC2T.2 size=991803 2024-09-22T08:25:20.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.118+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=I5RXX5EILC2T tag=CDIFOQ0ZRSRY type=write size=4137531 2024-09-22T08:25:20.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.121+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~5HUUP1IW809C.0 size=1048576 2024-09-22T08:25:20.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.122+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~5HUUP1IW809C.1 size=524268 2024-09-22T08:25:20.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.122+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=5HUUP1IW809C tag=Q4JCBYNCSD2V type=write size=2621420 2024-09-22T08:25:20.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.123+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~O0EQYL77KVER.0 size=1048576 2024-09-22T08:25:20.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.124+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~O0EQYL77KVER.1 size=208704 2024-09-22T08:25:20.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.127+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=O0EQYL77KVER tag=G8NKVINY6FVT type=write size=2305856 2024-09-22T08:25:20.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.129+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~ZIBYXLVN7H24.0 size=774438 2024-09-22T08:25:20.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.129+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=ZIBYXLVN7H24 tag=C5T06BID6RV0 type=write size=1823014 2024-09-22T08:25:20.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.131+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=35H3VTYKA1XH type=del 2024-09-22T08:25:20.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.132+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=AIF998KJL0DS type=del size=2273559 2024-09-22T08:25:20.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.134+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.0 size=1048576 2024-09-22T08:25:20.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.135+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.1 size=1048576 2024-09-22T08:25:20.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.136+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~4KBPTWR2PZTM.2 size=941936 2024-09-22T08:25:20.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.138+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=4KBPTWR2PZTM tag=2PG8QR4C043C type=write size=4087664 2024-09-22T08:25:20.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.141+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~BC5ZRPG6LZXC.0 size=305861 2024-09-22T08:25:20.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.141+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=BC5ZRPG6LZXC tag=8O9LG0N9LJS6 type=write size=1354437 2024-09-22T08:25:20.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.142+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=596CVYC31N9N type=write size=154389 2024-09-22T08:25:20.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.144+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=N17HR8S0GHA0 type=del size=295634 2024-09-22T08:25:20.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.145+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.0 size=1048576 2024-09-22T08:25:20.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.146+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.1 size=1048576 2024-09-22T08:25:20.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.147+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~ZB9249552JMS.2 size=107865 2024-09-22T08:25:20.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.150+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=ZB9249552JMS tag=T5UP8DDJKOEF type=write size=3253593 2024-09-22T08:25:20.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.153+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~EJCWHQ6V7NOM.0 size=1048576 2024-09-22T08:25:20.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.154+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~EJCWHQ6V7NOM.1 size=24645 2024-09-22T08:25:20.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.154+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=EJCWHQ6V7NOM tag=HSEUID32XSUY type=write size=2121797 2024-09-22T08:25:20.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.155+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.0 size=1048576 2024-09-22T08:25:20.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.157+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.1 size=1048576 2024-09-22T08:25:20.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.159+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~NVJEU6FURCJL.2 size=584452 2024-09-22T08:25:20.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.161+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=NVJEU6FURCJL tag=02TNMF14FOVZ type=write size=3730180 2024-09-22T08:25:20.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.164+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~788VOFZ7CPRW.0 size=316109 2024-09-22T08:25:20.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.164+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=788VOFZ7CPRW tag=XKPWQKS0EYTD type=write size=1364685 2024-09-22T08:25:20.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.165+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~EJN7KY38FL4J.0 size=1048576 2024-09-22T08:25:20.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.166+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~EJN7KY38FL4J.1 size=910313 2024-09-22T08:25:20.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.170+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=EJN7KY38FL4J tag=5CU14NZ8XQXZ type=write size=3007465 2024-09-22T08:25:20.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.172+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~CHIR1V9ANOET.0 size=1048576 2024-09-22T08:25:20.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.173+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~CHIR1V9ANOET.1 size=384066 2024-09-22T08:25:20.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.173+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=CHIR1V9ANOET tag=L529FAHOMS3K type=write size=2481218 2024-09-22T08:25:20.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.174+0000 7f8a8d811780 1 < canceled operation key=GMNVYF2BY872 tag=ZZ66GP8MKJWB type=del size=2151434 2024-09-22T08:25:20.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.178+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~98X65T1DFNAF.0 size=191571 2024-09-22T08:25:20.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.178+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=98X65T1DFNAF tag=UWQKRDJEDUN6 type=write size=1240147 2024-09-22T08:25:20.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.179+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=MRJ2V2C5DXIY type=del 2024-09-22T08:25:20.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.181+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=HEMEFJCE2ZLY type=del size=1856267 2024-09-22T08:25:20.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.182+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=9Q78L1NOMO4P type=del 2024-09-22T08:25:20.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.184+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=OD20GDEULLX1 type=del size=2925887 2024-09-22T08:25:20.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.185+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~C6RD1HXWMOMO.0 size=856009 2024-09-22T08:25:20.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.187+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=C6RD1HXWMOMO tag=J0Q3UVUCTXJ8 type=write size=1904585 2024-09-22T08:25:20.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.190+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~QPXF0XH1KEZ1.0 size=1048576 2024-09-22T08:25:20.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.191+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~QPXF0XH1KEZ1.1 size=297551 2024-09-22T08:25:20.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.191+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=QPXF0XH1KEZ1 tag=NQW89BO49BU7 type=write size=2394703 2024-09-22T08:25:20.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.191+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.0 size=1048576 2024-09-22T08:25:20.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.193+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.1 size=1048576 2024-09-22T08:25:20.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.194+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~DNHB18NZPPZU.2 size=195165 2024-09-22T08:25:20.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.197+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=DNHB18NZPPZU tag=RF42XQS8EDG0 type=write size=3340893 2024-09-22T08:25:20.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.198+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=OKSW21I6WSG1 type=write size=925808 2024-09-22T08:25:20.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.200+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=63EF1XJGXORJ type=del 2024-09-22T08:25:20.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.201+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=7LQDEJ2XBSZZ type=del size=763852 2024-09-22T08:25:20.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.203+0000 7f8a8d811780 1 < completed write operation key=WOSCCX4WX2FN tag=EN3LMERCDL18 type=write size=907916 2024-09-22T08:25:20.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.205+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.0 size=1048576 2024-09-22T08:25:20.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.207+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.1 size=1048576 2024-09-22T08:25:20.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.208+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.2 size=211766 2024-09-22T08:25:20.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.208+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=YI8PMX7RN3QM tag=293XNLSGO66V type=write size=3357494 2024-09-22T08:25:20.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.209+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=W9ITKJ1R3X1Q type=write size=267282 2024-09-22T08:25:20.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.212+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~LZPSZP856T41.0 size=1048576 2024-09-22T08:25:20.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.213+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~LZPSZP856T41.1 size=955164 2024-09-22T08:25:20.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.213+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=LZPSZP856T41 tag=L3QSDMG03QQ6 type=write size=3052316 2024-09-22T08:25:20.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.213+0000 7f8a8d811780 1 < canceled part key=_multipart_KIJ2DW4NSZKG.2~5HUUP1IW809C.0 size=1048576 2024-09-22T08:25:20.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.214+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~5HUUP1IW809C.1 size=524268 2024-09-22T08:25:20.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.217+0000 7f8a8d811780 1 < canceled multipart upload key=KIJ2DW4NSZKG upload=5HUUP1IW809C tag=Q4JCBYNCSD2V type=write size=2621420 2024-09-22T08:25:20.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.219+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.0 size=1048576 2024-09-22T08:25:20.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.221+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.1 size=1048576 2024-09-22T08:25:20.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.222+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.2 size=152915 2024-09-22T08:25:20.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.222+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=5GYUCPXDUFBM tag=UJ7W9320FT2U type=write size=3298643 2024-09-22T08:25:20.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.223+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~ZIBYXLVN7H24.0 size=774438 2024-09-22T08:25:20.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.226+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=ZIBYXLVN7H24 tag=C5T06BID6RV0 type=write size=1823014 2024-09-22T08:25:20.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.229+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.0 size=1048576 2024-09-22T08:25:20.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.229+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.1 size=1048576 2024-09-22T08:25:20.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.230+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.2 size=84150 2024-09-22T08:25:20.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.230+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=50YQ5ND4PHXK tag=JU5T6B6ERAEV type=write size=3229878 2024-09-22T08:25:20.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.233+0000 7f8a8d811780 1 < suggested update operation key=1719KI1YP1FT tag=AIF998KJL0DS type=del size=2273559 2024-09-22T08:25:20.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.234+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=PX5RXUNHLRHW type=del size=2782841 2024-09-22T08:25:20.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.236+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~BC5ZRPG6LZXC.0 size=305861 2024-09-22T08:25:20.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.238+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=BC5ZRPG6LZXC tag=8O9LG0N9LJS6 type=write size=1354437 2024-09-22T08:25:20.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.241+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~5IKA7SLYUGQI.0 size=86576 2024-09-22T08:25:20.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.241+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=5IKA7SLYUGQI tag=5B6SUHVJHP5L type=write size=1135152 2024-09-22T08:25:20.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.243+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=N17HR8S0GHA0 type=del 2024-09-22T08:25:20.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.243+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=NLE84S22Y8BY type=write size=339920 2024-09-22T08:25:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.245+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~EJCWHQ6V7NOM.0 size=1048576 2024-09-22T08:25:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.247+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~EJCWHQ6V7NOM.1 size=24645 2024-09-22T08:25:20.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.249+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=EJCWHQ6V7NOM tag=HSEUID32XSUY type=write size=2121797 2024-09-22T08:25:20.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.250+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=GSEEDTOX1R7L type=write size=121866 2024-09-22T08:25:20.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.251+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~788VOFZ7CPRW.0 size=316109 2024-09-22T08:25:20.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.254+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=788VOFZ7CPRW tag=XKPWQKS0EYTD type=write size=1364685 2024-09-22T08:25:20.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.255+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=264P85OM4E03 type=write size=458832 2024-09-22T08:25:20.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.257+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~CHIR1V9ANOET.0 size=1048576 2024-09-22T08:25:20.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.258+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~CHIR1V9ANOET.1 size=384066 2024-09-22T08:25:20.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.260+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=CHIR1V9ANOET tag=L529FAHOMS3K type=write size=2481218 2024-09-22T08:25:20.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.261+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=XUVMVICYDBQ4 type=del size=2101905 2024-09-22T08:25:20.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.262+0000 7f8a8d811780 1 < canceled part key=_multipart_7LLAS815MLFH.2~98X65T1DFNAF.0 size=191571 2024-09-22T08:25:20.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.264+0000 7f8a8d811780 1 < canceled multipart upload key=7LLAS815MLFH upload=98X65T1DFNAF tag=UWQKRDJEDUN6 type=write size=1240147 2024-09-22T08:25:20.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.266+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~NP83X3RKT2B4.0 size=890779 2024-09-22T08:25:20.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.266+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=NP83X3RKT2B4 tag=LBN1OH7ZWYR4 type=write size=1939355 2024-09-22T08:25:20.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.269+0000 7f8a8d811780 1 < canceled operation key=EILTWP17M0NL tag=HEMEFJCE2ZLY type=del size=1856267 2024-09-22T08:25:20.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.269+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=MUNVN0B9USCG type=del size=1317442 2024-09-22T08:25:20.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.271+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=OD20GDEULLX1 type=del 2024-09-22T08:25:20.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.274+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.0 size=1048576 2024-09-22T08:25:20.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.275+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.1 size=1048576 2024-09-22T08:25:20.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.276+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.2 size=1019823 2024-09-22T08:25:20.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.276+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=XDEOV3457CB2 tag=LMCUX2HCIVUY type=write size=4165551 2024-09-22T08:25:20.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.278+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~QPXF0XH1KEZ1.0 size=1048576 2024-09-22T08:25:20.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.279+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~QPXF0XH1KEZ1.1 size=297551 2024-09-22T08:25:20.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.281+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=QPXF0XH1KEZ1 tag=NQW89BO49BU7 type=write size=2394703 2024-09-22T08:25:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.282+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=H5F677ZR1DDF type=del size=346701 2024-09-22T08:25:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.284+0000 7f8a8d811780 1 < completed write operation key=RL59H41J8ZNF tag=OKSW21I6WSG1 type=write size=925808 2024-09-22T08:25:20.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.285+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=D0EW8DZ8GMRJ type=del size=799487 2024-09-22T08:25:20.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.286+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=7LQDEJ2XBSZZ type=del 2024-09-22T08:25:20.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.288+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=98QNNDA6DW9P type=del size=3126943 2024-09-22T08:25:20.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.289+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.0 size=1048576 2024-09-22T08:25:20.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.290+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.1 size=1048576 2024-09-22T08:25:20.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.291+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~YI8PMX7RN3QM.2 size=211766 2024-09-22T08:25:20.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.294+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=YI8PMX7RN3QM tag=293XNLSGO66V type=write size=3357494 2024-09-22T08:25:20.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.297+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~BBAFPQWZUOOP.0 size=889718 2024-09-22T08:25:20.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.297+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=BBAFPQWZUOOP tag=L33RR8DKEW6V type=write size=1938294 2024-09-22T08:25:20.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.298+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~LZPSZP856T41.0 size=1048576 2024-09-22T08:25:20.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.300+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~LZPSZP856T41.1 size=955164 2024-09-22T08:25:20.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.302+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=LZPSZP856T41 tag=L3QSDMG03QQ6 type=write size=3052316 2024-09-22T08:25:20.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.303+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=0BKHQGU0H1J8 type=del size=992740 2024-09-22T08:25:20.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.305+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.0 size=1048576 2024-09-22T08:25:20.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.306+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.1 size=1048576 2024-09-22T08:25:20.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.308+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~5GYUCPXDUFBM.2 size=152915 2024-09-22T08:25:20.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.310+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=5GYUCPXDUFBM tag=UJ7W9320FT2U type=write size=3298643 2024-09-22T08:25:20.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.311+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=YHR060ANPHKD type=del size=929741 2024-09-22T08:25:20.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.313+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.0 size=1048576 2024-09-22T08:25:20.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.314+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.1 size=1048576 2024-09-22T08:25:20.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.315+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~50YQ5ND4PHXK.2 size=84150 2024-09-22T08:25:20.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.318+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=50YQ5ND4PHXK tag=JU5T6B6ERAEV type=write size=3229878 2024-09-22T08:25:20.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.321+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.0 size=1048576 2024-09-22T08:25:20.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.322+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.1 size=1048576 2024-09-22T08:25:20.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.324+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.2 size=354190 2024-09-22T08:25:20.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.324+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=PWJWB9RRZDCI tag=HE3V3XAYTU5G type=write size=3499918 2024-09-22T08:25:20.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.328+0000 7f8a8d811780 1 < suggested update operation key=WR1JR0APSOKN tag=PX5RXUNHLRHW type=del size=2782841 2024-09-22T08:25:20.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.330+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=GG3GCCCDV3LW type=del size=3442778 2024-09-22T08:25:20.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.330+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~5IKA7SLYUGQI.0 size=86576 2024-09-22T08:25:20.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.333+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=5IKA7SLYUGQI tag=5B6SUHVJHP5L type=write size=1135152 2024-09-22T08:25:20.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.334+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=Z6PS1D6MHIQL type=del size=390468 2024-09-22T08:25:20.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.336+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=NLE84S22Y8BY type=write size=339920 2024-09-22T08:25:20.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.338+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~TS36V83U3UYM.0 size=1048576 2024-09-22T08:25:20.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.339+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~TS36V83U3UYM.1 size=615466 2024-09-22T08:25:20.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.339+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=TS36V83U3UYM tag=EEOWBI3OJQRO type=write size=2712618 2024-09-22T08:25:20.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.341+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=GSEEDTOX1R7L type=write size=121866 2024-09-22T08:25:20.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.343+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.0 size=1048576 2024-09-22T08:25:20.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.345+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.1 size=1048576 2024-09-22T08:25:20.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.346+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.2 size=125404 2024-09-22T08:25:20.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.346+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=B6RO4L0F6NK3 tag=8F9FYN9A8MQE type=write size=3271132 2024-09-22T08:25:20.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.350+0000 7f8a8d811780 1 < suggested update operation key=7LLAS815MLFH tag=264P85OM4E03 type=write size=458832 2024-09-22T08:25:20.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.350+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=G0LOSSPRGWUP type=del size=2475256 2024-09-22T08:25:20.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.354+0000 7f8a8d811780 1 < suggested remove operation key=LRFF14FU7C5I tag=XUVMVICYDBQ4 type=del 2024-09-22T08:25:20.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.355+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=7E97EORYGEPU type=del size=3912664 2024-09-22T08:25:20.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.356+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~NP83X3RKT2B4.0 size=890779 2024-09-22T08:25:20.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.359+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=NP83X3RKT2B4 tag=LBN1OH7ZWYR4 type=write size=1939355 2024-09-22T08:25:20.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.361+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~GXR8W8BL9XLN.0 size=233508 2024-09-22T08:25:20.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.361+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=GXR8W8BL9XLN tag=YMVNTAH58W0B type=write size=1282084 2024-09-22T08:25:20.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.363+0000 7f8a8d811780 -1 < failed to complete operation key=7LLAS815MLFH tag=MUNVN0B9USCG type=del size=1317442: (22) Invalid argument 2024-09-22T08:25:20.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.364+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=GC5D7K82ZGD9 type=del size=1898814 2024-09-22T08:25:20.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.365+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.0 size=1048576 2024-09-22T08:25:20.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.366+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.1 size=1048576 2024-09-22T08:25:20.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.368+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~XDEOV3457CB2.2 size=1019823 2024-09-22T08:25:20.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.370+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=XDEOV3457CB2 tag=LMCUX2HCIVUY type=write size=4165551 2024-09-22T08:25:20.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.373+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.0 size=1048576 2024-09-22T08:25:20.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.374+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.1 size=1048576 2024-09-22T08:25:20.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.375+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.2 size=891116 2024-09-22T08:25:20.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.375+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=34DHBKVNM8KL tag=O9AXE5DHC7GO type=write size=4036844 2024-09-22T08:25:20.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.376+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=H5F677ZR1DDF type=del 2024-09-22T08:25:20.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.378+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~DKZ0U5OMJJH0.0 size=1048576 2024-09-22T08:25:20.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.380+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~DKZ0U5OMJJH0.1 size=658753 2024-09-22T08:25:20.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.380+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=DKZ0U5OMJJH0 tag=7DYGJUUG63L8 type=write size=2755905 2024-09-22T08:25:20.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.381+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=D0EW8DZ8GMRJ type=del 2024-09-22T08:25:20.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.383+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=P3TPZ486TK1G type=del size=2985153 2024-09-22T08:25:20.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.383+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=98QNNDA6DW9P type=del 2024-09-22T08:25:20.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.387+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.0 size=1048576 2024-09-22T08:25:20.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.388+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.1 size=1048576 2024-09-22T08:25:20.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.388+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.2 size=403738 2024-09-22T08:25:20.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.388+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=HBACM95PL1AF tag=U7JWAU6HMURC type=write size=3549466 2024-09-22T08:25:20.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.390+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~BBAFPQWZUOOP.0 size=889718 2024-09-22T08:25:20.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.392+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=BBAFPQWZUOOP tag=L33RR8DKEW6V type=write size=1938294 2024-09-22T08:25:20.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.394+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.0 size=1048576 2024-09-22T08:25:20.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.395+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.1 size=1048576 2024-09-22T08:25:20.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.397+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.2 size=73507 2024-09-22T08:25:20.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.397+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=MEYJEG0XSK03 tag=W0S78MHI7AMB type=write size=3219235 2024-09-22T08:25:20.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.398+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=0BKHQGU0H1J8 type=del 2024-09-22T08:25:20.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.399+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=3ORG9S5XTHDW type=del size=2760552 2024-09-22T08:25:20.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.403+0000 7f8a8d811780 1 < suggested remove operation key=A8TGVQ273MNF tag=YHR060ANPHKD type=del 2024-09-22T08:25:20.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.406+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~8IKIFKNYAE82.0 size=145415 2024-09-22T08:25:20.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.406+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=8IKIFKNYAE82 tag=QDOCM2W1YUZB type=write size=1193991 2024-09-22T08:25:20.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.406+0000 7f8a8d811780 1 < canceled part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.0 size=1048576 2024-09-22T08:25:20.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.406+0000 7f8a8d811780 1 < canceled part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.1 size=1048576 2024-09-22T08:25:20.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.407+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~PWJWB9RRZDCI.2 size=354190 2024-09-22T08:25:20.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.409+0000 7f8a8d811780 1 < canceled multipart upload key=WR1JR0APSOKN upload=PWJWB9RRZDCI tag=HE3V3XAYTU5G type=write size=3499918 2024-09-22T08:25:20.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.412+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CNZJRDOTCM3P.0 size=1048576 2024-09-22T08:25:20.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.413+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~CNZJRDOTCM3P.1 size=293170 2024-09-22T08:25:20.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.413+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=CNZJRDOTCM3P tag=9RIKLW63TNCY type=write size=2390322 2024-09-22T08:25:20.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.414+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=GG3GCCCDV3LW type=del 2024-09-22T08:25:20.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.417+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~0ZBDV77X6FNL.0 size=998012 2024-09-22T08:25:20.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.417+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=0ZBDV77X6FNL tag=OJ8JOMIVQSMQ type=write size=2046588 2024-09-22T08:25:20.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.418+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=Z6PS1D6MHIQL type=del 2024-09-22T08:25:20.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.419+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=S40FNC5329D3 type=del size=392913 2024-09-22T08:25:20.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.421+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~TS36V83U3UYM.0 size=1048576 2024-09-22T08:25:20.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.422+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~TS36V83U3UYM.1 size=615466 2024-09-22T08:25:20.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.425+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=TS36V83U3UYM tag=EEOWBI3OJQRO type=write size=2712618 2024-09-22T08:25:20.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.427+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~RWO6WYRXOS3B.0 size=644752 2024-09-22T08:25:20.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.427+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=RWO6WYRXOS3B tag=I8M14993COIZ type=write size=1693328 2024-09-22T08:25:20.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.427+0000 7f8a8d811780 1 < canceled part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.0 size=1048576 2024-09-22T08:25:20.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.429+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.1 size=1048576 2024-09-22T08:25:20.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.430+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~B6RO4L0F6NK3.2 size=125404 2024-09-22T08:25:20.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.432+0000 7f8a8d811780 1 < canceled multipart upload key=7LLAS815MLFH upload=B6RO4L0F6NK3 tag=8F9FYN9A8MQE type=write size=3271132 2024-09-22T08:25:20.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.435+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.0 size=1048576 2024-09-22T08:25:20.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.436+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.1 size=1048576 2024-09-22T08:25:20.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.437+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.2 size=934731 2024-09-22T08:25:20.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.437+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=P81MAEJY3GWP tag=VBAHEKYT0N4G type=write size=4080459 2024-09-22T08:25:20.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.438+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=G0LOSSPRGWUP type=del 2024-09-22T08:25:20.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.440+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=B3JE8SS0QXXR type=del size=521444 2024-09-22T08:25:20.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.441+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=7E97EORYGEPU type=del 2024-09-22T08:25:20.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.444+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~VX5I3JIBWELJ.0 size=443001 2024-09-22T08:25:20.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.444+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=VX5I3JIBWELJ tag=G074HWVPDROL type=write size=1491577 2024-09-22T08:25:20.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.445+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~GXR8W8BL9XLN.0 size=233508 2024-09-22T08:25:20.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.448+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=GXR8W8BL9XLN tag=YMVNTAH58W0B type=write size=1282084 2024-09-22T08:25:20.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.450+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~YNF50UJ91TOS.0 size=193941 2024-09-22T08:25:20.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.450+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=YNF50UJ91TOS tag=4M8XRWOKLI2G type=write size=1242517 2024-09-22T08:25:20.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.453+0000 7f8a8d811780 1 < suggested update operation key=2EB57FFNN986 tag=GC5D7K82ZGD9 type=del size=1898814 2024-09-22T08:25:20.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.455+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~5QRIS56ASFON.0 size=1048576 2024-09-22T08:25:20.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.458+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~5QRIS56ASFON.1 size=998942 2024-09-22T08:25:20.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.458+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=5QRIS56ASFON tag=7QRFTTT3F7DR type=write size=3096094 2024-09-22T08:25:20.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.459+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.0 size=1048576 2024-09-22T08:25:20.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.462+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.1 size=1048576 2024-09-22T08:25:20.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.463+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~34DHBKVNM8KL.2 size=891116 2024-09-22T08:25:20.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.464+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=34DHBKVNM8KL tag=O9AXE5DHC7GO type=write size=4036844 2024-09-22T08:25:20.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.467+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~JDN9VYYHBGZT.0 size=405959 2024-09-22T08:25:20.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.467+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=JDN9VYYHBGZT tag=UQJDT2U1J44S type=write size=1454535 2024-09-22T08:25:20.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.467+0000 7f8a8d811780 1 < canceled part key=_multipart_9EY50PUC6AJJ.2~DKZ0U5OMJJH0.0 size=1048576 2024-09-22T08:25:20.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.469+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~DKZ0U5OMJJH0.1 size=658753 2024-09-22T08:25:20.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.471+0000 7f8a8d811780 1 < canceled multipart upload key=9EY50PUC6AJJ upload=DKZ0U5OMJJH0 tag=7DYGJUUG63L8 type=write size=2755905 2024-09-22T08:25:20.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.473+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=AGVMQCJJL1Y8 type=del size=2951331 2024-09-22T08:25:20.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.475+0000 7f8a8d811780 1 < suggested update operation key=911851NVIUQS tag=P3TPZ486TK1G type=del size=2985153 2024-09-22T08:25:20.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.477+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~LLP7XVUWCCYZ.0 size=1048576 2024-09-22T08:25:20.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.479+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~LLP7XVUWCCYZ.1 size=14172 2024-09-22T08:25:20.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.479+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=LLP7XVUWCCYZ tag=2DAF842EPSKI type=write size=2111324 2024-09-22T08:25:20.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.480+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.0 size=1048576 2024-09-22T08:25:20.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.481+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.1 size=1048576 2024-09-22T08:25:20.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.482+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~HBACM95PL1AF.2 size=403738 2024-09-22T08:25:20.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.485+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=HBACM95PL1AF tag=U7JWAU6HMURC type=write size=3549466 2024-09-22T08:25:20.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.486+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=KR5BKG3WZ7HU type=del size=515678 2024-09-22T08:25:20.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.487+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.0 size=1048576 2024-09-22T08:25:20.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.489+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.1 size=1048576 2024-09-22T08:25:20.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.489+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~MEYJEG0XSK03.2 size=73507 2024-09-22T08:25:20.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.491+0000 7f8a8d811780 1 < canceled multipart upload key=226G7R10IR1B upload=MEYJEG0XSK03 tag=W0S78MHI7AMB type=write size=3219235 2024-09-22T08:25:20.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.495+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.0 size=1048576 2024-09-22T08:25:20.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.496+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.1 size=1048576 2024-09-22T08:25:20.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.496+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.2 size=851429 2024-09-22T08:25:20.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.496+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=HQ77YPHEIL1Q tag=BI1C1RJAVVP6 type=write size=3997157 2024-09-22T08:25:20.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.498+0000 7f8a8d811780 -1 < failed to complete operation key=911851NVIUQS tag=3ORG9S5XTHDW type=del size=2760552: (22) Invalid argument 2024-09-22T08:25:20.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.500+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=107K6V2TAE48 type=del size=2160574 2024-09-22T08:25:20.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.501+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~8IKIFKNYAE82.0 size=145415 2024-09-22T08:25:20.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.503+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=8IKIFKNYAE82 tag=QDOCM2W1YUZB type=write size=1193991 2024-09-22T08:25:20.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.505+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=3J035TNC30FP type=del size=1179302 2024-09-22T08:25:20.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.506+0000 7f8a8d811780 1 < completed part key=_multipart_LRFF14FU7C5I.2~CNZJRDOTCM3P.0 size=1048576 2024-09-22T08:25:20.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.506+0000 7f8a8d811780 1 < canceled part key=_multipart_LRFF14FU7C5I.2~CNZJRDOTCM3P.1 size=293170 2024-09-22T08:25:20.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.508+0000 7f8a8d811780 1 < canceled multipart upload key=LRFF14FU7C5I upload=CNZJRDOTCM3P tag=9RIKLW63TNCY type=write size=2390322 2024-09-22T08:25:20.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.509+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=4G7EQ48LHT3W type=del size=1242889 2024-09-22T08:25:20.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.511+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~0ZBDV77X6FNL.0 size=998012 2024-09-22T08:25:20.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.514+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=0ZBDV77X6FNL tag=OJ8JOMIVQSMQ type=write size=2046588 2024-09-22T08:25:20.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.514+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=RO8BV8G4NCJH type=del size=1325808 2024-09-22T08:25:20.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.518+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=S40FNC5329D3 type=del 2024-09-22T08:25:20.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.519+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=C30D4P2HJSE6 type=write size=867132 2024-09-22T08:25:20.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.520+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~RWO6WYRXOS3B.0 size=644752 2024-09-22T08:25:20.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.523+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=RWO6WYRXOS3B tag=I8M14993COIZ type=write size=1693328 2024-09-22T08:25:20.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.525+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=WUNAFZA93N5F type=del size=1688626 2024-09-22T08:25:20.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.526+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.0 size=1048576 2024-09-22T08:25:20.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.526+0000 7f8a8d811780 1 < canceled part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.1 size=1048576 2024-09-22T08:25:20.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.527+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~P81MAEJY3GWP.2 size=934731 2024-09-22T08:25:20.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.529+0000 7f8a8d811780 1 < canceled multipart upload key=JWJ9T6XYCUYR upload=P81MAEJY3GWP tag=VBAHEKYT0N4G type=write size=4080459 2024-09-22T08:25:20.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.530+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=1QR166EB97HE type=del size=1473739 2024-09-22T08:25:20.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.532+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=B3JE8SS0QXXR type=del 2024-09-22T08:25:20.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.533+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=CLR0LPAD4PUF type=del size=3555514 2024-09-22T08:25:20.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.534+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~VX5I3JIBWELJ.0 size=443001 2024-09-22T08:25:20.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.537+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=VX5I3JIBWELJ tag=G074HWVPDROL type=write size=1491577 2024-09-22T08:25:20.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.538+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=NFLZQ5I1Q1RW type=del size=1726526 2024-09-22T08:25:20.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.540+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~YNF50UJ91TOS.0 size=193941 2024-09-22T08:25:20.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.542+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=YNF50UJ91TOS tag=4M8XRWOKLI2G type=write size=1242517 2024-09-22T08:25:20.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.543+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=415EXJGGRQD1 type=del size=1717541 2024-09-22T08:25:20.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.545+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~5QRIS56ASFON.0 size=1048576 2024-09-22T08:25:20.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.546+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~5QRIS56ASFON.1 size=998942 2024-09-22T08:25:20.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.549+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=5QRIS56ASFON tag=7QRFTTT3F7DR type=write size=3096094 2024-09-22T08:25:20.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.551+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~JQOLF112C38K.0 size=1048576 2024-09-22T08:25:20.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.552+0000 7f8a8d811780 1 > prepared part key=_multipart_S9JCKGZS5QLY.2~JQOLF112C38K.1 size=562338 2024-09-22T08:25:20.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.552+0000 7f8a8d811780 1 > prepared multipart upload key=S9JCKGZS5QLY upload=JQOLF112C38K tag=1MB68DCX79GZ type=write size=2659490 2024-09-22T08:25:20.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.552+0000 7f8a8d811780 1 < canceled part key=_multipart_WOSCCX4WX2FN.2~JDN9VYYHBGZT.0 size=405959 2024-09-22T08:25:20.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.555+0000 7f8a8d811780 1 < canceled multipart upload key=WOSCCX4WX2FN upload=JDN9VYYHBGZT tag=UQJDT2U1J44S type=write size=1454535 2024-09-22T08:25:20.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.558+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~I30WJ19TXS94.0 size=1048576 2024-09-22T08:25:20.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.559+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~I30WJ19TXS94.1 size=786288 2024-09-22T08:25:20.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.559+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=I30WJ19TXS94 tag=ATSAYMLQKFTB type=write size=2883440 2024-09-22T08:25:20.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.559+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=AGVMQCJJL1Y8 type=del 2024-09-22T08:25:20.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.561+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=ZR9O19ZYAZYT type=del size=3490550 2024-09-22T08:25:20.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.562+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~LLP7XVUWCCYZ.0 size=1048576 2024-09-22T08:25:20.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.564+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~LLP7XVUWCCYZ.1 size=14172 2024-09-22T08:25:20.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.566+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=LLP7XVUWCCYZ tag=2DAF842EPSKI type=write size=2111324 2024-09-22T08:25:20.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.569+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.0 size=1048576 2024-09-22T08:25:20.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.569+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.1 size=1048576 2024-09-22T08:25:20.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.571+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.2 size=917071 2024-09-22T08:25:20.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.571+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=ELDVAMJ6YSAO tag=ZGMU2VMZYFJC type=write size=4062799 2024-09-22T08:25:20.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.574+0000 7f8a8d811780 1 < suggested remove operation key=RCHUCAL6CQ4F tag=KR5BKG3WZ7HU type=del 2024-09-22T08:25:20.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.576+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=6TS2TMX654DS type=write size=163682 2024-09-22T08:25:20.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.577+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.0 size=1048576 2024-09-22T08:25:20.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.578+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.1 size=1048576 2024-09-22T08:25:20.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.580+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~HQ77YPHEIL1Q.2 size=851429 2024-09-22T08:25:20.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.582+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=HQ77YPHEIL1Q tag=BI1C1RJAVVP6 type=write size=3997157 2024-09-22T08:25:20.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.585+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.0 size=1048576 2024-09-22T08:25:20.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.586+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.1 size=1048576 2024-09-22T08:25:20.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.588+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.2 size=830172 2024-09-22T08:25:20.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.588+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=33K3IFJ7OTIZ tag=A5HLR1NVRP49 type=write size=3975900 2024-09-22T08:25:20.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.589+0000 7f8a8d811780 -1 < failed to complete operation key=RCHUCAL6CQ4F tag=107K6V2TAE48 type=del size=2160574: (22) Invalid argument 2024-09-22T08:25:20.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.592+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~KQDHK6RXGQPF.0 size=1048576 2024-09-22T08:25:20.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.593+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~KQDHK6RXGQPF.1 size=264967 2024-09-22T08:25:20.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.593+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=KQDHK6RXGQPF tag=YP9B08IRC2K5 type=write size=2362119 2024-09-22T08:25:20.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.595+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=3J035TNC30FP type=del 2024-09-22T08:25:20.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.596+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=C3JVC7FBQYNO type=del size=433589 2024-09-22T08:25:20.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.598+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=4G7EQ48LHT3W type=del size=1242889 2024-09-22T08:25:20.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.600+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.0 size=1048576 2024-09-22T08:25:20.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.601+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.1 size=1048576 2024-09-22T08:25:20.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.603+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.2 size=777711 2024-09-22T08:25:20.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.603+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=6R3ZPQRJ305N tag=B2K13PKGQCB6 type=write size=3923439 2024-09-22T08:25:20.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.605+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=RO8BV8G4NCJH type=del 2024-09-22T08:25:20.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.605+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=UL62XGXBOBJP type=del size=3285190 2024-09-22T08:25:20.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.607+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=C30D4P2HJSE6 type=write size=867132 2024-09-22T08:25:20.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.608+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=JYYADACH1TX2 type=write size=726522 2024-09-22T08:25:20.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.610+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=WUNAFZA93N5F type=del 2024-09-22T08:25:20.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.612+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~VCNRL3NFBTKS.0 size=484284 2024-09-22T08:25:20.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.612+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=VCNRL3NFBTKS tag=W14QX1EKOIV5 type=write size=1532860 2024-09-22T08:25:20.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.614+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=1QR166EB97HE type=del 2024-09-22T08:25:20.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.617+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~C2SEF047NLSC.0 size=1048576 2024-09-22T08:25:20.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.618+0000 7f8a8d811780 1 > prepared part key=_multipart_GMNVYF2BY872.2~C2SEF047NLSC.1 size=98520 2024-09-22T08:25:20.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.618+0000 7f8a8d811780 1 > prepared multipart upload key=GMNVYF2BY872 upload=C2SEF047NLSC tag=S4CRN98WHWF5 type=write size=2195672 2024-09-22T08:25:20.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.619+0000 7f8a8d811780 1 < canceled operation key=5VU70RE1GJS2 tag=CLR0LPAD4PUF type=del size=3555514 2024-09-22T08:25:20.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.622+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~ACRWF5I58K71.0 size=650367 2024-09-22T08:25:20.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.622+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=ACRWF5I58K71 tag=BU3H00LKS6AE type=write size=1698943 2024-09-22T08:25:20.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.624+0000 7f8a8d811780 -1 < failed to complete operation key=RCHUCAL6CQ4F tag=NFLZQ5I1Q1RW type=del size=1726526: (22) Invalid argument 2024-09-22T08:25:20.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.625+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=7347WFO87YOJ type=del size=3460537 2024-09-22T08:25:20.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.626+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=415EXJGGRQD1 type=del 2024-09-22T08:25:20.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.628+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=ZL5OL8EC0CAP type=del size=2948971 2024-09-22T08:25:20.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.629+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~JQOLF112C38K.0 size=1048576 2024-09-22T08:25:20.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.630+0000 7f8a8d811780 1 < completed part key=_multipart_S9JCKGZS5QLY.2~JQOLF112C38K.1 size=562338 2024-09-22T08:25:20.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.634+0000 7f8a8d811780 1 < completed multipart upload key=S9JCKGZS5QLY upload=JQOLF112C38K tag=1MB68DCX79GZ type=write size=2659490 2024-09-22T08:25:20.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.635+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~V4GO3LHKV6Q0.0 size=1048576 2024-09-22T08:25:20.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.637+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~V4GO3LHKV6Q0.1 size=77005 2024-09-22T08:25:20.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.637+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=V4GO3LHKV6Q0 tag=QKHAK3RTA32V type=write size=2174157 2024-09-22T08:25:20.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.637+0000 7f8a8d811780 1 < canceled part key=_multipart_911851NVIUQS.2~I30WJ19TXS94.0 size=1048576 2024-09-22T08:25:20.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.638+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~I30WJ19TXS94.1 size=786288 2024-09-22T08:25:20.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.640+0000 7f8a8d811780 1 < canceled multipart upload key=911851NVIUQS upload=I30WJ19TXS94 tag=ATSAYMLQKFTB type=write size=2883440 2024-09-22T08:25:20.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.644+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~RGPWPNBAT8B3.0 size=446266 2024-09-22T08:25:20.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.644+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=RGPWPNBAT8B3 tag=GPJ93TCJ2E1N type=write size=1494842 2024-09-22T08:25:20.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.646+0000 7f8a8d811780 1 < suggested remove operation key=EILTWP17M0NL tag=ZR9O19ZYAZYT type=del 2024-09-22T08:25:20.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.647+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=WNYSRIL6L9NS type=write size=235262 2024-09-22T08:25:20.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.649+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.0 size=1048576 2024-09-22T08:25:20.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.650+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.1 size=1048576 2024-09-22T08:25:20.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.652+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~ELDVAMJ6YSAO.2 size=917071 2024-09-22T08:25:20.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.653+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=ELDVAMJ6YSAO tag=ZGMU2VMZYFJC type=write size=4062799 2024-09-22T08:25:20.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.655+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=VHJ7AJD492TF type=del size=2554063 2024-09-22T08:25:20.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.656+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=6TS2TMX654DS type=write size=163682 2024-09-22T08:25:20.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.657+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=DRRF7NXOX7HZ type=del size=2403783 2024-09-22T08:25:20.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.659+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.0 size=1048576 2024-09-22T08:25:20.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.660+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.1 size=1048576 2024-09-22T08:25:20.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.661+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~33K3IFJ7OTIZ.2 size=830172 2024-09-22T08:25:20.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.663+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=33K3IFJ7OTIZ tag=A5HLR1NVRP49 type=write size=3975900 2024-09-22T08:25:20.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.666+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~C7L2WDNJLTA9.0 size=1048576 2024-09-22T08:25:20.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.667+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~C7L2WDNJLTA9.1 size=689297 2024-09-22T08:25:20.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.667+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=C7L2WDNJLTA9 tag=U3T2HW5XAS77 type=write size=2786449 2024-09-22T08:25:20.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.669+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~KQDHK6RXGQPF.0 size=1048576 2024-09-22T08:25:20.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.670+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~KQDHK6RXGQPF.1 size=264967 2024-09-22T08:25:20.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.672+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=KQDHK6RXGQPF tag=YP9B08IRC2K5 type=write size=2362119 2024-09-22T08:25:20.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.674+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=H9N6FY26HMHE type=del size=154596 2024-09-22T08:25:20.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.677+0000 7f8a8d811780 1 < suggested remove operation key=A8TGVQ273MNF tag=C3JVC7FBQYNO type=del 2024-09-22T08:25:20.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.679+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=5ZR71RECL8U1 type=del size=73889 2024-09-22T08:25:20.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.680+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.0 size=1048576 2024-09-22T08:25:20.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.681+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.1 size=1048576 2024-09-22T08:25:20.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.681+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~6R3ZPQRJ305N.2 size=777711 2024-09-22T08:25:20.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.684+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=6R3ZPQRJ305N tag=B2K13PKGQCB6 type=write size=3923439 2024-09-22T08:25:20.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.685+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=C6EFVAR8OX29 type=del size=3813764 2024-09-22T08:25:20.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.688+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=UL62XGXBOBJP type=del 2024-09-22T08:25:20.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.690+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=FYC5JGY42R6X type=del size=4041442 2024-09-22T08:25:20.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.691+0000 7f8a8d811780 1 < completed write operation key=H504PU8223G9 tag=JYYADACH1TX2 type=write size=726522 2024-09-22T08:25:20.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.693+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=3XMTZ1W2F6ME type=del size=3559576 2024-09-22T08:25:20.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.694+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~VCNRL3NFBTKS.0 size=484284 2024-09-22T08:25:20.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.697+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=VCNRL3NFBTKS tag=W14QX1EKOIV5 type=write size=1532860 2024-09-22T08:25:20.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.699+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~R5K4VALPULGY.0 size=1048576 2024-09-22T08:25:20.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.700+0000 7f8a8d811780 1 > prepared part key=_multipart_3T2TX83CSE2D.2~R5K4VALPULGY.1 size=757518 2024-09-22T08:25:20.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.700+0000 7f8a8d811780 1 > prepared multipart upload key=3T2TX83CSE2D upload=R5K4VALPULGY tag=3OU6VX0VMB8A type=write size=2854670 2024-09-22T08:25:20.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.702+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~C2SEF047NLSC.0 size=1048576 2024-09-22T08:25:20.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.704+0000 7f8a8d811780 1 < completed part key=_multipart_GMNVYF2BY872.2~C2SEF047NLSC.1 size=98520 2024-09-22T08:25:20.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.706+0000 7f8a8d811780 1 < completed multipart upload key=GMNVYF2BY872 upload=C2SEF047NLSC tag=S4CRN98WHWF5 type=write size=2195672 2024-09-22T08:25:20.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.709+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=BN0NWKOMTVA3 type=del size=2927112 2024-09-22T08:25:20.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.709+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~ACRWF5I58K71.0 size=650367 2024-09-22T08:25:20.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.712+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=ACRWF5I58K71 tag=BU3H00LKS6AE type=write size=1698943 2024-09-22T08:25:20.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.715+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~ENR6X7BS17WY.0 size=895403 2024-09-22T08:25:20.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.715+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=ENR6X7BS17WY tag=ABKUCK406GFC type=write size=1943979 2024-09-22T08:25:20.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.717+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=7347WFO87YOJ type=del 2024-09-22T08:25:20.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.719+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.0 size=1048576 2024-09-22T08:25:20.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.720+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.1 size=1048576 2024-09-22T08:25:20.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.722+0000 7f8a8d811780 1 > prepared part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.2 size=592046 2024-09-22T08:25:20.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.722+0000 7f8a8d811780 1 > prepared multipart upload key=WR1JR0APSOKN upload=RSOQ0BOMP5BE tag=K5340SV6OWG4 type=write size=3737774 2024-09-22T08:25:20.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.725+0000 7f8a8d811780 1 < completed delete operation key=KIJ2DW4NSZKG tag=ZL5OL8EC0CAP type=del 2024-09-22T08:25:20.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.727+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~F89RYVWMPKRA.0 size=774132 2024-09-22T08:25:20.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.727+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=F89RYVWMPKRA tag=503V37CQHF6S type=write size=1822708 2024-09-22T08:25:20.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.729+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~V4GO3LHKV6Q0.0 size=1048576 2024-09-22T08:25:20.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.730+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~V4GO3LHKV6Q0.1 size=77005 2024-09-22T08:25:20.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.732+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=V4GO3LHKV6Q0 tag=QKHAK3RTA32V type=write size=2174157 2024-09-22T08:25:20.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.734+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=BNNCNSHIKXOZ type=write size=446011 2024-09-22T08:25:20.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.735+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~RGPWPNBAT8B3.0 size=446266 2024-09-22T08:25:20.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.737+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=RGPWPNBAT8B3 tag=GPJ93TCJ2E1N type=write size=1494842 2024-09-22T08:25:20.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.740+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.0 size=1048576 2024-09-22T08:25:20.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.741+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.1 size=1048576 2024-09-22T08:25:20.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.742+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.2 size=266060 2024-09-22T08:25:20.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.742+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=CE3W2VBU34SA tag=BIQP45IVIMI8 type=write size=3411788 2024-09-22T08:25:20.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.743+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=WNYSRIL6L9NS type=write size=235262 2024-09-22T08:25:20.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.745+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=Z4PEVX1V9QVP type=del size=611846 2024-09-22T08:25:20.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.746+0000 7f8a8d811780 -1 < failed to complete operation key=QE6XEMOZMCF1 tag=VHJ7AJD492TF type=del size=2554063: (22) Invalid argument 2024-09-22T08:25:20.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.748+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~0EXVCZ3AKVDJ.0 size=1048576 2024-09-22T08:25:20.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.749+0000 7f8a8d811780 1 > prepared part key=_multipart_JWJ9T6XYCUYR.2~0EXVCZ3AKVDJ.1 size=421377 2024-09-22T08:25:20.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.749+0000 7f8a8d811780 1 > prepared multipart upload key=JWJ9T6XYCUYR upload=0EXVCZ3AKVDJ tag=WF6FO6AX43GX type=write size=2518529 2024-09-22T08:25:20.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.752+0000 7f8a8d811780 1 < suggested remove operation key=PIRW8N555T52 tag=DRRF7NXOX7HZ type=del 2024-09-22T08:25:20.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.754+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=4QUM6LH5GUC5 type=del size=2829418 2024-09-22T08:25:20.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.755+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~C7L2WDNJLTA9.0 size=1048576 2024-09-22T08:25:20.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.756+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~C7L2WDNJLTA9.1 size=689297 2024-09-22T08:25:20.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.758+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=C7L2WDNJLTA9 tag=U3T2HW5XAS77 type=write size=2786449 2024-09-22T08:25:20.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.759+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=XHQIXPYHP8K6 type=write size=716300 2024-09-22T08:25:20.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.761+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=H9N6FY26HMHE type=del 2024-09-22T08:25:20.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.762+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=YKWGCO6NK512 type=write size=137702 2024-09-22T08:25:20.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.763+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=5ZR71RECL8U1 type=del 2024-09-22T08:25:20.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.765+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=EFLV50GTZA0T type=del size=920649 2024-09-22T08:25:20.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.766+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=C6EFVAR8OX29 type=del 2024-09-22T08:25:20.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.768+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.0 size=1048576 2024-09-22T08:25:20.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.769+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.1 size=1048576 2024-09-22T08:25:20.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.771+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.2 size=951271 2024-09-22T08:25:20.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.771+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=KA3DNFEHSZ27 tag=BIPQY0BFF39F type=write size=4096999 2024-09-22T08:25:20.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.772+0000 7f8a8d811780 1 < canceled operation key=JP7IZ0CMXTSX tag=FYC5JGY42R6X type=del size=4041442 2024-09-22T08:25:20.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.774+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~3HWY0JEVOIZ5.0 size=789555 2024-09-22T08:25:20.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.774+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=3HWY0JEVOIZ5 tag=X264LKEUGTNP type=write size=1838131 2024-09-22T08:25:20.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.777+0000 7f8a8d811780 1 < suggested update operation key=7XBR6QIHD8TJ tag=3XMTZ1W2F6ME type=del size=3559576 2024-09-22T08:25:20.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.780+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~I23J88ZAY2ZB.0 size=1048576 2024-09-22T08:25:20.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.781+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~I23J88ZAY2ZB.1 size=288793 2024-09-22T08:25:20.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.781+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=I23J88ZAY2ZB tag=IPKONNN0SJ3K type=write size=2385945 2024-09-22T08:25:20.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.781+0000 7f8a8d811780 1 < canceled part key=_multipart_3T2TX83CSE2D.2~R5K4VALPULGY.0 size=1048576 2024-09-22T08:25:20.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.782+0000 7f8a8d811780 1 < completed part key=_multipart_3T2TX83CSE2D.2~R5K4VALPULGY.1 size=757518 2024-09-22T08:25:20.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.784+0000 7f8a8d811780 1 < canceled multipart upload key=3T2TX83CSE2D upload=R5K4VALPULGY tag=3OU6VX0VMB8A type=write size=2854670 2024-09-22T08:25:20.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.786+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=GNYQX8YXW2JJ type=write size=312989 2024-09-22T08:25:20.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.787+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=BN0NWKOMTVA3 type=del 2024-09-22T08:25:20.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.790+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.0 size=1048576 2024-09-22T08:25:20.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.791+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.1 size=1048576 2024-09-22T08:25:20.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.792+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.2 size=202697 2024-09-22T08:25:20.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.792+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=FB978GMFSDQ2 tag=KBZ76OE1FDTG type=write size=3348425 2024-09-22T08:25:20.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.793+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~ENR6X7BS17WY.0 size=895403 2024-09-22T08:25:20.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.796+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=ENR6X7BS17WY tag=ABKUCK406GFC type=write size=1943979 2024-09-22T08:25:20.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.798+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~X3UTYN8INRQ4.0 size=432563 2024-09-22T08:25:20.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.798+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=X3UTYN8INRQ4 tag=ZQUPBWP42Z1T type=write size=1481139 2024-09-22T08:25:20.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.800+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.0 size=1048576 2024-09-22T08:25:20.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.802+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.1 size=1048576 2024-09-22T08:25:20.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.802+0000 7f8a8d811780 1 < completed part key=_multipart_WR1JR0APSOKN.2~RSOQ0BOMP5BE.2 size=592046 2024-09-22T08:25:20.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.805+0000 7f8a8d811780 1 < completed multipart upload key=WR1JR0APSOKN upload=RSOQ0BOMP5BE tag=K5340SV6OWG4 type=write size=3737774 2024-09-22T08:25:20.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.806+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~DK6MYWFVEDRQ.0 size=1048576 2024-09-22T08:25:20.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.807+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~DK6MYWFVEDRQ.1 size=529406 2024-09-22T08:25:20.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.807+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=DK6MYWFVEDRQ tag=0C33DONE0X3B type=write size=2626558 2024-09-22T08:25:20.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.809+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~F89RYVWMPKRA.0 size=774132 2024-09-22T08:25:20.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.811+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=F89RYVWMPKRA tag=503V37CQHF6S type=write size=1822708 2024-09-22T08:25:20.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.812+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=EC2XNFW21JU8 type=del size=1525873 2024-09-22T08:25:20.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.814+0000 7f8a8d811780 1 < completed write operation key=RRTLTMWJIWSW tag=BNNCNSHIKXOZ type=write size=446011 2024-09-22T08:25:20.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.815+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=R4MTEFLOY4AC type=del size=104595 2024-09-22T08:25:20.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.817+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.0 size=1048576 2024-09-22T08:25:20.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.818+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.1 size=1048576 2024-09-22T08:25:20.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.819+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~CE3W2VBU34SA.2 size=266060 2024-09-22T08:25:20.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.821+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=CE3W2VBU34SA tag=BIQP45IVIMI8 type=write size=3411788 2024-09-22T08:25:20.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.823+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=AS9S23YQS58D type=write size=692668 2024-09-22T08:25:20.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.826+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=Z4PEVX1V9QVP type=del size=611846 2024-09-22T08:25:20.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.827+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=R6L2EYUE8IH6 type=del size=3518254 2024-09-22T08:25:20.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.829+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~0EXVCZ3AKVDJ.0 size=1048576 2024-09-22T08:25:20.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.830+0000 7f8a8d811780 1 < completed part key=_multipart_JWJ9T6XYCUYR.2~0EXVCZ3AKVDJ.1 size=421377 2024-09-22T08:25:20.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.833+0000 7f8a8d811780 1 < completed multipart upload key=JWJ9T6XYCUYR upload=0EXVCZ3AKVDJ tag=WF6FO6AX43GX type=write size=2518529 2024-09-22T08:25:20.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.834+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=3BZA11RPLQ84 type=del size=1786996 2024-09-22T08:25:20.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.835+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=4QUM6LH5GUC5 type=del 2024-09-22T08:25:20.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.837+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=7FNPLW4V65Q3 type=del size=622514 2024-09-22T08:25:20.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.838+0000 7f8a8d811780 1 < completed write operation key=GMNVYF2BY872 tag=XHQIXPYHP8K6 type=write size=716300 2024-09-22T08:25:20.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.840+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.0 size=1048576 2024-09-22T08:25:20.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.841+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.1 size=1048576 2024-09-22T08:25:20.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.842+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.2 size=624392 2024-09-22T08:25:20.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.842+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=R5OZG8HC5VEQ tag=U7UTYFL6TGAV type=write size=3770120 2024-09-22T08:25:20.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.845+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=YKWGCO6NK512 type=write size=137702 2024-09-22T08:25:20.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.845+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=KTC6OA0QHNW3 type=del size=175568 2024-09-22T08:25:20.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.848+0000 7f8a8d811780 1 < suggested update operation key=EILTWP17M0NL tag=EFLV50GTZA0T type=del size=920649 2024-09-22T08:25:20.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.849+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=W5YNCJT3J20W type=del size=2646443 2024-09-22T08:25:20.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.853+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.0 size=1048576 2024-09-22T08:25:20.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.854+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.1 size=1048576 2024-09-22T08:25:20.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.855+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~KA3DNFEHSZ27.2 size=951271 2024-09-22T08:25:20.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.857+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=KA3DNFEHSZ27 tag=BIPQY0BFF39F type=write size=4096999 2024-09-22T08:25:20.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.859+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=MGB5IXB1754X type=del size=3415142 2024-09-22T08:25:20.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.859+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~3HWY0JEVOIZ5.0 size=789555 2024-09-22T08:25:20.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.861+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=3HWY0JEVOIZ5 tag=X264LKEUGTNP type=write size=1838131 2024-09-22T08:25:20.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.863+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=UOADTTR2NUCS type=write size=336550 2024-09-22T08:25:20.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.864+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~I23J88ZAY2ZB.0 size=1048576 2024-09-22T08:25:20.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.865+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~I23J88ZAY2ZB.1 size=288793 2024-09-22T08:25:20.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.867+0000 7f8a8d811780 1 < completed multipart upload key=5VU70RE1GJS2 upload=I23J88ZAY2ZB tag=IPKONNN0SJ3K type=write size=2385945 2024-09-22T08:25:20.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.869+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=R6TH4LSL1IP8 type=del size=1414080 2024-09-22T08:25:20.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.871+0000 7f8a8d811780 1 < suggested remove operation key=S9JCKGZS5QLY tag=GNYQX8YXW2JJ type=write 2024-09-22T08:25:20.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.873+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=E537J7208A80 type=del size=1365214 2024-09-22T08:25:20.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.874+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.0 size=1048576 2024-09-22T08:25:20.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.875+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.1 size=1048576 2024-09-22T08:25:20.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.877+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~FB978GMFSDQ2.2 size=202697 2024-09-22T08:25:20.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.879+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=FB978GMFSDQ2 tag=KBZ76OE1FDTG type=write size=3348425 2024-09-22T08:25:20.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.880+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=8FZVSSMEX7FC type=del size=924762 2024-09-22T08:25:20.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.882+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~X3UTYN8INRQ4.0 size=432563 2024-09-22T08:25:20.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.884+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=X3UTYN8INRQ4 tag=ZQUPBWP42Z1T type=write size=1481139 2024-09-22T08:25:20.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.885+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=M74MR267FDKU type=del size=1685492 2024-09-22T08:25:20.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.887+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~DK6MYWFVEDRQ.0 size=1048576 2024-09-22T08:25:20.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.888+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~DK6MYWFVEDRQ.1 size=529406 2024-09-22T08:25:20.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.891+0000 7f8a8d811780 1 < completed multipart upload key=RL59H41J8ZNF upload=DK6MYWFVEDRQ tag=0C33DONE0X3B type=write size=2626558 2024-09-22T08:25:20.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.892+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=ZMR6DQAKAVUM type=del size=3624490 2024-09-22T08:25:20.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.893+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=EC2XNFW21JU8 type=del 2024-09-22T08:25:20.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.895+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=K4DVYM1G9SIA type=del size=1585932 2024-09-22T08:25:20.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.896+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=R4MTEFLOY4AC type=del 2024-09-22T08:25:20.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.897+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=V4Q19YJYTMU5 type=del size=1907263 2024-09-22T08:25:20.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.899+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=AS9S23YQS58D type=write size=692668 2024-09-22T08:25:20.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.902+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.0 size=1048576 2024-09-22T08:25:20.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.903+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.1 size=1048576 2024-09-22T08:25:20.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.904+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.2 size=943649 2024-09-22T08:25:20.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.904+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=C3KYHUAPZYAK tag=QM4VRKGLLBL8 type=write size=4089377 2024-09-22T08:25:20.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.906+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=R6L2EYUE8IH6 type=del 2024-09-22T08:25:20.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.908+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=0C0WDF6J1MOO type=del size=321810 2024-09-22T08:25:20.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.909+0000 7f8a8d811780 1 < canceled operation key=3T2TX83CSE2D tag=3BZA11RPLQ84 type=del size=1786996 2024-09-22T08:25:20.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.911+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=52XLTU1NZUZ2 type=del size=3554393 2024-09-22T08:25:20.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.911+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=7FNPLW4V65Q3 type=del 2024-09-22T08:25:20.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.914+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.0 size=1048576 2024-09-22T08:25:20.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.915+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.1 size=1048576 2024-09-22T08:25:20.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.916+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.2 size=420635 2024-09-22T08:25:20.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.916+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=PGPKXEPS1A1H tag=KPVWB0FFMWPU type=write size=3566363 2024-09-22T08:25:20.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.918+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.0 size=1048576 2024-09-22T08:25:20.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.919+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.1 size=1048576 2024-09-22T08:25:20.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.920+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~R5OZG8HC5VEQ.2 size=624392 2024-09-22T08:25:20.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.922+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=R5OZG8HC5VEQ tag=U7UTYFL6TGAV type=write size=3770120 2024-09-22T08:25:20.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.923+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=C42MRSR0IKNO type=del size=2215904 2024-09-22T08:25:20.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.925+0000 7f8a8d811780 1 < canceled operation key=2EB57FFNN986 tag=KTC6OA0QHNW3 type=del size=175568 2024-09-22T08:25:20.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.927+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.0 size=1048576 2024-09-22T08:25:20.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.929+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.1 size=1048576 2024-09-22T08:25:20.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.929+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.2 size=441187 2024-09-22T08:25:20.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.929+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=IW4HWU81M5DZ tag=N5649JQB3NXD type=write size=3586915 2024-09-22T08:25:20.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.931+0000 7f8a8d811780 1 < canceled operation key=QE6XEMOZMCF1 tag=W5YNCJT3J20W type=del size=2646443 2024-09-22T08:25:20.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.933+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.0 size=1048576 2024-09-22T08:25:20.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.934+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.1 size=1048576 2024-09-22T08:25:20.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.936+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.2 size=13747 2024-09-22T08:25:20.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.936+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=VT1KCPQQU2CO tag=MYANC2O42X7N type=write size=3159475 2024-09-22T08:25:20.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.937+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=MGB5IXB1754X type=del 2024-09-22T08:25:20.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.938+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=JRT1G8U7KA3A type=del size=2142889 2024-09-22T08:25:20.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.939+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=UOADTTR2NUCS type=write size=336550 2024-09-22T08:25:20.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.941+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=GO1NK1YYU2AJ type=del size=3321358 2024-09-22T08:25:20.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.942+0000 7f8a8d811780 1 < canceled operation key=IOZ7IXVOB70S tag=R6TH4LSL1IP8 type=del size=1414080 2024-09-22T08:25:20.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.944+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=KFAC97YLPRMH type=del size=1935289 2024-09-22T08:25:20.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.945+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=E537J7208A80 type=del 2024-09-22T08:25:20.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.947+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.0 size=1048576 2024-09-22T08:25:20.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.949+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.1 size=1048576 2024-09-22T08:25:20.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.949+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.2 size=908875 2024-09-22T08:25:20.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.949+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=VZK8Q1QAW0ZX tag=324HP7BJ9S41 type=write size=4054603 2024-09-22T08:25:20.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.951+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=8FZVSSMEX7FC type=del 2024-09-22T08:25:20.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.953+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.0 size=1048576 2024-09-22T08:25:20.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.954+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.1 size=1048576 2024-09-22T08:25:20.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.955+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.2 size=804551 2024-09-22T08:25:20.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.956+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=3PVHW6RPY6WF tag=T2SJ1V57DX5P type=write size=3950279 2024-09-22T08:25:20.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.958+0000 7f8a8d811780 1 < suggested remove operation key=KIJ2DW4NSZKG tag=M74MR267FDKU type=del 2024-09-22T08:25:20.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.959+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=7Z09TPY3M527 type=write size=45048 2024-09-22T08:25:20.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.963+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=ZMR6DQAKAVUM type=del size=3624490 2024-09-22T08:25:20.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.964+0000 7f8a8d811780 1 > prepared operation key=GMNVYF2BY872 tag=L462MNMBEGSV type=del size=2036756 2024-09-22T08:25:20.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.965+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=K4DVYM1G9SIA type=del 2024-09-22T08:25:20.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.967+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=LQVC9BZ2AZ2B type=write size=610915 2024-09-22T08:25:20.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.969+0000 7f8a8d811780 1 < suggested remove operation key=RCHUCAL6CQ4F tag=V4Q19YJYTMU5 type=del 2024-09-22T08:25:20.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.971+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=D06V3PX8SCGB type=del size=1520408 2024-09-22T08:25:20.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.972+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.0 size=1048576 2024-09-22T08:25:20.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.972+0000 7f8a8d811780 1 < canceled part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.1 size=1048576 2024-09-22T08:25:20.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.973+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~C3KYHUAPZYAK.2 size=943649 2024-09-22T08:25:20.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.976+0000 7f8a8d811780 1 < canceled multipart upload key=JP7IZ0CMXTSX upload=C3KYHUAPZYAK tag=QM4VRKGLLBL8 type=write size=4089377 2024-09-22T08:25:20.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.978+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=DGEPPB28QQI8 type=del size=3792814 2024-09-22T08:25:20.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.979+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=0C0WDF6J1MOO type=del 2024-09-22T08:25:20.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.980+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=1Z8HXGC63RH7 type=del size=2762610 2024-09-22T08:25:20.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.984+0000 7f8a8d811780 1 < completed delete operation key=JWJ9T6XYCUYR tag=52XLTU1NZUZ2 type=del 2024-09-22T08:25:20.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.984+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=FUE9C6PAKBCU type=del size=3235850 2024-09-22T08:25:20.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.985+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.0 size=1048576 2024-09-22T08:25:20.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.986+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.1 size=1048576 2024-09-22T08:25:20.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.987+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~PGPKXEPS1A1H.2 size=420635 2024-09-22T08:25:20.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.989+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=PGPKXEPS1A1H tag=KPVWB0FFMWPU type=write size=3566363 2024-09-22T08:25:20.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.992+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~UI86JOWA3W4B.0 size=1048576 2024-09-22T08:25:20.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.993+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~UI86JOWA3W4B.1 size=998543 2024-09-22T08:25:20.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.993+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=UI86JOWA3W4B tag=DM5F3V78K87O type=write size=3095695 2024-09-22T08:25:20.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.994+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=C42MRSR0IKNO type=del 2024-09-22T08:25:20.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.996+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=MRYR9SOXWY5K type=del size=3152146 2024-09-22T08:25:20.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.997+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.0 size=1048576 2024-09-22T08:25:20.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:20.999+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.1 size=1048576 2024-09-22T08:25:21.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.000+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~IW4HWU81M5DZ.2 size=441187 2024-09-22T08:25:21.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.003+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=IW4HWU81M5DZ tag=N5649JQB3NXD type=write size=3586915 2024-09-22T08:25:21.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.004+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=HPCUUYIT0C4W type=write size=990432 2024-09-22T08:25:21.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.004+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.0 size=1048576 2024-09-22T08:25:21.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.005+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.1 size=1048576 2024-09-22T08:25:21.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.005+0000 7f8a8d811780 1 < canceled part key=_multipart_EILTWP17M0NL.2~VT1KCPQQU2CO.2 size=13747 2024-09-22T08:25:21.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.008+0000 7f8a8d811780 1 < canceled multipart upload key=EILTWP17M0NL upload=VT1KCPQQU2CO tag=MYANC2O42X7N type=write size=3159475 2024-09-22T08:25:21.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.010+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=8MJ3N1JLPR84 type=del size=374886 2024-09-22T08:25:21.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.012+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=JRT1G8U7KA3A type=del 2024-09-22T08:25:21.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.014+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=2Q85KP2LPTKB type=del size=1993269 2024-09-22T08:25:21.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.015+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=GO1NK1YYU2AJ type=del 2024-09-22T08:25:21.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.018+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.0 size=1048576 2024-09-22T08:25:21.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.019+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.1 size=1048576 2024-09-22T08:25:21.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.020+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.2 size=660468 2024-09-22T08:25:21.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.020+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=4CP2BL4WR3RQ tag=YYAAG868QYV2 type=write size=3806196 2024-09-22T08:25:21.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.021+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=KFAC97YLPRMH type=del size=1935289 2024-09-22T08:25:21.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.022+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=DF3MW1GWRVYT type=write size=175569 2024-09-22T08:25:21.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.024+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.0 size=1048576 2024-09-22T08:25:21.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.025+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.1 size=1048576 2024-09-22T08:25:21.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.026+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~VZK8Q1QAW0ZX.2 size=908875 2024-09-22T08:25:21.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.028+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=VZK8Q1QAW0ZX tag=324HP7BJ9S41 type=write size=4054603 2024-09-22T08:25:21.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.029+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=LH3694VTR699 type=write size=145190 2024-09-22T08:25:21.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.030+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.0 size=1048576 2024-09-22T08:25:21.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.032+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.1 size=1048576 2024-09-22T08:25:21.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.033+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~3PVHW6RPY6WF.2 size=804551 2024-09-22T08:25:21.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.035+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=3PVHW6RPY6WF tag=T2SJ1V57DX5P type=write size=3950279 2024-09-22T08:25:21.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.036+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=3IEUB4XEMAVI type=del size=3260518 2024-09-22T08:25:21.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.037+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=7Z09TPY3M527 type=write size=45048 2024-09-22T08:25:21.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.039+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=MN77KYGMEEGP type=del size=3400078 2024-09-22T08:25:21.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.040+0000 7f8a8d811780 1 < completed delete operation key=GMNVYF2BY872 tag=L462MNMBEGSV type=del 2024-09-22T08:25:21.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.042+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=0YQC9BCXGYF7 type=del size=3745058 2024-09-22T08:25:21.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.043+0000 7f8a8d811780 1 < completed write operation key=WOSCCX4WX2FN tag=LQVC9BZ2AZ2B type=write size=610915 2024-09-22T08:25:21.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.045+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=3VS4JZOT6BRQ type=write size=1038355 2024-09-22T08:25:21.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.046+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=D06V3PX8SCGB type=del 2024-09-22T08:25:21.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.047+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=BSDIT9W69KZ0 type=del size=677346 2024-09-22T08:25:21.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.049+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=DGEPPB28QQI8 type=del 2024-09-22T08:25:21.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.050+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=ADVGWOK942XY type=del size=1348280 2024-09-22T08:25:21.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.052+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=1Z8HXGC63RH7 type=del size=2762610 2024-09-22T08:25:21.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.054+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=1O19BK3ZWVX6 type=del size=1879895 2024-09-22T08:25:21.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.056+0000 7f8a8d811780 1 < suggested remove operation key=2EB57FFNN986 tag=FUE9C6PAKBCU type=del 2024-09-22T08:25:21.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.058+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=R5WE8LD66YIE type=del size=3211065 2024-09-22T08:25:21.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.059+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~UI86JOWA3W4B.0 size=1048576 2024-09-22T08:25:21.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.060+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~UI86JOWA3W4B.1 size=998543 2024-09-22T08:25:21.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.063+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=UI86JOWA3W4B tag=DM5F3V78K87O type=write size=3095695 2024-09-22T08:25:21.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.064+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=P26CJ81KTVUJ type=del size=939518 2024-09-22T08:25:21.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.065+0000 7f8a8d811780 -1 < failed to complete operation key=7XNMR51803Y6 tag=MRYR9SOXWY5K type=del size=3152146: (22) Invalid argument 2024-09-22T08:25:21.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.068+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=NYWMHCWUCWRL type=del size=2008812 2024-09-22T08:25:21.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.069+0000 7f8a8d811780 1 < completed write operation key=911851NVIUQS tag=HPCUUYIT0C4W type=write size=990432 2024-09-22T08:25:21.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.071+0000 7f8a8d811780 1 > prepared operation key=9EY50PUC6AJJ tag=GC9UTF3OBWFY type=del size=477601 2024-09-22T08:25:21.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.072+0000 7f8a8d811780 1 < canceled operation key=911851NVIUQS tag=8MJ3N1JLPR84 type=del size=374886 2024-09-22T08:25:21.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.073+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=4XYYLORXIW51 type=del size=3996202 2024-09-22T08:25:21.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.074+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=2Q85KP2LPTKB type=del 2024-09-22T08:25:21.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.077+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~DXFC8ZBA7L9Q.0 size=1048576 2024-09-22T08:25:21.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.078+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~DXFC8ZBA7L9Q.1 size=1033717 2024-09-22T08:25:21.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.078+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=DXFC8ZBA7L9Q tag=YKUFZYVOHG0U type=write size=3130869 2024-09-22T08:25:21.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.080+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.0 size=1048576 2024-09-22T08:25:21.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.081+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.1 size=1048576 2024-09-22T08:25:21.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.082+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~4CP2BL4WR3RQ.2 size=660468 2024-09-22T08:25:21.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.084+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=4CP2BL4WR3RQ tag=YYAAG868QYV2 type=write size=3806196 2024-09-22T08:25:21.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.085+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=CZJTI59WF8DF type=del size=327273 2024-09-22T08:25:21.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.088+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=DF3MW1GWRVYT type=write size=175569 2024-09-22T08:25:21.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.090+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.0 size=1048576 2024-09-22T08:25:21.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.092+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.1 size=1048576 2024-09-22T08:25:21.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.093+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.2 size=441145 2024-09-22T08:25:21.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.093+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=J6OI27D5UKUF tag=R8WBAQRKIK8U type=write size=3586873 2024-09-22T08:25:21.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.094+0000 7f8a8d811780 1 < completed write operation key=WR1JR0APSOKN tag=LH3694VTR699 type=write size=145190 2024-09-22T08:25:21.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.096+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=HIA49UUHF95J type=del size=1732657 2024-09-22T08:25:21.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.097+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=3IEUB4XEMAVI type=del 2024-09-22T08:25:21.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.099+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=6N4P4QQTBU9T type=del size=3737679 2024-09-22T08:25:21.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.101+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=MN77KYGMEEGP type=del size=3400078 2024-09-22T08:25:21.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.103+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=WHNK02TV9KM4 type=del size=2300074 2024-09-22T08:25:21.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.104+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=0YQC9BCXGYF7 type=del 2024-09-22T08:25:21.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.106+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.0 size=1048576 2024-09-22T08:25:21.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.108+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.1 size=1048576 2024-09-22T08:25:21.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.108+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.2 size=395344 2024-09-22T08:25:21.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.108+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=P7M21I7RT1T6 tag=5X1YR3IXHLUL type=write size=3541072 2024-09-22T08:25:21.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.109+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=3VS4JZOT6BRQ type=write size=1038355 2024-09-22T08:25:21.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.111+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=LKJ8ED5XPDKT type=del size=355379 2024-09-22T08:25:21.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.114+0000 7f8a8d811780 1 < suggested remove operation key=5VU70RE1GJS2 tag=BSDIT9W69KZ0 type=del 2024-09-22T08:25:21.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.117+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.0 size=1048576 2024-09-22T08:25:21.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.119+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.1 size=1048576 2024-09-22T08:25:21.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.120+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.2 size=757895 2024-09-22T08:25:21.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.120+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=8SCKMUU38UGH tag=PE60GSINHK61 type=write size=3903623 2024-09-22T08:25:21.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.121+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=ADVGWOK942XY type=del 2024-09-22T08:25:21.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.122+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=N7PFBVQZ9YK9 type=del size=995739 2024-09-22T08:25:21.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.126+0000 7f8a8d811780 1 < suggested remove operation key=WR1JR0APSOKN tag=1O19BK3ZWVX6 type=del 2024-09-22T08:25:21.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.127+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=R1TD7PPRERYY type=del size=3282297 2024-09-22T08:25:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.128+0000 7f8a8d811780 1 < completed delete operation key=QE6XEMOZMCF1 tag=R5WE8LD66YIE type=del 2024-09-22T08:25:21.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.129+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=BJMM6SS05946 type=del size=2394352 2024-09-22T08:25:21.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.131+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=P26CJ81KTVUJ type=del 2024-09-22T08:25:21.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.133+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=UKE9XMH016GR type=del size=3532290 2024-09-22T08:25:21.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.134+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=NYWMHCWUCWRL type=del 2024-09-22T08:25:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.136+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=W04O67MFJADV type=del size=1994090 2024-09-22T08:25:21.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.137+0000 7f8a8d811780 1 < completed delete operation key=9EY50PUC6AJJ tag=GC9UTF3OBWFY type=del 2024-09-22T08:25:21.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.139+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=T4KHYBOR9J0K type=del size=3431952 2024-09-22T08:25:21.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.140+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=4XYYLORXIW51 type=del 2024-09-22T08:25:21.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.143+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~YCXPS00NDXWY.0 size=1048576 2024-09-22T08:25:21.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.144+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~YCXPS00NDXWY.1 size=678821 2024-09-22T08:25:21.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.144+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=YCXPS00NDXWY tag=VHLCQWJBQI9E type=write size=2775973 2024-09-22T08:25:21.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.146+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~DXFC8ZBA7L9Q.0 size=1048576 2024-09-22T08:25:21.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.147+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~DXFC8ZBA7L9Q.1 size=1033717 2024-09-22T08:25:21.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.149+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=DXFC8ZBA7L9Q tag=YKUFZYVOHG0U type=write size=3130869 2024-09-22T08:25:21.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.151+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=G5E8WBBO0221 type=del size=2888163 2024-09-22T08:25:21.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.152+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=CZJTI59WF8DF type=del 2024-09-22T08:25:21.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.156+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~Z813WU1KO51B.0 size=1048576 2024-09-22T08:25:21.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.156+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~Z813WU1KO51B.1 size=273799 2024-09-22T08:25:21.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.156+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=Z813WU1KO51B tag=M4LO2M19QWLH type=write size=2370951 2024-09-22T08:25:21.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.156+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.0 size=1048576 2024-09-22T08:25:21.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.157+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.1 size=1048576 2024-09-22T08:25:21.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.157+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~J6OI27D5UKUF.2 size=441145 2024-09-22T08:25:21.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.160+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=J6OI27D5UKUF tag=R8WBAQRKIK8U type=write size=3586873 2024-09-22T08:25:21.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.162+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=VS3EY05EGFWU type=write size=1010648 2024-09-22T08:25:21.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.163+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=HIA49UUHF95J type=del 2024-09-22T08:25:21.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.164+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=962VMSSIYUGS type=write size=626281 2024-09-22T08:25:21.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.166+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=6N4P4QQTBU9T type=del 2024-09-22T08:25:21.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.167+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=6ETLZSUHWTMY type=del size=4152219 2024-09-22T08:25:21.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.169+0000 7f8a8d811780 1 < completed delete operation key=RL59H41J8ZNF tag=WHNK02TV9KM4 type=del 2024-09-22T08:25:21.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.171+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~PKR6HCHKFYOK.0 size=1048576 2024-09-22T08:25:21.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.173+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~PKR6HCHKFYOK.1 size=842097 2024-09-22T08:25:21.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.173+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=PKR6HCHKFYOK tag=6SSIVLZTK35K type=write size=2939249 2024-09-22T08:25:21.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.174+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.0 size=1048576 2024-09-22T08:25:21.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.175+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.1 size=1048576 2024-09-22T08:25:21.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.176+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~P7M21I7RT1T6.2 size=395344 2024-09-22T08:25:21.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.178+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=P7M21I7RT1T6 tag=5X1YR3IXHLUL type=write size=3541072 2024-09-22T08:25:21.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.180+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=BUBO5FWD58PY type=del size=3460388 2024-09-22T08:25:21.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.181+0000 7f8a8d811780 1 < canceled operation key=0HCXP53D9NMP tag=LKJ8ED5XPDKT type=del size=355379 2024-09-22T08:25:21.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.183+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.0 size=1048576 2024-09-22T08:25:21.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.185+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.1 size=1048576 2024-09-22T08:25:21.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.186+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.2 size=728736 2024-09-22T08:25:21.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.186+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=CALWH706ZUF9 tag=XH1E325JZNA5 type=write size=3874464 2024-09-22T08:25:21.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.186+0000 7f8a8d811780 1 < canceled part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.0 size=1048576 2024-09-22T08:25:21.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.187+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.1 size=1048576 2024-09-22T08:25:21.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.188+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~8SCKMUU38UGH.2 size=757895 2024-09-22T08:25:21.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.190+0000 7f8a8d811780 1 < canceled multipart upload key=226G7R10IR1B upload=8SCKMUU38UGH tag=PE60GSINHK61 type=write size=3903623 2024-09-22T08:25:21.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.192+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=BLXFV1OSVVQ5 type=write size=320588 2024-09-22T08:25:21.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.194+0000 7f8a8d811780 1 < suggested update operation key=JWJ9T6XYCUYR tag=N7PFBVQZ9YK9 type=del size=995739 2024-09-22T08:25:21.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.196+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=XJ20Z04T7X99 type=del size=3391613 2024-09-22T08:25:21.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.197+0000 7f8a8d811780 1 < completed delete operation key=7XNMR51803Y6 tag=R1TD7PPRERYY type=del 2024-09-22T08:25:21.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.199+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=TCPMO7MF7BI9 type=write size=352653 2024-09-22T08:25:21.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.200+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=BJMM6SS05946 type=del 2024-09-22T08:25:21.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.201+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=C1WJEYQVWEQS type=del size=3261575 2024-09-22T08:25:21.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.203+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=UKE9XMH016GR type=del 2024-09-22T08:25:21.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.204+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=US32MYEF73GU type=del size=4011123 2024-09-22T08:25:21.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.205+0000 7f8a8d811780 -1 < failed to complete operation key=JWJ9T6XYCUYR tag=W04O67MFJADV type=del size=1994090: (22) Invalid argument 2024-09-22T08:25:21.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.209+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~GHHHY7ZI3LDG.0 size=1048576 2024-09-22T08:25:21.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.210+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~GHHHY7ZI3LDG.1 size=465368 2024-09-22T08:25:21.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.210+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=GHHHY7ZI3LDG tag=Q0Y3ZCSO6D23 type=write size=2562520 2024-09-22T08:25:21.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.213+0000 7f8a8d811780 1 < suggested remove operation key=3T2TX83CSE2D tag=T4KHYBOR9J0K type=del 2024-09-22T08:25:21.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.216+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~HX3PFX0Y22KV.0 size=709821 2024-09-22T08:25:21.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.216+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=HX3PFX0Y22KV tag=OFOEU9XAMTLV type=write size=1758397 2024-09-22T08:25:21.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.217+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~YCXPS00NDXWY.0 size=1048576 2024-09-22T08:25:21.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.218+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~YCXPS00NDXWY.1 size=678821 2024-09-22T08:25:21.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.220+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=YCXPS00NDXWY tag=VHLCQWJBQI9E type=write size=2775973 2024-09-22T08:25:21.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.222+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=MW30ZBPDEWBX type=del size=2451553 2024-09-22T08:25:21.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.224+0000 7f8a8d811780 1 < completed delete operation key=JP7IZ0CMXTSX tag=G5E8WBBO0221 type=del 2024-09-22T08:25:21.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.225+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=EVRN5MUPB9ID type=del size=2779927 2024-09-22T08:25:21.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.227+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~Z813WU1KO51B.0 size=1048576 2024-09-22T08:25:21.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.228+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~Z813WU1KO51B.1 size=273799 2024-09-22T08:25:21.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.232+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=Z813WU1KO51B tag=M4LO2M19QWLH type=write size=2370951 2024-09-22T08:25:21.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.234+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.0 size=1048576 2024-09-22T08:25:21.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.235+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.1 size=1048576 2024-09-22T08:25:21.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.236+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.2 size=198345 2024-09-22T08:25:21.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.236+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=6D9XHE59YMSK tag=Z16QGXG014OE type=write size=3344073 2024-09-22T08:25:21.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.237+0000 7f8a8d811780 1 < completed write operation key=JP7IZ0CMXTSX tag=VS3EY05EGFWU type=write size=1010648 2024-09-22T08:25:21.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.240+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~ZDPTF6X8UMNZ.0 size=1048576 2024-09-22T08:25:21.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.242+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~ZDPTF6X8UMNZ.1 size=437115 2024-09-22T08:25:21.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.242+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=ZDPTF6X8UMNZ tag=5G3AVWPWWX7R type=write size=2534267 2024-09-22T08:25:21.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.242+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=3T2TX83CSE2D tag=962VMSSIYUGS type=write size=626281: (2) No such file or directory 2024-09-22T08:25:21.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.244+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~8T4OU3AE7DBH.0 size=483358 2024-09-22T08:25:21.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.244+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=8T4OU3AE7DBH tag=2SYLK0SPJ11A type=write size=1531934 2024-09-22T08:25:21.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.246+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=6ETLZSUHWTMY type=del 2024-09-22T08:25:21.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.247+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=74LTJV8QE8NR type=del size=2441215 2024-09-22T08:25:21.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.247+0000 7f8a8d811780 1 < canceled part key=_multipart_RL59H41J8ZNF.2~PKR6HCHKFYOK.0 size=1048576 2024-09-22T08:25:21.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.249+0000 7f8a8d811780 1 < completed part key=_multipart_RL59H41J8ZNF.2~PKR6HCHKFYOK.1 size=842097 2024-09-22T08:25:21.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.253+0000 7f8a8d811780 1 < canceled multipart upload key=RL59H41J8ZNF upload=PKR6HCHKFYOK tag=6SSIVLZTK35K type=write size=2939249 2024-09-22T08:25:21.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.255+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=2DN3K92MIAGL type=write size=756824 2024-09-22T08:25:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.255+0000 7f8a8d811780 1 < completed delete operation key=LRFF14FU7C5I tag=BUBO5FWD58PY type=del 2024-09-22T08:25:21.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.259+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.0 size=1048576 2024-09-22T08:25:21.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.260+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.1 size=1048576 2024-09-22T08:25:21.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.261+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.2 size=778398 2024-09-22T08:25:21.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.261+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=GR2UWT04H1ZC tag=XZUKH81249UB type=write size=3924126 2024-09-22T08:25:21.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.262+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.0 size=1048576 2024-09-22T08:25:21.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.264+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.1 size=1048576 2024-09-22T08:25:21.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.265+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~CALWH706ZUF9.2 size=728736 2024-09-22T08:25:21.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.267+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=CALWH706ZUF9 tag=XH1E325JZNA5 type=write size=3874464 2024-09-22T08:25:21.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.271+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~LTBYSL4MIQJ8.0 size=373753 2024-09-22T08:25:21.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.271+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=LTBYSL4MIQJ8 tag=95XR7S84SR2Q type=write size=1422329 2024-09-22T08:25:21.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.273+0000 7f8a8d811780 1 < suggested remove operation key=RRTLTMWJIWSW tag=BLXFV1OSVVQ5 type=write 2024-09-22T08:25:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.276+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~IL1XSFP9C8BZ.0 size=1048576 2024-09-22T08:25:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.277+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~IL1XSFP9C8BZ.1 size=298652 2024-09-22T08:25:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.277+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=IL1XSFP9C8BZ tag=E6YN1HQ7KSS2 type=write size=2395804 2024-09-22T08:25:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.279+0000 7f8a8d811780 1 < completed delete operation key=0AOI0OB2YFVV tag=XJ20Z04T7X99 type=del 2024-09-22T08:25:21.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.281+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=FGNEGQR30CCJ type=del size=684344 2024-09-22T08:25:21.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.282+0000 7f8a8d811780 1 < completed write operation key=226G7R10IR1B tag=TCPMO7MF7BI9 type=write size=352653 2024-09-22T08:25:21.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.284+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~K934RXURTI69.0 size=867312 2024-09-22T08:25:21.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.284+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=K934RXURTI69 tag=1J7UESA2ASEJ type=write size=1915888 2024-09-22T08:25:21.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.288+0000 7f8a8d811780 1 < suggested update operation key=5VU70RE1GJS2 tag=C1WJEYQVWEQS type=del size=3261575 2024-09-22T08:25:21.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.289+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=0DIS2II9KGC9 type=write size=786566 2024-09-22T08:25:21.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.290+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=US32MYEF73GU type=del 2024-09-22T08:25:21.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.293+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~XFLIAR4QITEA.0 size=1048576 2024-09-22T08:25:21.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.294+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~XFLIAR4QITEA.1 size=113726 2024-09-22T08:25:21.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.294+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=XFLIAR4QITEA tag=HU15VBCYMUIK type=write size=2210878 2024-09-22T08:25:21.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.296+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~GHHHY7ZI3LDG.0 size=1048576 2024-09-22T08:25:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.297+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~GHHHY7ZI3LDG.1 size=465368 2024-09-22T08:25:21.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.300+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=GHHHY7ZI3LDG tag=Q0Y3ZCSO6D23 type=write size=2562520 2024-09-22T08:25:21.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.302+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=PTFITAZTWSPH type=del size=2560571 2024-09-22T08:25:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.303+0000 7f8a8d811780 1 < completed part key=_multipart_WOSCCX4WX2FN.2~HX3PFX0Y22KV.0 size=709821 2024-09-22T08:25:21.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.307+0000 7f8a8d811780 1 < completed multipart upload key=WOSCCX4WX2FN upload=HX3PFX0Y22KV tag=OFOEU9XAMTLV type=write size=1758397 2024-09-22T08:25:21.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.307+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=DWB90GJC4C2P type=del size=3601867 2024-09-22T08:25:21.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.309+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=MW30ZBPDEWBX type=del 2024-09-22T08:25:21.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.311+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=KVHUI8PQTNJB type=del size=1904220 2024-09-22T08:25:21.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.312+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=EVRN5MUPB9ID type=del 2024-09-22T08:25:21.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.314+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=OH5F94JJOFIY type=write size=516825 2024-09-22T08:25:21.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.315+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.0 size=1048576 2024-09-22T08:25:21.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.316+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.1 size=1048576 2024-09-22T08:25:21.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.317+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~6D9XHE59YMSK.2 size=198345 2024-09-22T08:25:21.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.320+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=6D9XHE59YMSK tag=Z16QGXG014OE type=write size=3344073 2024-09-22T08:25:21.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.322+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~8SYF202AHLFP.0 size=1048576 2024-09-22T08:25:21.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.323+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~8SYF202AHLFP.1 size=790388 2024-09-22T08:25:21.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.323+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=8SYF202AHLFP tag=8XE6354KQ31I type=write size=2887540 2024-09-22T08:25:21.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.324+0000 7f8a8d811780 1 < canceled part key=_multipart_0AOI0OB2YFVV.2~ZDPTF6X8UMNZ.0 size=1048576 2024-09-22T08:25:21.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.325+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~ZDPTF6X8UMNZ.1 size=437115 2024-09-22T08:25:21.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.327+0000 7f8a8d811780 1 < canceled multipart upload key=0AOI0OB2YFVV upload=ZDPTF6X8UMNZ tag=5G3AVWPWWX7R type=write size=2534267 2024-09-22T08:25:21.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.330+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~EHCPJ2KHP4B5.0 size=135808 2024-09-22T08:25:21.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.330+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=EHCPJ2KHP4B5 tag=H3LGYPCHS7WV type=write size=1184384 2024-09-22T08:25:21.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.331+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~8T4OU3AE7DBH.0 size=483358 2024-09-22T08:25:21.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.333+0000 7f8a8d811780 1 < completed multipart upload key=7LLAS815MLFH upload=8T4OU3AE7DBH tag=2SYLK0SPJ11A type=write size=1531934 2024-09-22T08:25:21.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.335+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=EUN95C7Q11L9 type=del size=4176618 2024-09-22T08:25:21.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.336+0000 7f8a8d811780 1 < completed delete operation key=1719KI1YP1FT tag=74LTJV8QE8NR type=del 2024-09-22T08:25:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.337+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=XMDJXU196HQ3 type=del size=924946 2024-09-22T08:25:21.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.340+0000 7f8a8d811780 1 < suggested update operation key=7LLAS815MLFH tag=2DN3K92MIAGL type=write size=756824 2024-09-22T08:25:21.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.343+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.0 size=1048576 2024-09-22T08:25:21.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.344+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.1 size=1048576 2024-09-22T08:25:21.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.345+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.2 size=460327 2024-09-22T08:25:21.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.345+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=6KVZRULF4YXB tag=VW49L3JORIQ3 type=write size=3606055 2024-09-22T08:25:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.347+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.0 size=1048576 2024-09-22T08:25:21.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.348+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.1 size=1048576 2024-09-22T08:25:21.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.349+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~GR2UWT04H1ZC.2 size=778398 2024-09-22T08:25:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.352+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=GR2UWT04H1ZC tag=XZUKH81249UB type=write size=3924126 2024-09-22T08:25:21.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.353+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=87G69SSTQ0VP type=del size=3807991 2024-09-22T08:25:21.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.355+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~LTBYSL4MIQJ8.0 size=373753 2024-09-22T08:25:21.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.357+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=LTBYSL4MIQJ8 tag=95XR7S84SR2Q type=write size=1422329 2024-09-22T08:25:21.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.359+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=5A9GWRJL4CFV type=del size=3967928 2024-09-22T08:25:21.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.360+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~IL1XSFP9C8BZ.0 size=1048576 2024-09-22T08:25:21.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.361+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~IL1XSFP9C8BZ.1 size=298652 2024-09-22T08:25:21.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.364+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=IL1XSFP9C8BZ tag=E6YN1HQ7KSS2 type=write size=2395804 2024-09-22T08:25:21.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.365+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=LIDZHUXRGKHO type=del size=3634235 2024-09-22T08:25:21.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.367+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=FGNEGQR30CCJ type=del 2024-09-22T08:25:21.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.368+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=AGV3MK7H7UVK type=del size=3520061 2024-09-22T08:25:21.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.371+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~K934RXURTI69.0 size=867312 2024-09-22T08:25:21.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.372+0000 7f8a8d811780 1 < completed multipart upload key=ER5UY1ML3R2H upload=K934RXURTI69 tag=1J7UESA2ASEJ type=write size=1915888 2024-09-22T08:25:21.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.375+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~KJAJEHF6TFP1.0 size=1048576 2024-09-22T08:25:21.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.376+0000 7f8a8d811780 1 > prepared part key=_multipart_7LLAS815MLFH.2~KJAJEHF6TFP1.1 size=887785 2024-09-22T08:25:21.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.376+0000 7f8a8d811780 1 > prepared multipart upload key=7LLAS815MLFH upload=KJAJEHF6TFP1 tag=5ONQ3V65B6P3 type=write size=2984937 2024-09-22T08:25:21.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.377+0000 7f8a8d811780 1 < completed write operation key=A8TGVQ273MNF tag=0DIS2II9KGC9 type=write size=786566 2024-09-22T08:25:21.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.380+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~UQG8B0S3JY0Z.0 size=1048576 2024-09-22T08:25:21.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.382+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~UQG8B0S3JY0Z.1 size=234891 2024-09-22T08:25:21.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.382+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=UQG8B0S3JY0Z tag=3KB2NXJOZI1C type=write size=2332043 2024-09-22T08:25:21.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.383+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~XFLIAR4QITEA.0 size=1048576 2024-09-22T08:25:21.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.384+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~XFLIAR4QITEA.1 size=113726 2024-09-22T08:25:21.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.386+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=XFLIAR4QITEA tag=HU15VBCYMUIK type=write size=2210878 2024-09-22T08:25:21.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.390+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ZI19MEJ4ZRE6.0 size=1048576 2024-09-22T08:25:21.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.393+0000 7f8a8d811780 1 > prepared part key=_multipart_2EB57FFNN986.2~ZI19MEJ4ZRE6.1 size=706416 2024-09-22T08:25:21.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.393+0000 7f8a8d811780 1 > prepared multipart upload key=2EB57FFNN986 upload=ZI19MEJ4ZRE6 tag=6Y8LHJFL5VUL type=write size=2803568 2024-09-22T08:25:21.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.395+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=PTFITAZTWSPH type=del 2024-09-22T08:25:21.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.398+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~D1MCVZ9PN6MX.0 size=1048576 2024-09-22T08:25:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.399+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~D1MCVZ9PN6MX.1 size=776231 2024-09-22T08:25:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.399+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=D1MCVZ9PN6MX tag=70UDA09ZCZZ5 type=write size=2873383 2024-09-22T08:25:21.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.400+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=DWB90GJC4C2P type=del 2024-09-22T08:25:21.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.402+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=4RE6WL6Q7TSL type=write size=213198 2024-09-22T08:25:21.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.404+0000 7f8a8d811780 1 < completed delete operation key=2EB57FFNN986 tag=KVHUI8PQTNJB type=del 2024-09-22T08:25:21.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.405+0000 7f8a8d811780 1 > prepared operation key=S9JCKGZS5QLY tag=LZ1042D74UFG type=del size=1966772 2024-09-22T08:25:21.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.407+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=OH5F94JJOFIY type=write size=516825 2024-09-22T08:25:21.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.408+0000 7f8a8d811780 1 > prepared operation key=IOZ7IXVOB70S tag=HZAIT2QDOKXK type=del size=1172998 2024-09-22T08:25:21.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.409+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~8SYF202AHLFP.0 size=1048576 2024-09-22T08:25:21.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.410+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~8SYF202AHLFP.1 size=790388 2024-09-22T08:25:21.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.413+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=8SYF202AHLFP tag=8XE6354KQ31I type=write size=2887540 2024-09-22T08:25:21.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.414+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=MO4L2PJDM5X8 type=del size=743384 2024-09-22T08:25:21.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.416+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~EHCPJ2KHP4B5.0 size=135808 2024-09-22T08:25:21.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.418+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=EHCPJ2KHP4B5 tag=H3LGYPCHS7WV type=write size=1184384 2024-09-22T08:25:21.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.419+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=Z1T5B7EI34NC type=write size=765910 2024-09-22T08:25:21.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.421+0000 7f8a8d811780 1 < canceled operation key=H504PU8223G9 tag=EUN95C7Q11L9 type=del size=4176618 2024-09-22T08:25:21.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.424+0000 7f8a8d811780 1 > prepared part key=_multipart_0AOI0OB2YFVV.2~KX2KVV40FC29.0 size=909228 2024-09-22T08:25:21.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.424+0000 7f8a8d811780 1 > prepared multipart upload key=0AOI0OB2YFVV upload=KX2KVV40FC29 tag=4JMHZ9G39QSS type=write size=1957804 2024-09-22T08:25:21.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.425+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=XMDJXU196HQ3 type=del 2024-09-22T08:25:21.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.427+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=Q7BQBYNS4VR0 type=del size=106605 2024-09-22T08:25:21.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.428+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.0 size=1048576 2024-09-22T08:25:21.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.429+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.1 size=1048576 2024-09-22T08:25:21.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.430+0000 7f8a8d811780 1 < completed part key=_multipart_1719KI1YP1FT.2~6KVZRULF4YXB.2 size=460327 2024-09-22T08:25:21.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.432+0000 7f8a8d811780 1 < completed multipart upload key=1719KI1YP1FT upload=6KVZRULF4YXB tag=VW49L3JORIQ3 type=write size=3606055 2024-09-22T08:25:21.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.435+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~C2CQLUYBVWFW.0 size=1048576 2024-09-22T08:25:21.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.436+0000 7f8a8d811780 1 > prepared part key=_multipart_MJJPUJP2NSOK.2~C2CQLUYBVWFW.1 size=257705 2024-09-22T08:25:21.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.436+0000 7f8a8d811780 1 > prepared multipart upload key=MJJPUJP2NSOK upload=C2CQLUYBVWFW tag=N3ZEW2GO9A11 type=write size=2354857 2024-09-22T08:25:21.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.437+0000 7f8a8d811780 1 < completed delete operation key=0HCXP53D9NMP tag=87G69SSTQ0VP type=del 2024-09-22T08:25:21.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.439+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=0PJMWYOOYKQB type=write size=430313 2024-09-22T08:25:21.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.440+0000 7f8a8d811780 1 < completed delete operation key=H504PU8223G9 tag=5A9GWRJL4CFV type=del 2024-09-22T08:25:21.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.441+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=U36XJZAKSG2H type=write size=963218 2024-09-22T08:25:21.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.445+0000 7f8a8d811780 1 < suggested update operation key=T5IAHQ3CUIFR tag=LIDZHUXRGKHO type=del size=3634235 2024-09-22T08:25:21.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.446+0000 7f8a8d811780 1 > prepared operation key=T5IAHQ3CUIFR tag=CVEX3J1FJ1GP type=del size=3850911 2024-09-22T08:25:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.447+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=AGV3MK7H7UVK type=del 2024-09-22T08:25:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.449+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=MN04WCN9YH6F type=write size=595892 2024-09-22T08:25:21.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.450+0000 7f8a8d811780 1 < completed part key=_multipart_7LLAS815MLFH.2~KJAJEHF6TFP1.0 size=1048576 2024-09-22T08:25:21.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.450+0000 7f8a8d811780 1 < canceled part key=_multipart_7LLAS815MLFH.2~KJAJEHF6TFP1.1 size=887785 2024-09-22T08:25:21.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.452+0000 7f8a8d811780 1 < canceled multipart upload key=7LLAS815MLFH upload=KJAJEHF6TFP1 tag=5ONQ3V65B6P3 type=write size=2984937 2024-09-22T08:25:21.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.454+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=VDUVFLDIDZY3 type=del size=569710 2024-09-22T08:25:21.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.455+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~UQG8B0S3JY0Z.0 size=1048576 2024-09-22T08:25:21.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.457+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~UQG8B0S3JY0Z.1 size=234891 2024-09-22T08:25:21.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.459+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=UQG8B0S3JY0Z tag=3KB2NXJOZI1C type=write size=2332043 2024-09-22T08:25:21.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.460+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=3QPP8A7TQV11 type=write size=966006 2024-09-22T08:25:21.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.463+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~ZI19MEJ4ZRE6.0 size=1048576 2024-09-22T08:25:21.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.463+0000 7f8a8d811780 1 < completed part key=_multipart_2EB57FFNN986.2~ZI19MEJ4ZRE6.1 size=706416 2024-09-22T08:25:21.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.466+0000 7f8a8d811780 1 < completed multipart upload key=2EB57FFNN986 upload=ZI19MEJ4ZRE6 tag=6Y8LHJFL5VUL type=write size=2803568 2024-09-22T08:25:21.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.467+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=H9KFUZ2SYL4J type=write size=374775 2024-09-22T08:25:21.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.469+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~D1MCVZ9PN6MX.0 size=1048576 2024-09-22T08:25:21.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.470+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~D1MCVZ9PN6MX.1 size=776231 2024-09-22T08:25:21.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.473+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=D1MCVZ9PN6MX tag=70UDA09ZCZZ5 type=write size=2873383 2024-09-22T08:25:21.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.475+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~YMHPBYH1AOKC.0 size=1048576 2024-09-22T08:25:21.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.476+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~YMHPBYH1AOKC.1 size=440895 2024-09-22T08:25:21.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.476+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=YMHPBYH1AOKC tag=PJ4JVQGVQW8I type=write size=2538047 2024-09-22T08:25:21.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.478+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=4RE6WL6Q7TSL type=write size=213198 2024-09-22T08:25:21.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.479+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=OW270TW300PY type=del size=556220 2024-09-22T08:25:21.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.481+0000 7f8a8d811780 1 < completed delete operation key=S9JCKGZS5QLY tag=LZ1042D74UFG type=del 2024-09-22T08:25:21.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.482+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=CR0G4UWTFEPR type=del size=1030840 2024-09-22T08:25:21.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.484+0000 7f8a8d811780 1 < completed delete operation key=IOZ7IXVOB70S tag=HZAIT2QDOKXK type=del 2024-09-22T08:25:21.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.486+0000 7f8a8d811780 1 > prepared part key=_multipart_RCHUCAL6CQ4F.2~4AHNN28ZZKN8.0 size=464064 2024-09-22T08:25:21.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.486+0000 7f8a8d811780 1 > prepared multipart upload key=RCHUCAL6CQ4F upload=4AHNN28ZZKN8 tag=AIV8IAN1XN37 type=write size=1512640 2024-09-22T08:25:21.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.488+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=MO4L2PJDM5X8 type=del 2024-09-22T08:25:21.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.490+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~KHQM89PQSXII.0 size=1048576 2024-09-22T08:25:21.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.491+0000 7f8a8d811780 1 > prepared part key=_multipart_226G7R10IR1B.2~KHQM89PQSXII.1 size=200392 2024-09-22T08:25:21.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.491+0000 7f8a8d811780 1 > prepared multipart upload key=226G7R10IR1B upload=KHQM89PQSXII tag=7OBHC9EW7K60 type=write size=2297544 2024-09-22T08:25:21.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.493+0000 7f8a8d811780 1 < completed write operation key=MJJPUJP2NSOK tag=Z1T5B7EI34NC type=write size=765910 2024-09-22T08:25:21.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.495+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=E8PHJCD99P3V type=del size=3086204 2024-09-22T08:25:21.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.497+0000 7f8a8d811780 1 < completed part key=_multipart_0AOI0OB2YFVV.2~KX2KVV40FC29.0 size=909228 2024-09-22T08:25:21.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.498+0000 7f8a8d811780 1 < completed multipart upload key=0AOI0OB2YFVV upload=KX2KVV40FC29 tag=4JMHZ9G39QSS type=write size=1957804 2024-09-22T08:25:21.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.500+0000 7f8a8d811780 1 > prepared operation key=RL59H41J8ZNF tag=L7ITYSYWI7UE type=write size=95805 2024-09-22T08:25:21.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.503+0000 7f8a8d811780 1 < suggested update operation key=7LLAS815MLFH tag=Q7BQBYNS4VR0 type=del size=106605 2024-09-22T08:25:21.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.505+0000 7f8a8d811780 1 > prepared operation key=H504PU8223G9 tag=H5GAHFZ8MUSE type=del size=1779928 2024-09-22T08:25:21.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.506+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~C2CQLUYBVWFW.0 size=1048576 2024-09-22T08:25:21.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.507+0000 7f8a8d811780 1 < completed part key=_multipart_MJJPUJP2NSOK.2~C2CQLUYBVWFW.1 size=257705 2024-09-22T08:25:21.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.510+0000 7f8a8d811780 1 < completed multipart upload key=MJJPUJP2NSOK upload=C2CQLUYBVWFW tag=N3ZEW2GO9A11 type=write size=2354857 2024-09-22T08:25:21.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.511+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=3YC8M5969W4T type=del size=3223436 2024-09-22T08:25:21.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.512+0000 7f8a8d811780 1 < completed write operation key=5VU70RE1GJS2 tag=0PJMWYOOYKQB type=write size=430313 2024-09-22T08:25:21.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.515+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=K5001P15RFSJ type=del size=2183620 2024-09-22T08:25:21.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.516+0000 7f8a8d811780 1 < completed write operation key=LRFF14FU7C5I tag=U36XJZAKSG2H type=write size=963218 2024-09-22T08:25:21.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.519+0000 7f8a8d811780 1 > prepared part key=_multipart_7XNMR51803Y6.2~V0V9RKPQLC6B.0 size=734247 2024-09-22T08:25:21.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.519+0000 7f8a8d811780 1 > prepared multipart upload key=7XNMR51803Y6 upload=V0V9RKPQLC6B tag=FAOR4G3E784I type=write size=1782823 2024-09-22T08:25:21.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.520+0000 7f8a8d811780 1 < completed delete operation key=T5IAHQ3CUIFR tag=CVEX3J1FJ1GP type=del 2024-09-22T08:25:21.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.521+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=XKAV6WUUJTL6 type=write size=245132 2024-09-22T08:25:21.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.523+0000 7f8a8d811780 1 < completed write operation key=7XBR6QIHD8TJ tag=MN04WCN9YH6F type=write size=595892 2024-09-22T08:25:21.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.524+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=1XWHMG5PZVKR type=del size=1891046 2024-09-22T08:25:21.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.528+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=VDUVFLDIDZY3 type=del 2024-09-22T08:25:21.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.530+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~CWEW393B5PI7.0 size=1048576 2024-09-22T08:25:21.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.531+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~CWEW393B5PI7.1 size=868897 2024-09-22T08:25:21.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.531+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=CWEW393B5PI7 tag=5A1EHSL41IWF type=write size=2966049 2024-09-22T08:25:21.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.533+0000 7f8a8d811780 1 < canceled operation key=EILTWP17M0NL tag=3QPP8A7TQV11 type=write size=966006 2024-09-22T08:25:21.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.534+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=FBLOF0M10XSI type=write size=859338 2024-09-22T08:25:21.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.535+0000 7f8a8d811780 1 < completed write operation key=ER5UY1ML3R2H tag=H9KFUZ2SYL4J type=write size=374775 2024-09-22T08:25:21.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.538+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.0 size=1048576 2024-09-22T08:25:21.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.539+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.1 size=1048576 2024-09-22T08:25:21.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.540+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.2 size=757145 2024-09-22T08:25:21.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.540+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=3NUL2EZ7R89S tag=HS9SHZM1PVQ6 type=write size=3902873 2024-09-22T08:25:21.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.542+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~YMHPBYH1AOKC.0 size=1048576 2024-09-22T08:25:21.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.543+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~YMHPBYH1AOKC.1 size=440895 2024-09-22T08:25:21.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.546+0000 7f8a8d811780 1 < completed multipart upload key=A8TGVQ273MNF upload=YMHPBYH1AOKC tag=PJ4JVQGVQW8I type=write size=2538047 2024-09-22T08:25:21.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.547+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=6UP2OW4YLHNV type=del size=3913989 2024-09-22T08:25:21.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.550+0000 7f8a8d811780 1 < suggested update operation key=JWJ9T6XYCUYR tag=OW270TW300PY type=del size=556220 2024-09-22T08:25:21.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.551+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=Q7N3O72TEX1K type=del size=2440723 2024-09-22T08:25:21.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.555+0000 7f8a8d811780 1 < suggested update operation key=2EB57FFNN986 tag=CR0G4UWTFEPR type=del size=1030840 2024-09-22T08:25:21.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.557+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.0 size=1048576 2024-09-22T08:25:21.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.559+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.1 size=1048576 2024-09-22T08:25:21.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.561+0000 7f8a8d811780 1 > prepared part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.2 size=408331 2024-09-22T08:25:21.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.561+0000 7f8a8d811780 1 > prepared multipart upload key=ER5UY1ML3R2H upload=X3SWLV9K7J6J tag=30XQUA8AMFRC type=write size=3554059 2024-09-22T08:25:21.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.562+0000 7f8a8d811780 1 < completed part key=_multipart_RCHUCAL6CQ4F.2~4AHNN28ZZKN8.0 size=464064 2024-09-22T08:25:21.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.565+0000 7f8a8d811780 1 < completed multipart upload key=RCHUCAL6CQ4F upload=4AHNN28ZZKN8 tag=AIV8IAN1XN37 type=write size=1512640 2024-09-22T08:25:21.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.567+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.0 size=1048576 2024-09-22T08:25:21.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.568+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.1 size=1048576 2024-09-22T08:25:21.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.570+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.2 size=710071 2024-09-22T08:25:21.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.570+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=9Q2L1CF150TW tag=O57Y4W990VA0 type=write size=3855799 2024-09-22T08:25:21.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.572+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~KHQM89PQSXII.0 size=1048576 2024-09-22T08:25:21.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.572+0000 7f8a8d811780 1 < completed part key=_multipart_226G7R10IR1B.2~KHQM89PQSXII.1 size=200392 2024-09-22T08:25:21.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.575+0000 7f8a8d811780 1 < completed multipart upload key=226G7R10IR1B upload=KHQM89PQSXII tag=7OBHC9EW7K60 type=write size=2297544 2024-09-22T08:25:21.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.576+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=26LGAV28BMVC type=del size=954831 2024-09-22T08:25:21.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.577+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=E8PHJCD99P3V type=del 2024-09-22T08:25:21.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.580+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=D3W382KP2KQ1 type=del size=1523322 2024-09-22T08:25:21.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.582+0000 7f8a8d811780 1 < suggested update operation key=RL59H41J8ZNF tag=L7ITYSYWI7UE type=write size=95805 2024-09-22T08:25:21.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.583+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=ZOK5P89A5H5O type=write size=782937 2024-09-22T08:25:21.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.586+0000 7f8a8d811780 1 < suggested update operation key=H504PU8223G9 tag=H5GAHFZ8MUSE type=del size=1779928 2024-09-22T08:25:21.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.588+0000 7f8a8d811780 1 > prepared operation key=JWJ9T6XYCUYR tag=NNKB7136SL25 type=del size=1138321 2024-09-22T08:25:21.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.589+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=3YC8M5969W4T type=del 2024-09-22T08:25:21.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.591+0000 7f8a8d811780 1 > prepared operation key=7LLAS815MLFH tag=S6A85SB6A8OY type=del size=3910791 2024-09-22T08:25:21.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.592+0000 7f8a8d811780 1 < completed delete operation key=WR1JR0APSOKN tag=K5001P15RFSJ type=del 2024-09-22T08:25:21.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.595+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.0 size=1048576 2024-09-22T08:25:21.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.597+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.1 size=1048576 2024-09-22T08:25:21.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.597+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.2 size=425758 2024-09-22T08:25:21.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.597+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=K0J7PYD8ECB0 tag=B9F4FCZ84RUG type=write size=3571486 2024-09-22T08:25:21.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.598+0000 7f8a8d811780 1 < completed part key=_multipart_7XNMR51803Y6.2~V0V9RKPQLC6B.0 size=734247 2024-09-22T08:25:21.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.601+0000 7f8a8d811780 1 < completed multipart upload key=7XNMR51803Y6 upload=V0V9RKPQLC6B tag=FAOR4G3E784I type=write size=1782823 2024-09-22T08:25:21.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.602+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=P34RBAFQE5WO type=del size=2231339 2024-09-22T08:25:21.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.604+0000 7f8a8d811780 1 < completed write operation key=EILTWP17M0NL tag=XKAV6WUUJTL6 type=write size=245132 2024-09-22T08:25:21.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.605+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=WNEO3JZG14CN type=del size=1807893 2024-09-22T08:25:21.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.608+0000 7f8a8d811780 1 < suggested remove operation key=JWJ9T6XYCUYR tag=1XWHMG5PZVKR type=del 2024-09-22T08:25:21.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.609+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=N3YWXJJIH2DQ type=del size=232241 2024-09-22T08:25:21.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.611+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~CWEW393B5PI7.0 size=1048576 2024-09-22T08:25:21.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.612+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~CWEW393B5PI7.1 size=868897 2024-09-22T08:25:21.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.615+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=CWEW393B5PI7 tag=5A1EHSL41IWF type=write size=2966049 2024-09-22T08:25:21.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.616+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=NSFQNO6IF09E type=del size=1481538 2024-09-22T08:25:21.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.617+0000 7f8a8d811780 1 < canceled operation key=0HCXP53D9NMP tag=FBLOF0M10XSI type=write size=859338 2024-09-22T08:25:21.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.620+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.0 size=1048576 2024-09-22T08:25:21.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.621+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.1 size=1048576 2024-09-22T08:25:21.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.622+0000 7f8a8d811780 1 > prepared part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.2 size=166248 2024-09-22T08:25:21.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.622+0000 7f8a8d811780 1 > prepared multipart upload key=JP7IZ0CMXTSX upload=FQQ3U2GRI1Q0 tag=3Z9NUA88YM05 type=write size=3311976 2024-09-22T08:25:21.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.624+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.0 size=1048576 2024-09-22T08:25:21.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.625+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.1 size=1048576 2024-09-22T08:25:21.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.626+0000 7f8a8d811780 1 < completed part key=_multipart_EILTWP17M0NL.2~3NUL2EZ7R89S.2 size=757145 2024-09-22T08:25:21.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.629+0000 7f8a8d811780 1 < completed multipart upload key=EILTWP17M0NL upload=3NUL2EZ7R89S tag=HS9SHZM1PVQ6 type=write size=3902873 2024-09-22T08:25:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.631+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~AL2BLY0J1BK2.0 size=1048576 2024-09-22T08:25:21.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.633+0000 7f8a8d811780 1 > prepared part key=_multipart_KIJ2DW4NSZKG.2~AL2BLY0J1BK2.1 size=285576 2024-09-22T08:25:21.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.633+0000 7f8a8d811780 1 > prepared multipart upload key=KIJ2DW4NSZKG upload=AL2BLY0J1BK2 tag=A9LHGWSLONYO type=write size=2382728 2024-09-22T08:25:21.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.635+0000 7f8a8d811780 1 < suggested update operation key=3T2TX83CSE2D tag=6UP2OW4YLHNV type=del size=3913989 2024-09-22T08:25:21.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.637+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=1K5W3XL37U0X type=del size=2923611 2024-09-22T08:25:21.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.639+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=Q7N3O72TEX1K type=del 2024-09-22T08:25:21.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.640+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=MLRZ84QFPVFD type=del size=1328862 2024-09-22T08:25:21.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.642+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.0 size=1048576 2024-09-22T08:25:21.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.642+0000 7f8a8d811780 1 < canceled part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.1 size=1048576 2024-09-22T08:25:21.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.643+0000 7f8a8d811780 1 < completed part key=_multipart_ER5UY1ML3R2H.2~X3SWLV9K7J6J.2 size=408331 2024-09-22T08:25:21.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.646+0000 7f8a8d811780 1 < canceled multipart upload key=ER5UY1ML3R2H upload=X3SWLV9K7J6J tag=30XQUA8AMFRC type=write size=3554059 2024-09-22T08:25:21.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.648+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.0 size=1048576 2024-09-22T08:25:21.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.649+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.1 size=1048576 2024-09-22T08:25:21.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.651+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.2 size=999420 2024-09-22T08:25:21.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.651+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=LU3Y7WTI442L tag=PBQWZW4AYKS5 type=write size=4145148 2024-09-22T08:25:21.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.652+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.0 size=1048576 2024-09-22T08:25:21.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.653+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.1 size=1048576 2024-09-22T08:25:21.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.655+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~9Q2L1CF150TW.2 size=710071 2024-09-22T08:25:21.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.657+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=9Q2L1CF150TW tag=O57Y4W990VA0 type=write size=3855799 2024-09-22T08:25:21.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.659+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=Z5GZ11RTYTLN type=del size=830216 2024-09-22T08:25:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.661+0000 7f8a8d811780 1 < suggested remove operation key=WR1JR0APSOKN tag=26LGAV28BMVC type=del 2024-09-22T08:25:21.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.666+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~Q99ID8D0PF34.0 size=1048576 2024-09-22T08:25:21.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.667+0000 7f8a8d811780 1 > prepared part key=_multipart_A8TGVQ273MNF.2~Q99ID8D0PF34.1 size=263720 2024-09-22T08:25:21.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.667+0000 7f8a8d811780 1 > prepared multipart upload key=A8TGVQ273MNF upload=Q99ID8D0PF34 tag=WIYD1PWYG44V type=write size=2360872 2024-09-22T08:25:21.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.669+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=D3W382KP2KQ1 type=del 2024-09-22T08:25:21.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.670+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=IG5B4SJEK86T type=del size=3591565 2024-09-22T08:25:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.672+0000 7f8a8d811780 1 < completed write operation key=PIRW8N555T52 tag=ZOK5P89A5H5O type=write size=782937 2024-09-22T08:25:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.674+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~GFP4XVRZ7SD0.0 size=752803 2024-09-22T08:25:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.674+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=GFP4XVRZ7SD0 tag=B78C580VOUPF type=write size=1801379 2024-09-22T08:25:21.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.675+0000 7f8a8d811780 -1 < no bi entry to suggest for operation key=JWJ9T6XYCUYR tag=NNKB7136SL25 type=del size=1138321: (2) No such file or directory 2024-09-22T08:25:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.676+0000 7f8a8d811780 1 > prepared operation key=WR1JR0APSOKN tag=GVU7L8O4X54O type=del size=2019062 2024-09-22T08:25:21.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.678+0000 7f8a8d811780 1 < completed delete operation key=7LLAS815MLFH tag=S6A85SB6A8OY type=del 2024-09-22T08:25:21.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.679+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=V2UNSLDW9OBP type=del size=31637 2024-09-22T08:25:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.681+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.0 size=1048576 2024-09-22T08:25:21.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.682+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.1 size=1048576 2024-09-22T08:25:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.683+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~K0J7PYD8ECB0.2 size=425758 2024-09-22T08:25:21.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.685+0000 7f8a8d811780 1 < completed multipart upload key=PIRW8N555T52 upload=K0J7PYD8ECB0 tag=B9F4FCZ84RUG type=write size=3571486 2024-09-22T08:25:21.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.686+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=SN3PMBXAD1I7 type=del size=2522611 2024-09-22T08:25:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.688+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=P34RBAFQE5WO type=del 2024-09-22T08:25:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.689+0000 7f8a8d811780 1 > prepared operation key=RRTLTMWJIWSW tag=42JK6BLCKRIU type=del size=3723463 2024-09-22T08:25:21.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.693+0000 7f8a8d811780 1 < suggested update operation key=KIJ2DW4NSZKG tag=WNEO3JZG14CN type=del size=1807893 2024-09-22T08:25:21.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.694+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=5PZ1ZS7ZABPC type=del size=932580 2024-09-22T08:25:21.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.697+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=N3YWXJJIH2DQ type=del 2024-09-22T08:25:21.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.698+0000 7f8a8d811780 1 > prepared operation key=226G7R10IR1B tag=DTPG4X6TCTC6 type=del size=3700657 2024-09-22T08:25:21.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.699+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=NSFQNO6IF09E type=del 2024-09-22T08:25:21.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.702+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~Y36ZFELVYAE3.0 size=1048576 2024-09-22T08:25:21.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.703+0000 7f8a8d811780 1 > prepared part key=_multipart_911851NVIUQS.2~Y36ZFELVYAE3.1 size=43514 2024-09-22T08:25:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.703+0000 7f8a8d811780 1 > prepared multipart upload key=911851NVIUQS upload=Y36ZFELVYAE3 tag=TTEK06D3U3LD type=write size=2140666 2024-09-22T08:25:21.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.704+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.0 size=1048576 2024-09-22T08:25:21.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.706+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.1 size=1048576 2024-09-22T08:25:21.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.706+0000 7f8a8d811780 1 < completed part key=_multipart_JP7IZ0CMXTSX.2~FQQ3U2GRI1Q0.2 size=166248 2024-09-22T08:25:21.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.710+0000 7f8a8d811780 1 < completed multipart upload key=JP7IZ0CMXTSX upload=FQQ3U2GRI1Q0 tag=3Z9NUA88YM05 type=write size=3311976 2024-09-22T08:25:21.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.712+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.0 size=1048576 2024-09-22T08:25:21.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.712+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.1 size=1048576 2024-09-22T08:25:21.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.714+0000 7f8a8d811780 1 > prepared part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.2 size=942975 2024-09-22T08:25:21.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.714+0000 7f8a8d811780 1 > prepared multipart upload key=QE6XEMOZMCF1 upload=C3ENKDC4VMYN tag=KH8DZDLMDR7U type=write size=4088703 2024-09-22T08:25:21.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.716+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~AL2BLY0J1BK2.0 size=1048576 2024-09-22T08:25:21.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.716+0000 7f8a8d811780 1 < completed part key=_multipart_KIJ2DW4NSZKG.2~AL2BLY0J1BK2.1 size=285576 2024-09-22T08:25:21.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.719+0000 7f8a8d811780 1 < completed multipart upload key=KIJ2DW4NSZKG upload=AL2BLY0J1BK2 tag=A9LHGWSLONYO type=write size=2382728 2024-09-22T08:25:21.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.721+0000 7f8a8d811780 1 > prepared operation key=WOSCCX4WX2FN tag=H5PLUJXWI3Q2 type=del size=1900555 2024-09-22T08:25:21.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.722+0000 7f8a8d811780 1 < completed delete operation key=PIRW8N555T52 tag=1K5W3XL37U0X type=del 2024-09-22T08:25:21.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.723+0000 7f8a8d811780 1 > prepared operation key=7XNMR51803Y6 tag=62BIHLTSQ03J type=del size=3435602 2024-09-22T08:25:21.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.724+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=MLRZ84QFPVFD type=del 2024-09-22T08:25:21.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.728+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.0 size=1048576 2024-09-22T08:25:21.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.728+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.1 size=1048576 2024-09-22T08:25:21.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.729+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.2 size=929792 2024-09-22T08:25:21.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.729+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=VMI14WG8XSYP tag=MC2I1K91UQS1 type=write size=4075520 2024-09-22T08:25:21.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.732+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.0 size=1048576 2024-09-22T08:25:21.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.732+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.1 size=1048576 2024-09-22T08:25:21.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.733+0000 7f8a8d811780 1 < completed part key=_multipart_IOZ7IXVOB70S.2~LU3Y7WTI442L.2 size=999420 2024-09-22T08:25:21.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.735+0000 7f8a8d811780 1 < completed multipart upload key=IOZ7IXVOB70S upload=LU3Y7WTI442L tag=PBQWZW4AYKS5 type=write size=4145148 2024-09-22T08:25:21.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.737+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=U44RBX28LJBT type=write size=800015 2024-09-22T08:25:21.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.738+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=Z5GZ11RTYTLN type=del 2024-09-22T08:25:21.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.740+0000 7f8a8d811780 1 > prepared operation key=911851NVIUQS tag=3E40S3XIQVBK type=del size=2152148 2024-09-22T08:25:21.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.740+0000 7f8a8d811780 1 < canceled part key=_multipart_A8TGVQ273MNF.2~Q99ID8D0PF34.0 size=1048576 2024-09-22T08:25:21.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.741+0000 7f8a8d811780 1 < completed part key=_multipart_A8TGVQ273MNF.2~Q99ID8D0PF34.1 size=263720 2024-09-22T08:25:21.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.744+0000 7f8a8d811780 1 < canceled multipart upload key=A8TGVQ273MNF upload=Q99ID8D0PF34 tag=WIYD1PWYG44V type=write size=2360872 2024-09-22T08:25:21.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.745+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=S9B6NS6NLB7S type=del size=1427698 2024-09-22T08:25:21.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.747+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=IG5B4SJEK86T type=del 2024-09-22T08:25:21.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.749+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=JU2XWT640QD1 type=del size=2266088 2024-09-22T08:25:21.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.750+0000 7f8a8d811780 1 < completed part key=_multipart_9EY50PUC6AJJ.2~GFP4XVRZ7SD0.0 size=752803 2024-09-22T08:25:21.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.753+0000 7f8a8d811780 1 < completed multipart upload key=9EY50PUC6AJJ upload=GFP4XVRZ7SD0 tag=B78C580VOUPF type=write size=1801379 2024-09-22T08:25:21.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.756+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.0 size=1048576 2024-09-22T08:25:21.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.757+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.1 size=1048576 2024-09-22T08:25:21.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.758+0000 7f8a8d811780 1 > prepared part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.2 size=845290 2024-09-22T08:25:21.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.758+0000 7f8a8d811780 1 > prepared multipart upload key=5VU70RE1GJS2 upload=TBSSK1Y1HA5Q tag=21TBU7Z4LJDP type=write size=3991018 2024-09-22T08:25:21.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.761+0000 7f8a8d811780 1 < suggested update operation key=WR1JR0APSOKN tag=GVU7L8O4X54O type=del size=2019062 2024-09-22T08:25:21.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.763+0000 7f8a8d811780 1 > prepared operation key=PIRW8N555T52 tag=FNJMSKDYAE9S type=del size=1531651 2024-09-22T08:25:21.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.765+0000 7f8a8d811780 1 < completed delete operation key=EILTWP17M0NL tag=V2UNSLDW9OBP type=del 2024-09-22T08:25:21.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.767+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.0 size=1048576 2024-09-22T08:25:21.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.769+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.1 size=1048576 2024-09-22T08:25:21.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.770+0000 7f8a8d811780 1 > prepared part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.2 size=133728 2024-09-22T08:25:21.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.770+0000 7f8a8d811780 1 > prepared multipart upload key=H504PU8223G9 upload=2GP5HYL1R95L tag=RX5YSVA9LE31 type=write size=3279456 2024-09-22T08:25:21.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.771+0000 7f8a8d811780 1 < completed delete operation key=5VU70RE1GJS2 tag=SN3PMBXAD1I7 type=del 2024-09-22T08:25:21.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.772+0000 7f8a8d811780 1 > prepared operation key=7XBR6QIHD8TJ tag=RQ84VEWI9S8F type=del size=1428989 2024-09-22T08:25:21.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.774+0000 7f8a8d811780 1 < completed delete operation key=RRTLTMWJIWSW tag=42JK6BLCKRIU type=del 2024-09-22T08:25:21.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.775+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=TRUARLRG5PHH type=del size=347145 2024-09-22T08:25:21.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.777+0000 7f8a8d811780 1 < completed delete operation key=RCHUCAL6CQ4F tag=5PZ1ZS7ZABPC type=del 2024-09-22T08:25:21.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.780+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.0 size=1048576 2024-09-22T08:25:21.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.781+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.1 size=1048576 2024-09-22T08:25:21.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.782+0000 7f8a8d811780 1 > prepared part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.2 size=622393 2024-09-22T08:25:21.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.782+0000 7f8a8d811780 1 > prepared multipart upload key=T5IAHQ3CUIFR upload=EVRXCETBRFFG tag=HCQR9D36QEML type=write size=3768121 2024-09-22T08:25:21.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.783+0000 7f8a8d811780 1 < completed delete operation key=226G7R10IR1B tag=DTPG4X6TCTC6 type=del 2024-09-22T08:25:21.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.785+0000 7f8a8d811780 1 > prepared operation key=LRFF14FU7C5I tag=TWI1FQQLRG71 type=del size=1166427 2024-09-22T08:25:21.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.786+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~Y36ZFELVYAE3.0 size=1048576 2024-09-22T08:25:21.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.787+0000 7f8a8d811780 1 < completed part key=_multipart_911851NVIUQS.2~Y36ZFELVYAE3.1 size=43514 2024-09-22T08:25:21.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.790+0000 7f8a8d811780 1 < completed multipart upload key=911851NVIUQS upload=Y36ZFELVYAE3 tag=TTEK06D3U3LD type=write size=2140666 2024-09-22T08:25:21.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.793+0000 7f8a8d811780 1 > prepared part key=_multipart_0HCXP53D9NMP.2~TV5SU5YVE9UZ.0 size=614188 2024-09-22T08:25:21.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.793+0000 7f8a8d811780 1 > prepared multipart upload key=0HCXP53D9NMP upload=TV5SU5YVE9UZ tag=8LKK01VXO7GN type=write size=1662764 2024-09-22T08:25:21.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.794+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.0 size=1048576 2024-09-22T08:25:21.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.795+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.1 size=1048576 2024-09-22T08:25:21.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.797+0000 7f8a8d811780 1 < completed part key=_multipart_QE6XEMOZMCF1.2~C3ENKDC4VMYN.2 size=942975 2024-09-22T08:25:21.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.799+0000 7f8a8d811780 1 < completed multipart upload key=QE6XEMOZMCF1 upload=C3ENKDC4VMYN tag=KH8DZDLMDR7U type=write size=4088703 2024-09-22T08:25:21.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.802+0000 7f8a8d811780 1 > prepared operation key=JP7IZ0CMXTSX tag=4VVNEUXE5MIN type=write size=238884 2024-09-22T08:25:21.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.804+0000 7f8a8d811780 1 < completed delete operation key=WOSCCX4WX2FN tag=H5PLUJXWI3Q2 type=del 2024-09-22T08:25:21.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.805+0000 7f8a8d811780 1 > prepared operation key=MJJPUJP2NSOK tag=HAV5PH0B9BY2 type=del size=884213 2024-09-22T08:25:21.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.809+0000 7f8a8d811780 1 < suggested remove operation key=7XNMR51803Y6 tag=62BIHLTSQ03J type=del 2024-09-22T08:25:21.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.810+0000 7f8a8d811780 1 > prepared operation key=QE6XEMOZMCF1 tag=H9S8K3NTG87F type=del size=3870423 2024-09-22T08:25:21.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.812+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.0 size=1048576 2024-09-22T08:25:21.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.813+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.1 size=1048576 2024-09-22T08:25:21.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.813+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~VMI14WG8XSYP.2 size=929792 2024-09-22T08:25:21.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.816+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=VMI14WG8XSYP tag=MC2I1K91UQS1 type=write size=4075520 2024-09-22T08:25:21.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.817+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=R7J7WZZM7TXU type=del size=3271472 2024-09-22T08:25:21.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.818+0000 7f8a8d811780 1 < completed write operation key=0HCXP53D9NMP tag=U44RBX28LJBT type=write size=800015 2024-09-22T08:25:21.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.820+0000 7f8a8d811780 1 > prepared operation key=ER5UY1ML3R2H tag=FXDY139VC25S type=del size=331551 2024-09-22T08:25:21.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.821+0000 7f8a8d811780 1 < completed delete operation key=911851NVIUQS tag=3E40S3XIQVBK type=del 2024-09-22T08:25:21.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.823+0000 7f8a8d811780 1 > prepared operation key=3T2TX83CSE2D tag=XFM0RB8RNAKO type=del size=1128727 2024-09-22T08:25:21.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.824+0000 7f8a8d811780 1 < canceled operation key=A8TGVQ273MNF tag=S9B6NS6NLB7S type=del size=1427698 2024-09-22T08:25:21.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.827+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~DIFS82U18H0Q.0 size=1048576 2024-09-22T08:25:21.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.828+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~DIFS82U18H0Q.1 size=419897 2024-09-22T08:25:21.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.828+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=DIFS82U18H0Q tag=S8AIBLMWMB3C type=write size=2517049 2024-09-22T08:25:21.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.829+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=JU2XWT640QD1 type=del 2024-09-22T08:25:21.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.831+0000 7f8a8d811780 1 > prepared operation key=1719KI1YP1FT tag=7LWJ14CJW5GQ type=del size=3409866 2024-09-22T08:25:21.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.832+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.0 size=1048576 2024-09-22T08:25:21.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.833+0000 7f8a8d811780 1 < completed part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.1 size=1048576 2024-09-22T08:25:21.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.833+0000 7f8a8d811780 1 < canceled part key=_multipart_5VU70RE1GJS2.2~TBSSK1Y1HA5Q.2 size=845290 2024-09-22T08:25:21.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.836+0000 7f8a8d811780 1 < canceled multipart upload key=5VU70RE1GJS2 upload=TBSSK1Y1HA5Q tag=21TBU7Z4LJDP type=write size=3991018 2024-09-22T08:25:21.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.838+0000 7f8a8d811780 1 > prepared operation key=A8TGVQ273MNF tag=QXAC8765Y0F7 type=del size=4067991 2024-09-22T08:25:21.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.839+0000 7f8a8d811780 1 < canceled operation key=PIRW8N555T52 tag=FNJMSKDYAE9S type=del size=1531651 2024-09-22T08:25:21.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.841+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P15Z51LMA1GK.0 size=1048576 2024-09-22T08:25:21.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.842+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P15Z51LMA1GK.1 size=1048576 2024-09-22T08:25:21.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.844+0000 7f8a8d811780 1 > prepared part key=_multipart_LRFF14FU7C5I.2~P15Z51LMA1GK.2 size=859220 2024-09-22T08:25:21.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.844+0000 7f8a8d811780 1 > prepared multipart upload key=LRFF14FU7C5I upload=P15Z51LMA1GK tag=M0Q5BG0P67EJ type=write size=4004948 2024-09-22T08:25:21.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.846+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.0 size=1048576 2024-09-22T08:25:21.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.847+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.1 size=1048576 2024-09-22T08:25:21.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.848+0000 7f8a8d811780 1 < completed part key=_multipart_H504PU8223G9.2~2GP5HYL1R95L.2 size=133728 2024-09-22T08:25:21.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.851+0000 7f8a8d811780 1 < completed multipart upload key=H504PU8223G9 upload=2GP5HYL1R95L tag=RX5YSVA9LE31 type=write size=3279456 2024-09-22T08:25:21.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.852+0000 7f8a8d811780 1 > prepared operation key=0HCXP53D9NMP tag=J321VTXMCCH0 type=del size=2893222 2024-09-22T08:25:21.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.854+0000 7f8a8d811780 1 < completed delete operation key=7XBR6QIHD8TJ tag=RQ84VEWI9S8F type=del 2024-09-22T08:25:21.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.857+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~S2NLG17M1HRA.0 size=1048576 2024-09-22T08:25:21.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.858+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~S2NLG17M1HRA.1 size=1048576 2024-09-22T08:25:21.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.858+0000 7f8a8d811780 1 > prepared part key=_multipart_PIRW8N555T52.2~S2NLG17M1HRA.2 size=288827 2024-09-22T08:25:21.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.858+0000 7f8a8d811780 1 > prepared multipart upload key=PIRW8N555T52 upload=S2NLG17M1HRA tag=4CULE3V3NONB type=write size=3434555 2024-09-22T08:25:21.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.860+0000 7f8a8d811780 1 < completed delete operation key=A8TGVQ273MNF tag=TRUARLRG5PHH type=del 2024-09-22T08:25:21.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.862+0000 7f8a8d811780 1 > prepared operation key=2EB57FFNN986 tag=K4PH7HXRWHTF type=del size=683072 2024-09-22T08:25:21.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.863+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.0 size=1048576 2024-09-22T08:25:21.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.864+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.1 size=1048576 2024-09-22T08:25:21.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.865+0000 7f8a8d811780 1 < completed part key=_multipart_T5IAHQ3CUIFR.2~EVRXCETBRFFG.2 size=622393 2024-09-22T08:25:21.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.868+0000 7f8a8d811780 1 < completed multipart upload key=T5IAHQ3CUIFR upload=EVRXCETBRFFG tag=HCQR9D36QEML type=write size=3768121 2024-09-22T08:25:21.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.869+0000 7f8a8d811780 1 > prepared operation key=KIJ2DW4NSZKG tag=WYCPXTTJRN6C type=del size=418889 2024-09-22T08:25:21.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.872+0000 7f8a8d811780 1 < suggested remove operation key=LRFF14FU7C5I tag=TWI1FQQLRG71 type=del 2024-09-22T08:25:21.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.874+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~FS1OSLGA6LKV.0 size=1048576 2024-09-22T08:25:21.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.875+0000 7f8a8d811780 1 > prepared part key=_multipart_1719KI1YP1FT.2~FS1OSLGA6LKV.1 size=844927 2024-09-22T08:25:21.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.875+0000 7f8a8d811780 1 > prepared multipart upload key=1719KI1YP1FT upload=FS1OSLGA6LKV tag=862HF843PNUY type=write size=2942079 2024-09-22T08:25:21.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.878+0000 7f8a8d811780 1 < completed part key=_multipart_0HCXP53D9NMP.2~TV5SU5YVE9UZ.0 size=614188 2024-09-22T08:25:21.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.879+0000 7f8a8d811780 1 < completed multipart upload key=0HCXP53D9NMP upload=TV5SU5YVE9UZ tag=8LKK01VXO7GN type=write size=1662764 2024-09-22T08:25:21.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.882+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~YJYEKG75TWLB.0 size=1048576 2024-09-22T08:25:21.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.883+0000 7f8a8d811780 1 > prepared part key=_multipart_RL59H41J8ZNF.2~YJYEKG75TWLB.1 size=59838 2024-09-22T08:25:21.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.883+0000 7f8a8d811780 1 > prepared multipart upload key=RL59H41J8ZNF upload=YJYEKG75TWLB tag=7HXF1WOBB04W type=write size=2156990 2024-09-22T08:25:21.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.884+0000 7f8a8d811780 1 < completed write operation key=JP7IZ0CMXTSX tag=4VVNEUXE5MIN type=write size=238884 2024-09-22T08:25:21.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.885+0000 7f8a8d811780 1 > prepared operation key=EILTWP17M0NL tag=FZ5WD7NEE1AP type=del size=4047977 2024-09-22T08:25:21.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.887+0000 7f8a8d811780 1 < completed delete operation key=MJJPUJP2NSOK tag=HAV5PH0B9BY2 type=del 2024-09-22T08:25:21.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.889+0000 7f8a8d811780 1 > prepared part key=_multipart_IOZ7IXVOB70S.2~5QCKUGOA6RDL.0 size=248215 2024-09-22T08:25:21.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.889+0000 7f8a8d811780 1 > prepared multipart upload key=IOZ7IXVOB70S upload=5QCKUGOA6RDL tag=6MV3N4VD1B38 type=write size=1296791 2024-09-22T08:25:21.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.891+0000 7f8a8d811780 1 < suggested remove operation key=QE6XEMOZMCF1 tag=H9S8K3NTG87F type=del 2024-09-22T08:25:21.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.893+0000 7f8a8d811780 1 > prepared operation key=0AOI0OB2YFVV tag=DLD4IAESO2BL type=del size=2335955 2024-09-22T08:25:21.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.895+0000 7f8a8d811780 1 < suggested update operation key=RCHUCAL6CQ4F tag=R7J7WZZM7TXU type=del size=3271472 2024-09-22T08:25:21.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.897+0000 7f8a8d811780 1 > prepared operation key=RCHUCAL6CQ4F tag=VXOFH6RXUTBB type=del size=2868198 2024-09-22T08:25:21.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.899+0000 7f8a8d811780 1 < completed delete operation key=ER5UY1ML3R2H tag=FXDY139VC25S type=del 2024-09-22T08:25:21.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.902+0000 7f8a8d811780 1 > prepared part key=_multipart_9EY50PUC6AJJ.2~ZPCCB0GTFN2W.0 size=24288 2024-09-22T08:25:21.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.902+0000 7f8a8d811780 1 > prepared multipart upload key=9EY50PUC6AJJ upload=ZPCCB0GTFN2W tag=1V5FNXMYRI4P type=write size=1072864 2024-09-22T08:25:21.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.903+0000 7f8a8d811780 1 < completed delete operation key=3T2TX83CSE2D tag=XFM0RB8RNAKO type=del 2024-09-22T08:25:21.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.904+0000 7f8a8d811780 1 > prepared operation key=5VU70RE1GJS2 tag=N5S9E02X4W87 type=del size=2502954 2024-09-22T08:25:21.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.905+0000 7f8a8d811780 1 < canceled part key=_multipart_PIRW8N555T52.2~DIFS82U18H0Q.0 size=1048576 2024-09-22T08:25:21.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.906+0000 7f8a8d811780 1 < completed part key=_multipart_PIRW8N555T52.2~DIFS82U18H0Q.1 size=419897 2024-09-22T08:25:21.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.909+0000 7f8a8d811780 1 < canceled multipart upload key=PIRW8N555T52 upload=DIFS82U18H0Q tag=S8AIBLMWMB3C type=write size=2517049 2024-09-22T08:25:21.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.911+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~I3CO2K923PT3.0 size=1048576 2024-09-22T08:25:21.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.912+0000 7f8a8d811780 1 > prepared part key=_multipart_EILTWP17M0NL.2~I3CO2K923PT3.1 size=471623 2024-09-22T08:25:21.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.912+0000 7f8a8d811780 1 > prepared multipart upload key=EILTWP17M0NL upload=I3CO2K923PT3 tag=1UAJS6Y9QAEM type=write size=2568775 2024-09-22T08:25:21.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.915+0000 7f8a8d811780 1 < suggested remove operation key=1719KI1YP1FT tag=7LWJ14CJW5GQ type=del 2024-09-22T08:25:21.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.918+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~HN56NVQIXFDT.0 size=1048576 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.919+0000 7f8a8d811780 1 > prepared part key=_multipart_WOSCCX4WX2FN.2~HN56NVQIXFDT.1 size=373582 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:25:21.919+0000 7f8a8d811780 1 > prepared multipart upload key=WOSCCX4WX2FN upload=HN56NVQIXFDT tag=J3741U290O4Y type=write size=2470734 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_stats.simulate (11083 ms) 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 1 test from cls_rgw_stats (11083 ms total) 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:25:21.920 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:22.929 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 1 test from 1 test suite ran. (13988 ms total) 2024-09-22T08:25:22.929 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 1 test. 2024-09-22T08:25:22.933 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:25:22.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:25:23.015 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-22T08:25:23.016 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-22T08:25:23.017 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-22T08:25:23.102 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:25:23.102 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-22T08:25:23.102 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:24.932 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 31 tests from CmpOmap 2024-09-22T08:25:24.932 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-22T08:25:24.951 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (20 ms) 2024-09-22T08:25:24.952 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-22T08:25:24.955 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-09-22T08:25:24.955 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-22T08:25:24.957 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-22T08:25:24.958 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-22T08:25:24.962 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-22T08:25:24.962 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-22T08:25:24.967 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-22T08:25:24.968 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-22T08:25:24.975 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-22T08:25:24.976 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-22T08:25:24.978 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-22T08:25:24.979 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-22T08:25:24.981 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (2 ms) 2024-09-22T08:25:24.981 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-22T08:25:24.984 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-22T08:25:24.984 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-22T08:25:24.987 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-22T08:25:24.988 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-22T08:25:24.988 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-09-22T08:25:24.988 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-22T08:25:24.989 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-22T08:25:24.989 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-22T08:25:24.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-22T08:25:24.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-22T08:25:25.001 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-22T08:25:25.001 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-22T08:25:25.007 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-22T08:25:25.007 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-22T08:25:25.014 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-22T08:25:25.015 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-22T08:25:25.023 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-22T08:25:25.023 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-22T08:25:25.030 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-09-22T08:25:25.031 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-22T08:25:25.032 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-22T08:25:25.033 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-22T08:25:25.035 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-22T08:25:25.035 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-22T08:25:25.037 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-22T08:25:25.037 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-22T08:25:25.037 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-22T08:25:25.037 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-22T08:25:25.044 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-22T08:25:25.044 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-22T08:25:25.050 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-22T08:25:25.050 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-22T08:25:25.057 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-22T08:25:25.057 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-22T08:25:25.064 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-22T08:25:25.064 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-22T08:25:25.066 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-22T08:25:25.066 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-22T08:25:25.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-22T08:25:25.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-22T08:25:25.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-22T08:25:25.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-22T08:25:25.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-22T08:25:25.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-22T08:25:25.078 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-22T08:25:25.078 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 31 tests from CmpOmap (146 ms total) 2024-09-22T08:25:25.078 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:25:25.078 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:25:25.940 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 31 tests from 1 test suite ran. (2838 ms total) 2024-09-22T08:25:25.940 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 31 tests. 2024-09-22T08:25:25.943 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:25:25.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:25:25.987 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-22T08:25:25.988 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-22T08:25:25.988 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-22T08:25:26.074 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:25:26.074 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:25:26.074 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:25:26.074 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-22T08:25:26.074 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-22T08:25:28.959 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2885 ms) 2024-09-22T08:25:28.960 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-22T08:25:31.965 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3006 ms) 2024-09-22T08:25:31.965 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-22T08:25:35.000 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Reserve (3035 ms) 2024-09-22T08:25:35.001 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-22T08:25:38.007 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3007 ms) 2024-09-22T08:25:38.007 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-22T08:25:41.042 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Commit (3034 ms) 2024-09-22T08:25:41.042 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-22T08:25:44.049 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Stats (3008 ms) 2024-09-22T08:25:44.050 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-22T08:25:48.127 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4077 ms) 2024-09-22T08:25:48.127 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-22T08:25:51.136 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Abort (3009 ms) 2024-09-22T08:25:51.136 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-22T08:25:54.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveError (3036 ms) 2024-09-22T08:25:54.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-22T08:25:57.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.CommitError (3021 ms) 2024-09-22T08:25:57.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-22T08:26:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AbortError (3023 ms) 2024-09-22T08:26:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-22T08:26:03.242 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3025 ms) 2024-09-22T08:26:03.242 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-22T08:26:06.250 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3009 ms) 2024-09-22T08:26:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-22T08:26:09.274 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3024 ms) 2024-09-22T08:26:09.274 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-22T08:26:12.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3012 ms) 2024-09-22T08:26:12.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-22T08:26:15.299 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3013 ms) 2024-09-22T08:26:15.299 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-22T08:26:18.316 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3017 ms) 2024-09-22T08:26:18.316 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-22T08:26:21.328 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Cleanup (3011 ms) 2024-09-22T08:26:21.328 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-22T08:26:32.409 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11082 ms) 2024-09-22T08:26:32.410 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-22T08:26:35.439 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3029 ms) 2024-09-22T08:26:35.439 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-22T08:26:48.831 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13393 ms) 2024-09-22T08:26:48.832 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-22T08:26:52.854 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4023 ms) 2024-09-22T08:26:52.854 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-22T08:26:57.876 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5022 ms) 2024-09-22T08:26:57.876 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5034 ms) 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from TestCls2PCQueue (96836 ms total) 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (96836 ms total) 2024-09-22T08:27:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-22T08:27:02.912 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:27:02.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:27:02.951 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-22T08:27:02.952 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-22T08:27:02.952 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-22T08:27:03.042 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:03.042 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:03.043 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:27:03.043 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:04.921 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from ClsAccount 2024-09-22T08:27:04.921 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.add 2024-09-22T08:27:04.938 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.add (18 ms) 2024-09-22T08:27:04.938 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.get 2024-09-22T08:27:04.943 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-22T08:27:04.943 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.rm 2024-09-22T08:27:04.950 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-22T08:27:04.951 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.list 2024-09-22T08:27:04.965 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-22T08:27:04.965 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from ClsAccount (45 ms total) 2024-09-22T08:27:04.965 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:04.965 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:05.915 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (2872 ms total) 2024-09-22T08:27:05.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-22T08:27:05.917 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:27:05.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:27:05.960 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-22T08:27:05.961 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-22T08:27:05.961 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-22T08:27:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:06.054 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-22T08:27:06.055 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:07.941 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 6 tests from rgw_gc_log 2024-09-22T08:27:07.941 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-22T08:27:07.957 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.init_existing_queue (16 ms) 2024-09-22T08:27:07.957 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-22T08:27:07.961 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-22T08:27:07.961 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-22T08:27:08.174 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (213 ms) 2024-09-22T08:27:08.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-22T08:27:08.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-22T08:27:08.176 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-22T08:27:08.178 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-22T08:27:08.178 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-22T08:27:08.180 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-22T08:27:08.181 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 6 tests from rgw_gc_log (240 ms total) 2024-09-22T08:27:08.181 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:08.181 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:08.945 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 6 tests from 1 test suite ran. (2891 ms total) 2024-09-22T08:27:08.945 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 6 tests. 2024-09-22T08:27:08.948 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:27:08.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:27:08.994 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-22T08:27:08.995 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-22T08:27:08.995 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from TestRGWObj 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.underscore 2024-09-22T08:27:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.054 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.055 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.056 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.057 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.058 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.059 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.060 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.061 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.062 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.063 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.064 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.065 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.066 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.067 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.068 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.069 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.070 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-22T08:27:09.071 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.072 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.073 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.074 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.075 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.076 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.077 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-22T08:27:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.079 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.080 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.081 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.082 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.083 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.084 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.085 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.086 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.087 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.088 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.089 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.090 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.091 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.093 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.094 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.095 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.096 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.097 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.098 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.099 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.100 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.101 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.102 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.103 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.104 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-22T08:27:09.105 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.106 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.107 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.108 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.109 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.110 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.111 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.112 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.113 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.114 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.115 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.116 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.117 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.118 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.119 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.120 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.121 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.122 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.123 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.124 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.124 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:27:09.124 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.124 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.125 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.125 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.125 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.126 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.127 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.128 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.129 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.130 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.131 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.132 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.133 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.134 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.135 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.136 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.137 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.138 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.139 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.140 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.141 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.142 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.143 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.144 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.145 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.146 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.147 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.148 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-22T08:27:09.149 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.150 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.151 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.152 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.153 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.154 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.155 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.156 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.157 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.158 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.159 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.160 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.161 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.162 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.163 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.165 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.166 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.167 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.168 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.169 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.170 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.171 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.172 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.173 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.174 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.175 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.176 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.177 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.178 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.179 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.180 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.181 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.182 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.183 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.184 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.185 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.186 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.187 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.188 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.189 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.190 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.191 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.192 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.193 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.194 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.195 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.196 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.197 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.198 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.199 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.200 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.201 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.202 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.203 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.204 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.205 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.206 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.207 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.208 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.209 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.210 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.211 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.212 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.213 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.214 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.215 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.216 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.217 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.218 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.219 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.220 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.221 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.222 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.223 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.224 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.225 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.226 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.227 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker_myobj 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.228 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.229 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker_myobj 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.230 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.231 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns_myobj 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.232 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.233 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.234 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.235 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.236 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.237 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.238 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.239 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.240 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.241 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-22T08:27:09.242 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.243 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.244 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker___myobj 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.246 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker___myobj 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.247 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.248 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns__myobj 2024-09-22T08:27:09.249 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.250 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.251 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.252 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.253 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.254 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.255 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.256 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.257 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.258 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.259 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.260 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.261 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker___myobj_ 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.262 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.263 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker___myobj_ 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.264 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.265 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.266 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.267 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.268 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.269 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.270 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.271 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.272 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.273 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.274 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-22T08:27:09.275 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.276 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-22T08:27:09.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-22T08:27:09.277 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:27:09.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:27:09.320 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-22T08:27:09.322 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-22T08:27:09.322 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-22T08:27:09.471 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:09.471 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:09.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.511+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 20 realm 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.513+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.514+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.514+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.514+0000 7f032512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:27:09.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.514+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.515+0000 7f032512c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:27:09.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.515+0000 7f032512c800 20 searching for the correct realm 2024-09-22T08:27:09.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.523+0000 7f0321650640 0 -- 172.21.15.78:0/2875168227 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f0308036030 msgr2=0x7f0308041a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:27:09.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.735+0000 7f031864e640 0 -- 172.21.15.78:0/2875168227 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f031c05d040 msgr2=0x7f031c061ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:27:09.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.944+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:27:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 zone default found 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 4 Realm: () 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 zonegroup default 2024-09-22T08:27:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.945+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.946+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.946+0000 7f032512c800 20 started sync module instance, tier type = 2024-09-22T08:27:09.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.946+0000 7f032512c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=0 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=1 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=2 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=3 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=4 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=5 2024-09-22T08:27:09.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.956+0000 7f032512c800 20 add_watcher() i=6 2024-09-22T08:27:09.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.957+0000 7f032512c800 20 add_watcher() i=7 2024-09-22T08:27:09.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.957+0000 7f032512c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:27:09.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.959+0000 7f01d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:27:09.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.960+0000 7f032512c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:27:09.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.960+0000 7f032512c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:27:09.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.960+0000 7f032512c800 5 note: GC not initialized 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.960+0000 7f01d67e4640 20 reqs_thread_entry: start 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 20 init_complete bucket index max shards: 11 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 20 Filter name: none 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f01cffff640 20 reqs_thread_entry: start 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-22T08:27:09.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.961+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-22T08:27:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 cache get: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= : miss 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 20 rados->read ofs=0 len=0 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= info.flags=0x0 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 adding default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= to cache LRU end 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 cache get: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= : hit (negative entry) 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.962+0000 7f032512c800 10 cache get: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= : hit (negative entry) 2024-09-22T08:27:09.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:27:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f032512c800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:27:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f032512c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-22T08:27:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f01f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94806259001408 notifier 5366 bl.length()=697 2024-09-22T08:27:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f01f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:27:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.963+0000 7f01f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:27:09.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.966+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:27:09.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.966+0000 7f032512c800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:27:09.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.966+0000 7f032512c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-22T08:27:09.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.967+0000 7f01f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856707 cookie 94806258997760 notifier 5366 bl.length()=194 2024-09-22T08:27:09.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.967+0000 7f01f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:27:09.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.967+0000 7f01f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:27:09.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f032512c800 10 cache put: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= info.flags=0x7 2024-09-22T08:27:09.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f032512c800 10 moving default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= to cache LRU end 2024-09-22T08:27:09.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f032512c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CRrMkXQl4gqq9/hH505TSJBxVAQ=, ofs0, ns] 2024-09-22T08:27:09.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f01f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856707 cookie 94806259001408 notifier 5366 bl.length()=203 2024-09-22T08:27:09.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f01f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= info.flags=0x7 2024-09-22T08:27:09.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.972+0000 7f01f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CRrMkXQl4gqq9/hH505TSJBxVAQ= to cache LRU end 2024-09-22T08:27:09.974 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:27:09.974 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "ceph-test-librgw-file", 2024-09-22T08:27:09.974 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "librgw test user", 2024-09-22T08:27:09.974 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "librgw@example.com", 2024-09-22T08:27:09.974 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "ceph-test-librgw-file", 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "CRrMkXQl4gqq9/hH505TSJBxVAQ=", 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "41NGoztDW5PcAMcIqtkPebnz9GXs1iy8N6/lE4cVRFiySA52e0VPPQ==", 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:27:09.963237Z" 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-22T08:27:09.975 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-22T08:27:09.976 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:27:09.963218Z", 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-22T08:27:09.977 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:27:09.978 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:09.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.974+0000 7f01d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:27:09.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.977+0000 7f032512c800 20 remove_watcher() i=0 2024-09-22T08:27:09.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.977+0000 7f032512c800 2 removed watcher, disabling cache 2024-09-22T08:27:09.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.978+0000 7f032512c800 20 remove_watcher() i=1 2024-09-22T08:27:09.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.979+0000 7f032512c800 20 remove_watcher() i=2 2024-09-22T08:27:09.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.980+0000 7f032512c800 20 remove_watcher() i=3 2024-09-22T08:27:09.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.981+0000 7f032512c800 20 remove_watcher() i=4 2024-09-22T08:27:09.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.983+0000 7f032512c800 20 remove_watcher() i=5 2024-09-22T08:27:09.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.984+0000 7f032512c800 20 remove_watcher() i=6 2024-09-22T08:27:09.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:09.985+0000 7f032512c800 20 remove_watcher() i=7 2024-09-22T08:27:09.997 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.1 2024-09-22T08:27:10.019 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:27:10.019 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:10.019 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:27:10.019 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:27:10.030 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:10.030 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:10.404 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (385 ms) 2024-09-22T08:27:10.404 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:27:10.405 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:27:10.405 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:27:10.405 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:27:10.405 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:27:10.420 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-22T08:27:10.424 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/f1 2024-09-22T08:27:10.428 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/f2 2024-09-22T08:27:10.431 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/f1 2024-09-22T08:27:10.434 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-22T08:27:10.437 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-22T08:27:10.440 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-22T08:27:10.443 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-22T08:27:10.446 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-22T08:27:10.449 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-22T08:27:10.452 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-22T08:27:10.455 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-22T08:27:10.457 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (53 ms) 2024-09-22T08:27:10.458 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:27:10.569 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (111 ms) 2024-09-22T08:27:10.569 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:27:10.569 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:27:10.569 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:27:10.587 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-22T08:27:10.587 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:27:10.632 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (45 ms) 2024-09-22T08:27:10.632 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:27:10.632 INFO:tasks.workunit.client.0.smithi078.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-22T08:27:10.638 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-22T08:27:10.638 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:27:10.638 INFO:tasks.workunit.client.0.smithi078.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:27:10.645 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:27:10.646 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:27:10.647 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:27:10.647 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:27:10.648 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:27:10.648 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:27:10.648 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:27:10.649 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:27:10.649 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:27:10.651 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:27:10.651 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:27:10.651 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:27:10.653 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:27:10.653 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:27:10.654 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:27:10.654 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-22T08:27:10.654 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (175 ms) 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (1 ms) 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:27:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:27:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:27:10.838 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:27:10.838 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:27:10.841 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:27:10.843 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:27:10.845 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:27:10.846 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:27:10.847 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:27:10.847 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:27:10.848 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:27:10.848 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:27:10.849 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:27:10.851 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:27:10.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:10.850+0000 7fcd609268c0 -1 shutting down 2024-09-22T08:27:10.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:10.851+0000 7fcc38777640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66449, si_uid : 1000, si_addr0x3e800010391, si_status0 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29721 ms) 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30553 ms total) 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30553 ms total) 2024-09-22T08:27:40.572 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-22T08:27:40.579 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.2 2024-09-22T08:27:40.603 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:27:40.603 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:27:40.603 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:27:40.603 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:27:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:27:40.612 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:27:40.992 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-22T08:27:40.993 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:27:40.994 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:27:40.995 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:27:40.996 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:40.991+0000 7feadff398c0 -1 shutting down 2024-09-22T08:27:40.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:27:40.992+0000 7fe9b7ed5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67068, si_uid : 1000, si_addr0x3e8000105fc, si_status0 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30369 ms) 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30759 ms total) 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30759 ms total) 2024-09-22T08:28:11.362 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-22T08:28:11.367 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.3 2024-09-22T08:28:11.390 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:28:11.390 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:28:11.390 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:28:11.390 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:28:11.400 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:28:11.400 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:28:11.815 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (425 ms) 2024-09-22T08:28:11.815 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:28:11.815 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-22T08:28:11.815 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:28:11.815 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:28:11.816 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:28:11.821 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-22T08:28:11.821 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:28:11.885 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (64 ms) 2024-09-22T08:28:11.885 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:28:11.886 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:28:11.887 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:28:11.888 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:28:11.888 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:28:11.888 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:28:11.889 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:28:11.889 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:28:11.889 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:28:11.890 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:28:11.890 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:28:11.891 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:28:11.891 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:28:11.891 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:28:11.893 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:28:11.893 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:28:11.894 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:28:11.894 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-22T08:28:11.894 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:28:11.894 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:28:11.895 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:28:11.896 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:28:11.896 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:28:11.896 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:28:11.896 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:28:11.901 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:28:11.902 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:28:11.905 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:28:11.906 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:28:11.909 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:28:11.910 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:28:11.910 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:28:11.911 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:28:11.911 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:28:11.911 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:28:11.912 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-22T08:28:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:28:11.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:28:11.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:28:11.913+0000 7f0afab268c0 -1 shutting down 2024-09-22T08:28:11.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:28:11.914+0000 7f09d1fcf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67687, si_uid : 1000, si_addr0x3e800010867, si_status0 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29912 ms) 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30436 ms total) 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30436 ms total) 2024-09-22T08:28:41.826 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-22T08:28:41.832 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2.1 2024-09-22T08:28:41.857 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:28:41.857 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:28:41.857 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:28:41.857 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:28:41.866 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:28:41.866 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:28:42.040 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (183 ms) 2024-09-22T08:28:42.041 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:28:42.041 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:28:42.041 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:28:42.054 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-22T08:28:42.054 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:28:42.054 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:28:42.055 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:28:42.064 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave0 2024-09-22T08:28:42.076 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave1 2024-09-22T08:28:42.087 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave2 2024-09-22T08:28:42.100 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave3 2024-09-22T08:28:42.110 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave4 2024-09-22T08:28:42.120 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave5 2024-09-22T08:28:42.131 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave6 2024-09-22T08:28:42.141 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave7 2024-09-22T08:28:42.151 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave8 2024-09-22T08:28:42.162 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave9 2024-09-22T08:28:42.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (108 ms) 2024-09-22T08:28:42.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (300 ms) 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:28:42.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:28:42.461+0000 7fb9e39248c0 -1 shutting down 2024-09-22T08:28:42.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:28:42.462+0000 7fb8bb89a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68307, si_uid : 1000, si_addr0x3e800010ad3, si_status0 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29844 ms) 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW (30449 ms total) 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (30449 ms total) 2024-09-22T08:29:12.307 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-22T08:29:12.313 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2.2 2024-09-22T08:29:12.338 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:29:12.338 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:29:12.338 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:29:12.338 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:29:12.348 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:29:12.348 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (442 ms) 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:29:12.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:29:12.813 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-22T08:29:12.813 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:29:12.823 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave0 2024-09-22T08:29:12.833 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave1 2024-09-22T08:29:12.843 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave2 2024-09-22T08:29:12.854 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave3 2024-09-22T08:29:12.864 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave4 2024-09-22T08:29:12.877 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave5 2024-09-22T08:29:12.887 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave6 2024-09-22T08:29:12.900 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave7 2024-09-22T08:29:12.909 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave8 2024-09-22T08:29:12.922 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave9 2024-09-22T08:29:12.923 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (110 ms) 2024-09-22T08:29:12.923 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:29:13.214 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (291 ms) 2024-09-22T08:29:13.214 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:29:13.213+0000 7f1dddf248c0 -1 shutting down 2024-09-22T08:29:13.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:29:13.214+0000 7f1cb5e9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68926, si_uid : 1000, si_addr0x3e800010d3e, si_status0 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29838 ms) 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW (30714 ms total) 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (30714 ms total) 2024-09-22T08:29:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-22T08:29:43.059 INFO:tasks.workunit.client.0.smithi078.stdout:phase 3.1 2024-09-22T08:29:43.375 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:29:43.375 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:29:43.375 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:29:43.375 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:29:43.384 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:29:43.384 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:29:43.798 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (423 ms) 2024-09-22T08:29:43.798 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:29:43.798 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:29:43.798 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:29:43.811 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-22T08:29:43.811 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:29:43.814 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-22T08:29:43.814 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:29:43.816 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:29:43.816 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:29:44.228 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE1 (412 ms) 2024-09-22T08:29:44.228 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:29:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE2 (48 ms) 2024-09-22T08:29:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:29:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:29:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:29:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:29:44.275+0000 7f27585458c0 -1 shutting down 2024-09-22T08:29:44.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:29:44.276+0000 7f2632282640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69545, si_uid : 1000, si_addr0x3e800010fa9, si_status0 2024-09-22T08:30:14.067 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29791 ms) 2024-09-22T08:30:14.067 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW (30692 ms total) 2024-09-22T08:30:14.067 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:30:14.067 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:30:14.068 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 13 tests from 1 test suite ran. (30692 ms total) 2024-09-22T08:30:14.068 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 13 tests. 2024-09-22T08:30:14.075 INFO:tasks.workunit.client.0.smithi078.stdout:phase 3.2 2024-09-22T08:30:14.395 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:30:14.395 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:30:14.395 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:30:14.396 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:30:14.779 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-09-22T08:30:14.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:30:14.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:30:14.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:30:14.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:30:14.780 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:30:14.786 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-22T08:30:14.786 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:30:14.790 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-22T08:30:14.790 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE1 (51 ms) 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:30:14.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:30:14.845 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-22T08:30:14.845 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:30:14.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:30:14.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:30:14.873+0000 7f2ae70ab8c0 -1 shutting down 2024-09-22T08:30:14.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:30:14.874+0000 7f29c0de8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70165, si_uid : 1000, si_addr0x3e800011215, si_status0 2024-09-22T08:30:44.841 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29967 ms) 2024-09-22T08:30:44.842 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW (30446 ms total) 2024-09-22T08:30:44.842 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:30:44.842 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:30:44.842 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 13 tests from 1 test suite ran. (30446 ms total) 2024-09-22T08:30:44.842 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 13 tests. 2024-09-22T08:30:44.848 INFO:tasks.workunit.client.0.smithi078.stdout:phase 4.1 2024-09-22T08:30:44.872 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:read i1: 64001 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:read s1: blunderbuss 2024-09-22T08:30:44.873 INFO:tasks.workunit.client.0.smithi078.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:30:44.874 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:30:44.884 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:30:44.884 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:30:45.268 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-22T08:30:45.268 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:30:45.269 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:30:45.269 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:30:45.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2024-09-22T08:30:45.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_0 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_1 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_2 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_3 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_4 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_5 2024-09-22T08:30:45.891 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_6 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_7 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_8 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_9 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_10 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_11 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_12 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_13 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_14 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_15 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_16 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_17 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_18 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_19 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_20 2024-09-22T08:30:45.892 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_21 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_22 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_23 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_24 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_25 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_26 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_27 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_28 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_29 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_30 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_31 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_32 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_33 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_34 2024-09-22T08:30:45.893 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_35 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_36 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_37 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_38 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_39 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_40 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_41 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_42 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_43 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_44 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_45 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_46 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_47 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_48 2024-09-22T08:30:45.894 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_49 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_50 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_51 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_52 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_53 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_54 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_55 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_56 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_57 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_58 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_59 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_60 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_61 2024-09-22T08:30:45.895 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_62 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_63 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_64 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_65 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_66 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_67 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_68 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_69 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_70 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_71 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_72 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_73 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_74 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_75 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_76 2024-09-22T08:30:45.896 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_77 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_78 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_79 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_80 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_81 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_82 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_83 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_84 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_85 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_86 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_87 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_88 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_89 2024-09-22T08:30:45.897 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_90 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_91 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_92 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_93 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_94 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_95 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_96 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_97 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_98 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_99 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (603 ms) 2024-09-22T08:30:45.898 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:30:45.899 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:30:45.900 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:30:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:30:45.902 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:30:45.903 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:30:45.904 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:30:45.905 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:30:45.906 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:30:45.907 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:30:45.908 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:30:45.909 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:30:45.910 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:30:45.911 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:30:45.912 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:30:45.913 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:30:45.914 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:30:45.915 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:30:45.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:30:45.894+0000 7f4c24a1b8c0 -1 shutting down 2024-09-22T08:30:45.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:30:45.896+0000 7f4afa654640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70784, si_uid : 1000, si_addr0x3e800011480, si_status0 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29709 ms) 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW (30732 ms total) 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (30732 ms total) 2024-09-22T08:31:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-22T08:31:15.611 INFO:tasks.workunit.client.0.smithi078.stdout:phase 4.2 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:read i1: 64001 2024-09-22T08:31:15.636 INFO:tasks.workunit.client.0.smithi078.stdout:read s1: blunderbuss 2024-09-22T08:31:15.637 INFO:tasks.workunit.client.0.smithi078.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:31:15.637 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:31:15.645 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:31:15.645 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:31:16.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (423 ms) 2024-09-22T08:31:16.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:31:16.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:31:16.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:31:16.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:31:16.073 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:31:16.074 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:31:16.075 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:31:16.076 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:31:16.077 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:31:16.078 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:31:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:31:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:31:16.072+0000 7f54138538c0 -1 shutting down 2024-09-22T08:31:16.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:31:16.073+0000 7f52ed592640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71403, si_uid : 1000, si_addr0x3e8000116eb, si_status0 2024-09-22T08:31:46.201 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30128 ms) 2024-09-22T08:31:46.201 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW (30565 ms total) 2024-09-22T08:31:46.201 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:31:46.201 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:31:46.202 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (30565 ms total) 2024-09-22T08:31:46.202 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-22T08:31:46.207 INFO:tasks.workunit.client.0.smithi078.stdout:phase 5.1 2024-09-22T08:31:46.240 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:31:46.241 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:31:46.241 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:31:46.241 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:31:46.251 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:31:46.251 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:31:46.655 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (415 ms) 2024-09-22T08:31:46.655 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:31:46.656 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:31:46.656 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:31:46.667 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-22T08:31:46.667 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:31:46.671 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-22T08:31:46.671 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:31:46.671 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:31:46.671 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:31:46.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:31:46.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:31:46.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:31:46.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:31:46.677 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-22T08:31:46.678 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:31:46.680 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:31:46.681 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:31:46.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:31:46.678+0000 7fdbb2d378c0 -1 shutting down 2024-09-22T08:31:46.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:31:46.680+0000 7fda8acd2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72022, si_uid : 1000, si_addr0x3e800011956, si_status0 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30078 ms) 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW (30517 ms total) 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (30517 ms total) 2024-09-22T08:32:16.758 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-22T08:32:16.764 INFO:tasks.workunit.client.0.smithi078.stdout:phase 5.2 2024-09-22T08:32:16.797 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:32:16.797 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:32:16.797 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:32:16.797 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:32:16.804 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:16.804 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:17.184 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-22T08:32:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:32:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:32:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:32:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:32:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:32:17.191 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-22T08:32:17.191 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:32:17.191 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:32:17.192 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:32:17.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:32:17.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:32:17.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:32:17.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:32:17.193 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:32:17.196 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-22T08:32:17.197 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:32:17.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:32:17.230+0000 7f6de41378c0 -1 shutting down 2024-09-22T08:32:17.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:32:17.231+0000 7f6cbc0d2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72641, si_uid : 1000, si_addr0x3e800011bc1, si_status0 2024-09-22T08:32:47.590 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30359 ms) 2024-09-22T08:32:47.590 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW (30793 ms total) 2024-09-22T08:32:47.590 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:32:47.590 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:32:47.590 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (30793 ms total) 2024-09-22T08:32:47.591 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-22T08:32:47.596 INFO:tasks.workunit.client.0.smithi078.stdout:phase 6.1 2024-09-22T08:32:47.621 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:32:47.621 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-22T08:32:47.621 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from LibRGW 2024-09-22T08:32:47.622 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:32:47.628 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:32:47.629 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:32:48.009 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-22T08:32:48.009 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:32:48.010 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:32:48.010 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-22T08:32:48.031 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKETS (21 ms) 2024-09-22T08:32:48.031 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-22T08:32:48.039 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-22T08:32:48.040 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-22T08:32:48.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.TOPDIR_RENAME (20 ms) 2024-09-22T08:32:48.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-22T08:32:48.083 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-22T08:32:48.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (24 ms) 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:32:48.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:32:48.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:32:48.106+0000 7f23533338c0 -1 shutting down 2024-09-22T08:32:48.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:32:48.108+0000 7f222b20e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 73261, si_uid : 1000, si_addr0x3e800011e2d, si_status0 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30163 ms) 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from LibRGW (30649 ms total) 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 10 tests from 1 test suite ran. (30649 ms total) 2024-09-22T08:33:18.271 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 10 tests. 2024-09-22T08:33:18.278 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:33:18.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:33:18.321 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-22T08:33:18.322 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-22T08:33:18.322 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z ']' 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:33:18.396 INFO:tasks.workunit.client.0.smithi078.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-22T08:33:18.432 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:33:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:33:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.468+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.470+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.470+0000 7f598a923800 20 realm 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.470+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.471+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.471+0000 7f598a923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.471+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.471+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.471+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.472+0000 7f598a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:18.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.472+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.473+0000 7f598a923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:33:18.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.473+0000 7f598a923800 20 searching for the correct realm 2024-09-22T08:33:18.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.475+0000 7f5986e45640 0 -- 172.21.15.78:0/3381000177 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f59700873f0 msgr2=0x7f5970087850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:18.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.479+0000 7f597de43640 0 -- 172.21.15.78:0/3381000177 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5980032400 msgr2=0x7f5980032880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:33:18.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:33:18.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:33:18.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:33:18.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:33:18.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.484+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:33:18.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 zone default found 2024-09-22T08:33:18.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 4 Realm: () 2024-09-22T08:33:18.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 zonegroup default 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.485+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.486+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.486+0000 7f598a923800 20 started sync module instance, tier type = 2024-09-22T08:33:18.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.486+0000 7f598a923800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=0 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=1 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=2 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=3 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=4 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=5 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.495+0000 7f598a923800 20 add_watcher() i=6 2024-09-22T08:33:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.497+0000 7f598a923800 20 add_watcher() i=7 2024-09-22T08:33:18.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.497+0000 7f598a923800 2 all 8 watchers are set, enabling cache 2024-09-22T08:33:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.498+0000 7f583cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:33:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:33:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 5 note: GC not initialized 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f57b77fe640 20 reqs_thread_entry: start 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 20 init_complete bucket index max shards: 11 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 20 Filter name: none 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f57b57fa640 20 reqs_thread_entry: start 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-22T08:33:18.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.499+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-22T08:33:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:33:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-22T08:33:18.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.500+0000 7f598a923800 20 rados->read ofs=0 len=0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.501+0000 7f598a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.501+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.501+0000 7f598a923800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.501+0000 7f598a923800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:33:18.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.501+0000 7f598a923800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f598a923800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f598a923800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f5869ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856772 cookie 93984270909104 notifier 5949 bl.length()=677 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f5869ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:33:18.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.502+0000 7f5869ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:33:18.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:33:18.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f598a923800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:33:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f598a923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-22T08:33:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f5869ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 93984270894784 notifier 5949 bl.length()=187 2024-09-22T08:33:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f5869ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:33:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.506+0000 7f5869ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.508+0000 7f598a923800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.508+0000 7f598a923800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.508+0000 7f598a923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.509+0000 7f5869ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856714 cookie 93984270894784 notifier 5949 bl.length()=197 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.509+0000 7f5869ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:33:18.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.509+0000 7f5869ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "ceph-test-maven", 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "maven test user", 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "sigv4@example.com", 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "ceph-test-maven", 2024-09-22T08:33:18.512 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:33:18.502028Z" 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:33:18.513 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-22T08:33:18.514 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:33:18.501995Z", 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.511+0000 7f583cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.513+0000 7f598a923800 20 remove_watcher() i=0 2024-09-22T08:33:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.513+0000 7f598a923800 2 removed watcher, disabling cache 2024-09-22T08:33:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.514+0000 7f598a923800 20 remove_watcher() i=1 2024-09-22T08:33:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.515+0000 7f598a923800 20 remove_watcher() i=2 2024-09-22T08:33:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.516+0000 7f598a923800 20 remove_watcher() i=3 2024-09-22T08:33:18.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.517+0000 7f598a923800 20 remove_watcher() i=4 2024-09-22T08:33:18.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.518+0000 7f598a923800 20 remove_watcher() i=5 2024-09-22T08:33:18.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.519+0000 7f598a923800 20 remove_watcher() i=6 2024-09-22T08:33:18.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:33:18.520+0000 7f598a923800 20 remove_watcher() i=7 2024-09-22T08:33:18.532 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z ']' 2024-09-22T08:33:18.532 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-22T08:33:18.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-22T08:33:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi078.front.sepia.ceph.com:80 2024-09-22T08:33:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi078.front.sepia.ceph.com:80 2024-09-22T08:33:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-22T08:33:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-22T08:33:18.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ ./mvnw clean package 2024-09-22T08:33:18.627 INFO:tasks.workunit.client.0.smithi078.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:33:20.080 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Scanning for projects... 2024-09-22T08:33:20.201 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-22T08:33:20.281 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 67 kB/s) 2024-09-22T08:33:20.292 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-22T08:33:20.330 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.2 MB/s) 2024-09-22T08:33:20.338 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-22T08:33:20.356 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.3 MB/s) 2024-09-22T08:33:20.379 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:20.379 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:33:20.379 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:33:20.379 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] from pom.xml 2024-09-22T08:33:20.379 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:33:20.381 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-22T08:33:20.396 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-22T08:33:20.402 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-22T08:33:20.417 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-22T08:33:20.420 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-22T08:33:20.436 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-22T08:33:20.442 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-22T08:33:20.457 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-22T08:33:20.468 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-22T08:33:20.483 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.4 MB/s) 2024-09-22T08:33:20.490 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-22T08:33:20.505 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-22T08:33:20.507 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-22T08:33:20.522 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-09-22T08:33:20.524 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-22T08:33:20.539 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-22T08:33:20.543 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-22T08:33:20.559 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-22T08:33:20.566 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-22T08:33:20.582 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-22T08:33:20.589 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-22T08:33:20.604 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-22T08:33:20.609 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-22T08:33:20.625 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-22T08:33:20.631 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-22T08:33:20.646 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-22T08:33:20.648 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-22T08:33:20.663 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.6 MB/s) 2024-09-22T08:33:20.668 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-22T08:33:20.683 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-22T08:33:20.688 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-22T08:33:20.702 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-22T08:33:20.708 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-22T08:33:20.722 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-22T08:33:20.726 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-22T08:33:20.741 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-22T08:33:20.747 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-22T08:33:20.761 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-22T08:33:20.763 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-22T08:33:20.778 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-22T08:33:20.780 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-22T08:33:20.796 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-22T08:33:20.799 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-22T08:33:20.813 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-22T08:33:20.817 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-22T08:33:20.833 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-22T08:33:20.846 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-22T08:33:20.860 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-22T08:33:20.862 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-22T08:33:20.877 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-22T08:33:20.881 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-22T08:33:20.895 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.4 MB/s) 2024-09-22T08:33:20.903 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-22T08:33:20.917 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 286 kB/s) 2024-09-22T08:33:20.919 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-22T08:33:20.934 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-22T08:33:20.936 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-22T08:33:20.950 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-22T08:33:20.954 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-22T08:33:20.969 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-22T08:33:20.973 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-22T08:33:20.987 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-22T08:33:20.991 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-22T08:33:21.006 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-22T08:33:21.011 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-22T08:33:21.025 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-22T08:33:21.028 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-22T08:33:21.043 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-22T08:33:21.047 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-22T08:33:21.062 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-22T08:33:21.064 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-22T08:33:21.079 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-22T08:33:21.081 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-22T08:33:21.095 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-22T08:33:21.097 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-22T08:33:21.111 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-22T08:33:21.114 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-22T08:33:21.128 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-22T08:33:21.132 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-22T08:33:21.146 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 175 kB/s) 2024-09-22T08:33:21.149 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-22T08:33:21.164 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-22T08:33:21.167 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-22T08:33:21.182 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-22T08:33:21.185 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-22T08:33:21.199 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-22T08:33:21.203 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-22T08:33:21.217 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-22T08:33:21.222 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-22T08:33:21.236 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-22T08:33:21.239 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-22T08:33:21.253 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-22T08:33:21.256 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-22T08:33:21.271 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-22T08:33:21.275 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-22T08:33:21.289 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-22T08:33:21.292 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-22T08:33:21.307 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-22T08:33:21.310 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-22T08:33:21.324 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-22T08:33:21.328 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-22T08:33:21.342 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 292 kB/s) 2024-09-22T08:33:21.344 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-22T08:33:21.358 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-22T08:33:21.361 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-22T08:33:21.376 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-22T08:33:21.377 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-22T08:33:21.391 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-22T08:33:21.393 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-22T08:33:21.408 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-22T08:33:21.410 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-22T08:33:21.424 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-22T08:33:21.428 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-22T08:33:21.442 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-22T08:33:21.444 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-22T08:33:21.458 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-22T08:33:21.461 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-22T08:33:21.475 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 1.1 MB/s) 2024-09-22T08:33:21.477 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-22T08:33:21.493 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-22T08:33:21.499 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-22T08:33:21.513 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-22T08:33:21.517 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-22T08:33:21.531 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-22T08:33:21.533 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-22T08:33:21.549 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-22T08:33:21.553 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-22T08:33:21.567 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-22T08:33:21.570 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-22T08:33:21.585 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-22T08:33:21.587 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-22T08:33:21.603 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-22T08:33:21.608 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-22T08:33:21.623 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-22T08:33:21.625 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-22T08:33:21.639 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-22T08:33:21.642 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-22T08:33:21.656 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:33:21.658 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-22T08:33:21.672 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-22T08:33:21.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-22T08:33:21.688 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-22T08:33:21.690 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-22T08:33:21.704 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-22T08:33:21.706 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-22T08:33:21.721 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-22T08:33:21.722 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-22T08:33:21.736 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-22T08:33:21.738 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-22T08:33:21.753 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-22T08:33:21.755 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-22T08:33:21.773 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:33:21.773 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-22T08:33:21.786 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-22T08:33:21.789 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-22T08:33:21.803 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-22T08:33:21.806 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-22T08:33:21.820 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-22T08:33:21.822 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-22T08:33:21.836 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 233 kB/s) 2024-09-22T08:33:21.837 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-22T08:33:21.852 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-22T08:33:21.854 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-22T08:33:21.869 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-22T08:33:21.871 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-22T08:33:21.885 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-22T08:33:21.901 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-22T08:33:21.980 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-22T08:33:21.982 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-22T08:33:21.982 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-22T08:33:21.982 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-22T08:33:21.982 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-22T08:33:21.983 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-22T08:33:21.998 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 987 kB/s) 2024-09-22T08:33:21.999 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-22T08:33:22.013 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.5/16 kB Progress (1): 9.6/16 kB Progress (1): 14/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 517 kB/s) 2024-09-22T08:33:22.013 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-22T08:33:22.041 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (3): 2.8/49 kB | 1.4/35 kB | 1.4/98 kB Progress (3): 2.8/49 kB | 2.8/35 kB | 1.4/98 kB Progress (3): 2.8/49 kB | 2.8/35 kB | 2.8/98 kB Progress (3): 4.1/49 kB | 2.8/35 kB | 2.8/98 kB Progress (3): 4.1/49 kB | 2.8/35 kB | 4.1/98 kB Progress (3): 5.5/49 kB | 2.8/35 kB | 4.1/98 kB Progress (3): 5.5/49 kB | 4.1/35 kB | 4.1/98 kB Progress (3): 6.9/49 kB | 4.1/35 kB | 4.1/98 kB Progress (3): 6.9/49 kB | 4.1/35 kB | 5.5/98 kB Progress (3): 8.3/49 kB | 4.1/35 kB | 5.5/98 kB Progress (3): 8.3/49 kB | 5.5/35 kB | 5.5/98 kB Progress (3): 8.3/49 kB | 5.5/35 kB | 6.9/98 kB Progress (3): 8.3/49 kB | 6.9/35 kB | 6.9/98 kB Progress (3): 9.7/49 kB | 6.9/35 kB | 6.9/98 kB Progress (3): 9.7/49 kB | 8.3/35 kB | 6.9/98 kB Progress (3): 9.7/49 kB | 8.3/35 kB | 8.3/98 kB Progress (3): 9.7/49 kB | 9.7/35 kB | 8.3/98 kB Progress (3): 11/49 kB | 9.7/35 kB | 8.3/98 kB Progress (3): 11/49 kB | 11/35 kB | 8.3/98 kB Progress (3): 12/49 kB | 11/35 kB | 8.3/98 kB Progress (3): 12/49 kB | 11/35 kB | 9.7/98 kB Progress (3): 14/49 kB | 11/35 kB | 9.7/98 kB Progress (3): 14/49 kB | 12/35 kB | 9.7/98 kB Progress (3): 15/49 kB | 12/35 kB | 9.7/98 kB Progress (3): 15/49 kB | 12/35 kB | 11/98 kB Progress (3): 15/49 kB | 14/35 kB | 11/98 kB Progress (3): 15/49 kB | 14/35 kB | 12/98 kB Progress (3): 15/49 kB | 15/35 kB | 12/98 kB Progress (3): 15/49 kB | 15/35 kB | 14/98 kB Progress (3): 15/49 kB | 16/35 kB | 14/98 kB Progress (3): 15/49 kB | 16/35 kB | 15/98 kB Progress (3): 17/49 kB | 16/35 kB | 15/98 kB Progress (4): 17/49 kB | 16/35 kB | 15/98 kB | 1.4/71 kB Progress (4): 18/49 kB | 16/35 kB | 15/98 kB | 1.4/71 kB Progress (4): 18/49 kB | 16/35 kB | 15/98 kB | 2.8/71 kB Progress (4): 18/49 kB | 16/35 kB | 16/98 kB | 2.8/71 kB Progress (4): 18/49 kB | 16/35 kB | 16/98 kB | 4.1/71 kB Progress (4): 18/49 kB | 16/35 kB | 18/98 kB | 4.1/71 kB Progress (4): 18/49 kB | 18/35 kB | 18/98 kB | 4.1/71 kB Progress (4): 18/49 kB | 18/35 kB | 19/98 kB | 4.1/71 kB Progress (4): 18/49 kB | 18/35 kB | 19/98 kB | 5.5/71 kB Progress (4): 19/49 kB | 18/35 kB | 19/98 kB | 5.5/71 kB Progress (4): 19/49 kB | 18/35 kB | 19/98 kB | 6.9/71 kB Progress (4): 19/49 kB | 18/35 kB | 21/98 kB | 6.9/71 kB Progress (4): 19/49 kB | 18/35 kB | 21/98 kB | 8.3/71 kB Progress (4): 19/49 kB | 19/35 kB | 21/98 kB | 8.3/71 kB Progress (4): 19/49 kB | 19/35 kB | 21/98 kB | 9.7/71 kB Progress (4): 21/49 kB | 19/35 kB | 21/98 kB | 9.7/71 kB Progress (4): 21/49 kB | 19/35 kB | 21/98 kB | 11/71 kB Progress (4): 21/49 kB | 21/35 kB | 21/98 kB | 11/71 kB Progress (4): 21/49 kB | 21/35 kB | 21/98 kB | 12/71 kB Progress (4): 22/49 kB | 21/35 kB | 21/98 kB | 12/71 kB Progress (4): 22/49 kB | 21/35 kB | 21/98 kB | 14/71 kB Progress (4): 22/49 kB | 22/35 kB | 21/98 kB | 14/71 kB Progress (4): 22/49 kB | 22/35 kB | 22/98 kB | 14/71 kB Progress (4): 22/49 kB | 23/35 kB | 22/98 kB | 14/71 kB Progress (4): 22/49 kB | 23/35 kB | 22/98 kB | 15/71 kB Progress (4): 23/49 kB | 23/35 kB | 22/98 kB | 15/71 kB Progress (4): 23/49 kB | 25/35 kB | 22/98 kB | 15/71 kB Progress (4): 23/49 kB | 25/35 kB | 23/98 kB | 15/71 kB Progress (4): 23/49 kB | 25/35 kB | 23/98 kB | 17/71 kB Progress (4): 25/49 kB | 25/35 kB | 23/98 kB | 17/71 kB Progress (4): 25/49 kB | 25/35 kB | 23/98 kB | 18/71 kB Progress (4): 25/49 kB | 25/35 kB | 25/98 kB | 18/71 kB Progress (4): 25/49 kB | 26/35 kB | 25/98 kB | 18/71 kB Progress (4): 25/49 kB | 26/35 kB | 26/98 kB | 18/71 kB Progress (4): 25/49 kB | 26/35 kB | 26/98 kB | 19/71 kB Progress (4): 26/49 kB | 26/35 kB | 26/98 kB | 19/71 kB Progress (4): 26/49 kB | 26/35 kB | 26/98 kB | 21/71 kB Progress (4): 28/49 kB | 26/35 kB | 26/98 kB | 21/71 kB Progress (4): 28/49 kB | 26/35 kB | 27/98 kB | 21/71 kB Progress (4): 28/49 kB | 27/35 kB | 27/98 kB | 21/71 kB Progress (4): 28/49 kB | 27/35 kB | 29/98 kB | 21/71 kB Progress (4): 29/49 kB | 27/35 kB | 29/98 kB | 21/71 kB Progress (4): 29/49 kB | 27/35 kB | 30/98 kB | 21/71 kB Progress (4): 29/49 kB | 29/35 kB | 30/98 kB | 21/71 kB Progress (4): 30/49 kB | 29/35 kB | 30/98 kB | 21/71 kB Progress (4): 30/49 kB | 30/35 kB | 30/98 kB | 21/71 kB Progress (4): 30/49 kB | 30/35 kB | 30/98 kB | 22/71 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 22/71 kB | 12/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 23/71 kB | 12/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 25/71 kB | 12/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 26/71 kB | 12/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 26/71 kB | 29/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 28/71 kB | 29/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 28/71 kB | 45/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 29/71 kB | 45/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 45/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 61/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 78/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 94/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 98/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 115/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 131/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 135/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 151/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 168/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 184/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 196/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 213/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 229/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 246/782 kB Progress (5): 30/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 262/782 kB Progress (5): 31/49 kB | 30/35 kB | 30/98 kB | 30/71 kB | 262/782 kB Progress (5): 31/49 kB | 32/35 kB | 30/98 kB | 30/71 kB | 262/782 kB Progress (5): 33/49 kB | 32/35 kB | 30/98 kB | 30/71 kB | 262/782 kB Progress (5): 33/49 kB | 32/35 kB | 32/98 kB | 30/71 kB | 262/782 kB Progress (5): 34/49 kB | 32/35 kB | 32/98 kB | 30/71 kB | 262/782 kB Progress (5): 34/49 kB | 32/35 kB | 33/98 kB | 30/71 kB | 262/782 kB Progress (5): 36/49 kB | 32/35 kB | 33/98 kB | 30/71 kB | 262/782 kB Progress (5): 36/49 kB | 32/35 kB | 33/98 kB | 30/71 kB | 278/782 kB Progress (5): 36/49 kB | 33/35 kB | 33/98 kB | 30/71 kB | 278/782 kB Progress (5): 37/49 kB | 33/35 kB | 33/98 kB | 30/71 kB | 278/782 kB Progress (5): 37/49 kB | 33/35 kB | 34/98 kB | 30/71 kB | 278/782 kB Progress (5): 37/49 kB | 34/35 kB | 34/98 kB | 30/71 kB | 278/782 kB Progress (5): 37/49 kB | 34/35 kB | 36/98 kB | 30/71 kB | 278/782 kB Progress (5): 38/49 kB | 34/35 kB | 36/98 kB | 30/71 kB | 278/782 kB Progress (5): 38/49 kB | 34/35 kB | 36/98 kB | 30/71 kB | 295/782 kB Progress (5): 40/49 kB | 34/35 kB | 36/98 kB | 30/71 kB | 295/782 kB Progress (5): 40/49 kB | 34/35 kB | 37/98 kB | 30/71 kB | 295/782 kB Progress (5): 40/49 kB | 35 kB | 37/98 kB | 30/71 kB | 295/782 kB Progress (5): 40/49 kB | 35 kB | 38/98 kB | 30/71 kB | 295/782 kB Progress (5): 41/49 kB | 35 kB | 38/98 kB | 30/71 kB | 295/782 kB Progress (5): 41/49 kB | 35 kB | 40/98 kB | 30/71 kB | 295/782 kB Progress (5): 41/49 kB | 35 kB | 40/98 kB | 30/71 kB | 311/782 kB Progress (5): 41/49 kB | 35 kB | 40/98 kB | 32/71 kB | 311/782 kB Progress (5): 42/49 kB | 35 kB | 40/98 kB | 32/71 kB | 311/782 kB Progress (5): 42/49 kB | 35 kB | 41/98 kB | 32/71 kB | 311/782 kB Progress (5): 44/49 kB | 35 kB | 41/98 kB | 32/71 kB | 311/782 kB Progress (5): 44/49 kB | 35 kB | 41/98 kB | 33/71 kB | 311/782 kB Progress (5): 44/49 kB | 35 kB | 41/98 kB | 33/71 kB | 328/782 kB Progress (5): 45/49 kB | 35 kB | 41/98 kB | 33/71 kB | 328/782 kB Progress (5): 45/49 kB | 35 kB | 43/98 kB | 33/71 kB | 328/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-22T08:33:22.041 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 45/49 kB | 44/98 kB | 33/71 kB | 328/782 kB Progress (4): 47/49 kB | 44/98 kB | 33/71 kB | 328/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-22T08:33:22.041 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 47/49 kB | 45/98 kB | 33/71 kB | 328/782 kB Progress (4): 48/49 kB | 45/98 kB | 33/71 kB | 328/782 kB Progress (4): 48/49 kB | 45/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 45/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 47/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 48/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 49/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 51/98 kB | 33/71 kB | 344/782 kB Progress (4): 49 kB | 51/98 kB | 33/71 kB | 360/782 kB Progress (4): 49 kB | 52/98 kB | 33/71 kB | 360/782 kB Progress (4): 49 kB | 53/98 kB | 33/71 kB | 360/782 kB Progress (4): 49 kB | 55/98 kB | 33/71 kB | 360/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-22T08:33:22.042 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 56/98 kB | 33/71 kB | 360/782 kB Progress (3): 56/98 kB | 33/71 kB | 377/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-22T08:33:22.047 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 57/98 kB | 33/71 kB | 377/782 kB Progress (3): 57/98 kB | 49/71 kB | 377/782 kB Progress (3): 59/98 kB | 49/71 kB | 377/782 kB Progress (3): 60/98 kB | 49/71 kB | 377/782 kB Progress (3): 60/98 kB | 49/71 kB | 393/782 kB Progress (3): 62/98 kB | 49/71 kB | 393/782 kB Progress (3): 62/98 kB | 49/71 kB | 409/782 kB Progress (3): 62/98 kB | 49/71 kB | 426/782 kB Progress (3): 62/98 kB | 49/71 kB | 442/782 kB Progress (3): 62/98 kB | 49/71 kB | 459/782 kB Progress (3): 62/98 kB | 49/71 kB | 475/782 kB Progress (3): 62/98 kB | 49/71 kB | 491/782 kB Progress (3): 62/98 kB | 49/71 kB | 508/782 kB Progress (3): 62/98 kB | 49/71 kB | 524/782 kB Progress (3): 62/98 kB | 49/71 kB | 541/782 kB Progress (3): 62/98 kB | 49/71 kB | 557/782 kB Progress (3): 62/98 kB | 49/71 kB | 573/782 kB Progress (3): 62/98 kB | 49/71 kB | 590/782 kB Progress (3): 62/98 kB | 49/71 kB | 606/782 kB Progress (3): 62/98 kB | 49/71 kB | 622/782 kB Progress (3): 62/98 kB | 49/71 kB | 639/782 kB Progress (3): 62/98 kB | 49/71 kB | 655/782 kB Progress (3): 62/98 kB | 49/71 kB | 672/782 kB Progress (3): 62/98 kB | 49/71 kB | 688/782 kB Progress (3): 62/98 kB | 49/71 kB | 704/782 kB Progress (3): 62/98 kB | 49/71 kB | 721/782 kB Progress (3): 62/98 kB | 49/71 kB | 737/782 kB Progress (3): 62/98 kB | 49/71 kB | 753/782 kB Progress (3): 62/98 kB | 49/71 kB | 770/782 kB Progress (3): 62/98 kB | 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-22T08:33:22.047 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-22T08:33:22.051 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 63/98 kB | 49/71 kB Progress (2): 63/98 kB | 66/71 kB Progress (2): 79/98 kB | 66/71 kB Progress (2): 79/98 kB | 71 kB Progress (2): 95/98 kB | 71 kB Progress (2): 98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-22T08:33:22.051 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-22T08:33:22.052 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-22T08:33:22.052 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-22T08:33:22.055 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/11 kB Progress (1): 2.8/11 kB Progress (1): 4.1/11 kB Progress (1): 5.5/11 kB Progress (1): 6.9/11 kB Progress (1): 8.3/11 kB Progress (1): 9.7/11 kB Progress (1): 11/11 kB Progress (1): 11 kB Progress (2): 11 kB | 1.4/205 kB Progress (2): 11 kB | 2.8/205 kB Progress (2): 11 kB | 4.1/205 kB Progress (2): 11 kB | 5.5/205 kB Progress (2): 11 kB | 6.9/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 160 kB/s) 2024-09-22T08:33:22.055 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.3/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-22T08:33:22.062 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 16/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 382 kB/s) 2024-09-22T08:33:22.062 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-22T08:33:22.069 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 33/205 kB Progress (2): 33/205 kB | 16/81 kB Progress (2): 33/205 kB | 33/81 kB Progress (2): 49/205 kB | 33/81 kB Progress (2): 49/205 kB | 49/81 kB Progress (2): 66/205 kB | 49/81 kB Progress (3): 66/205 kB | 49/81 kB | 16/798 kB Progress (3): 66/205 kB | 66/81 kB | 16/798 kB Progress (3): 78/205 kB | 66/81 kB | 16/798 kB Progress (4): 78/205 kB | 66/81 kB | 16/798 kB | 13 kB Progress (4): 78/205 kB | 80/81 kB | 16/798 kB | 13 kB Progress (4): 78/205 kB | 81 kB | 16/798 kB | 13 kB Progress (4): 78/205 kB | 81 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 154 kB/s) 2024-09-22T08:33:22.070 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 945 kB/s) 2024-09-22T08:33:22.070 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-22T08:33:22.070 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-22T08:33:22.079 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 94/205 kB | 33/798 kB Progress (2): 111/205 kB | 33/798 kB Progress (2): 111/205 kB | 49/798 kB Progress (2): 111/205 kB | 62/798 kB Progress (3): 111/205 kB | 62/798 kB | 16/182 kB Progress (3): 111/205 kB | 62/798 kB | 33/182 kB Progress (3): 111/205 kB | 62/798 kB | 49/182 kB Progress (3): 111/205 kB | 62/798 kB | 66/182 kB Progress (3): 111/205 kB | 62/798 kB | 79/182 kB Progress (3): 111/205 kB | 62/798 kB | 96/182 kB Progress (3): 127/205 kB | 62/798 kB | 96/182 kB Progress (3): 127/205 kB | 62/798 kB | 112/182 kB Progress (3): 127/205 kB | 62/798 kB | 128/182 kB Progress (3): 143/205 kB | 62/798 kB | 128/182 kB Progress (3): 143/205 kB | 62/798 kB | 145/182 kB Progress (3): 160/205 kB | 62/798 kB | 145/182 kB Progress (3): 160/205 kB | 62/798 kB | 161/182 kB Progress (3): 160/205 kB | 62/798 kB | 178/182 kB Progress (3): 160/205 kB | 62/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.9 MB/s) 2024-09-22T08:33:22.079 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-22T08:33:22.080 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 176/205 kB | 62/798 kB Progress (2): 176/205 kB | 78/798 kB Progress (2): 193/205 kB | 78/798 kB Progress (2): 193/205 kB | 95/798 kB Progress (2): 205 kB | 95/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-22T08:33:22.081 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-22T08:33:22.087 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 111/798 kB Progress (1): 128/798 kB Progress (1): 144/798 kB Progress (2): 144/798 kB | 16/151 kB Progress (3): 144/798 kB | 16/151 kB | 16/27 kB Progress (3): 160/798 kB | 16/151 kB | 16/27 kB Progress (3): 160/798 kB | 33/151 kB | 16/27 kB Progress (3): 160/798 kB | 49/151 kB | 16/27 kB Progress (3): 160/798 kB | 49/151 kB | 27 kB Progress (3): 177/798 kB | 49/151 kB | 27 kB Progress (3): 177/798 kB | 66/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 270 kB/s) 2024-09-22T08:33:22.087 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-22T08:33:22.089 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 177/798 kB | 82/151 kB Progress (2): 177/798 kB | 98/151 kB Progress (2): 177/798 kB | 113/151 kB Progress (2): 177/798 kB | 129/151 kB Progress (2): 177/798 kB | 145/151 kB Progress (2): 177/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-22T08:33:22.089 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-22T08:33:22.094 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 193/798 kB Progress (1): 210/798 kB Progress (1): 226/798 kB Progress (1): 242/798 kB Progress (1): 259/798 kB Progress (2): 259/798 kB | 16/30 kB Progress (2): 275/798 kB | 16/30 kB Progress (2): 275/798 kB | 30 kB Progress (2): 291/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 273 kB/s) 2024-09-22T08:33:22.094 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-22T08:33:22.100 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 308/798 kB Progress (2): 308/798 kB | 16/385 kB Progress (2): 324/798 kB | 16/385 kB Progress (2): 324/798 kB | 33/385 kB Progress (2): 324/798 kB | 49/385 kB Progress (2): 324/798 kB | 66/385 kB Progress (2): 341/798 kB | 66/385 kB Progress (2): 357/798 kB | 66/385 kB Progress (2): 357/798 kB | 81/385 kB Progress (2): 357/798 kB | 98/385 kB Progress (2): 373/798 kB | 98/385 kB Progress (2): 373/798 kB | 114/385 kB Progress (2): 390/798 kB | 114/385 kB Progress (2): 390/798 kB | 131/385 kB Progress (2): 390/798 kB | 147/385 kB Progress (2): 406/798 kB | 147/385 kB Progress (2): 406/798 kB | 163/385 kB Progress (2): 423/798 kB | 163/385 kB Progress (2): 423/798 kB | 180/385 kB Progress (2): 423/798 kB | 196/385 kB Progress (2): 423/798 kB | 213/385 kB Progress (2): 423/798 kB | 229/385 kB Progress (2): 423/798 kB | 245/385 kB Progress (2): 423/798 kB | 262/385 kB Progress (3): 423/798 kB | 262/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 113 kB/s) 2024-09-22T08:33:22.100 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-22T08:33:22.105 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 439/798 kB | 262/385 kB Progress (2): 455/798 kB | 262/385 kB Progress (2): 472/798 kB | 262/385 kB Progress (3): 472/798 kB | 262/385 kB | 16/75 kB Progress (3): 488/798 kB | 262/385 kB | 16/75 kB Progress (3): 488/798 kB | 262/385 kB | 33/75 kB Progress (3): 504/798 kB | 262/385 kB | 33/75 kB Progress (3): 504/798 kB | 262/385 kB | 49/75 kB Progress (3): 521/798 kB | 262/385 kB | 49/75 kB Progress (3): 537/798 kB | 262/385 kB | 49/75 kB Progress (3): 537/798 kB | 262/385 kB | 66/75 kB Progress (3): 554/798 kB | 262/385 kB | 66/75 kB Progress (3): 554/798 kB | 262/385 kB | 75 kB Progress (3): 570/798 kB | 262/385 kB | 75 kB Progress (3): 586/798 kB | 262/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 616 kB/s) 2024-09-22T08:33:22.105 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-22T08:33:22.109 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 603/798 kB | 262/385 kB Progress (2): 619/798 kB | 262/385 kB Progress (2): 636/798 kB | 262/385 kB Progress (2): 636/798 kB | 278/385 kB Progress (2): 652/798 kB | 278/385 kB Progress (2): 652/798 kB | 294/385 kB Progress (2): 668/798 kB | 294/385 kB Progress (2): 685/798 kB | 294/385 kB Progress (2): 685/798 kB | 311/385 kB Progress (2): 685/798 kB | 327/385 kB Progress (2): 701/798 kB | 327/385 kB Progress (2): 701/798 kB | 344/385 kB Progress (2): 717/798 kB | 344/385 kB Progress (3): 717/798 kB | 344/385 kB | 16/780 kB Progress (3): 717/798 kB | 360/385 kB | 16/780 kB Progress (3): 734/798 kB | 360/385 kB | 16/780 kB Progress (3): 734/798 kB | 360/385 kB | 33/780 kB Progress (3): 734/798 kB | 376/385 kB | 33/780 kB Progress (3): 750/798 kB | 376/385 kB | 33/780 kB Progress (3): 750/798 kB | 385 kB | 33/780 kB Progress (3): 750/798 kB | 385 kB | 49/780 kB Progress (3): 767/798 kB | 385 kB | 49/780 kB Progress (3): 767/798 kB | 385 kB | 62/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-22T08:33:22.109 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 783/798 kB | 62/780 kB Progress (2): 783/798 kB | 78/780 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-22T08:33:22.110 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 798 kB | 78/780 kB Progress (2): 798 kB | 94/780 kB Progress (2): 798 kB | 111/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.3 MB/s) 2024-09-22T08:33:22.110 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-22T08:33:22.122 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 127/780 kB Progress (1): 144/780 kB Progress (1): 160/780 kB Progress (1): 176/780 kB Progress (1): 193/780 kB Progress (1): 209/780 kB Progress (1): 226/780 kB Progress (1): 242/780 kB Progress (1): 258/780 kB Progress (1): 275/780 kB Progress (1): 291/780 kB Progress (1): 307/780 kB Progress (1): 324/780 kB Progress (1): 340/780 kB Progress (1): 357/780 kB Progress (2): 357/780 kB | 15/329 kB Progress (2): 373/780 kB | 15/329 kB Progress (2): 389/780 kB | 15/329 kB Progress (2): 406/780 kB | 15/329 kB Progress (2): 422/780 kB | 15/329 kB Progress (2): 439/780 kB | 15/329 kB Progress (2): 455/780 kB | 15/329 kB Progress (2): 455/780 kB | 31/329 kB Progress (2): 471/780 kB | 31/329 kB Progress (2): 488/780 kB | 31/329 kB Progress (2): 504/780 kB | 31/329 kB Progress (2): 520/780 kB | 31/329 kB Progress (2): 520/780 kB | 48/329 kB Progress (2): 537/780 kB | 48/329 kB Progress (2): 553/780 kB | 48/329 kB Progress (2): 570/780 kB | 48/329 kB Progress (2): 586/780 kB | 48/329 kB Progress (2): 602/780 kB | 48/329 kB Progress (2): 619/780 kB | 48/329 kB Progress (2): 635/780 kB | 48/329 kB Progress (2): 652/780 kB | 48/329 kB Progress (2): 652/780 kB | 64/329 kB Progress (2): 668/780 kB | 64/329 kB Progress (2): 684/780 kB | 64/329 kB Progress (2): 701/780 kB | 64/329 kB Progress (2): 717/780 kB | 64/329 kB Progress (3): 717/780 kB | 64/329 kB | 16/501 kB Progress (3): 733/780 kB | 64/329 kB | 16/501 kB Progress (3): 733/780 kB | 64/329 kB | 33/501 kB Progress (3): 750/780 kB | 64/329 kB | 33/501 kB Progress (3): 750/780 kB | 64/329 kB | 49/501 kB Progress (3): 766/780 kB | 64/329 kB | 49/501 kB Progress (3): 766/780 kB | 64/329 kB | 65/501 kB Progress (3): 780 kB | 64/329 kB | 65/501 kB Progress (3): 780 kB | 64/329 kB | 81/501 kB Progress (3): 780 kB | 64/329 kB | 97/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.7 MB/s) 2024-09-22T08:33:22.122 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 64/329 kB | 114/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-22T08:33:22.126 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 64/329 kB | 130/501 kB Progress (2): 64/329 kB | 147/501 kB Progress (2): 64/329 kB | 163/501 kB Progress (2): 64/329 kB | 179/501 kB Progress (2): 64/329 kB | 196/501 kB Progress (2): 64/329 kB | 212/501 kB Progress (2): 64/329 kB | 228/501 kB Progress (3): 64/329 kB | 228/501 kB | 16/354 kB Progress (4): 64/329 kB | 228/501 kB | 16/354 kB | 16/41 kB Progress (4): 64/329 kB | 228/501 kB | 33/354 kB | 16/41 kB Progress (4): 64/329 kB | 245/501 kB | 33/354 kB | 16/41 kB Progress (4): 64/329 kB | 245/501 kB | 33/354 kB | 33/41 kB Progress (4): 64/329 kB | 245/501 kB | 49/354 kB | 33/41 kB Progress (4): 64/329 kB | 245/501 kB | 49/354 kB | 41 kB Progress (4): 64/329 kB | 261/501 kB | 49/354 kB | 41 kB Progress (4): 64/329 kB | 261/501 kB | 61/354 kB | 41 kB Progress (4): 64/329 kB | 261/501 kB | 78/354 kB | 41 kB Progress (4): 64/329 kB | 278/501 kB | 78/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 292 kB/s) 2024-09-22T08:33:22.126 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 64/329 kB | 278/501 kB | 94/354 kB Progress (3): 64/329 kB | 294/501 kB | 94/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-22T08:33:22.140 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 81/329 kB | 294/501 kB | 94/354 kB Progress (3): 81/329 kB | 294/501 kB | 111/354 kB Progress (3): 81/329 kB | 310/501 kB | 111/354 kB Progress (3): 97/329 kB | 310/501 kB | 111/354 kB Progress (4): 97/329 kB | 310/501 kB | 111/354 kB | 6.4 kB Progress (4): 97/329 kB | 310/501 kB | 127/354 kB | 6.4 kB Progress (4): 97/329 kB | 327/501 kB | 127/354 kB | 6.4 kB Progress (4): 113/329 kB | 327/501 kB | 127/354 kB | 6.4 kB Progress (4): 113/329 kB | 327/501 kB | 143/354 kB | 6.4 kB Progress (4): 113/329 kB | 343/501 kB | 143/354 kB | 6.4 kB Progress (4): 130/329 kB | 343/501 kB | 143/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 41 kB/s) 2024-09-22T08:33:22.140 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-22T08:33:22.142 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 130/329 kB | 343/501 kB | 160/354 kB Progress (3): 130/329 kB | 360/501 kB | 160/354 kB Progress (3): 146/329 kB | 360/501 kB | 160/354 kB Progress (3): 146/329 kB | 360/501 kB | 176/354 kB Progress (3): 146/329 kB | 376/501 kB | 176/354 kB Progress (3): 162/329 kB | 376/501 kB | 176/354 kB Progress (3): 162/329 kB | 392/501 kB | 176/354 kB Progress (3): 162/329 kB | 392/501 kB | 193/354 kB Progress (3): 179/329 kB | 392/501 kB | 193/354 kB Progress (3): 179/329 kB | 409/501 kB | 193/354 kB Progress (3): 179/329 kB | 409/501 kB | 209/354 kB Progress (3): 179/329 kB | 425/501 kB | 209/354 kB Progress (3): 179/329 kB | 429/501 kB | 209/354 kB Progress (3): 195/329 kB | 429/501 kB | 209/354 kB Progress (3): 195/329 kB | 446/501 kB | 209/354 kB Progress (3): 195/329 kB | 446/501 kB | 225/354 kB Progress (3): 212/329 kB | 446/501 kB | 225/354 kB Progress (3): 212/329 kB | 458/501 kB | 225/354 kB Progress (3): 212/329 kB | 458/501 kB | 242/354 kB Progress (3): 212/329 kB | 466/501 kB | 242/354 kB Progress (3): 228/329 kB | 466/501 kB | 242/354 kB Progress (3): 228/329 kB | 482/501 kB | 242/354 kB Progress (3): 228/329 kB | 482/501 kB | 258/354 kB Progress (3): 228/329 kB | 499/501 kB | 258/354 kB Progress (3): 228/329 kB | 501 kB | 258/354 kB Progress (3): 244/329 kB | 501 kB | 258/354 kB Progress (3): 244/329 kB | 501 kB | 274/354 kB Progress (3): 261/329 kB | 501 kB | 274/354 kB Progress (3): 261/329 kB | 501 kB | 291/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-22T08:33:22.142 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-22T08:33:22.144 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 277/329 kB | 291/354 kB Progress (2): 277/329 kB | 307/354 kB Progress (2): 294/329 kB | 307/354 kB Progress (2): 294/329 kB | 324/354 kB Progress (2): 310/329 kB | 324/354 kB Progress (2): 310/329 kB | 340/354 kB Progress (2): 310/329 kB | 354 kB Progress (2): 326/329 kB | 354 kB Progress (2): 329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-22T08:33:22.144 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.1 MB/s) 2024-09-22T08:33:22.144 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-22T08:33:22.145 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-22T08:33:22.157 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (2): 66/586 kB | 16/211 kB Progress (2): 81/586 kB | 16/211 kB Progress (2): 81/586 kB | 33/211 kB Progress (2): 97/586 kB | 33/211 kB Progress (2): 97/586 kB | 49/211 kB Progress (2): 113/586 kB | 49/211 kB Progress (2): 113/586 kB | 66/211 kB Progress (2): 130/586 kB | 66/211 kB Progress (2): 130/586 kB | 82/211 kB Progress (2): 146/586 kB | 82/211 kB Progress (2): 146/586 kB | 98/211 kB Progress (2): 163/586 kB | 98/211 kB Progress (2): 163/586 kB | 114/211 kB Progress (2): 179/586 kB | 114/211 kB Progress (2): 179/586 kB | 131/211 kB Progress (2): 195/586 kB | 131/211 kB Progress (2): 195/586 kB | 147/211 kB Progress (2): 212/586 kB | 147/211 kB Progress (2): 212/586 kB | 164/211 kB Progress (2): 228/586 kB | 164/211 kB Progress (2): 228/586 kB | 180/211 kB Progress (2): 245/586 kB | 180/211 kB Progress (2): 245/586 kB | 196/211 kB Progress (2): 261/586 kB | 196/211 kB Progress (2): 261/586 kB | 211 kB Progress (2): 277/586 kB | 211 kB Progress (3): 277/586 kB | 211 kB | 14 kB Progress (3): 294/586 kB | 211 kB | 14 kB Progress (3): 310/586 kB | 211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 84 kB/s) 2024-09-22T08:33:22.157 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-22T08:33:22.157 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-22T08:33:22.157 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-22T08:33:22.160 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 326/586 kB Progress (1): 343/586 kB Progress (1): 359/586 kB Progress (1): 376/586 kB Progress (1): 392/586 kB Progress (2): 392/586 kB | 6.8 kB Progress (2): 408/586 kB | 6.8 kB Progress (2): 425/586 kB | 6.8 kB Progress (3): 425/586 kB | 6.8 kB | 16/106 kB Progress (3): 441/586 kB | 6.8 kB | 16/106 kB Progress (3): 441/586 kB | 6.8 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-22T08:33:22.160 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-22T08:33:22.160 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 441/586 kB | 49/106 kB Progress (2): 458/586 kB | 49/106 kB Progress (2): 458/586 kB | 65/106 kB Progress (2): 474/586 kB | 65/106 kB Progress (2): 474/586 kB | 81/106 kB Progress (2): 490/586 kB | 81/106 kB Progress (2): 490/586 kB | 98/106 kB Progress (2): 507/586 kB | 98/106 kB Progress (2): 507/586 kB | 106 kB Progress (2): 523/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 607 kB/s) 2024-09-22T08:33:22.160 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-22T08:33:22.161 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 539/586 kB Progress (1): 556/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-22T08:33:22.161 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-22T08:33:22.176 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 62/245 kB Progress (1): 78/245 kB Progress (1): 95/245 kB Progress (2): 95/245 kB | 15 kB Progress (2): 111/245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 81 kB/s) 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 127/245 kB Progress (2): 127/245 kB | 16/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 144/245 kB | 16/205 kB Progress (2): 144/245 kB | 33/205 kB Progress (3): 144/245 kB | 33/205 kB | 16/16 kB Progress (3): 144/245 kB | 33/205 kB | 16 kB Progress (3): 160/245 kB | 33/205 kB | 16 kB Progress (3): 160/245 kB | 49/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 87 kB/s) 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 177/245 kB | 49/205 kB Progress (2): 177/245 kB | 65/205 kB Progress (2): 193/245 kB | 65/205 kB Progress (2): 193/245 kB | 81/205 kB Progress (3): 193/245 kB | 81/205 kB | 6.4 kB Progress (3): 209/245 kB | 81/205 kB | 6.4 kB Progress (3): 209/245 kB | 98/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 226/245 kB | 98/205 kB Progress (2): 226/245 kB | 114/205 kB Progress (2): 242/245 kB | 114/205 kB Progress (2): 242/245 kB | 130/205 kB Progress (2): 245 kB | 130/205 kB Progress (2): 245 kB | 147/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-22T08:33:22.177 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-22T08:33:22.178 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-22T08:33:22.187 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 112 kB/s) 2024-09-22T08:33:22.188 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 119 kB/s) 2024-09-22T08:33:22.188 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-22T08:33:22.192 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 888 kB/s) 2024-09-22T08:33:22.209 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:22.210 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-22T08:33:22.215 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-22T08:33:22.229 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-22T08:33:22.231 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-22T08:33:22.245 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-22T08:33:22.247 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-22T08:33:22.262 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-22T08:33:22.265 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-22T08:33:22.279 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-22T08:33:22.284 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-22T08:33:22.300 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.6 MB/s) 2024-09-22T08:33:22.301 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-22T08:33:22.321 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 79/215 kB Progress (1): 88/215 kB Progress (1): 104/215 kB Progress (1): 120/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-22T08:33:22.374 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:22.374 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:33:22.379 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-22T08:33:22.393 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-22T08:33:22.396 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-22T08:33:22.410 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-22T08:33:22.413 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-22T08:33:22.427 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-22T08:33:22.429 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-22T08:33:22.444 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-22T08:33:22.446 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-22T08:33:22.460 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:33:22.462 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-22T08:33:22.476 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-22T08:33:22.479 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-22T08:33:22.493 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-22T08:33:22.495 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-22T08:33:22.508 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-22T08:33:22.510 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-22T08:33:22.524 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-22T08:33:22.526 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-22T08:33:22.540 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-22T08:33:22.541 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-22T08:33:22.555 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-22T08:33:22.557 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-22T08:33:22.571 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-22T08:33:22.573 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-22T08:33:22.588 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-22T08:33:22.590 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-22T08:33:22.604 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-22T08:33:22.608 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-22T08:33:22.621 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 392 kB/s) 2024-09-22T08:33:22.623 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-22T08:33:22.637 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-22T08:33:22.641 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-22T08:33:22.655 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-22T08:33:22.658 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-22T08:33:22.673 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-22T08:33:22.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-22T08:33:22.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-22T08:33:22.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-22T08:33:22.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-22T08:33:22.674 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 2.5 kB Progress (3): 16/41 kB | 2.5 kB | 16/269 kB Progress (4): 16/41 kB | 2.5 kB | 16/269 kB | 8.5 kB Progress (4): 33/41 kB | 2.5 kB | 16/269 kB | 8.5 kB Progress (5): 33/41 kB | 2.5 kB | 16/269 kB | 8.5 kB | 16/55 kB Progress (5): 41 kB | 2.5 kB | 16/269 kB | 8.5 kB | 16/55 kB Progress (5): 41 kB | 2.5 kB | 33/269 kB | 8.5 kB | 16/55 kB Progress (5): 41 kB | 2.5 kB | 33/269 kB | 8.5 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 33/269 kB | 8.5 kB | 49/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 49/269 kB | 49/55 kB Progress (2): 49/269 kB | 55 kB Progress (2): 65/269 kB | 55 kB Progress (2): 82/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-22T08:33:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-22T08:33:22.711 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/587 kB Progress (2): 16/587 kB | 16/327 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 33/587 kB | 33/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 64/587 kB | 33/327 kB Progress (2): 64/587 kB | 49/327 kB Progress (2): 80/587 kB | 49/327 kB Progress (2): 80/587 kB | 65/327 kB Progress (2): 97/587 kB | 65/327 kB Progress (2): 113/587 kB | 65/327 kB Progress (2): 113/587 kB | 82/327 kB Progress (2): 129/587 kB | 82/327 kB Progress (2): 129/587 kB | 98/327 kB Progress (2): 146/587 kB | 98/327 kB Progress (2): 162/587 kB | 98/327 kB Progress (2): 162/587 kB | 114/327 kB Progress (2): 179/587 kB | 114/327 kB Progress (2): 179/587 kB | 131/327 kB Progress (2): 195/587 kB | 131/327 kB Progress (2): 195/587 kB | 147/327 kB Progress (2): 211/587 kB | 147/327 kB Progress (2): 228/587 kB | 147/327 kB Progress (2): 228/587 kB | 163/327 kB Progress (2): 244/587 kB | 163/327 kB Progress (2): 244/587 kB | 180/327 kB Progress (2): 261/587 kB | 180/327 kB Progress (2): 277/587 kB | 180/327 kB Progress (2): 277/587 kB | 196/327 kB Progress (2): 293/587 kB | 196/327 kB Progress (2): 293/587 kB | 213/327 kB Progress (2): 310/587 kB | 213/327 kB Progress (2): 326/587 kB | 213/327 kB Progress (2): 326/587 kB | 229/327 kB Progress (2): 342/587 kB | 229/327 kB Progress (2): 342/587 kB | 245/327 kB Progress (2): 359/587 kB | 245/327 kB Progress (2): 375/587 kB | 245/327 kB Progress (2): 375/587 kB | 262/327 kB Progress (2): 392/587 kB | 262/327 kB Progress (2): 392/587 kB | 278/327 kB Progress (2): 408/587 kB | 278/327 kB Progress (2): 424/587 kB | 278/327 kB Progress (2): 424/587 kB | 295/327 kB Progress (2): 441/587 kB | 295/327 kB Progress (2): 441/587 kB | 311/327 kB Progress (2): 457/587 kB | 311/327 kB Progress (2): 474/587 kB | 311/327 kB Progress (2): 474/587 kB | 327 kB Progress (2): 490/587 kB | 327 kB Progress (2): 506/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-22T08:33:22.711 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 16 MB/s) 2024-09-22T08:33:22.741 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:33:22.742 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:22.742 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:33:22.745 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-22T08:33:22.760 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-22T08:33:22.761 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-22T08:33:22.775 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-22T08:33:22.777 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-22T08:33:22.791 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-22T08:33:22.793 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-22T08:33:22.807 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-22T08:33:22.809 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-22T08:33:22.824 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-22T08:33:22.826 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-22T08:33:22.842 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-22T08:33:22.844 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-22T08:33:22.858 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-22T08:33:22.861 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-22T08:33:22.875 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-22T08:33:22.877 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-22T08:33:22.891 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-22T08:33:22.894 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-22T08:33:22.908 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-22T08:33:22.910 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-22T08:33:22.924 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-22T08:33:22.926 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-22T08:33:22.940 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-22T08:33:22.942 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-22T08:33:22.956 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-22T08:33:22.957 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-22T08:33:22.972 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-22T08:33:22.974 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-22T08:33:22.988 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-22T08:33:22.990 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-22T08:33:23.003 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-22T08:33:23.006 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-22T08:33:23.020 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-22T08:33:23.021 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-22T08:33:23.035 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-22T08:33:23.038 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-22T08:33:23.052 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-22T08:33:23.053 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-22T08:33:23.067 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:33:23.068 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-22T08:33:23.082 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-22T08:33:23.084 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-22T08:33:23.098 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-22T08:33:23.099 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-22T08:33:23.113 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-22T08:33:23.118 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-22T08:33:23.132 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-22T08:33:23.133 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-22T08:33:23.133 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-22T08:33:23.133 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-22T08:33:23.133 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-22T08:33:23.133 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-22T08:33:23.146 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-22T08:33:23.146 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-22T08:33:23.150 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 16/122 kB Progress (3): 55 kB | 16/122 kB | 16/27 kB Progress (4): 55 kB | 16/122 kB | 16/27 kB | 16/334 kB Progress (4): 55 kB | 16/122 kB | 27 kB | 16/334 kB Progress (4): 55 kB | 33/122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-22T08:33:23.150 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-22T08:33:23.150 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 33/122 kB | 27 kB | 33/334 kB Progress (3): 49/122 kB | 27 kB | 33/334 kB Progress (3): 49/122 kB | 27 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-22T08:33:23.150 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-22T08:33:23.150 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 49/122 kB | 66/334 kB Progress (2): 66/122 kB | 66/334 kB Progress (2): 66/122 kB | 82/334 kB Progress (2): 82/122 kB | 82/334 kB Progress (2): 82/122 kB | 98/334 kB Progress (2): 98/122 kB | 98/334 kB Progress (2): 98/122 kB | 115/334 kB Progress (2): 115/122 kB | 115/334 kB Progress (2): 122 kB | 115/334 kB Progress (2): 122 kB | 131/334 kB Progress (2): 122 kB | 147/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-22T08:33:23.151 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 262/334 kB Progress (1): 279/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 328/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 19 MB/s) 2024-09-22T08:33:23.160 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (2): 65/267 kB | 4.7 kB Progress (2): 82/267 kB | 4.7 kB Progress (2): 98/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-22T08:33:23.162 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 114/267 kB Progress (1): 131/267 kB Progress (2): 131/267 kB | 16/23 kB Progress (2): 131/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-22T08:33:23.163 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-22T08:33:23.215 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-22T08:33:23.215 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-22T08:33:23.895 INFO:tasks.workunit.client.0.smithi078.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:33:23.896 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:23.896 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:33:23.898 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:33:23.898 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:23.899 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:33:23.903 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-22T08:33:23.903 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-22T08:33:24.044 INFO:tasks.workunit.client.0.smithi078.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:33:24.044 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:24.044 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:33:24.048 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-22T08:33:24.062 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-22T08:33:24.065 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-22T08:33:24.079 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-22T08:33:24.083 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-22T08:33:24.097 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-22T08:33:24.100 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-22T08:33:24.114 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-22T08:33:24.117 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-22T08:33:24.131 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-22T08:33:24.134 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-22T08:33:24.148 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-22T08:33:24.151 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-22T08:33:24.165 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-22T08:33:24.168 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-22T08:33:24.183 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-22T08:33:24.184 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-22T08:33:24.199 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-22T08:33:24.202 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-22T08:33:24.217 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-22T08:33:24.220 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-22T08:33:24.234 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-22T08:33:24.237 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-22T08:33:24.251 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-22T08:33:24.253 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-22T08:33:24.268 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-22T08:33:24.271 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-22T08:33:24.285 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-22T08:33:24.287 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-22T08:33:24.301 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-22T08:33:24.305 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-22T08:33:24.319 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-22T08:33:24.322 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-22T08:33:24.338 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-22T08:33:24.342 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-22T08:33:24.359 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1/8.1 kB Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-09-22T08:33:24.364 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-22T08:33:24.378 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-22T08:33:24.382 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-22T08:33:24.397 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-22T08:33:24.400 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-22T08:33:24.413 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-22T08:33:24.415 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-22T08:33:24.430 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-22T08:33:24.432 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-22T08:33:24.445 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-22T08:33:24.448 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-22T08:33:24.461 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-22T08:33:24.462 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-22T08:33:24.476 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-22T08:33:24.478 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-22T08:33:24.492 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-22T08:33:24.494 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-22T08:33:24.507 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-22T08:33:24.509 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-22T08:33:24.522 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-22T08:33:24.524 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-22T08:33:24.538 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-22T08:33:24.539 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-22T08:33:24.553 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-22T08:33:24.556 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-22T08:33:24.570 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-22T08:33:24.574 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-22T08:33:24.588 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-22T08:33:24.590 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-22T08:33:24.605 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-22T08:33:24.607 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-22T08:33:24.622 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-22T08:33:24.623 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-22T08:33:24.637 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-22T08:33:24.639 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-22T08:33:24.653 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-22T08:33:24.654 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-22T08:33:24.669 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-22T08:33:24.673 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-22T08:33:24.686 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-22T08:33:24.688 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-22T08:33:24.702 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0.3/15 kB Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-22T08:33:24.705 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-22T08:33:24.720 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-22T08:33:24.721 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-22T08:33:24.734 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-22T08:33:24.736 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-22T08:33:24.750 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-22T08:33:24.752 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-22T08:33:24.766 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-22T08:33:24.769 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-22T08:33:24.782 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 327 kB/s) 2024-09-22T08:33:24.786 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-22T08:33:24.800 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-22T08:33:24.802 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-22T08:33:24.816 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-22T08:33:24.818 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-22T08:33:24.832 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-22T08:33:24.834 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-22T08:33:24.848 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-22T08:33:24.850 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-22T08:33:24.863 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.4 MB/s) 2024-09-22T08:33:24.865 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-22T08:33:24.879 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-22T08:33:24.880 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-22T08:33:24.894 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-22T08:33:24.896 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-22T08:33:24.910 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-22T08:33:24.911 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-22T08:33:24.925 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-22T08:33:24.927 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-22T08:33:24.940 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-22T08:33:24.943 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-22T08:33:24.956 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.7 MB/s) 2024-09-22T08:33:24.958 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-22T08:33:24.972 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-22T08:33:24.975 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-22T08:33:24.989 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-22T08:33:24.992 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-22T08:33:25.006 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-22T08:33:25.008 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-22T08:33:25.021 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-22T08:33:25.023 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-22T08:33:25.037 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-22T08:33:25.038 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-22T08:33:25.052 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-22T08:33:25.055 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-22T08:33:25.069 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-22T08:33:25.076 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-22T08:33:25.094 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-22T08:33:25.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-22T08:33:25.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-22T08:33:25.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-22T08:33:25.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-22T08:33:25.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-22T08:33:25.110 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 16/171 kB Progress (3): 8.2 kB | 16/171 kB | 16/26 kB Progress (4): 8.2 kB | 16/171 kB | 16/26 kB | 8.2/14 kB Progress (4): 8.2 kB | 16/171 kB | 16/26 kB | 14 kB Progress (4): 8.2 kB | 16/171 kB | 26 kB | 14 kB Progress (5): 8.2 kB | 16/171 kB | 26 kB | 14 kB | 16/118 kB Progress (5): 8.2 kB | 33/171 kB | 26 kB | 14 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-22T08:33:25.113 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-22T08:33:25.113 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-22T08:33:25.113 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-22T08:33:25.113 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 33/171 kB | 26 kB | 33/118 kB Progress (3): 49/171 kB | 26 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-22T08:33:25.114 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-22T08:33:25.114 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 64/171 kB | 33/118 kB Progress (2): 64/171 kB | 49/118 kB Progress (2): 64/171 kB | 64/118 kB Progress (2): 81/171 kB | 64/118 kB Progress (2): 81/171 kB | 80/118 kB Progress (2): 97/171 kB | 80/118 kB Progress (2): 97/171 kB | 97/118 kB Progress (2): 113/171 kB | 97/118 kB Progress (2): 113/171 kB | 113/118 kB Progress (2): 130/171 kB | 113/118 kB Progress (2): 130/171 kB | 118 kB Progress (2): 146/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-22T08:33:25.114 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-22T08:33:25.114 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-22T08:33:25.114 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-22T08:33:25.128 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (3): 16/136 kB | 16/146 kB | 16/61 kB Progress (3): 16/136 kB | 33/146 kB | 16/61 kB Progress (3): 33/136 kB | 33/146 kB | 16/61 kB Progress (3): 33/136 kB | 33/146 kB | 33/61 kB Progress (3): 49/136 kB | 33/146 kB | 33/61 kB Progress (3): 49/136 kB | 49/146 kB | 33/61 kB Progress (3): 49/136 kB | 49/146 kB | 49/61 kB Progress (3): 64/136 kB | 49/146 kB | 49/61 kB Progress (3): 64/136 kB | 66/146 kB | 49/61 kB Progress (3): 81/136 kB | 66/146 kB | 49/61 kB Progress (3): 81/136 kB | 66/146 kB | 61 kB Progress (3): 97/136 kB | 66/146 kB | 61 kB Progress (3): 97/136 kB | 82/146 kB | 61 kB Progress (3): 113/136 kB | 82/146 kB | 61 kB Progress (3): 113/136 kB | 94/146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-22T08:33:25.129 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-22T08:33:25.129 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 130/136 kB | 94/146 kB Progress (2): 130/136 kB | 111/146 kB Progress (2): 136 kB | 111/146 kB Progress (2): 136 kB | 127/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-22T08:33:25.129 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 127/146 kB | 16/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-22T08:33:25.129 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 143/146 kB | 16/501 kB Progress (3): 143/146 kB | 16/501 kB | 16/58 kB Progress (3): 146 kB | 16/501 kB | 16/58 kB Progress (3): 146 kB | 33/501 kB | 16/58 kB Progress (3): 146 kB | 33/501 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-22T08:33:25.129 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 49/501 kB | 33/58 kB Progress (2): 49/501 kB | 49/58 kB Progress (2): 49/501 kB | 58 kB Progress (2): 65/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-22T08:33:25.135 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-22T08:33:25.142 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (2): 33/124 kB | 0/2.4 MB Progress (2): 33/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0.1/2.4 MB Progress (2): 65/124 kB | 0.1/2.4 MB Progress (2): 65/124 kB | 0.1/2.4 MB Progress (2): 65/124 kB | 0.1/2.4 MB Progress (2): 65/124 kB | 0.1/2.4 MB Progress (2): 82/124 kB | 0.1/2.4 MB Progress (2): 82/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 114/124 kB | 0.1/2.4 MB Progress (2): 114/124 kB | 0.2/2.4 MB Progress (2): 124 kB | 0.2/2.4 MB Progress (2): 124 kB | 0.2/2.4 MB Progress (2): 124 kB | 0.2/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-22T08:33:25.171 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 32 MB/s) 2024-09-22T08:33:25.255 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:25.256 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-22T08:33:25.258 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-22T08:33:25.272 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-22T08:33:25.274 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-22T08:33:25.288 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-22T08:33:25.289 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-22T08:33:25.303 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-22T08:33:25.305 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-22T08:33:25.319 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-22T08:33:25.322 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-22T08:33:25.335 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-22T08:33:25.338 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-22T08:33:25.352 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-22T08:33:25.355 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-22T08:33:25.368 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-22T08:33:25.370 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-22T08:33:25.384 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-22T08:33:25.386 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-22T08:33:25.400 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-22T08:33:25.403 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-22T08:33:25.417 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-22T08:33:25.419 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-22T08:33:25.433 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-22T08:33:25.435 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-22T08:33:25.449 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-22T08:33:25.451 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-22T08:33:25.465 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-22T08:33:25.470 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-22T08:33:25.484 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-22T08:33:25.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-22T08:33:25.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-22T08:33:25.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-22T08:33:25.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-22T08:33:25.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-22T08:33:25.502 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15/26 kB Progress (2): 15/26 kB | 16/79 kB Progress (3): 15/26 kB | 16/79 kB | 16/211 kB Progress (3): 26 kB | 16/79 kB | 16/211 kB Progress (4): 26 kB | 16/79 kB | 16/211 kB | 0/1.0 MB Progress (4): 26 kB | 16/79 kB | 33/211 kB | 0/1.0 MB Progress (4): 26 kB | 33/79 kB | 33/211 kB | 0/1.0 MB Progress (4): 26 kB | 33/79 kB | 33/211 kB | 0/1.0 MB Progress (4): 26 kB | 33/79 kB | 49/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-22T08:33:25.502 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 33/79 kB | 49/211 kB | 0/1.0 MB | 16/58 kB Progress (4): 49/79 kB | 49/211 kB | 0/1.0 MB | 16/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-22T08:33:25.502 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 49/79 kB | 63/211 kB | 0/1.0 MB | 16/58 kB Progress (4): 49/79 kB | 63/211 kB | 0/1.0 MB | 31/58 kB Progress (4): 49/79 kB | 63/211 kB | 0/1.0 MB | 31/58 kB Progress (4): 63/79 kB | 63/211 kB | 0/1.0 MB | 31/58 kB Progress (4): 63/79 kB | 79/211 kB | 0/1.0 MB | 31/58 kB Progress (4): 63/79 kB | 79/211 kB | 0/1.0 MB | 48/58 kB Progress (4): 63/79 kB | 79/211 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 79 kB | 79/211 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 79 kB | 96/211 kB | 0.1/1.0 MB | 48/58 kB Progress (4): 79 kB | 96/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 96/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 112/211 kB | 0.1/1.0 MB | 58 kB Progress (4): 79 kB | 112/211 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-22T08:33:25.502 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-22T08:33:25.502 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 112/211 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-22T08:33:25.503 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-22T08:33:25.515 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 33/116 kB Progress (2): 1.0/1.0 MB | 33/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 63/116 kB Progress (2): 1.0 MB | 63/116 kB Progress (2): 1.0 MB | 79/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 35 MB/s) 2024-09-22T08:33:25.516 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 79/116 kB | 16/267 kB Progress (2): 96/116 kB | 16/267 kB Progress (2): 96/116 kB | 33/267 kB Progress (2): 112/116 kB | 33/267 kB Progress (2): 116 kB | 33/267 kB Progress (2): 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-22T08:33:25.518 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.9 MB/s) 2024-09-22T08:33:25.673 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-22T08:33:25.696 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:33:25.696 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:33:25.696 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:33:25.697 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Total time: 5.634 s 2024-09-22T08:33:25.697 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Finished at: 2024-09-22T08:33:25Z 2024-09-22T08:33:25.697 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:33:25.709 INFO:tasks.workunit.client.0.smithi078.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-22T08:33:25.718 INFO:tasks.workunit.client.0.smithi078.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:33:26.719 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Scanning for projects... 2024-09-22T08:33:26.814 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:26.814 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:33:26.814 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:33:26.815 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] from pom.xml 2024-09-22T08:33:26.815 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:33:27.131 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:27.131 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:33:27.215 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:33:27.217 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:27.217 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:33:27.304 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:33:27.304 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:27.304 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:33:27.306 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:33:27.306 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:27.306 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:33:27.311 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:33:27.311 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:27.311 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:33:27.485 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-22T08:33:27.680 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-22T08:33:27.919 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.7/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 19 kB/s) 2024-09-22T08:33:27.931 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-22T08:33:27.950 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-22T08:33:27.957 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-22T08:33:27.977 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-22T08:33:27.983 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-22T08:33:28.000 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-22T08:33:28.003 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-22T08:33:28.022 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-22T08:33:28.025 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-22T08:33:28.041 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-22T08:33:28.044 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-22T08:33:28.060 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-22T08:33:28.066 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-22T08:33:28.089 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-22T08:33:28.090 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-22T08:33:28.091 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-22T08:33:28.091 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-22T08:33:28.091 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-22T08:33:28.093 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-22T08:33:28.112 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 763 kB/s) 2024-09-22T08:33:28.152 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/169 kB Progress (2): 2.8/103 kB | 1.4/169 kB Progress (2): 2.8/103 kB | 2.8/169 kB Progress (3): 2.8/103 kB | 2.8/169 kB | 1.4/189 kB Progress (4): 2.8/103 kB | 2.8/169 kB | 1.4/189 kB | 1.4/7.7 kB Progress (4): 2.8/103 kB | 2.8/169 kB | 2.8/189 kB | 1.4/7.7 kB Progress (4): 2.8/103 kB | 4.1/169 kB | 2.8/189 kB | 1.4/7.7 kB Progress (4): 4.1/103 kB | 4.1/169 kB | 2.8/189 kB | 1.4/7.7 kB Progress (4): 4.1/103 kB | 5.5/169 kB | 2.8/189 kB | 1.4/7.7 kB Progress (4): 4.1/103 kB | 5.5/169 kB | 4.1/189 kB | 1.4/7.7 kB Progress (4): 4.1/103 kB | 5.5/169 kB | 4.1/189 kB | 2.8/7.7 kB Progress (4): 4.1/103 kB | 5.5/169 kB | 5.5/189 kB | 2.8/7.7 kB Progress (4): 4.1/103 kB | 6.9/169 kB | 5.5/189 kB | 2.8/7.7 kB Progress (4): 5.5/103 kB | 6.9/169 kB | 5.5/189 kB | 2.8/7.7 kB Progress (4): 5.5/103 kB | 8.3/169 kB | 5.5/189 kB | 2.8/7.7 kB Progress (4): 5.5/103 kB | 8.3/169 kB | 6.9/189 kB | 2.8/7.7 kB Progress (4): 5.5/103 kB | 8.3/169 kB | 6.9/189 kB | 4.1/7.7 kB Progress (4): 5.5/103 kB | 8.3/169 kB | 8.3/189 kB | 4.1/7.7 kB Progress (4): 5.5/103 kB | 9.7/169 kB | 8.3/189 kB | 4.1/7.7 kB Progress (4): 6.9/103 kB | 9.7/169 kB | 8.3/189 kB | 4.1/7.7 kB Progress (4): 6.9/103 kB | 11/169 kB | 8.3/189 kB | 4.1/7.7 kB Progress (4): 6.9/103 kB | 11/169 kB | 9.7/189 kB | 4.1/7.7 kB Progress (4): 6.9/103 kB | 11/169 kB | 9.7/189 kB | 5.5/7.7 kB Progress (4): 6.9/103 kB | 11/169 kB | 11/189 kB | 5.5/7.7 kB Progress (4): 6.9/103 kB | 12/169 kB | 11/189 kB | 5.5/7.7 kB Progress (4): 8.3/103 kB | 12/169 kB | 11/189 kB | 5.5/7.7 kB Progress (4): 8.3/103 kB | 12/169 kB | 12/189 kB | 5.5/7.7 kB Progress (4): 8.3/103 kB | 12/169 kB | 12/189 kB | 6.9/7.7 kB Progress (4): 8.3/103 kB | 12/169 kB | 14/189 kB | 6.9/7.7 kB Progress (4): 9.7/103 kB | 12/169 kB | 14/189 kB | 6.9/7.7 kB Progress (4): 9.7/103 kB | 14/169 kB | 14/189 kB | 6.9/7.7 kB Progress (4): 11/103 kB | 14/169 kB | 14/189 kB | 6.9/7.7 kB Progress (4): 11/103 kB | 14/169 kB | 15/189 kB | 6.9/7.7 kB Progress (4): 11/103 kB | 14/169 kB | 15/189 kB | 7.7 kB Progress (4): 11/103 kB | 14/169 kB | 16/189 kB | 7.7 kB Progress (4): 12/103 kB | 14/169 kB | 16/189 kB | 7.7 kB Progress (4): 12/103 kB | 15/169 kB | 16/189 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 125 kB/s) 2024-09-22T08:33:28.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 14/103 kB | 15/169 kB | 16/189 kB Progress (3): 14/103 kB | 17/169 kB | 16/189 kB Progress (3): 15/103 kB | 17/169 kB | 16/189 kB Progress (3): 15/103 kB | 18/169 kB | 16/189 kB Progress (3): 15/103 kB | 18/169 kB | 33/189 kB Progress (3): 16/103 kB | 18/169 kB | 33/189 kB Progress (3): 16/103 kB | 19/169 kB | 33/189 kB Progress (3): 18/103 kB | 19/169 kB | 33/189 kB Progress (3): 18/103 kB | 21/169 kB | 33/189 kB Progress (3): 19/103 kB | 21/169 kB | 33/189 kB Progress (3): 19/103 kB | 21/169 kB | 49/189 kB Progress (3): 19/103 kB | 22/169 kB | 49/189 kB Progress (3): 21/103 kB | 22/169 kB | 49/189 kB Progress (3): 21/103 kB | 23/169 kB | 49/189 kB Progress (3): 22/103 kB | 23/169 kB | 49/189 kB Progress (3): 22/103 kB | 25/169 kB | 49/189 kB Progress (3): 23/103 kB | 25/169 kB | 49/189 kB Progress (3): 23/103 kB | 26/169 kB | 49/189 kB Progress (3): 25/103 kB | 26/169 kB | 49/189 kB Progress (3): 25/103 kB | 28/169 kB | 49/189 kB Progress (3): 26/103 kB | 28/169 kB | 49/189 kB Progress (3): 26/103 kB | 29/169 kB | 49/189 kB Progress (3): 27/103 kB | 29/169 kB | 49/189 kB Progress (3): 27/103 kB | 30/169 kB | 49/189 kB Progress (3): 29/103 kB | 30/169 kB | 49/189 kB Progress (3): 29/103 kB | 32/169 kB | 49/189 kB Progress (3): 30/103 kB | 32/169 kB | 49/189 kB Progress (3): 30/103 kB | 33/169 kB | 49/189 kB Progress (3): 32/103 kB | 33/169 kB | 49/189 kB Progress (3): 32/103 kB | 34/169 kB | 49/189 kB Progress (3): 33/103 kB | 34/169 kB | 49/189 kB Progress (3): 33/103 kB | 36/169 kB | 49/189 kB Progress (3): 34/103 kB | 36/169 kB | 49/189 kB Progress (3): 34/103 kB | 37/169 kB | 49/189 kB Progress (3): 36/103 kB | 37/169 kB | 49/189 kB Progress (3): 36/103 kB | 39/169 kB | 49/189 kB Progress (3): 37/103 kB | 39/169 kB | 49/189 kB Progress (3): 37/103 kB | 40/169 kB | 49/189 kB Progress (3): 38/103 kB | 40/169 kB | 49/189 kB Progress (3): 38/103 kB | 41/169 kB | 49/189 kB Progress (3): 40/103 kB | 41/169 kB | 49/189 kB Progress (3): 40/103 kB | 43/169 kB | 49/189 kB Progress (3): 41/103 kB | 43/169 kB | 49/189 kB Progress (3): 41/103 kB | 43/169 kB | 66/189 kB Progress (3): 41/103 kB | 44/169 kB | 66/189 kB Progress (3): 43/103 kB | 44/169 kB | 66/189 kB Progress (3): 43/103 kB | 46/169 kB | 66/189 kB Progress (3): 43/103 kB | 46/169 kB | 79/189 kB Progress (3): 43/103 kB | 47/169 kB | 79/189 kB Progress (3): 44/103 kB | 47/169 kB | 79/189 kB Progress (3): 44/103 kB | 48/169 kB | 79/189 kB Progress (3): 45/103 kB | 48/169 kB | 79/189 kB Progress (3): 45/103 kB | 48/169 kB | 96/189 kB Progress (3): 45/103 kB | 49/169 kB | 96/189 kB Progress (3): 47/103 kB | 49/169 kB | 96/189 kB Progress (3): 47/103 kB | 49/169 kB | 112/189 kB Progress (3): 48/103 kB | 49/169 kB | 112/189 kB Progress (3): 49/103 kB | 49/169 kB | 112/189 kB Progress (3): 49/103 kB | 49/169 kB | 128/189 kB Progress (3): 49/103 kB | 66/169 kB | 128/189 kB Progress (3): 51/103 kB | 66/169 kB | 128/189 kB Progress (3): 52/103 kB | 66/169 kB | 128/189 kB Progress (3): 52/103 kB | 82/169 kB | 128/189 kB Progress (3): 54/103 kB | 82/169 kB | 128/189 kB Progress (3): 55/103 kB | 82/169 kB | 128/189 kB Progress (3): 56/103 kB | 82/169 kB | 128/189 kB Progress (3): 56/103 kB | 82/169 kB | 145/189 kB Progress (3): 58/103 kB | 82/169 kB | 145/189 kB Progress (3): 59/103 kB | 82/169 kB | 145/189 kB Progress (3): 61/103 kB | 82/169 kB | 145/189 kB Progress (3): 62/103 kB | 82/169 kB | 145/189 kB Progress (3): 62/103 kB | 82/169 kB | 145/189 kB Progress (3): 79/103 kB | 82/169 kB | 145/189 kB Progress (3): 79/103 kB | 82/169 kB | 161/189 kB Progress (3): 79/103 kB | 82/169 kB | 178/189 kB Progress (3): 95/103 kB | 82/169 kB | 178/189 kB Progress (3): 95/103 kB | 82/169 kB | 189 kB Progress (3): 103 kB | 82/169 kB | 189 kB Progress (3): 103 kB | 98/169 kB | 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-22T08:33:28.177 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-22T08:33:28.189 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-22T08:33:28.202 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:33:28.202 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:33:28.202 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] T E S T S 2024-09-22T08:33:28.203 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:33:28.654 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-22T08:33:28.780 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjects.java: starting test run: 2024-09-22T08:33:28.780 INFO:tasks.workunit.client.0.smithi078.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:33:28.780 INFO:tasks.workunit.client.0.smithi078.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:33:28.780 INFO:tasks.workunit.client.0.smithi078.stdout: EndpointUrl=http://smithi078.front.sepia.ceph.com:80 2024-09-22T08:33:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-22T08:33:28.877 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Environment Variables Read 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: S3 Client Initialized 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.179 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-22T08:33:29.180 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-22T08:33:29.180 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generated Big Files 2024-09-22T08:33:29.460 INFO:tasks.workunit.client.0.smithi078.stdout:HeadBucketResponse() 2024-09-22T08:33:29.460 INFO:tasks.workunit.client.0.smithi078.stdout:sheik is ready 2024-09-22T08:33:29.461 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Test Bucket Created 2024-09-22T08:33:29.478 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-22T08:33:29.678 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-22T08:33:29.878 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-22T08:33:29.979 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-22T08:33:30.079 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-22T08:33:30.279 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-22T08:33:30.479 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-22T08:33:30.680 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-22T08:33:30.980 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-22T08:33:31.281 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-22T08:33:34.586 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-22T08:33:38.692 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-22T08:34:00.121 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-0b 2024-09-22T08:34:00.122 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-8b 2024-09-22T08:34:00.123 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-200b 2024-09-22T08:34:00.124 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-21983b 2024-09-22T08:34:00.125 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-5519b 2024-09-22T08:34:00.126 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-204329b 2024-09-22T08:34:00.127 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-256k 2024-09-22T08:34:00.128 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-1m 2024-09-22T08:34:00.129 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-1038757b 2024-09-22T08:34:00.219 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-0b 2024-09-22T08:34:00.260 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:00.320 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-8b 2024-09-22T08:34:00.320 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:00.420 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-200b 2024-09-22T08:34:00.519 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:00.620 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-21983b 2024-09-22T08:34:00.620 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:00.720 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-5519b 2024-09-22T08:34:00.720 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:00.820 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-204329b 2024-09-22T08:34:00.920 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:01.020 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-256k 2024-09-22T08:34:01.120 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:01.221 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-1m 2024-09-22T08:34:01.421 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:01.521 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-22T08:34:01.721 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-22T08:34:01.822 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-22T08:34:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-22T08:34:06.427 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-22T08:34:31.621 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.96 s -- in io.ceph.jcksum.PutObjects 2024-09-22T08:34:31.634 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:34:31.634 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Results: 2024-09-22T08:34:31.634 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:34:31.634 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-22T08:34:31.634 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-22T08:34:31.636 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:34:31.636 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:34:31.636 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:34:31.637 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Total time: 01:04 min 2024-09-22T08:34:31.637 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Finished at: 2024-09-22T08:34:31Z 2024-09-22T08:34:31.637 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:34:31.649 INFO:tasks.workunit.client.0.smithi078.stderr:+ exit 2024-09-22T08:34:31.649 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:34:31.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:34:31.729 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-22T08:34:31.729 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:34:32.082 DEBUG:teuthology.parallel:result is None 2024-09-22T08:34:32.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:34:32.120 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:34:32.120 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:34:32.189 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:34:32.189 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:34:32.199 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:34:32.199 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:34:32.199 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:34:32.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:34:32.259 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:34:32.259 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:34:32.329 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:34:32.329 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:34:32.398 INFO:tasks.workunit:timeout=3h 2024-09-22T08:34:32.398 INFO:tasks.workunit:cleanup=True 2024-09-22T08:34:32.398 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:34:32.467 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:35:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:35:32.439 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:35:32.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:35:32.441 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:35:32.444 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:35:32.513 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:35:32.515 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:35:32.515 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:35:32.565 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:35:32.612 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:35:32.651 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:35:32.653 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:35:32.653 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:35:32.692 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:35:32.695 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:35:32.695 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:35:32.765 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-22T08:35:32.766 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-22T08:35:32.766 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-22T08:35:32.840 INFO:tasks.workunit.client.0.smithi078.stdout:INFO: fully qualified domain name: smithi078.front.sepia.ceph.com 2024-09-22T08:35:32.840 INFO:tasks.workunit.client.0.smithi078.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-22T08:35:32.840 INFO:tasks.workunit.client.0.smithi078.stdout:== TESTING VERSIONED BUCKET == 2024-09-22T08:35:35.441 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:35:35.615 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-22T08:35:35.620 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:35:35.664 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-22T08:35:35.664 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-22T08:35:35.665 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:35:35.816 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:35:35.821 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:35:36.557 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-22T08:35:37.359 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-22T08:35:37.361 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:35:37.893 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:35:37.894 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:35:37.943 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:35:37.944 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:35:37.990 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:35:37.991 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:35:38.033 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:35:38.034 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:35:38.101 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:35:38.102 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:35:38.238 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:35:38.239 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:35:38.243 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:35:38.245 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:35:38.254 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:35:38.256 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:35:38.257 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:35:38.258 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:35:38.260 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:35:38.334 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:35:39.361 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:35:39.597 INFO:tasks.workunit.client.0.smithi078.stdout:INFO: creating user 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "testid", 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "M. Tester", 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "tester@ceph.com", 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "testid", 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "0555b35654ad1656d804", 2024-09-22T08:35:39.917 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:35:39.903657Z" 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:39.918 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-22T08:35:39.903644Z", 2024-09-22T08:35:39.919 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-22T08:35:39.920 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-22T08:35:39.920 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-22T08:35:39.920 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-22T08:35:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:5+0 records in 2024-09-22T08:35:40.230 INFO:tasks.workunit.client.0.smithi078.stderr:5+0 records out 2024-09-22T08:35:40.230 INFO:tasks.workunit.client.0.smithi078.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.015064 s, 348 MB/s 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:bucket nams is reupload-bkt-125480 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:endpoint is http://smithi078.front.sepia.ceph.com:80 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:start UploadId=2~gNDFgMOy-EKp8zXmhU-s2ZggAlAZLLg 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 2} 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.498 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1} 2024-09-22T08:35:49.499 INFO:tasks.workunit.client.0.smithi078.stdout:completing multipart upload, parts=[{'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 1}, {'ETag': '"01ecb2f312dc708f9ac1f3c164e4663b"', 'PartNumber': 2}] 2024-09-22T08:35:50.537 INFO:tasks.workunit.client.0.smithi078.stdout:radosgw-admin bucket radoslist: 2024-09-22T08:35:50.538 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4_mpu_test4 2024-09-22T08:35:50.538 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__multipart_mpu_test4.2~gNDFgMOy-EKp8zXmhU-s2ZggAlAZLLg.2 2024-09-22T08:35:50.538 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__multipart_mpu_test4.q7UvGxf2h6NZu6VwAgOQBxUtV3Aj2oZq.1 2024-09-22T08:35:50.538 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__:sF7F7YFWaMCV4Hw3diSMFWpQPor6Ndg_mpu_test4 2024-09-22T08:35:50.597 INFO:tasks.workunit.client.0.smithi078.stdout:rados ls: 2024-09-22T08:35:50.598 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4_mpu_test4 2024-09-22T08:35:50.598 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__multipart_mpu_test4.2~gNDFgMOy-EKp8zXmhU-s2ZggAlAZLLg.2 2024-09-22T08:35:50.598 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__multipart_mpu_test4.q7UvGxf2h6NZu6VwAgOQBxUtV3Aj2oZq.1 2024-09-22T08:35:50.598 INFO:tasks.workunit.client.0.smithi078.stdout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4__:sF7F7YFWaMCV4Hw3diSMFWpQPor6Ndg_mpu_test4 2024-09-22T08:35:50.601 INFO:tasks.workunit.client.0.smithi078.stdout:== PASSED == 2024-09-22T08:35:50.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:35:50.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:35:50.680 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-22T08:35:50.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:35:51.037 DEBUG:teuthology.parallel:result is None 2024-09-22T08:35:51.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:35:51.075 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:35:51.075 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:35:51.143 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:35:51.144 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-22T08:35:51.156 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-22T08:35:51.157 INFO:tasks.ragweed:Downloading ragweed... 2024-09-22T08:35:51.157 INFO:tasks.ragweed:Using branch 'wip-skoduri-cloud-restore' for ragweed 2024-09-22T08:35:51.157 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b wip-skoduri-cloud-restore https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:35:51.212 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T08:35:51.240 INFO:teuthology.orchestra.run.smithi078.stderr:fatal: Remote branch wip-skoduri-cloud-restore not found in upstream origin 2024-09-22T08:35:51.240 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-22T08:35:51.242 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-22T08:35:51.242 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:35:51.311 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T08:35:51.482 INFO:tasks.ragweed:Creating rgw users... 2024-09-22T08:35:51.482 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-22T08:35:51.482 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key QFXEJLUCKFRHEPHQXRHP --secret MfBySukDvuXMlilkmDEK86nRzA0qADy8L7WcldXuxjwNFBJhHRsi7w== --email ragweed.client.0+test@test.test --system false 2024-09-22T08:35:51.588 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:51.588 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:51.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.621+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.622+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.622+0000 7fe02e324800 20 realm 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.622+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:51.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.623+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.624+0000 7fe02e324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.625+0000 7fe02e324800 20 searching for the correct realm 2024-09-22T08:35:51.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.627+0000 7fe02a703640 0 -- 172.21.15.78:0/1490927414 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fe0200910b0 msgr2=0x7fe02008fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:51.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.832+0000 7fe029701640 0 -- 172.21.15.78:0/1490927414 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fe024027040 msgr2=0x7fe0240695a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:35:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:35:51.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.838+0000 7fe02e324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 zone default found 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 4 Realm: () 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 zonegroup default 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.839+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.840+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.840+0000 7fe02e324800 20 started sync module instance, tier type = 2024-09-22T08:35:51.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.840+0000 7fe02e324800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=0 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=1 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=2 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=3 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=4 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=5 2024-09-22T08:35:51.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.850+0000 7fe02e324800 20 add_watcher() i=6 2024-09-22T08:35:51.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.851+0000 7fe02e324800 20 add_watcher() i=7 2024-09-22T08:35:51.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.851+0000 7fe02e324800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:51.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fdedb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 5 note: GC not initialized 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fdeda7fc640 20 reqs_thread_entry: start 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 20 Filter name: none 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fde4bfff640 20 reqs_thread_entry: start 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T08:35:51.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.853+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache get: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP : miss 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP info.flags=0x0 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 adding default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP to cache LRU end 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache get: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP : hit (negative entry) 2024-09-22T08:35:51.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.854+0000 7fe02e324800 10 cache get: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP : hit (negative entry) 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fe02e324800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fe02e324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fdf0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758650 cookie 94817391357296 notifier 5693 bl.length()=675 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fdf0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T08:35:51.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.856+0000 7fdf0d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:35:51.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T08:35:51.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fe02e324800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:35:51.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fe02e324800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T08:35:51.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fdf0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758603 cookie 94817391354496 notifier 5693 bl.length()=202 2024-09-22T08:35:51.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fdf0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T08:35:51.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.859+0000 7fdf0d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T08:35:51.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fe02e324800 10 cache put: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP info.flags=0x7 2024-09-22T08:35:51.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fe02e324800 10 moving default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP to cache LRU end 2024-09-22T08:35:51.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fe02e324800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:QFXEJLUCKFRHEPHQXRHP, ofs0, ns] 2024-09-22T08:35:51.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fdf0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758662 cookie 94817391364928 notifier 5693 bl.length()=190 2024-09-22T08:35:51.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fdf0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP info.flags=0x7 2024-09-22T08:35:51.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.862+0000 7fdf0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QFXEJLUCKFRHEPHQXRHP to cache LRU end 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "ragweed.client.0", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "ragweed.client.0", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "QFXEJLUCKFRHEPHQXRHP", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "MfBySukDvuXMlilkmDEK86nRzA0qADy8L7WcldXuxjwNFBJhHRsi7w==", 2024-09-22T08:35:51.865 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:35:51.855825Z" 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:35:51.867 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:35:51.855814Z", 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.865+0000 7fdedb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.867+0000 7fe02e324800 20 remove_watcher() i=0 2024-09-22T08:35:51.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.867+0000 7fe02e324800 2 removed watcher, disabling cache 2024-09-22T08:35:51.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.868+0000 7fe02e324800 20 remove_watcher() i=1 2024-09-22T08:35:51.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.869+0000 7fe02e324800 20 remove_watcher() i=2 2024-09-22T08:35:51.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.870+0000 7fe02e324800 20 remove_watcher() i=3 2024-09-22T08:35:51.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.871+0000 7fe02e324800 20 remove_watcher() i=4 2024-09-22T08:35:51.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.872+0000 7fe02e324800 20 remove_watcher() i=5 2024-09-22T08:35:51.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.873+0000 7fe02e324800 20 remove_watcher() i=6 2024-09-22T08:35:51.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.874+0000 7fe02e324800 20 remove_watcher() i=7 2024-09-22T08:35:51.886 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-22T08:35:51.886 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key BCICLBZQBVMQNWLKUDBH --secret HYxfab2qF2WzQA/QrYx+Yw8jnJKXGgWshWjc1XnHKVo0Bz4fpRwMFA== --email sysuser.client.0+test@test.test --system true 2024-09-22T08:35:51.953 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:35:51.953 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:35:51.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.986+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 realm 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.988+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.989+0000 7f2bbfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.989+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.990+0000 7f2bbfd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:35:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.990+0000 7f2bbfd0c800 20 searching for the correct realm 2024-09-22T08:35:51.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.992+0000 7f2bb4ffc640 0 -- 172.21.15.78:0/4012824591 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55b6ea5cb830 msgr2=0x55b6ea5cdc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:51.995+0000 7f2bb4ffc640 0 -- 172.21.15.78:0/4012824591 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2bb804cc20 msgr2=0x7f2bb8054410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:35:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.201+0000 7f2bbfd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:35:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:35:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 zone default found 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 4 Realm: () 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 zonegroup default 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.202+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 started sync module instance, tier type = 2024-09-22T08:35:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.203+0000 7f2bbfd0c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:35:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=0 2024-09-22T08:35:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=1 2024-09-22T08:35:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=2 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=3 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=4 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=5 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.213+0000 7f2bbfd0c800 20 add_watcher() i=6 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.214+0000 7f2bbfd0c800 20 add_watcher() i=7 2024-09-22T08:35:52.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.214+0000 7f2bbfd0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:35:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.216+0000 7f2a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.216+0000 7f2bbfd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:35:52.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.216+0000 7f2bbfd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 5 note: GC not initialized 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2a71fe3640 20 reqs_thread_entry: start 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 20 Filter name: none 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f29e37fe640 20 reqs_thread_entry: start 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-22T08:35:52.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.217+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 cache get: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH : miss 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 20 rados->read ofs=0 len=0 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH info.flags=0x0 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 adding default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH to cache LRU end 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 cache get: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH : hit (negative entry) 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.218+0000 7f2bbfd0c800 10 cache get: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH : hit (negative entry) 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.219+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.219+0000 7f2bbfd0c800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.219+0000 7f2bbfd0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T08:35:52.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.220+0000 7f2a93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758604 cookie 94244104404608 notifier 5708 bl.length()=675 2024-09-22T08:35:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.220+0000 7f2a93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T08:35:52.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.220+0000 7f2a93fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2bbfd0c800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2bbfd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2a93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758651 cookie 94244104411488 notifier 5708 bl.length()=202 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2a93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T08:35:52.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.223+0000 7f2a93fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T08:35:52.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.225+0000 7f2bbfd0c800 10 cache put: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH info.flags=0x7 2024-09-22T08:35:52.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.225+0000 7f2bbfd0c800 10 moving default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH to cache LRU end 2024-09-22T08:35:52.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.225+0000 7f2bbfd0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:BCICLBZQBVMQNWLKUDBH, ofs0, ns] 2024-09-22T08:35:52.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.226+0000 7f2a937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 94244104408736 notifier 5708 bl.length()=190 2024-09-22T08:35:52.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.226+0000 7f2a937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH info.flags=0x7 2024-09-22T08:35:52.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.226+0000 7f2a937fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BCICLBZQBVMQNWLKUDBH to cache LRU end 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "sysuser.client.0", 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "sysuser.client.0", 2024-09-22T08:35:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "BCICLBZQBVMQNWLKUDBH", 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "HYxfab2qF2WzQA/QrYx+Yw8jnJKXGgWshWjc1XnHKVo0Bz4fpRwMFA==", 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:35:52.219396Z" 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "system": true, 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:35:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:35:52.230 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:35:52.219385Z", 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.228+0000 7f2a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.230+0000 7f2bbfd0c800 20 remove_watcher() i=0 2024-09-22T08:35:52.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.230+0000 7f2bbfd0c800 2 removed watcher, disabling cache 2024-09-22T08:35:52.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.231+0000 7f2bbfd0c800 20 remove_watcher() i=1 2024-09-22T08:35:52.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.232+0000 7f2bbfd0c800 20 remove_watcher() i=2 2024-09-22T08:35:52.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.233+0000 7f2bbfd0c800 20 remove_watcher() i=3 2024-09-22T08:35:52.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.234+0000 7f2bbfd0c800 20 remove_watcher() i=4 2024-09-22T08:35:52.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.235+0000 7f2bbfd0c800 20 remove_watcher() i=5 2024-09-22T08:35:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.236+0000 7f2bbfd0c800 20 remove_watcher() i=6 2024-09-22T08:35:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:35:52.238+0000 7f2bbfd0c800 20 remove_watcher() i=7 2024-09-22T08:35:52.249 INFO:tasks.ragweed:Configuring ragweed... 2024-09-22T08:35:52.250 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:35:52.250 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-22T08:35:52.278 INFO:tasks.ragweed:Configuring boto... 2024-09-22T08:35:52.279 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:35:52.279 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-22T08:35:52.348 DEBUG:teuthology.orchestra.run.smithi078:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-22T08:35:52.533 INFO:teuthology.orchestra.run.smithi078.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-22T08:35:52.719 INFO:teuthology.orchestra.run.smithi078.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-22T08:35:53.260 INFO:teuthology.orchestra.run.smithi078.stdout:py installdeps: -rrequirements.txt 2024-09-22T08:35:59.286 INFO:teuthology.orchestra.run.smithi078.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-22T08:36:02.453 INFO:teuthology.orchestra.run.smithi078.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.1,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=4202d041b1a5ede48511310103793d019d5a7dc3ad6b2e34784a543f844622f0,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-22T08:36:02.453 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test-pre: PYTHONHASHSEED='3355676926' 2024-09-22T08:36:02.453 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-22T08:36:02.653 INFO:teuthology.orchestra.run.smithi078.stdout:============================= test session starts ============================== 2024-09-22T08:36:02.653 INFO:teuthology.orchestra.run.smithi078.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-22T08:36:02.653 INFO:teuthology.orchestra.run.smithi078.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T08:36:02.653 INFO:teuthology.orchestra.run.smithi078.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:36:02.653 INFO:teuthology.orchestra.run.smithi078.stdout:configfile: pytest.ini 2024-09-22T08:36:02.748 INFO:teuthology.orchestra.run.smithi078.stdout:collecting ... collected 9 items 2024-09-22T08:36:02.749 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:36:04.831 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-22T08:36:06.866 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-22T08:36:08.728 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-22T08:36:11.067 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-22T08:36:13.304 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-22T08:36:21.601 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-22T08:36:26.182 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-22T08:36:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-22T08:36:39.814 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-22T08:36:39.814 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:36:39.814 INFO:teuthology.orchestra.run.smithi078.stdout:=============================== warnings summary =============================== 2024-09-22T08:36:39.814 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T08:36:39.815 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T08:36:39.815 INFO:teuthology.orchestra.run.smithi078.stdout: import imp 2024-09-22T08:36:39.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:36:39.815 INFO:teuthology.orchestra.run.smithi078.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T08:36:39.815 INFO:teuthology.orchestra.run.smithi078.stdout:======================== 9 passed, 1 warning in 37.16s ========================= 2024-09-22T08:36:39.844 INFO:teuthology.orchestra.run.smithi078.stdout:___________________________________ summary ____________________________________ 2024-09-22T08:36:39.844 INFO:teuthology.orchestra.run.smithi078.stdout: py: commands succeeded 2024-09-22T08:36:39.844 INFO:teuthology.orchestra.run.smithi078.stdout: congratulations :) 2024-09-22T08:36:39.861 INFO:tasks.ragweed:Cleaning up boto... 2024-09-22T08:36:39.862 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-22T08:36:39.890 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-22T08:36:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:40.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.021+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 realm 2024-09-22T08:36:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.023+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.024+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.024+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.025+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.025+0000 7f1a8302f800 20 searching for the correct realm 2024-09-22T08:36:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.028+0000 7f1a80b19640 0 -- 172.21.15.78:0/3389749159 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f1a740b7040 msgr2=0x7f1a740b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.234+0000 7f1a80b19640 0 -- 172.21.15.78:0/3389749159 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x560ec3bb62e0 msgr2=0x560ec3bb87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.237+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 zone default found 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 4 Realm: () 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 zonegroup default 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.238+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 started sync module instance, tier type = 2024-09-22T08:36:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.239+0000 7f1a8302f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:36:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=0 2024-09-22T08:36:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=1 2024-09-22T08:36:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=2 2024-09-22T08:36:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=3 2024-09-22T08:36:40.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=4 2024-09-22T08:36:40.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=5 2024-09-22T08:36:40.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.249+0000 7f1a8302f800 20 add_watcher() i=6 2024-09-22T08:36:40.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.250+0000 7f1a8302f800 20 add_watcher() i=7 2024-09-22T08:36:40.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.250+0000 7f1a8302f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:40.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.253+0000 7f19377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.253+0000 7f1a8302f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:40.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.253+0000 7f1a8302f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.291+0000 7f19367e4640 20 reqs_thread_entry: start 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.291+0000 7f1a8302f800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.291+0000 7f1a8302f800 20 Filter name: none 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.291+0000 7f192ffff640 20 reqs_thread_entry: start 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T08:36:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.292+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 : miss 2024-09-22T08:36:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=426 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 info.flags=0x17 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 to cache LRU end 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.293+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 2024-09-22T08:36:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.294+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-22T08:36:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.294+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-22T08:36:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.294+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-22T08:36:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.295+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-22T08:36:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.295+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-22T08:36:40.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.295+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-22T08:36:40.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.296+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-22T08:36:40.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.297+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-22T08:36:40.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.298+0000 7f1a8302f800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-22T08:36:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560ec3c779b8 s->prefetch_data=0 2024-09-22T08:36:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 10 manifest: total_size = 7786 2024-09-22T08:36:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14252809720689713890 2024-09-22T08:36:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560ec3c779b8 s->prefetch_data=0 2024-09-22T08:36:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c779b8 2024-09-22T08:36:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.299+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.1 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7786 stripe_ofs=7786 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14252809720689713890 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.cYZT9ubj_UJPBBF1CCcvEDc5U5QSKUp_0 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.302+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14252809720689713890 2024-09-22T08:36:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.303+0000 7f1957fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-22T08:36:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.303+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560ec3c77468 s->prefetch_data=0 2024-09-22T08:36:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.304+0000 7f1a8302f800 10 manifest: total_size = 4855 2024-09-22T08:36:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.304+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5696456169338480988 2024-09-22T08:36:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.304+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560ec3c77468 s->prefetch_data=0 2024-09-22T08:36:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.304+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77468 2024-09-22T08:36:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.304+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.2 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=4855 stripe_ofs=4855 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5696456169338480988 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.IR9U3YbIympe0tXAhoGJTnZqQLm6UBb_0 2024-09-22T08:36:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-22T08:36:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.306+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5696456169338480988 2024-09-22T08:36:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.307+0000 7f19577fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-22T08:36:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560ec3c77468 s->prefetch_data=0 2024-09-22T08:36:40.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 10 manifest: total_size = 7687 2024-09-22T08:36:40.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11439022963743978123 2024-09-22T08:36:40.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560ec3c77468 s->prefetch_data=0 2024-09-22T08:36:40.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77468 2024-09-22T08:36:40.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.308+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.2 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7687 stripe_ofs=7687 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11439022963743978123 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.ZrZQsRPGeZ0mI8wiVB-RtRwr3YSVR5M_0 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.310+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11439022963743978123 2024-09-22T08:36:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.311+0000 7f1957fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-22T08:36:40.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560ec3c773f8 s->prefetch_data=0 2024-09-22T08:36:40.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 10 manifest: total_size = 13086 2024-09-22T08:36:40.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555078406106324417 2024-09-22T08:36:40.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560ec3c773f8 s->prefetch_data=0 2024-09-22T08:36:40.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c773f8 2024-09-22T08:36:40.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.312+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.3 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=13086 stripe_ofs=13086 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555078406106324417 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.zCu2EO9tYqr5l-OmdpAofL15w-aYluu_0 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.315+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555078406106324417 2024-09-22T08:36:40.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.316+0000 7f19577fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-22T08:36:40.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.316+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.317+0000 7f1a8302f800 10 manifest: total_size = 5226 2024-09-22T08:36:40.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.317+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18436295146112537858 2024-09-22T08:36:40.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.317+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.317+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77398 2024-09-22T08:36:40.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.317+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.4 2024-09-22T08:36:40.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.319+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5226 stripe_ofs=5226 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18436295146112537858 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.kyK0A6Vd_xx8nIJwBvsLhVObRRyRCdG_0 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.320+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18436295146112537858 2024-09-22T08:36:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1957fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-22T08:36:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 10 manifest: total_size = 7537 2024-09-22T08:36:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10406049797907352289 2024-09-22T08:36:40.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77398 2024-09-22T08:36:40.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.321+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.4 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7537 stripe_ofs=7537 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10406049797907352289 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.5_b7tqx-ZYVxwqYZ29JStE73caToUdY_0 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.324+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10406049797907352289 2024-09-22T08:36:40.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.325+0000 7f19577fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-22T08:36:40.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.325+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.326+0000 7f1a8302f800 10 manifest: total_size = 7424 2024-09-22T08:36:40.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.326+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5276182144388907360 2024-09-22T08:36:40.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.326+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3b582a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.326+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77398 2024-09-22T08:36:40.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.326+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.5 2024-09-22T08:36:40.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7424 stripe_ofs=7424 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5276182144388907360 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.-hMRU2ey07TJIKnGmw870ZmksgDuZBA_0 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.328+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5276182144388907360 2024-09-22T08:36:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.329+0000 7f1957fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c770d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 10 manifest: total_size = 7805 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11860268674666089244 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c770d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77398 2024-09-22T08:36:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.330+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.7 2024-09-22T08:36:40.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7805 stripe_ofs=7805 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11860268674666089244 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.fCbAWP81LV2mA49cFs7Lcx0G3qWvLHf_0 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.332+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11860268674666089244 2024-09-22T08:36:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f19577fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-22T08:36:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f1a8302f800 10 manifest: total_size = 7741 2024-09-22T08:36:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13449246359536976596 2024-09-22T08:36:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560ec3c77398 s->prefetch_data=0 2024-09-22T08:36:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.334+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c77398 2024-09-22T08:36:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.335+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5.8 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7741 stripe_ofs=7741 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13449246359536976596 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.8KK9mKdL1wH6WQUhIUSiSH9jQi87Dmr_0 2024-09-22T08:36:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.337+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13449246359536976596 2024-09-22T08:36:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.338+0000 7f1957fff640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-22T08:36:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.338+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.338+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.339+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.339+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.339+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.339+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.339+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.341+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-22T08:36:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.341+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.341+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=204 2024-09-22T08:36:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.341+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-22T08:36:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.341+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-22T08:36:40.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.342+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-22T08:36:40.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.342+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-22T08:36:40.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.342+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562385 cookie 94621413385744 notifier 6123 bl.length()=162 2024-09-22T08:36:40.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.345+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 from cache 2024-09-22T08:36:40.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.345+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5, ofs0, ns] 2024-09-22T08:36:40.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.345+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94621413402400 notifier 6123 bl.length()=219 2024-09-22T08:36:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.349+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 : miss 2024-09-22T08:36:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.349+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.349+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.349+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 info.flags=0x0 2024-09-22T08:36:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.349+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5 to cache LRU end 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 : miss 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=457 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 info.flags=0x17 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 to cache LRU end 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.352+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 2024-09-22T08:36:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:36:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c79210 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560ec3c04888 s->prefetch_data=0 2024-09-22T08:36:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 10 manifest: total_size = 886297 2024-09-22T08:36:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6376544789280000448 2024-09-22T08:36:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c79210 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560ec3c04888 s->prefetch_data=0 2024-09-22T08:36:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c04888 2024-09-22T08:36:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.357+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12.10 2024-09-22T08:36:40.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:36:40.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6376544789280000448 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.1 2024-09-22T08:36:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.2 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.3 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.4 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.360+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6376544789280000448 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.361+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.362+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.364+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-22T08:36:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.364+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.364+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=235 2024-09-22T08:36:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.364+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-22T08:36:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.364+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-22T08:36:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.365+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-22T08:36:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.365+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-22T08:36:40.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.366+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94621413383232 notifier 6123 bl.length()=191 2024-09-22T08:36:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.368+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 from cache 2024-09-22T08:36:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.368+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12, ofs0, ns] 2024-09-22T08:36:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.368+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562440 cookie 94621413397024 notifier 6123 bl.length()=249 2024-09-22T08:36:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.372+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 : miss 2024-09-22T08:36:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.372+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.373+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.373+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 info.flags=0x0 2024-09-22T08:36:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.373+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12 to cache LRU end 2024-09-22T08:36:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 : miss 2024-09-22T08:36:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=464 2024-09-22T08:36:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 info.flags=0x17 2024-09-22T08:36:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 to cache LRU end 2024-09-22T08:36:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.375+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 2024-09-22T08:36:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:36:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c016f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560ec3c04888 s->prefetch_data=0 2024-09-22T08:36:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 10 manifest: total_size = 74198 2024-09-22T08:36:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2973385253971671832 2024-09-22T08:36:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c016f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560ec3c04888 s->prefetch_data=0 2024-09-22T08:36:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c04888 2024-09-22T08:36:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.380+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13.10 2024-09-22T08:36:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-22T08:36:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T08:36:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2973385253971671832 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.1 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.2 2024-09-22T08:36:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.3 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.4 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.383+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2973385253971671832 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.384+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.384+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.384+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.385+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.385+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.385+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.385+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.385+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.387+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-22T08:36:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.387+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.387+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=242 2024-09-22T08:36:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.387+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-22T08:36:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.387+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-22T08:36:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.388+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-22T08:36:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.388+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-22T08:36:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.388+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94621413390224 notifier 6123 bl.length()=198 2024-09-22T08:36:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.391+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 from cache 2024-09-22T08:36:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.391+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13, ofs0, ns] 2024-09-22T08:36:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.391+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562441 cookie 94621413383232 notifier 6123 bl.length()=256 2024-09-22T08:36:40.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.396+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 : miss 2024-09-22T08:36:40.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.396+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.396+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.396+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 info.flags=0x0 2024-09-22T08:36:40.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.396+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13 to cache LRU end 2024-09-22T08:36:40.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.398+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 : miss 2024-09-22T08:36:40.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.398+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=459 2024-09-22T08:36:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 info.flags=0x17 2024-09-22T08:36:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 to cache LRU end 2024-09-22T08:36:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.399+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 2024-09-22T08:36:40.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.403+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo[QGaaf-wkGXHrdH1A3ITrFtzR6a7dZwJ] 2024-09-22T08:36:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.403+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.404+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bc4650 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560ec3c05a48 s->prefetch_data=0 2024-09-22T08:36:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.404+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to 3fpxohl73jf3vnc82deube209xworozx 2024-09-22T08:36:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.404+0000 7f1a8302f800 20 get_obj_state_impl: setting s->olh_tag to acc5jmsoy4w26iei9uogtwriliwjumjf 2024-09-22T08:36:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.404+0000 7f1a8302f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=acc5jmsoy4w26iei9uogtwriliwjumjf 2024-09-22T08:36:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.405+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.408+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.408+0000 7f1a8302f800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.408+0000 7f1a8302f800 20 olh_log_entry: epoch=3 op=3 key=foo[QGaaf-wkGXHrdH1A3ITrFtzR6a7dZwJ] 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.408+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bc4650 obj=test-client.0-r-test-multipart-index-versioning.1:_:QGaaf-wkGXHrdH1A3ITrFtzR6a7dZwJ_foo state=0x560ec3c10db8 s->prefetch_data=0 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.409+0000 7f1a8302f800 10 manifest: total_size = 1667 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.409+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18433953105740866593 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.409+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bc4650 obj=test-client.0-r-test-multipart-index-versioning.1:_:QGaaf-wkGXHrdH1A3ITrFtzR6a7dZwJ_foo state=0x560ec3c10db8 s->prefetch_data=0 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.409+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c10db8 2024-09-22T08:36:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.409+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T08:36:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-22T08:36:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-22T08:36:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18433953105740866593 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.1 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.2 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-22T08:36:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.3 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.4 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.411+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18433953105740866593 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.412+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo[QGaaf-wkGXHrdH1A3ITrFtzR6a7dZwJ] 2024-09-22T08:36:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.414+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bc4650 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560ec3c05a48 s->prefetch_data=0 2024-09-22T08:36:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.415+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.416+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11.10 2024-09-22T08:36:40.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.416+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.416+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.417+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.417+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.417+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.417+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.417+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.418+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-22T08:36:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.418+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.419+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=237 2024-09-22T08:36:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.419+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-22T08:36:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.419+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-22T08:36:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.420+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-22T08:36:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.420+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-22T08:36:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.420+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94621413390224 notifier 6123 bl.length()=193 2024-09-22T08:36:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.423+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 from cache 2024-09-22T08:36:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.423+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11, ofs0, ns] 2024-09-22T08:36:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.423+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94621413405040 notifier 6123 bl.length()=251 2024-09-22T08:36:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.428+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 : miss 2024-09-22T08:36:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.428+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.429+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.429+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 info.flags=0x0 2024-09-22T08:36:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.429+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11 to cache LRU end 2024-09-22T08:36:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.430+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 : miss 2024-09-22T08:36:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.430+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=449 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 info.flags=0x17 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 to cache LRU end 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.431+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.434+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.434+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c78ed0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.435+0000 7f1a8302f800 10 manifest: total_size = 74198 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.435+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2498272717580941688 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.435+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c78ed0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.435+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bb6978 2024-09-22T08:36:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.435+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10.10 2024-09-22T08:36:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2498272717580941688 2024-09-22T08:36:40.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.1 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.2 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.3 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.4 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.437+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2498272717580941688 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.438+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.439+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.441+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-22T08:36:40.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.441+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.442+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=227 2024-09-22T08:36:40.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.442+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-22T08:36:40.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.442+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-22T08:36:40.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.443+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-22T08:36:40.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.443+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-22T08:36:40.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.443+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562442 cookie 94621413397024 notifier 6123 bl.length()=183 2024-09-22T08:36:40.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.445+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 from cache 2024-09-22T08:36:40.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.445+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10, ofs0, ns] 2024-09-22T08:36:40.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.446+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 94621413399712 notifier 6123 bl.length()=241 2024-09-22T08:36:40.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.449+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 : miss 2024-09-22T08:36:40.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.449+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.449+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.449+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 info.flags=0x0 2024-09-22T08:36:40.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.449+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10 to cache LRU end 2024-09-22T08:36:40.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.451+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 : miss 2024-09-22T08:36:40.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.451+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 info.flags=0x17 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 to cache LRU end 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 2024-09-22T08:36:40.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.452+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T08:36:40.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.453+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T08:36:40.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.454+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:36:40.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.454+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T08:36:40.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.454+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T08:36:40.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.454+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:36:40.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.455+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T08:36:40.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.455+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:36:40.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.455+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T08:36:40.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.455+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T08:36:40.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.455+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T08:36:40.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.456+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T08:36:40.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.456+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c05790 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560ec3bb7988 s->prefetch_data=0 2024-09-22T08:36:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.457+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.457+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _e0baqaj74mCspJSgR-h5NNxyMLZKUar 2024-09-22T08:36:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.457+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c05790 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560ec3bb7988 s->prefetch_data=0 2024-09-22T08:36:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.457+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bb7988 2024-09-22T08:36:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.457+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.0 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _e0baqaj74mCspJSgR-h5NNxyMLZKUar 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.o9YuudwYW-9g9IPw-IQ1f9yiMr0LjRp_0 2024-09-22T08:36:40.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:36:40.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.459+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _e0baqaj74mCspJSgR-h5NNxyMLZKUar 2024-09-22T08:36:40.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.460+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T08:36:40.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c0f330 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _K73NIYHt9fqJ5qWqPYrJyOskRhZ8cdF 2024-09-22T08:36:40.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c0f330 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.461+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.2 2024-09-22T08:36:40.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _K73NIYHt9fqJ5qWqPYrJyOskRhZ8cdF 2024-09-22T08:36:40.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.-QoIvRf8Kc1acfpkZm-QGSFq98GoG9H_0 2024-09-22T08:36:40.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:36:40.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.464+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _K73NIYHt9fqJ5qWqPYrJyOskRhZ8cdF 2024-09-22T08:36:40.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.465+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T08:36:40.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.465+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06920 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.466+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.466+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4440803065802937280 2024-09-22T08:36:40.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.466+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06920 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.466+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.466+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.3 2024-09-22T08:36:40.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4440803065802937280 2024-09-22T08:36:40.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.TA74ryNAFpwDaaxFPfqjM4kUk-D1upQ_0 2024-09-22T08:36:40.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T08:36:40.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.468+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4440803065802937280 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406df90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _STr3LBU7zVaPZASSzZ74tKVGXb06CmP 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406df90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.470+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.5 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _STr3LBU7zVaPZASSzZ74tKVGXb06CmP 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.wyC_NmSu63E3tdJgtVfV_pdMytJ78y5_0 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.474+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _STr3LBU7zVaPZASSzZ74tKVGXb06CmP 2024-09-22T08:36:40.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.475+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T08:36:40.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.475+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.476+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.476+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _0fHP5FFvTq9F4HSaojUViDGU4b23aRq 2024-09-22T08:36:40.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.476+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.476+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.476+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.5 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _0fHP5FFvTq9F4HSaojUViDGU4b23aRq 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.s0nZ4w_gCAqnL0qckl5BueD9ALVSOIn_0 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:36:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.478+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _0fHP5FFvTq9F4HSaojUViDGU4b23aRq 2024-09-22T08:36:40.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.479+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T08:36:40.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.479+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406df90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.480+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.480+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8937643622615014543 2024-09-22T08:36:40.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.480+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406df90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.480+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.480+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.5 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8937643622615014543 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.tIWUKAl9-Myu4RT1bP3xOoXaZ7IoqDX_0 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.482+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8937643622615014543 2024-09-22T08:36:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.483+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:36:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.483+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c022f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.484+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.484+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _MlZuvsQgF2Qc-hvcyrzPmCisWgmt43m 2024-09-22T08:36:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.484+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c022f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.484+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.484+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.7 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _MlZuvsQgF2Qc-hvcyrzPmCisWgmt43m 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.flbcKCcqeYL7Kv5LVEazUXqwp_QJH5B_0 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.486+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _MlZuvsQgF2Qc-hvcyrzPmCisWgmt43m 2024-09-22T08:36:40.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.487+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T08:36:40.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.487+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c0f330 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.488+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.488+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3948092353761421127 2024-09-22T08:36:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.488+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c0f330 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.488+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.488+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.7 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3948092353761421127 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.bfMHiZi_Gi_bk2Cl-CELtzGnat26zNb_0 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.490+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3948092353761421127 2024-09-22T08:36:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.491+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:36:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.491+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c022f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.492+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.492+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684714860470176784 2024-09-22T08:36:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.492+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c022f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.492+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.492+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.7 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684714860470176784 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.tIWUKAl9-Myu4RT1bP3xOoXaZ7IoqDX_0 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.494+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684714860470176784 2024-09-22T08:36:40.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T08:36:40.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406ddf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607473174258539364 2024-09-22T08:36:40.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406ddf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.495+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.496+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.8 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607473174258539364 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.bfMHiZi_Gi_bk2Cl-CELtzGnat26zNb_0 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.498+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607473174258539364 2024-09-22T08:36:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.499+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T08:36:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.499+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.500+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.500+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _ukcK4Ky_di_sAIDyL3uuR9QOykPVWqT 2024-09-22T08:36:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.500+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.500+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.500+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.8 2024-09-22T08:36:40.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _ukcK4Ky_di_sAIDyL3uuR9QOykPVWqT 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.qLAOF1ssxsX6sy8NUQDveT7Mb8vqM20_0 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.502+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _ukcK4Ky_di_sAIDyL3uuR9QOykPVWqT 2024-09-22T08:36:40.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.503+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c778d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 10 manifest: total_size = 5242880 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3551323198016478381 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c778d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.504+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16.9 2024-09-22T08:36:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3551323198016478381 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.TA74ryNAFpwDaaxFPfqjM4kUk-D1upQ_0 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.506+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3551323198016478381 2024-09-22T08:36:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.507+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T08:36:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.508+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.510+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-22T08:36:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.510+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.510+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=233 2024-09-22T08:36:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.510+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-22T08:36:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.511+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-22T08:36:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.511+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-22T08:36:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.511+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-22T08:36:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.512+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94621413390224 notifier 6123 bl.length()=189 2024-09-22T08:36:40.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.514+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 from cache 2024-09-22T08:36:40.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.514+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16, ofs0, ns] 2024-09-22T08:36:40.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.515+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94621413405040 notifier 6123 bl.length()=247 2024-09-22T08:36:40.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.518+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 : miss 2024-09-22T08:36:40.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.518+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.518+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.518+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 info.flags=0x0 2024-09-22T08:36:40.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.518+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16 to cache LRU end 2024-09-22T08:36:40.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.520+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 : miss 2024-09-22T08:36:40.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.520+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 info.flags=0x17 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 to cache LRU end 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 2024-09-22T08:36:40.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.521+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T08:36:40.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.522+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T08:36:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.523+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:36:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.523+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T08:36:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.523+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T08:36:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.523+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:36:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.524+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T08:36:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.524+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:36:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.524+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T08:36:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.525+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T08:36:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.525+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T08:36:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.525+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T08:36:40.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c057b30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 10 manifest: total_size = 16378 2024-09-22T08:36:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _x5klB0cTZz_Y2cGpXyK4u4agfTphLZ9 2024-09-22T08:36:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c057b30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.526+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.0 2024-09-22T08:36:40.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _x5klB0cTZz_Y2cGpXyK4u4agfTphLZ9 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.01MG3zfA0rhKVzk28EwvPvuAtTTf2Bb_0 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.528+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _x5klB0cTZz_Y2cGpXyK4u4agfTphLZ9 2024-09-22T08:36:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T08:36:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfbf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _KYvTO-f67Qo3qCxxKCIsqFy5D-L8MSA 2024-09-22T08:36:40.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfbf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.530+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.2 2024-09-22T08:36:40.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.532+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.532+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _KYvTO-f67Qo3qCxxKCIsqFy5D-L8MSA 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CGc_OqXeUI2T_EkQQkahCx2fFpDac75_0 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CGc_OqXeUI2T_EkQQkahCx2fFpDac75_1 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.533+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _KYvTO-f67Qo3qCxxKCIsqFy5D-L8MSA 2024-09-22T08:36:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T08:36:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfbf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7848615742815598861 2024-09-22T08:36:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfbf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.534+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.3 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7848615742815598861 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.1 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.2 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.3 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.537+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7848615742815598861 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.538+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bf9140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _p7AJDFOEoIUM2gnWgKrfE9ddKLXpdNJ 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bf9140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.539+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.5 2024-09-22T08:36:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _p7AJDFOEoIUM2gnWgKrfE9ddKLXpdNJ 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CqMRPVsgL41-OkQ0L63akDosn8_VQLx_0 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CqMRPVsgL41-OkQ0L63akDosn8_VQLx_1 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.541+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _p7AJDFOEoIUM2gnWgKrfE9ddKLXpdNJ 2024-09-22T08:36:40.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T08:36:40.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _cFaPvXbsRWZ42dXpnMEH8dx5jb9ZMTV 2024-09-22T08:36:40.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.543+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.5 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _cFaPvXbsRWZ42dXpnMEH8dx5jb9ZMTV 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.QfY5a5WEMIzBCpp1lZMuH7xmYuI7vg9_0 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.QfY5a5WEMIzBCpp1lZMuH7xmYuI7vg9_1 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.546+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _cFaPvXbsRWZ42dXpnMEH8dx5jb9ZMTV 2024-09-22T08:36:40.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c79d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T08:36:40.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 10 manifest: total_size = 16378 2024-09-22T08:36:40.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13972130294765185792 2024-09-22T08:36:40.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c79d80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.547+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.5 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7671 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7671 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-22T08:36:40.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13972130294765185792 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.1 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.2 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.3 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.550+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13972130294765185792 2024-09-22T08:36:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:36:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _5x4eu0-msB2zm0qmoNYYvl9O8s-GXBB 2024-09-22T08:36:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.553+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.7 2024-09-22T08:36:40.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _5x4eu0-msB2zm0qmoNYYvl9O8s-GXBB 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.-C-SzQDWlO3BcUKxUYs-tSY4xgbnmtu_0 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.-C-SzQDWlO3BcUKxUYs-tSY4xgbnmtu_1 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.555+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _5x4eu0-msB2zm0qmoNYYvl9O8s-GXBB 2024-09-22T08:36:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.556+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T08:36:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c057b30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17678182596955150627 2024-09-22T08:36:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c057b30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.557+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.7 2024-09-22T08:36:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17678182596955150627 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.1 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.2 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.3 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-22T08:36:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.559+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17678182596955150627 2024-09-22T08:36:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:36:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 10 manifest: total_size = 16378 2024-09-22T08:36:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1915819580818418341 2024-09-22T08:36:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.562+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.7 2024-09-22T08:36:40.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-22T08:36:40.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-22T08:36:40.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7671 2024-09-22T08:36:40.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-22T08:36:40.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7671 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1915819580818418341 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.1 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.2 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.3 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-22T08:36:40.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.565+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1915819580818418341 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.566+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.566+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfd390 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.567+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.567+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1354458018823790459 2024-09-22T08:36:40.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.567+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfd390 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.567+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.567+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.8 2024-09-22T08:36:40.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1354458018823790459 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.1 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.2 2024-09-22T08:36:40.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-22T08:36:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.3 2024-09-22T08:36:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-22T08:36:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.569+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1354458018823790459 2024-09-22T08:36:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.570+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7c061480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 10 manifest: total_size = 16378 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to _Ia5PYUWzmoSXM8WaVYQflKrej1LgIYJ 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7c061480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.571+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.8 2024-09-22T08:36:40.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: _Ia5PYUWzmoSXM8WaVYQflKrej1LgIYJ 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.IYZZOs8msdquShKc2xM-UE9rEV4hfj1_0 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.573+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _Ia5PYUWzmoSXM8WaVYQflKrej1LgIYJ 2024-09-22T08:36:40.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.574+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.511848886037254734 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.575+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17.9 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.511848886037254734 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.1 2024-09-22T08:36:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.2 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.3 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.577+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.511848886037254734 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.578+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.579+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.579+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.580+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.580+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.580+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.580+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.580+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.581+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-22T08:36:40.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.581+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.582+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=243 2024-09-22T08:36:40.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.582+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-22T08:36:40.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.582+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-22T08:36:40.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.583+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-22T08:36:40.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.583+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-22T08:36:40.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.583+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94621413394288 notifier 6123 bl.length()=199 2024-09-22T08:36:40.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.586+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 from cache 2024-09-22T08:36:40.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.586+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17, ofs0, ns] 2024-09-22T08:36:40.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.586+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 94621413390224 notifier 6123 bl.length()=257 2024-09-22T08:36:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.589+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 : miss 2024-09-22T08:36:40.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.589+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.590+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.590+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 info.flags=0x0 2024-09-22T08:36:40.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.590+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17 to cache LRU end 2024-09-22T08:36:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.591+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 : miss 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.591+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 info.flags=0x17 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 to cache LRU end 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.592+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 2024-09-22T08:36:40.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.593+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:36:40.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.594+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:36:40.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.595+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:36:40.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.596+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bff570 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.597+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.597+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12377123036364499294 2024-09-22T08:36:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.597+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bff570 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.597+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bb6978 2024-09-22T08:36:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.597+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15.3 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12377123036364499294 2024-09-22T08:36:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.1 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.2 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.3 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.599+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12377123036364499294 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 10 manifest: total_size = 541681 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8867620006619743517 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a740e7810 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bb6978 2024-09-22T08:36:40.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.601+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15.5 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-22T08:36:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8867620006619743517 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.1 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.2 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.3 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.604+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8867620006619743517 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c050d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 10 manifest: total_size = 11534336 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5123027321257605170 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c050d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560ec3bb6978 s->prefetch_data=0 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bb6978 2024-09-22T08:36:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.605+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15.7 2024-09-22T08:36:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T08:36:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5123027321257605170 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.1 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.2 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.3 2024-09-22T08:36:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-22T08:36:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.608+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5123027321257605170 2024-09-22T08:36:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.609+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:36:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.609+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.609+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.610+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.610+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.610+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.610+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.610+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.611+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-22T08:36:40.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.611+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.612+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=238 2024-09-22T08:36:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.612+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-22T08:36:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.612+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-22T08:36:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.613+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-22T08:36:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.613+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-22T08:36:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.613+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94621413399712 notifier 6123 bl.length()=194 2024-09-22T08:36:40.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.615+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 from cache 2024-09-22T08:36:40.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.615+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15, ofs0, ns] 2024-09-22T08:36:40.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.616+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94621413390224 notifier 6123 bl.length()=252 2024-09-22T08:36:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.619+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 : miss 2024-09-22T08:36:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.619+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.619+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.619+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 info.flags=0x0 2024-09-22T08:36:40.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.619+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15 to cache LRU end 2024-09-22T08:36:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.621+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 : miss 2024-09-22T08:36:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.621+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=450 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 info.flags=0x17 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 to cache LRU end 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.622+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 2024-09-22T08:36:40.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.623+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T08:36:40.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.624+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T08:36:40.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.625+0000 7f1a8302f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T08:36:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c28c40 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 10 manifest: total_size = 10485760 2024-09-22T08:36:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16999782863712473876 2024-09-22T08:36:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c28c40 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.626+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14.3 2024-09-22T08:36:40.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16999782863712473876 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.gaDfhhUAbtHrHgXAeGJ5Ed_lmZLXtnu_0 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.gaDfhhUAbtHrHgXAeGJ5Ed_lmZLXtnu_1 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-22T08:36:40.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.628+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16999782863712473876 2024-09-22T08:36:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.629+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T08:36:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406ddf0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 10 manifest: total_size = 53505 2024-09-22T08:36:40.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9918956401586122000 2024-09-22T08:36:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7406ddf0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.630+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14.5 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=53505 stripe_ofs=53505 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9918956401586122000 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.cfqrh0mdElmg-PytcrWiG7jgPnZxXKl_0 2024-09-22T08:36:40.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-22T08:36:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.633+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9918956401586122000 2024-09-22T08:36:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f19577fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T08:36:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bb87e0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 10 manifest: total_size = 10485760 2024-09-22T08:36:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6484337337564679278 2024-09-22T08:36:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bb87e0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560ec3bfddb8 s->prefetch_data=0 2024-09-22T08:36:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3bfddb8 2024-09-22T08:36:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.634+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14.7 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.636+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.636+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6484337337564679278 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.NUBoxh6wXiDjIm4Ab1MqQ1-w2bHnv5t_0 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.NUBoxh6wXiDjIm4Ab1MqQ1-w2bHnv5t_1 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-22T08:36:40.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.637+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6484337337564679278 2024-09-22T08:36:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.638+0000 7f1957fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T08:36:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.638+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.638+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.639+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.639+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.639+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.639+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.639+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.640+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-22T08:36:40.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.640+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.641+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=228 2024-09-22T08:36:40.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.641+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-22T08:36:40.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.641+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-22T08:36:40.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.642+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-22T08:36:40.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.642+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-22T08:36:40.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.642+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94621413390224 notifier 6123 bl.length()=184 2024-09-22T08:36:40.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.644+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 from cache 2024-09-22T08:36:40.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.644+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14, ofs0, ns] 2024-09-22T08:36:40.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.645+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562443 cookie 94621413383232 notifier 6123 bl.length()=242 2024-09-22T08:36:40.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.648+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 : miss 2024-09-22T08:36:40.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.648+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.648+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.648+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 info.flags=0x0 2024-09-22T08:36:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.648+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14 to cache LRU end 2024-09-22T08:36:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.650+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 : miss 2024-09-22T08:36:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.650+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 info.flags=0x17 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 to cache LRU end 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.651+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 2024-09-22T08:36:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.653+0000 7f1a8302f800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:36:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.653+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:36:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.654+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:36:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.655+0000 7f1a8302f800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06800 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 10 manifest: total_size = 0 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1913748269386355427 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c06800 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.656+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7.2 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfd540 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 10 manifest: total_size = 0 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10010516167893102163 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3bfd540 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.659+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7.3 2024-09-22T08:36:40.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.660+0000 7f19577fe640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:36:40.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.661+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1a8302f800 10 manifest: total_size = 0 2024-09-22T08:36:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2818223724811934780 2024-09-22T08:36:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a6c0239a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7.6 2024-09-22T08:36:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.662+0000 7f1957fff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:36:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.664+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7c05dfd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.665+0000 7f1a8302f800 10 manifest: total_size = 0 2024-09-22T08:36:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.665+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12973457646121078089 2024-09-22T08:36:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.665+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7c05dfd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.665+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.665+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7.8 2024-09-22T08:36:40.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.666+0000 7f19577fe640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:36:40.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.667+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.667+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f19577fe640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:36:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.669+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.671+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-22T08:36:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.671+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.671+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:36:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.671+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-22T08:36:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.671+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-22T08:36:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.672+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-22T08:36:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.672+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-22T08:36:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.673+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 94621413383232 notifier 6123 bl.length()=181 2024-09-22T08:36:40.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.675+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 from cache 2024-09-22T08:36:40.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.675+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7, ofs0, ns] 2024-09-22T08:36:40.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.676+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 94621413383232 notifier 6123 bl.length()=238 2024-09-22T08:36:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.679+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 : miss 2024-09-22T08:36:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.679+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.679+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.679+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 info.flags=0x0 2024-09-22T08:36:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.679+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7 to cache LRU end 2024-09-22T08:36:40.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.681+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 : miss 2024-09-22T08:36:40.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.681+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 info.flags=0x17 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 to cache LRU end 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.682+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 2024-09-22T08:36:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.683+0000 7f1a8302f800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:36:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.683+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:36:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.684+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:36:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.685+0000 7f1a8302f800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 10 manifest: total_size = 38 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14528430930489427833 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.686+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8.2 2024-09-22T08:36:40.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14528430930489427833 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.CWn96TBEiamV-tJPJNmKJc-cZj4KYrq_0 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.688+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14528430930489427833 2024-09-22T08:36:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.689+0000 7f1957fff640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:36:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 10 manifest: total_size = 527 2024-09-22T08:36:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14726001015127537213 2024-09-22T08:36:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a6f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.690+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8.3 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14726001015127537213 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.BB7rdfaLz4kQ-QpQDmB8wVmoDVlSkWz_0 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.693+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14726001015127537213 2024-09-22T08:36:40.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f19577fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:36:40.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 10 manifest: total_size = 38 2024-09-22T08:36:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.958283340596782144 2024-09-22T08:36:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.694+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8.6 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.958283340596782144 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.x6Da4uaoejJA3_-miFraxKKNi9AMEu__0 2024-09-22T08:36:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-22T08:36:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.697+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.958283340596782144 2024-09-22T08:36:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.698+0000 7f1957fff640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:36:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.698+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.699+0000 7f1a8302f800 10 manifest: total_size = 524288 2024-09-22T08:36:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.699+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15294605432572947880 2024-09-22T08:36:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.699+0000 7f1a8302f800 20 get_obj_state: octx=0x7f1a7405a5d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560ec3c08848 s->prefetch_data=0 2024-09-22T08:36:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.699+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c08848 2024-09-22T08:36:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.699+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8.8 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15294605432572947880 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.kn7sXQwC_55LKbVdtEn2FsFyxBSfPlK_0 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.701+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15294605432572947880 2024-09-22T08:36:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.702+0000 7f19577fe640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:36:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.702+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.702+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.703+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.703+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.703+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.703+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.703+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.705+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-22T08:36:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.705+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.705+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:36:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.705+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-22T08:36:40.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.705+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-22T08:36:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.706+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-22T08:36:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.706+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-22T08:36:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.707+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 94621413383232 notifier 6123 bl.length()=181 2024-09-22T08:36:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.709+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 from cache 2024-09-22T08:36:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.709+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8, ofs0, ns] 2024-09-22T08:36:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.709+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94621413383232 notifier 6123 bl.length()=238 2024-09-22T08:36:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.712+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 : miss 2024-09-22T08:36:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.712+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.713+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.713+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 info.flags=0x0 2024-09-22T08:36:40.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.713+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8 to cache LRU end 2024-09-22T08:36:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 : miss 2024-09-22T08:36:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T08:36:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 info.flags=0x17 2024-09-22T08:36:40.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 to cache LRU end 2024-09-22T08:36:40.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:40.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T08:36:40.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.715+0000 7f1a8302f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 2024-09-22T08:36:40.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.716+0000 7f1a8302f800 10 cls_bucket_list_unordered: got ___ 2024-09-22T08:36:40.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.717+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T08:36:40.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.718+0000 7f1a8302f800 10 cls_bucket_list_unordered: got __ 2024-09-22T08:36:40.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.719+0000 7f1a8302f800 10 cls_bucket_list_unordered: got obj 2024-09-22T08:36:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.719+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.720+0000 7f1a8302f800 10 manifest: total_size = 49187 2024-09-22T08:36:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.720+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1529601610199811943 2024-09-22T08:36:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.720+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.720+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c138e8 2024-09-22T08:36:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.720+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9.2 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1529601610199811943 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.fzbsHA_xphHmN7QeKRQItMXheFFMlN3_0 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.722+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1529601610199811943 2024-09-22T08:36:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.723+0000 7f1957fff640 20 handle_completion(): completion ok for obj=___ 2024-09-22T08:36:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 10 manifest: total_size = 4134 2024-09-22T08:36:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2096373681473584530 2024-09-22T08:36:40.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c138e8 2024-09-22T08:36:40.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.724+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9.3 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2096373681473584530 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.ZjFTfPGm5o9BygtZPXhCLtBYy5u1mAr_0 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.726+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2096373681473584530 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.727+0000 7f19577fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 10 manifest: total_size = 4134 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6797888531450290566 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c04b70 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c138e8 2024-09-22T08:36:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.728+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9.6 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6797888531450290566 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.wjumyeMRsWIR1wQiNXbv95XGkOqV05Y_0 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.731+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6797888531450290566 2024-09-22T08:36:40.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1957fff640 20 handle_completion(): completion ok for obj=__ 2024-09-22T08:36:40.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c060d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 10 manifest: total_size = 55 2024-09-22T08:36:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18439069729583001442 2024-09-22T08:36:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 20 get_obj_state: octx=0x560ec3c060d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560ec3c138e8 s->prefetch_data=0 2024-09-22T08:36:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 20 prepare_atomic_modification: state is not atomic. state=0x560ec3c138e8 2024-09-22T08:36:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.732+0000 7f1a8302f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9.8 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18439069729583001442 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.PQMdfHyr-CRcq8Av_7EAJfKWEcvOp-c_0 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T08:36:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.735+0000 7f1a8302f800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18439069729583001442 2024-09-22T08:36:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.736+0000 7f19577fe640 20 handle_completion(): completion ok for obj=obj 2024-09-22T08:36:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.736+0000 7f1a8302f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:36:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.736+0000 7f1a8302f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:36:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.737+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:36:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.737+0000 7f1a8302f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:36:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.737+0000 7f1a8302f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:36:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.737+0000 7f1a8302f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:36:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.737+0000 7f1a8302f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9])"; uploads.size()=0; is_truncated=0 2024-09-22T08:36:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.739+0000 7f1a8302f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-22T08:36:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.739+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.739+0000 7f1a8302f800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T08:36:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.739+0000 7f1a8302f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-22T08:36:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.739+0000 7f1a8302f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-22T08:36:40.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.740+0000 7f1a8302f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-22T08:36:40.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.740+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-22T08:36:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.741+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94621413383232 notifier 6123 bl.length()=181 2024-09-22T08:36:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.743+0000 7f1a8302f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 from cache 2024-09-22T08:36:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.743+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9, ofs0, ns] 2024-09-22T08:36:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.743+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 94621413383232 notifier 6123 bl.length()=238 2024-09-22T08:36:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.749+0000 7f1a8302f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 : miss 2024-09-22T08:36:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.749+0000 7f1a8302f800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.749+0000 7f1a8302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.749+0000 7f1a8302f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 info.flags=0x0 2024-09-22T08:36:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.749+0000 7f1a8302f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9 to cache LRU end 2024-09-22T08:36:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.751+0000 7f1a8302f800 10 removing key index: QFXEJLUCKFRHEPHQXRHP 2024-09-22T08:36:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.752+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:QFXEJLUCKFRHEPHQXRHP, ofs0, ns] 2024-09-22T08:36:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.752+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94621413402400 notifier 6123 bl.length()=170 2024-09-22T08:36:40.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.754+0000 7f1a8302f800 10 removing email index: ragweed.client.0+test@test.test 2024-09-22T08:36:40.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.754+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T08:36:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.755+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94621413390224 notifier 6123 bl.length()=182 2024-09-22T08:36:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.756+0000 7f1a8302f800 10 removing user buckets index 2024-09-22T08:36:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.757+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-22T08:36:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.757+0000 7f19577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 94621413399712 notifier 6123 bl.length()=173 2024-09-22T08:36:40.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.758+0000 7f1a8302f800 10 removing user index: ragweed.client.0 2024-09-22T08:36:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.759+0000 7f1a8302f800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-22T08:36:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.759+0000 7f1a8302f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T08:36:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.759+0000 7f1957fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94621413397024 notifier 6123 bl.length()=165 2024-09-22T08:36:40.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.763+0000 7f19377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:40.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.766+0000 7f1a8302f800 20 remove_watcher() i=0 2024-09-22T08:36:40.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.766+0000 7f1a8302f800 2 removed watcher, disabling cache 2024-09-22T08:36:40.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.767+0000 7f1a8302f800 20 remove_watcher() i=1 2024-09-22T08:36:40.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.768+0000 7f1a8302f800 20 remove_watcher() i=2 2024-09-22T08:36:40.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.769+0000 7f1a8302f800 20 remove_watcher() i=3 2024-09-22T08:36:40.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.770+0000 7f1a8302f800 20 remove_watcher() i=4 2024-09-22T08:36:40.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.771+0000 7f1a8302f800 20 remove_watcher() i=5 2024-09-22T08:36:40.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.772+0000 7f1a8302f800 20 remove_watcher() i=6 2024-09-22T08:36:40.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.773+0000 7f1a8302f800 20 remove_watcher() i=7 2024-09-22T08:36:40.784 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-22T08:36:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:36:40.884 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:36:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.873+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 realm 2024-09-22T08:36:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.875+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.876+0000 7f23b3f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:40.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.876+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:40.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.877+0000 7f23b3f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:36:40.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.877+0000 7f23b3f20800 20 searching for the correct realm 2024-09-22T08:36:40.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:40.879+0000 7f23b0303640 0 -- 172.21.15.78:0/2958646995 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f239807d020 msgr2=0x7f2398001930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.085+0000 7f23af301640 0 -- 172.21.15.78:0/2958646995 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f23a0028bc0 msgr2=0x7f23a0047430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:36:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.090+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 zone default found 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 4 Realm: () 2024-09-22T08:36:41.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 zonegroup default 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.091+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.092+0000 7f23b3f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.092+0000 7f23b3f20800 20 started sync module instance, tier type = 2024-09-22T08:36:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.092+0000 7f23b3f20800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:36:41.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=0 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=1 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=2 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=3 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=4 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=5 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.100+0000 7f23b3f20800 20 add_watcher() i=6 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.101+0000 7f23b3f20800 20 add_watcher() i=7 2024-09-22T08:36:41.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.101+0000 7f23b3f20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:36:41.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.103+0000 7f2265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.103+0000 7f23b3f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:36:41.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.103+0000 7f23b3f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:36:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f2264fe1640 20 reqs_thread_entry: start 2024-09-22T08:36:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f23b3f20800 20 init_complete bucket index max shards: 11 2024-09-22T08:36:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f23b3f20800 20 Filter name: none 2024-09-22T08:36:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f21de7fc640 20 reqs_thread_entry: start 2024-09-22T08:36:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f23b3f20800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T08:36:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.138+0000 7f23b3f20800 20 rados->read ofs=0 len=0 2024-09-22T08:36:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.139+0000 7f23b3f20800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:36:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.139+0000 7f23b3f20800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-22T08:36:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.139+0000 7f23b3f20800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T08:36:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.139+0000 7f23b3f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:36:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.139+0000 7f23b3f20800 10 removing key index: BCICLBZQBVMQNWLKUDBH 2024-09-22T08:36:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.140+0000 7f23b3f20800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:BCICLBZQBVMQNWLKUDBH, ofs0, ns] 2024-09-22T08:36:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.140+0000 7f228effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562381 cookie 93861061073456 notifier 6141 bl.length()=170 2024-09-22T08:36:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.142+0000 7f23b3f20800 10 removing email index: sysuser.client.0+test@test.test 2024-09-22T08:36:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.143+0000 7f23b3f20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T08:36:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.143+0000 7f228effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 93861061076224 notifier 6141 bl.length()=182 2024-09-22T08:36:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.144+0000 7f23b3f20800 10 removing user buckets index 2024-09-22T08:36:41.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.145+0000 7f23b3f20800 10 removing user index: sysuser.client.0 2024-09-22T08:36:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.146+0000 7f23b3f20800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-22T08:36:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.146+0000 7f23b3f20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T08:36:41.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.147+0000 7f228e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 93861061072400 notifier 6141 bl.length()=165 2024-09-22T08:36:41.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.148+0000 7f2265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:36:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.151+0000 7f23b3f20800 20 remove_watcher() i=0 2024-09-22T08:36:41.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.151+0000 7f23b3f20800 2 removed watcher, disabling cache 2024-09-22T08:36:41.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.152+0000 7f23b3f20800 20 remove_watcher() i=1 2024-09-22T08:36:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.152+0000 7f23b3f20800 20 remove_watcher() i=2 2024-09-22T08:36:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.153+0000 7f23b3f20800 20 remove_watcher() i=3 2024-09-22T08:36:41.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.154+0000 7f23b3f20800 20 remove_watcher() i=4 2024-09-22T08:36:41.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.155+0000 7f23b3f20800 20 remove_watcher() i=5 2024-09-22T08:36:41.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.156+0000 7f23b3f20800 20 remove_watcher() i=6 2024-09-22T08:36:41.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:36:41.157+0000 7f23b3f20800 20 remove_watcher() i=7 2024-09-22T08:36:41.169 INFO:tasks.ragweed:Removing ragweed... 2024-09-22T08:36:41.169 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T08:36:41.250 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:36:41.260 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:36:41.260 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:36:41.260 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:36:41.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:36:41.289 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:36:41.290 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:36:41.358 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:36:41.358 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:36:41.427 INFO:tasks.workunit:timeout=3h 2024-09-22T08:36:41.427 INFO:tasks.workunit:cleanup=True 2024-09-22T08:36:41.428 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:36:41.497 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:37:41.073 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:41.074 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:37:41.078 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:37:41.147 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:37:41.149 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:37:41.149 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:37:41.198 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:37:41.246 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:37:41.285 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:37:41.286 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:37:41.287 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:37:41.326 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:37:41.329 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:37:41.329 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:37:41.398 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-22T08:37:41.399 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-22T08:37:41.399 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T08:37:41.472 INFO:tasks.workunit.client.0.smithi078.stderr:+ ulimit -c 0 2024-09-22T08:37:41.472 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T08:37:41.472 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:37:41.472 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:37:43.749 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:37:43.750 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:37:43.750 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:37:43.750 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T08:37:43.751 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-22T08:37:43.976 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:37:44.158 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-22T08:37:44.163 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:37:44.208 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-22T08:37:44.208 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-22T08:37:44.208 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:37:44.361 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:37:44.366 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:37:45.107 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-22T08:37:45.156 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-22T08:37:45.924 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-22T08:37:45.925 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:37:46.469 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:37:46.470 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:37:46.518 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:37:46.519 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:37:46.564 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:37:46.566 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:37:46.616 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:37:46.617 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:37:46.693 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:37:46.694 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:37:46.888 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:37:46.890 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:37:46.894 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:37:46.895 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:37:46.905 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:37:46.906 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:37:46.907 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:37:46.909 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:37:46.910 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:37:46.983 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:37:47.992 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:37:48.109 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-22T08:37:48.231 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-22T08:37:48.265 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.266 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.303+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.304+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.304+0000 7f778fd23800 20 realm 2024-09-22T08:37:48.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.304+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.305+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.305+0000 7f778fd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.305+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.305+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.305+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.306+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.306+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.307+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:48.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.307+0000 7f778fd23800 20 searching for the correct realm 2024-09-22T08:37:48.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.309+0000 7f778c1af640 0 -- 172.21.15.78:0/3043890344 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f778000b040 msgr2=0x7f7780060600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:48.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.515+0000 7f778b1ad640 0 -- 172.21.15.78:0/3043890344 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7784050040 msgr2=0x7f7784051940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:48.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.521+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 zone default found 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 4 Realm: () 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 zonegroup default 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 started sync module instance, tier type = 2024-09-22T08:37:48.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.522+0000 7f778fd23800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=0 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=1 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=2 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=3 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=4 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=5 2024-09-22T08:37:48.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.533+0000 7f778fd23800 20 add_watcher() i=6 2024-09-22T08:37:48.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.534+0000 7f778fd23800 20 add_watcher() i=7 2024-09-22T08:37:48.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.534+0000 7f778fd23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:48.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f7641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f778fd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f778fd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f778fd23800 5 note: GC not initialized 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f7640fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.536+0000 7f778fd23800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 20 Filter name: none 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f75ba7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-22T08:37:48.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.537+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=22 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 20 rados_obj.operate() r=0 bl.length=420 2024-09-22T08:37:48.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.538+0000 7f778fd23800 20 get_user_info_from_index found 0 xattrs 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-22T08:37:48.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.539+0000 7f7641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:48.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.543+0000 7f778fd23800 20 remove_watcher() i=0 2024-09-22T08:37:48.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.543+0000 7f778fd23800 2 removed watcher, disabling cache 2024-09-22T08:37:48.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.544+0000 7f778fd23800 20 remove_watcher() i=1 2024-09-22T08:37:48.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.546+0000 7f778fd23800 20 remove_watcher() i=2 2024-09-22T08:37:48.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.547+0000 7f778fd23800 20 remove_watcher() i=3 2024-09-22T08:37:48.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.548+0000 7f778fd23800 20 remove_watcher() i=4 2024-09-22T08:37:48.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.549+0000 7f778fd23800 20 remove_watcher() i=5 2024-09-22T08:37:48.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.550+0000 7f778fd23800 20 remove_watcher() i=6 2024-09-22T08:37:48.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.551+0000 7f778fd23800 20 remove_watcher() i=7 2024-09-22T08:37:48.924 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard add 2024-09-22T08:37:48.924 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:48.926 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:48.953 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:48.953 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:48.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.989+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 realm 2024-09-22T08:37:48.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.991+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.992+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:48.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.992+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:48.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.993+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:48.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.993+0000 7fe8fad25800 20 searching for the correct realm 2024-09-22T08:37:48.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.996+0000 7fe8f6933640 0 -- 172.21.15.78:0/341588238 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55bc71617630 msgr2=0x55bc71619af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:48.999+0000 7fe8f6933640 0 -- 172.21.15.78:0/341588238 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55bc7160ae00 msgr2=0x55bc7160d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.003+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 zone default found 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 4 Realm: () 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 zonegroup default 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.004+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.005+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.005+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.005+0000 7fe8fad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.005+0000 7fe8fad25800 20 started sync module instance, tier type = 2024-09-22T08:37:49.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.005+0000 7fe8fad25800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:49.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=0 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=1 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=2 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=3 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=4 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=5 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.014+0000 7fe8fad25800 20 add_watcher() i=6 2024-09-22T08:37:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.015+0000 7fe8fad25800 20 add_watcher() i=7 2024-09-22T08:37:49.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.015+0000 7fe8fad25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.017+0000 7fe7ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 5 note: GC not initialized 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe727fff640 20 reqs_thread_entry: start 2024-09-22T08:37:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 20 Filter name: none 2024-09-22T08:37:49.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe725ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:49.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.018+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.019+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.019+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.019+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.019+0000 7fe8fad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.019+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.020+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.020+0000 7fe8fad25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.020+0000 7fe8fad25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:49.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.020+0000 7fe8fad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:49.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.022+0000 7fe7ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.024+0000 7fe8fad25800 20 remove_watcher() i=0 2024-09-22T08:37:49.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.024+0000 7fe8fad25800 2 removed watcher, disabling cache 2024-09-22T08:37:49.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.025+0000 7fe8fad25800 20 remove_watcher() i=1 2024-09-22T08:37:49.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.026+0000 7fe8fad25800 20 remove_watcher() i=2 2024-09-22T08:37:49.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.027+0000 7fe8fad25800 20 remove_watcher() i=3 2024-09-22T08:37:49.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.028+0000 7fe8fad25800 20 remove_watcher() i=4 2024-09-22T08:37:49.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.029+0000 7fe8fad25800 20 remove_watcher() i=5 2024-09-22T08:37:49.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.030+0000 7fe8fad25800 20 remove_watcher() i=6 2024-09-22T08:37:49.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.031+0000 7fe8fad25800 20 remove_watcher() i=7 2024-09-22T08:37:49.042 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:49.042 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:49.042 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-22T08:37:49.043 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:49.044 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-22T08:37:49.074 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.074 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.111+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 realm 2024-09-22T08:37:49.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.113+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.114+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.114+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.115+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.115+0000 7effb1142800 20 searching for the correct realm 2024-09-22T08:37:49.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.116+0000 7efface86640 0 -- 172.21.15.78:0/2524208870 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x5641890f11d0 msgr2=0x5641890f3690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.119+0000 7efface86640 0 -- 172.21.15.78:0/2524208870 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7eff9c0ae420 msgr2=0x7eff9c0bfa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.126+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 zone default found 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 4 Realm: () 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 zonegroup default 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.127+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.128+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.128+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.128+0000 7effb1142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.128+0000 7effb1142800 20 started sync module instance, tier type = 2024-09-22T08:37:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.128+0000 7effb1142800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=0 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=1 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=2 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=3 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=4 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=5 2024-09-22T08:37:49.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.137+0000 7effb1142800 20 add_watcher() i=6 2024-09-22T08:37:49.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.138+0000 7effb1142800 20 add_watcher() i=7 2024-09-22T08:37:49.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.138+0000 7effb1142800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.139+0000 7efe62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.139+0000 7effb1142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.139+0000 7effb1142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 5 note: GC not initialized 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7efe61fe3640 20 reqs_thread_entry: start 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 20 Filter name: none 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7efdd37fe640 20 reqs_thread_entry: start 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:49.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:49.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:49.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:49.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.140+0000 7effb1142800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.141+0000 7effb1142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.143+0000 7efe62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.145+0000 7effb1142800 20 remove_watcher() i=0 2024-09-22T08:37:49.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.145+0000 7effb1142800 2 removed watcher, disabling cache 2024-09-22T08:37:49.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.146+0000 7effb1142800 20 remove_watcher() i=1 2024-09-22T08:37:49.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.147+0000 7effb1142800 20 remove_watcher() i=2 2024-09-22T08:37:49.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.148+0000 7effb1142800 20 remove_watcher() i=3 2024-09-22T08:37:49.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.149+0000 7effb1142800 20 remove_watcher() i=4 2024-09-22T08:37:49.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.150+0000 7effb1142800 20 remove_watcher() i=5 2024-09-22T08:37:49.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.151+0000 7effb1142800 20 remove_watcher() i=6 2024-09-22T08:37:49.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.152+0000 7effb1142800 20 remove_watcher() i=7 2024-09-22T08:37:49.165 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard list 2024-09-22T08:37:49.192 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.192 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.228+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 realm 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.230+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.231+0000 7f1c89526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.231+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.231+0000 7f1c89526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.232+0000 7f1c89526800 20 searching for the correct realm 2024-09-22T08:37:49.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.232+0000 7f1c849d8640 0 -- 172.21.15.78:0/1174441429 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f1c7806a070 msgr2=0x7f1c780a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.437+0000 7f1c851d9640 0 -- 172.21.15.78:0/1174441429 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x563904848aa0 msgr2=0x56390484af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 zone default found 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 4 Realm: () 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 zonegroup default 2024-09-22T08:37:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.443+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 started sync module instance, tier type = 2024-09-22T08:37:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.444+0000 7f1c89526800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=0 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=1 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=2 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=3 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=4 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=5 2024-09-22T08:37:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.454+0000 7f1c89526800 20 add_watcher() i=6 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.455+0000 7f1c89526800 20 add_watcher() i=7 2024-09-22T08:37:49.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.455+0000 7f1c89526800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.456+0000 7f1b3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1c89526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1c89526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1c89526800 5 note: GC not initialized 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1b3a7e4640 20 reqs_thread_entry: start 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1c89526800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1c89526800 20 Filter name: none 2024-09-22T08:37:49.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.457+0000 7f1aabfff640 20 reqs_thread_entry: start 2024-09-22T08:37:49.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.464+0000 7f1b3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.465+0000 7f1c89526800 20 remove_watcher() i=0 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.466+0000 7f1c89526800 2 removed watcher, disabling cache 2024-09-22T08:37:49.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.466+0000 7f1c89526800 20 remove_watcher() i=1 2024-09-22T08:37:49.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.468+0000 7f1c89526800 20 remove_watcher() i=2 2024-09-22T08:37:49.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.469+0000 7f1c89526800 20 remove_watcher() i=3 2024-09-22T08:37:49.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.469+0000 7f1c89526800 20 remove_watcher() i=4 2024-09-22T08:37:49.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.470+0000 7f1c89526800 20 remove_watcher() i=5 2024-09-22T08:37:49.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.471+0000 7f1c89526800 20 remove_watcher() i=6 2024-09-22T08:37:49.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.472+0000 7f1c89526800 20 remove_watcher() i=7 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi078.stderr:bucket name a-bucket 2024-09-22T08:37:49.483 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard process 2024-09-22T08:37:49.484 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard process 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:49.512 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:49.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.548+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 realm 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.550+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.551+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.551+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.552+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:49.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.552+0000 7fdfcc22f800 20 searching for the correct realm 2024-09-22T08:37:49.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.554+0000 7fdfca51a640 0 -- 172.21.15.78:0/3165701702 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x55831c605c50 msgr2=0x7fdfb4041980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.760+0000 7fdfc1518640 0 -- 172.21.15.78:0/3165701702 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fdfc4061040 msgr2=0x7fdfc40a4dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:49.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:49.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:49.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:49.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.765+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:49.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 zone default found 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 4 Realm: () 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 zonegroup default 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.766+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.767+0000 7fdfcc22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.767+0000 7fdfcc22f800 20 started sync module instance, tier type = 2024-09-22T08:37:49.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.767+0000 7fdfcc22f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=0 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=1 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=2 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=3 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=4 2024-09-22T08:37:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=5 2024-09-22T08:37:49.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.777+0000 7fdfcc22f800 20 add_watcher() i=6 2024-09-22T08:37:49.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.778+0000 7fdfcc22f800 20 add_watcher() i=7 2024-09-22T08:37:49.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.778+0000 7fdfcc22f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:49.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fde7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:49.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 5 note: GC not initialized 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fde7a7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 20 Filter name: none 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fddebfff640 20 reqs_thread_entry: start 2024-09-22T08:37:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.780+0000 7fdfcc22f800 20 processing logshard = reshard.0000000000 2024-09-22T08:37:49.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.783+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T08:37:49.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.783+0000 7fdfcc22f800 20 processing logshard = reshard.0000000001 2024-09-22T08:37:49.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.786+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T08:37:49.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.786+0000 7fdfcc22f800 20 processing logshard = reshard.0000000002 2024-09-22T08:37:49.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.788+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T08:37:49.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.788+0000 7fdfcc22f800 20 processing logshard = reshard.0000000003 2024-09-22T08:37:49.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.791+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T08:37:49.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.791+0000 7fdfcc22f800 20 processing logshard = reshard.0000000004 2024-09-22T08:37:49.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.793+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T08:37:49.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.793+0000 7fdfcc22f800 20 processing logshard = reshard.0000000005 2024-09-22T08:37:49.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.795+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T08:37:49.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.795+0000 7fdfcc22f800 20 processing logshard = reshard.0000000006 2024-09-22T08:37:49.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.797+0000 7fdfcc22f800 20 process_entry resharding a-bucket 2024-09-22T08:37:49.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.797+0000 7fdfcc22f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:49.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.797+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:49.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T08:37:49.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:49.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:37:49.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:49.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:49.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:49.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.798+0000 7fdfcc22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:49.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdfcc22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdfcc22f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdfcc22f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdfcc22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:49.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdead7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 94021605345936 notifier 6228 bl.length()=911 2024-09-22T08:37:49.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdead7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdead7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.804+0000 7fdead7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.806+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:49.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.806+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:49.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.806+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:49.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.806+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:49.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.0 2024-09-22T08:37:49.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.810+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1 2024-09-22T08:37:49.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.811+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2 2024-09-22T08:37:49.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.811+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3 2024-09-22T08:37:49.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.811+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.4 2024-09-22T08:37:49.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.812+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.5 2024-09-22T08:37:49.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.812+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.6 2024-09-22T08:37:49.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.813+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.7 2024-09-22T08:37:49.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.814+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.8 2024-09-22T08:37:49.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.814+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.9 2024-09-22T08:37:49.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.814+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.10 2024-09-22T08:37:49.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.815+0000 7fdfcc22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:49.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.815+0000 7fdfcc22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdfcc22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdfcc22f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdfcc22f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdfcc22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:49.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdeacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94021605345936 notifier 6228 bl.length()=911 2024-09-22T08:37:49.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdeacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdeacff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.816+0000 7fdeacff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.818+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:49.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.818+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:49.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.818+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:49.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.818+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:49.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.820+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.0 2024-09-22T08:37:49.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.820+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1 2024-09-22T08:37:49.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.821+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2 2024-09-22T08:37:49.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.821+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3 2024-09-22T08:37:49.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.821+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.4 2024-09-22T08:37:49.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.821+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.5 2024-09-22T08:37:49.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.822+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.6 2024-09-22T08:37:49.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.822+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.7 2024-09-22T08:37:49.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.822+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.8 2024-09-22T08:37:49.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.823+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.9 2024-09-22T08:37:49.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.823+0000 7fdfcc22f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.10 2024-09-22T08:37:49.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.823+0000 7fdfcc22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:49.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.823+0000 7fdfcc22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:49.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.824+0000 7fdfcc22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.824+0000 7fdfcc22f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.824+0000 7fdfcc22f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.824+0000 7fdfcc22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.825+0000 7fdeacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562456 cookie 94021605345936 notifier 6228 bl.length()=879 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.825+0000 7fdeacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.825+0000 7fdeacff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.825+0000 7fdeacff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:49.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.826+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:49.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.826+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:49.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.826+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:49.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.826+0000 7fdfcc22f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:49.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.828+0000 7fdfcc22f800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:49.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.829+0000 7fdfcc22f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T08:37:49.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.831+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T08:37:49.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.831+0000 7fdfcc22f800 20 processing logshard = reshard.0000000007 2024-09-22T08:37:49.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.833+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T08:37:49.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.833+0000 7fdfcc22f800 20 processing logshard = reshard.0000000008 2024-09-22T08:37:49.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.835+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T08:37:49.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.835+0000 7fdfcc22f800 20 processing logshard = reshard.0000000009 2024-09-22T08:37:49.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.837+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T08:37:49.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.837+0000 7fdfcc22f800 20 processing logshard = reshard.0000000010 2024-09-22T08:37:49.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.840+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T08:37:49.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.840+0000 7fdfcc22f800 20 processing logshard = reshard.0000000011 2024-09-22T08:37:49.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.842+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T08:37:49.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.842+0000 7fdfcc22f800 20 processing logshard = reshard.0000000012 2024-09-22T08:37:49.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.844+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T08:37:49.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.844+0000 7fdfcc22f800 20 processing logshard = reshard.0000000013 2024-09-22T08:37:49.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.847+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T08:37:49.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.847+0000 7fdfcc22f800 20 processing logshard = reshard.0000000014 2024-09-22T08:37:49.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.849+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T08:37:49.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.849+0000 7fdfcc22f800 20 processing logshard = reshard.0000000015 2024-09-22T08:37:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.851+0000 7fdfcc22f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T08:37:49.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.852+0000 7fde7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.855+0000 7fdfcc22f800 20 remove_watcher() i=0 2024-09-22T08:37:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.855+0000 7fdfcc22f800 2 removed watcher, disabling cache 2024-09-22T08:37:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.856+0000 7fdfcc22f800 20 remove_watcher() i=1 2024-09-22T08:37:49.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.857+0000 7fdfcc22f800 20 remove_watcher() i=2 2024-09-22T08:37:49.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.858+0000 7fdfcc22f800 20 remove_watcher() i=3 2024-09-22T08:37:49.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.859+0000 7fdfcc22f800 20 remove_watcher() i=4 2024-09-22T08:37:49.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.860+0000 7fdfcc22f800 20 remove_watcher() i=5 2024-09-22T08:37:49.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.861+0000 7fdfcc22f800 20 remove_watcher() i=6 2024-09-22T08:37:49.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:49.862+0000 7fdfcc22f800 20 remove_watcher() i=7 2024-09-22T08:37:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:54.912 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:54.912 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:54.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.952+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 realm 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:54.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:54.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:54.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.954+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:54.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.955+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:54.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.955+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:54.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.956+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:54.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.956+0000 7fc842933800 20 searching for the correct realm 2024-09-22T08:37:54.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.958+0000 7fc835d98640 0 -- 172.21.15.78:0/1181916514 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x555ff06ac9c0 msgr2=0x555ff06aedb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:54.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:54.962+0000 7fc835d98640 0 -- 172.21.15.78:0/1181916514 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc838051960 msgr2=0x7fc838050440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.170+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:55.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 zone default found 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 4 Realm: () 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 zonegroup default 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.171+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 started sync module instance, tier type = 2024-09-22T08:37:55.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.172+0000 7fc842933800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=0 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=1 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=2 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=3 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=4 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=5 2024-09-22T08:37:55.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.182+0000 7fc842933800 20 add_watcher() i=6 2024-09-22T08:37:55.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.184+0000 7fc842933800 20 add_watcher() i=7 2024-09-22T08:37:55.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.184+0000 7fc842933800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:55.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc6f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:55.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 5 note: GC not initialized 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc66f7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 20 Filter name: none 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc66d7fa640 20 reqs_thread_entry: start 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.186+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.187+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:55.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.187+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:55.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:55.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:55.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.188+0000 7fc842933800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:55.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.189+0000 7fc842933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:55.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.190+0000 7fc6f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.193+0000 7fc842933800 20 remove_watcher() i=0 2024-09-22T08:37:55.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.193+0000 7fc842933800 2 removed watcher, disabling cache 2024-09-22T08:37:55.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.194+0000 7fc842933800 20 remove_watcher() i=1 2024-09-22T08:37:55.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.195+0000 7fc842933800 20 remove_watcher() i=2 2024-09-22T08:37:55.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.196+0000 7fc842933800 20 remove_watcher() i=3 2024-09-22T08:37:55.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.197+0000 7fc842933800 20 remove_watcher() i=4 2024-09-22T08:37:55.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.198+0000 7fc842933800 20 remove_watcher() i=5 2024-09-22T08:37:55.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.199+0000 7fc842933800 20 remove_watcher() i=6 2024-09-22T08:37:55.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.200+0000 7fc842933800 20 remove_watcher() i=7 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard add non empty bucket 2024-09-22T08:37:55.213 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.521 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:55.549 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:55.550 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:55.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.586+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 realm 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.588+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.589+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.589+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.590+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:55.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.590+0000 7fd578375800 20 searching for the correct realm 2024-09-22T08:37:55.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.592+0000 7fd576660640 0 -- 172.21.15.78:0/3471798429 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd56002f070 msgr2=0x7fd560068cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.596+0000 7fd56ffff640 0 -- 172.21.15.78:0/3471798429 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd5700b0eb0 msgr2=0x7fd5700b8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:55.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:55.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.600+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 zone default found 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 4 Realm: () 2024-09-22T08:37:55.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:55.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:55.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 zonegroup default 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.601+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.602+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.602+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.602+0000 7fd578375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.602+0000 7fd578375800 20 started sync module instance, tier type = 2024-09-22T08:37:55.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.602+0000 7fd578375800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:55.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=0 2024-09-22T08:37:55.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=1 2024-09-22T08:37:55.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=2 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=3 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=4 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=5 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.611+0000 7fd578375800 20 add_watcher() i=6 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.612+0000 7fd578375800 20 add_watcher() i=7 2024-09-22T08:37:55.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.612+0000 7fd578375800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:55.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.614+0000 7fd41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.614+0000 7fd578375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:55.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.614+0000 7fd578375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:55.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.614+0000 7fd578375800 5 note: GC not initialized 2024-09-22T08:37:55.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd41e7fc640 20 reqs_thread_entry: start 2024-09-22T08:37:55.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd578375800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd578375800 20 Filter name: none 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd397fff640 20 reqs_thread_entry: start 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.615+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:55.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.616+0000 7fd578375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:55.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.618+0000 7fd41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.620+0000 7fd578375800 20 remove_watcher() i=0 2024-09-22T08:37:55.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.620+0000 7fd578375800 2 removed watcher, disabling cache 2024-09-22T08:37:55.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.621+0000 7fd578375800 20 remove_watcher() i=1 2024-09-22T08:37:55.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.622+0000 7fd578375800 20 remove_watcher() i=2 2024-09-22T08:37:55.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.623+0000 7fd578375800 20 remove_watcher() i=3 2024-09-22T08:37:55.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.624+0000 7fd578375800 20 remove_watcher() i=4 2024-09-22T08:37:55.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.625+0000 7fd578375800 20 remove_watcher() i=5 2024-09-22T08:37:55.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.627+0000 7fd578375800 20 remove_watcher() i=6 2024-09-22T08:37:55.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.628+0000 7fd578375800 20 remove_watcher() i=7 2024-09-22T08:37:55.639 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.639 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:55.639 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-22T08:37:55.640 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.641 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-22T08:37:55.671 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:55.671 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:55.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.707+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 realm 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.709+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.710+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.710+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.711+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:55.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.711+0000 7fc788c40800 20 searching for the correct realm 2024-09-22T08:37:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.713+0000 7fc786f2b640 0 -- 172.21.15.78:0/3161758175 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fc77c078750 msgr2=0x7fc77c041a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.717+0000 7fc785f29640 0 -- 172.21.15.78:0/3161758175 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc780033060 msgr2=0x7fc780066ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:55.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:55.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:55.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:55.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:55.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:55.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.721+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 zone default found 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 4 Realm: () 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 zonegroup default 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.722+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.723+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.723+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.723+0000 7fc788c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.723+0000 7fc788c40800 20 started sync module instance, tier type = 2024-09-22T08:37:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.723+0000 7fc788c40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=0 2024-09-22T08:37:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=1 2024-09-22T08:37:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=2 2024-09-22T08:37:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=3 2024-09-22T08:37:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=4 2024-09-22T08:37:55.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=5 2024-09-22T08:37:55.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.731+0000 7fc788c40800 20 add_watcher() i=6 2024-09-22T08:37:55.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.732+0000 7fc788c40800 20 add_watcher() i=7 2024-09-22T08:37:55.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.732+0000 7fc788c40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:55.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc63cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc788c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc788c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc788c40800 5 note: GC not initialized 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc5b77fe640 20 reqs_thread_entry: start 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc788c40800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.734+0000 7fc788c40800 20 Filter name: none 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc5b57fa640 20 reqs_thread_entry: start 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:55.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.735+0000 7fc788c40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.736+0000 7fc788c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:55.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.737+0000 7fc63cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.739+0000 7fc788c40800 20 remove_watcher() i=0 2024-09-22T08:37:55.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.739+0000 7fc788c40800 2 removed watcher, disabling cache 2024-09-22T08:37:55.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.740+0000 7fc788c40800 20 remove_watcher() i=1 2024-09-22T08:37:55.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.741+0000 7fc788c40800 20 remove_watcher() i=2 2024-09-22T08:37:55.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.742+0000 7fc788c40800 20 remove_watcher() i=3 2024-09-22T08:37:55.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.743+0000 7fc788c40800 20 remove_watcher() i=4 2024-09-22T08:37:55.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.744+0000 7fc788c40800 20 remove_watcher() i=5 2024-09-22T08:37:55.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.745+0000 7fc788c40800 20 remove_watcher() i=6 2024-09-22T08:37:55.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.746+0000 7fc788c40800 20 remove_watcher() i=7 2024-09-22T08:37:55.759 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard list 2024-09-22T08:37:55.785 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:55.785 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:55.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.821+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 realm 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.823+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.824+0000 7fc7fb62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.824+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.825+0000 7fc7fb62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:55.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.825+0000 7fc7fb62f800 20 searching for the correct realm 2024-09-22T08:37:55.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.826+0000 7fc7f0918640 0 -- 172.21.15.78:0/1346768351 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fc7ec02e040 msgr2=0x7fc7ec02e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.830+0000 7fc7f0918640 0 -- 172.21.15.78:0/1346768351 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x562b8c9b18b0 msgr2=0x562b8c9b3ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.835+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 zone default found 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 4 Realm: () 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 zonegroup default 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.836+0000 7fc7fb62f800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.837+0000 7fc7fb62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.837+0000 7fc7fb62f800 20 started sync module instance, tier type = 2024-09-22T08:37:55.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.837+0000 7fc7fb62f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=0 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=1 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=2 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=3 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=4 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=5 2024-09-22T08:37:55.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.845+0000 7fc7fb62f800 20 add_watcher() i=6 2024-09-22T08:37:55.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.846+0000 7fc7fb62f800 20 add_watcher() i=7 2024-09-22T08:37:55.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.846+0000 7fc7fb62f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:55.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.847+0000 7fc6affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.847+0000 7fc7fb62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.847+0000 7fc7fb62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.847+0000 7fc7fb62f800 5 note: GC not initialized 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.847+0000 7fc6aefe5640 20 reqs_thread_entry: start 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.848+0000 7fc7fb62f800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.848+0000 7fc7fb62f800 20 Filter name: none 2024-09-22T08:37:55.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.848+0000 7fc6acfe1640 20 reqs_thread_entry: start 2024-09-22T08:37:55.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.853+0000 7fc6affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:55.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.856+0000 7fc7fb62f800 20 remove_watcher() i=0 2024-09-22T08:37:55.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.856+0000 7fc7fb62f800 2 removed watcher, disabling cache 2024-09-22T08:37:55.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.857+0000 7fc7fb62f800 20 remove_watcher() i=1 2024-09-22T08:37:55.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.858+0000 7fc7fb62f800 20 remove_watcher() i=2 2024-09-22T08:37:55.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.859+0000 7fc7fb62f800 20 remove_watcher() i=3 2024-09-22T08:37:55.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.860+0000 7fc7fb62f800 20 remove_watcher() i=4 2024-09-22T08:37:55.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.861+0000 7fc7fb62f800 20 remove_watcher() i=5 2024-09-22T08:37:55.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.862+0000 7fc7fb62f800 20 remove_watcher() i=6 2024-09-22T08:37:55.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.862+0000 7fc7fb62f800 20 remove_watcher() i=7 2024-09-22T08:37:55.874 INFO:tasks.workunit.client.0.smithi078.stderr:bucket name a-bucket 2024-09-22T08:37:55.874 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard process non empty bucket 2024-09-22T08:37:55.875 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:55.876 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard process 2024-09-22T08:37:55.902 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:55.902 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:55.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.939+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.940+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.940+0000 7fcaf0d25800 20 realm 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.940+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.941+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.941+0000 7fcaf0d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.941+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.941+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:55.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.941+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.942+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:55.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.942+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:55.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.942+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:55.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.942+0000 7fcaf0d25800 20 searching for the correct realm 2024-09-22T08:37:55.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:55.944+0000 7fcaed2a3640 0 -- 172.21.15.78:0/1662022668 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fcad4078b40 msgr2=0x7fcad4070970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:56.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.149+0000 7fcaec2a1640 0 -- 172.21.15.78:0/1662022668 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fcae4082b10 msgr2=0x7fcae406c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:56.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.154+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:56.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 zone default found 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 4 Realm: () 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 zonegroup default 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.155+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.156+0000 7fcaf0d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.156+0000 7fcaf0d25800 20 started sync module instance, tier type = 2024-09-22T08:37:56.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.156+0000 7fcaf0d25800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=0 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=1 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=2 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=3 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=4 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.164+0000 7fcaf0d25800 20 add_watcher() i=5 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.165+0000 7fcaf0d25800 20 add_watcher() i=6 2024-09-22T08:37:56.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.165+0000 7fcaf0d25800 20 add_watcher() i=7 2024-09-22T08:37:56.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.165+0000 7fcaf0d25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:56.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.167+0000 7fc9a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:56.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.167+0000 7fcaf0d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:56.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.167+0000 7fcaf0d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:56.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.167+0000 7fcaf0d25800 5 note: GC not initialized 2024-09-22T08:37:56.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.168+0000 7fc9a1fe3640 20 reqs_thread_entry: start 2024-09-22T08:37:56.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.168+0000 7fcaf0d25800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:56.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.168+0000 7fcaf0d25800 20 Filter name: none 2024-09-22T08:37:56.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.168+0000 7fc9137fe640 20 reqs_thread_entry: start 2024-09-22T08:37:56.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.168+0000 7fcaf0d25800 20 processing logshard = reshard.0000000000 2024-09-22T08:37:56.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.170+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T08:37:56.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.170+0000 7fcaf0d25800 20 processing logshard = reshard.0000000001 2024-09-22T08:37:56.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.172+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T08:37:56.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.172+0000 7fcaf0d25800 20 processing logshard = reshard.0000000002 2024-09-22T08:37:56.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.174+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T08:37:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.174+0000 7fcaf0d25800 20 processing logshard = reshard.0000000003 2024-09-22T08:37:56.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.177+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T08:37:56.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.177+0000 7fcaf0d25800 20 processing logshard = reshard.0000000004 2024-09-22T08:37:56.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.179+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T08:37:56.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.179+0000 7fcaf0d25800 20 processing logshard = reshard.0000000005 2024-09-22T08:37:56.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.182+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T08:37:56.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.182+0000 7fcaf0d25800 20 processing logshard = reshard.0000000006 2024-09-22T08:37:56.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 20 process_entry resharding a-bucket 2024-09-22T08:37:56.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:37:56.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.183+0000 7fcaf0d25800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:56.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.184+0000 7fcaf0d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:56.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.191+0000 7fcaf0d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.191+0000 7fcaf0d25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.191+0000 7fcaf0d25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.191+0000 7fcaf0d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:56.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.191+0000 7fc9c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562457 cookie 94073564273536 notifier 6318 bl.length()=911 2024-09-22T08:37:56.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.192+0000 7fc9c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.192+0000 7fc9c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.192+0000 7fc9c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.193+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:56.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.193+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:56.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.193+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:56.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.193+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:37:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:37:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:56.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.198+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.199+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.199+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.199+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.199+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.200+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.200+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:56.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.200+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.200+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.201+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.202+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.202+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.202+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.202+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.203+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.203+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:56.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.205+0000 7fcaf0d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:56.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.205+0000 7fcaf0d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fcaf0d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fcaf0d25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fcaf0d25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fcaf0d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fc9c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94073564273536 notifier 6318 bl.length()=911 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fc9c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fc9c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.207+0000 7fc9c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.208+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:56.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.208+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:56.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.208+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:56.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.208+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.0 2024-09-22T08:37:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.1 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.211+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.2 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.212+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.212+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.3 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.212+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.212+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.4 2024-09-22T08:37:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.5 2024-09-22T08:37:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.6 2024-09-22T08:37:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.213+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.7 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.8 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.9 2024-09-22T08:37:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:56.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.10 2024-09-22T08:37:56.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:56.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.214+0000 7fcaf0d25800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.1.11 2024-09-22T08:37:56.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.215+0000 7fcaf0d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:56.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.215+0000 7fcaf0d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:37:56.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fcaf0d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fcaf0d25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fcaf0d25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fcaf0d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fc9c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94073564273536 notifier 6318 bl.length()=879 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.216+0000 7fc9c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.217+0000 7fc9c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:37:56.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.217+0000 7fc9c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:37:56.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.218+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:37:56.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.218+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:37:56.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.218+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:37:56.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.218+0000 7fcaf0d25800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:37:56.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.220+0000 7fcaf0d25800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-22T08:37:56.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.221+0000 7fcaf0d25800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T08:37:56.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.223+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T08:37:56.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.223+0000 7fcaf0d25800 20 processing logshard = reshard.0000000007 2024-09-22T08:37:56.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.225+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T08:37:56.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.225+0000 7fcaf0d25800 20 processing logshard = reshard.0000000008 2024-09-22T08:37:56.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.227+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T08:37:56.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.227+0000 7fcaf0d25800 20 processing logshard = reshard.0000000009 2024-09-22T08:37:56.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.229+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T08:37:56.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.229+0000 7fcaf0d25800 20 processing logshard = reshard.0000000010 2024-09-22T08:37:56.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.232+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T08:37:56.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.232+0000 7fcaf0d25800 20 processing logshard = reshard.0000000011 2024-09-22T08:37:56.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.234+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T08:37:56.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.234+0000 7fcaf0d25800 20 processing logshard = reshard.0000000012 2024-09-22T08:37:56.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.236+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T08:37:56.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.236+0000 7fcaf0d25800 20 processing logshard = reshard.0000000013 2024-09-22T08:37:56.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.239+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T08:37:56.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.239+0000 7fcaf0d25800 20 processing logshard = reshard.0000000014 2024-09-22T08:37:56.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.241+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T08:37:56.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.241+0000 7fcaf0d25800 20 processing logshard = reshard.0000000015 2024-09-22T08:37:56.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.243+0000 7fcaf0d25800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T08:37:56.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.244+0000 7fc9a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:56.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.246+0000 7fcaf0d25800 20 remove_watcher() i=0 2024-09-22T08:37:56.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.246+0000 7fcaf0d25800 2 removed watcher, disabling cache 2024-09-22T08:37:56.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.247+0000 7fcaf0d25800 20 remove_watcher() i=1 2024-09-22T08:37:56.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.248+0000 7fcaf0d25800 20 remove_watcher() i=2 2024-09-22T08:37:56.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.249+0000 7fcaf0d25800 20 remove_watcher() i=3 2024-09-22T08:37:56.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.250+0000 7fcaf0d25800 20 remove_watcher() i=4 2024-09-22T08:37:56.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.251+0000 7fcaf0d25800 20 remove_watcher() i=5 2024-09-22T08:37:56.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.252+0000 7fcaf0d25800 20 remove_watcher() i=6 2024-09-22T08:37:56.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.253+0000 7fcaf0d25800 20 remove_watcher() i=7 2024-09-22T08:37:56.266 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:37:56.295 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:56.295 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:56.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.333+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 20 realm 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.335+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.336+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.336+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.336+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:56.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.336+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.337+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:56.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.337+0000 7f37f43a7800 20 searching for the correct realm 2024-09-22T08:37:56.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.339+0000 7f37f2692640 0 -- 172.21.15.78:0/3849222599 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f37dc0ab830 msgr2=0x7f37dc0b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:56.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.544+0000 7f37f1690640 0 -- 172.21.15.78:0/3849222599 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f37e4003d20 msgr2=0x7f37e401b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.548+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:56.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 zone default found 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 4 Realm: () 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 zonegroup default 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.549+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 started sync module instance, tier type = 2024-09-22T08:37:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.550+0000 7f37f43a7800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=0 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=1 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=2 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=3 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=4 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=5 2024-09-22T08:37:56.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.559+0000 7f37f43a7800 20 add_watcher() i=6 2024-09-22T08:37:56.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.560+0000 7f37f43a7800 20 add_watcher() i=7 2024-09-22T08:37:56.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.560+0000 7f37f43a7800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:56.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.561+0000 7f36a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:56.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 5 note: GC not initialized 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f36a27fc640 20 reqs_thread_entry: start 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 20 Filter name: none 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f3613fff640 20 reqs_thread_entry: start 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.562+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.563+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:56.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.563+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:56.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:56.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:37:56.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 rados->read ofs=0 len=0 2024-09-22T08:37:56.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:37:56.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.564+0000 7f37f43a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:56.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.566+0000 7f36a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:56.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.568+0000 7f37f43a7800 20 remove_watcher() i=0 2024-09-22T08:37:56.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.568+0000 7f37f43a7800 2 removed watcher, disabling cache 2024-09-22T08:37:56.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.569+0000 7f37f43a7800 20 remove_watcher() i=1 2024-09-22T08:37:56.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.570+0000 7f37f43a7800 20 remove_watcher() i=2 2024-09-22T08:37:56.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.571+0000 7f37f43a7800 20 remove_watcher() i=3 2024-09-22T08:37:56.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.572+0000 7f37f43a7800 20 remove_watcher() i=4 2024-09-22T08:37:56.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.573+0000 7f37f43a7800 20 remove_watcher() i=5 2024-09-22T08:37:56.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.574+0000 7f37f43a7800 20 remove_watcher() i=6 2024-09-22T08:37:56.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:56.575+0000 7f37f43a7800 20 remove_watcher() i=7 2024-09-22T08:37:56.586 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:56.587 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:56.587 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-22T08:37:56.587 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:56.587 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-22T08:37:56.587 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:57.412 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:37:57.440 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:57.440 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:57.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.475+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 realm 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.478+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.479+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:57.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.479+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.479+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:57.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.479+0000 7fa70f616800 20 searching for the correct realm 2024-09-22T08:37:57.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.482+0000 7fa70b5e8640 0 -- 172.21.15.78:0/4212735915 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa700036070 msgr2=0x7fa700042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:57.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.687+0000 7fa70a5e6640 0 -- 172.21.15.78:0/4212735915 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa70401b040 msgr2=0x7fa704066fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.692+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:57.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 zone default found 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 4 Realm: () 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 zonegroup default 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.693+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.694+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.694+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.694+0000 7fa70f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.694+0000 7fa70f616800 20 started sync module instance, tier type = 2024-09-22T08:37:57.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.694+0000 7fa70f616800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=0 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=1 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=2 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=3 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=4 2024-09-22T08:37:57.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=5 2024-09-22T08:37:57.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.703+0000 7fa70f616800 20 add_watcher() i=6 2024-09-22T08:37:57.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.704+0000 7fa70f616800 20 add_watcher() i=7 2024-09-22T08:37:57.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.704+0000 7fa70f616800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:57.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.705+0000 7fa5c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:57.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:57.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 5 note: GC not initialized 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa53bfff640 20 reqs_thread_entry: start 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 20 Filter name: none 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa539ffb640 20 reqs_thread_entry: start 2024-09-22T08:37:57.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.706+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.707+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.707+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.707+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.707+0000 7fa70f616800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.707+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.708+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:57.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.708+0000 7fa70f616800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.708+0000 7fa70f616800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:57.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.708+0000 7fa70f616800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:57.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.710+0000 7fa5c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:57.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.712+0000 7fa70f616800 20 remove_watcher() i=0 2024-09-22T08:37:57.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.712+0000 7fa70f616800 2 removed watcher, disabling cache 2024-09-22T08:37:57.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.713+0000 7fa70f616800 20 remove_watcher() i=1 2024-09-22T08:37:57.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.714+0000 7fa70f616800 20 remove_watcher() i=2 2024-09-22T08:37:57.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.715+0000 7fa70f616800 20 remove_watcher() i=3 2024-09-22T08:37:57.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.716+0000 7fa70f616800 20 remove_watcher() i=4 2024-09-22T08:37:57.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.717+0000 7fa70f616800 20 remove_watcher() i=5 2024-09-22T08:37:57.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.718+0000 7fa70f616800 20 remove_watcher() i=6 2024-09-22T08:37:57.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.719+0000 7fa70f616800 20 remove_watcher() i=7 2024-09-22T08:37:57.730 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:57.730 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:57.730 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:57.731 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:57.733 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-22T08:37:57.766 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:57.766 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:57.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.802+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 realm 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.804+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.805+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.805+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.806+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.806+0000 7fa04593b800 20 searching for the correct realm 2024-09-22T08:37:57.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.807+0000 7fa041e26640 0 -- 172.21.15.78:0/1075338761 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5583cb073f50 msgr2=0x5583cb0763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:57.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.811+0000 7fa03bfff640 0 -- 172.21.15.78:0/1075338761 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x5583cb078210 msgr2=0x5583cb07a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:57.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:57.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.816+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 zone default found 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 4 Realm: () 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:57.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 zonegroup default 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.817+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.818+0000 7fa04593b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.818+0000 7fa04593b800 20 started sync module instance, tier type = 2024-09-22T08:37:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.818+0000 7fa04593b800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=0 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=1 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=2 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=3 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=4 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=5 2024-09-22T08:37:57.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.826+0000 7fa04593b800 20 add_watcher() i=6 2024-09-22T08:37:57.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.827+0000 7fa04593b800 20 add_watcher() i=7 2024-09-22T08:37:57.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.827+0000 7fa04593b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7f9ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7fa04593b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7fa04593b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7fa04593b800 5 note: GC not initialized 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7f9ef67e4640 20 reqs_thread_entry: start 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.829+0000 7fa04593b800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 20 Filter name: none 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7f9e67fff640 20 reqs_thread_entry: start 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:37:57.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 : miss 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.830+0000 7fa04593b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.831+0000 7fa04593b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.831+0000 7fa04593b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.831+0000 7fa04593b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.831+0000 7fa04593b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.831+0000 7fa04593b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.832+0000 7fa04593b800 -1 Injecting error=-5 at location=init_index 2024-09-22T08:37:57.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.832+0000 7fa04593b800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-22T08:37:57.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.833+0000 7f9ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:57.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.835+0000 7fa04593b800 20 remove_watcher() i=0 2024-09-22T08:37:57.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.835+0000 7fa04593b800 2 removed watcher, disabling cache 2024-09-22T08:37:57.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.836+0000 7fa04593b800 20 remove_watcher() i=1 2024-09-22T08:37:57.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.837+0000 7fa04593b800 20 remove_watcher() i=2 2024-09-22T08:37:57.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.838+0000 7fa04593b800 20 remove_watcher() i=3 2024-09-22T08:37:57.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.839+0000 7fa04593b800 20 remove_watcher() i=4 2024-09-22T08:37:57.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.840+0000 7fa04593b800 20 remove_watcher() i=5 2024-09-22T08:37:57.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.841+0000 7fa04593b800 20 remove_watcher() i=6 2024-09-22T08:37:57.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.842+0000 7fa04593b800 20 remove_watcher() i=7 2024-09-22T08:37:57.855 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:37:57.884 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:57.884 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:57.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.919+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 realm 2024-09-22T08:37:57.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.921+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.922+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:57.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.922+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:57.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.923+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:57.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.923+0000 7f757a287800 20 searching for the correct realm 2024-09-22T08:37:57.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:57.925+0000 7f7578579640 0 -- 172.21.15.78:0/2091940004 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f75600af850 msgr2=0x7f75600af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:58.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.129+0000 7f756f577640 0 -- 172.21.15.78:0/2091940004 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f757002f060 msgr2=0x7f75700263b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.134+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:58.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 zone default found 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 4 Realm: () 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 zonegroup default 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.135+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 started sync module instance, tier type = 2024-09-22T08:37:58.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.136+0000 7f757a287800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=0 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=1 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=2 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=3 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=4 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=5 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.145+0000 7f757a287800 20 add_watcher() i=6 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.146+0000 7f757a287800 20 add_watcher() i=7 2024-09-22T08:37:58.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.146+0000 7f757a287800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:58.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.148+0000 7f742e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:58.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:58.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 5 note: GC not initialized 2024-09-22T08:37:58.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f742d7e2640 20 reqs_thread_entry: start 2024-09-22T08:37:58.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:58.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 20 Filter name: none 2024-09-22T08:37:58.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f74267fc640 20 reqs_thread_entry: start 2024-09-22T08:37:58.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.149+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.150+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.150+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.150+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.150+0000 7f757a287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.150+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.151+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.151+0000 7f757a287800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.151+0000 7f757a287800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:58.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.151+0000 7f757a287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:58.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.153+0000 7f742e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.155+0000 7f757a287800 20 remove_watcher() i=0 2024-09-22T08:37:58.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.155+0000 7f757a287800 2 removed watcher, disabling cache 2024-09-22T08:37:58.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.156+0000 7f757a287800 20 remove_watcher() i=1 2024-09-22T08:37:58.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.157+0000 7f757a287800 20 remove_watcher() i=2 2024-09-22T08:37:58.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.158+0000 7f757a287800 20 remove_watcher() i=3 2024-09-22T08:37:58.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.159+0000 7f757a287800 20 remove_watcher() i=4 2024-09-22T08:37:58.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.160+0000 7f757a287800 20 remove_watcher() i=5 2024-09-22T08:37:58.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.161+0000 7f757a287800 20 remove_watcher() i=6 2024-09-22T08:37:58.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.162+0000 7f757a287800 20 remove_watcher() i=7 2024-09-22T08:37:58.173 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:58.174 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:58.174 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:37:58.174 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:58.265 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:37:58.295 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:58.295 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:58.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.332+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 realm 2024-09-22T08:37:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:58.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.333+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.334+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:58.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.334+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.335+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:58.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.335+0000 7ff3755a2800 20 searching for the correct realm 2024-09-22T08:37:58.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.336+0000 7ff36a88b640 0 -- 172.21.15.78:0/3893153 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7ff36408ab40 msgr2=0x7ff36406c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:37:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.341+0000 7ff37308c640 0 -- 172.21.15.78:0/3893153 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x56491286fe10 msgr2=0x5649128722d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.346+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:58.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 zone default found 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 4 Realm: () 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 zonegroup default 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.347+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.348+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.348+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.348+0000 7ff3755a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.348+0000 7ff3755a2800 20 started sync module instance, tier type = 2024-09-22T08:37:58.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.348+0000 7ff3755a2800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=0 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=1 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=2 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=3 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=4 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=5 2024-09-22T08:37:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.356+0000 7ff3755a2800 20 add_watcher() i=6 2024-09-22T08:37:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.357+0000 7ff3755a2800 20 add_watcher() i=7 2024-09-22T08:37:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.357+0000 7ff3755a2800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:58.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff3755a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff3755a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff3755a2800 5 note: GC not initialized 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff228fe1640 20 reqs_thread_entry: start 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.359+0000 7ff3755a2800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 20 Filter name: none 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff1a27fc640 20 reqs_thread_entry: start 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:37:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 : miss 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.360+0000 7ff3755a2800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:37:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.361+0000 7ff3755a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.365+0000 7ff3755a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.365+0000 7ff3755a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.365+0000 7ff3755a2800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.365+0000 7ff3755a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20, ofs0, ns] 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.366+0000 7ff2567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94871843510672 notifier 6408 bl.length()=995 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.366+0000 7ff2567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.366+0000 7ff2567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.366+0000 7ff2567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.367+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_sources= new_sources= 2024-09-22T08:37:58.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.367+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential sources added=[] removed=[] 2024-09-22T08:37:58.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.367+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_dests= new_dests= 2024-09-22T08:37:58.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.367+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential dests added=[] removed=[] 2024-09-22T08:37:58.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.0 2024-09-22T08:37:58.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.0 2024-09-22T08:37:58.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.1 2024-09-22T08:37:58.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.1 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.2 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.2 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.3 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.3 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.4 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.4 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.5 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.5 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.6 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.6 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.7 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.7 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.8 2024-09-22T08:37:58.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.8 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.9 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.9 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.10 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.10 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.11 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1.11 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.0 2024-09-22T08:37:58.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.372+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.373+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.2 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.373+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.3 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.373+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.4 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.374+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.5 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.374+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.6 2024-09-22T08:37:58.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.375+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.7 2024-09-22T08:37:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.375+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.8 2024-09-22T08:37:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.376+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.9 2024-09-22T08:37:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.376+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.10 2024-09-22T08:37:58.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.379+0000 7ff3755a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:58.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.379+0000 7ff3755a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff3755a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff3755a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff3755a2800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff3755a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20, ofs0, ns] 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff2567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94871843510672 notifier 6408 bl.length()=995 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff2567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff2567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.381+0000 7ff2567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.383+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_sources= new_sources= 2024-09-22T08:37:58.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.383+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential sources added=[] removed=[] 2024-09-22T08:37:58.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.383+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_dests= new_dests= 2024-09-22T08:37:58.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.383+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential dests added=[] removed=[] 2024-09-22T08:37:58.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.385+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.0 2024-09-22T08:37:58.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.385+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.1 2024-09-22T08:37:58.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.386+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.2 2024-09-22T08:37:58.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.386+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.3 2024-09-22T08:37:58.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.386+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.4 2024-09-22T08:37:58.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.386+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.5 2024-09-22T08:37:58.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.387+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.6 2024-09-22T08:37:58.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.387+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.7 2024-09-22T08:37:58.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.387+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.8 2024-09-22T08:37:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.388+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.9 2024-09-22T08:37:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.388+0000 7ff3755a2800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20.10 2024-09-22T08:37:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.388+0000 7ff3755a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 : hit (requested=0x17, cached=0x17) 2024-09-22T08:37:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.388+0000 7ff3755a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff3755a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff3755a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff3755a2800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff3755a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20, ofs0, ns] 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff256ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562460 cookie 94871843510672 notifier 6408 bl.length()=963 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff256ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 info.flags=0x17 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff256ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 to cache LRU end 2024-09-22T08:37:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.390+0000 7ff256ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:37:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.391+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_sources= new_sources= 2024-09-22T08:37:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.391+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential sources added=[] removed=[] 2024-09-22T08:37:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.391+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): orig_dests= new_dests= 2024-09-22T08:37:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.391+0000 7ff3755a2800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20]): potential dests added=[] removed=[] 2024-09-22T08:37:58.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.394+0000 7ff3755a2800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-22T08:37:58.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.395+0000 7ff229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.397+0000 7ff3755a2800 20 remove_watcher() i=0 2024-09-22T08:37:58.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.397+0000 7ff3755a2800 2 removed watcher, disabling cache 2024-09-22T08:37:58.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.398+0000 7ff3755a2800 20 remove_watcher() i=1 2024-09-22T08:37:58.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.400+0000 7ff3755a2800 20 remove_watcher() i=2 2024-09-22T08:37:58.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.401+0000 7ff3755a2800 20 remove_watcher() i=3 2024-09-22T08:37:58.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.402+0000 7ff3755a2800 20 remove_watcher() i=4 2024-09-22T08:37:58.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.404+0000 7ff3755a2800 20 remove_watcher() i=5 2024-09-22T08:37:58.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.406+0000 7ff3755a2800 20 remove_watcher() i=6 2024-09-22T08:37:58.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.408+0000 7ff3755a2800 20 remove_watcher() i=7 2024-09-22T08:37:58.421 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:37:58.449 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:58.449 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:37:58.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.485+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 realm 2024-09-22T08:37:58.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:37:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.487+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.488+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:58.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.488+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.488+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:37:58.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.488+0000 7f4852924800 20 searching for the correct realm 2024-09-22T08:37:58.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.490+0000 7f484dd01640 0 -- 172.21.15.78:0/3075955208 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x56300e28ea10 msgr2=0x56300e290e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:58.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.493+0000 7f484dd01640 0 -- 172.21.15.78:0/3075955208 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f484803c070 msgr2=0x7f48480698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.698+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:37:58.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 zone default found 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 4 Realm: () 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 zonegroup default 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.699+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:37:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 started sync module instance, tier type = 2024-09-22T08:37:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.700+0000 7f4852924800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=0 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=1 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=2 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=3 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=4 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=5 2024-09-22T08:37:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.711+0000 7f4852924800 20 add_watcher() i=6 2024-09-22T08:37:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.712+0000 7f4852924800 20 add_watcher() i=7 2024-09-22T08:37:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.712+0000 7f4852924800 2 all 8 watchers are set, enabling cache 2024-09-22T08:37:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.713+0000 7f4704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:37:58.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:37:58.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 5 note: GC not initialized 2024-09-22T08:37:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f467f7fe640 20 reqs_thread_entry: start 2024-09-22T08:37:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 20 init_complete bucket index max shards: 11 2024-09-22T08:37:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 20 Filter name: none 2024-09-22T08:37:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f467d7fa640 20 reqs_thread_entry: start 2024-09-22T08:37:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.714+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.715+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.715+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.715+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.715+0000 7f4852924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.715+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.716+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:37:58.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.716+0000 7f4852924800 20 rados->read ofs=0 len=0 2024-09-22T08:37:58.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.716+0000 7f4852924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:37:58.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.716+0000 7f4852924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:37:58.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.718+0000 7f4704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:37:58.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.721+0000 7f4852924800 20 remove_watcher() i=0 2024-09-22T08:37:58.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.721+0000 7f4852924800 2 removed watcher, disabling cache 2024-09-22T08:37:58.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.722+0000 7f4852924800 20 remove_watcher() i=1 2024-09-22T08:37:58.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.723+0000 7f4852924800 20 remove_watcher() i=2 2024-09-22T08:37:58.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.724+0000 7f4852924800 20 remove_watcher() i=3 2024-09-22T08:37:58.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.725+0000 7f4852924800 20 remove_watcher() i=4 2024-09-22T08:37:58.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.726+0000 7f4852924800 20 remove_watcher() i=5 2024-09-22T08:37:58.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.727+0000 7f4852924800 20 remove_watcher() i=6 2024-09-22T08:37:58.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:37:58.728+0000 7f4852924800 20 remove_watcher() i=7 2024-09-22T08:37:58.739 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:58.739 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:37:58.739 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:37:58.739 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:59.119 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-22T08:37:59.119 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:37:59.937 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:37:59.965 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:37:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:00.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.001+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 realm 2024-09-22T08:38:00.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.003+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.004+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.004+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.005+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:00.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.005+0000 7f2c44f22800 20 searching for the correct realm 2024-09-22T08:38:00.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.007+0000 7f2c413af640 0 -- 172.21.15.78:0/3207271279 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2c2c04e070 msgr2=0x7f2c2c073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.212+0000 7f2c3bfff640 0 -- 172.21.15.78:0/3207271279 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2c3c069040 msgr2=0x7f2c3c060a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.216+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:00.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 zone default found 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 4 Realm: () 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 zonegroup default 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.217+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.218+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.218+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.218+0000 7f2c44f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.218+0000 7f2c44f22800 20 started sync module instance, tier type = 2024-09-22T08:38:00.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.218+0000 7f2c44f22800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=0 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=1 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=2 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=3 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=4 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=5 2024-09-22T08:38:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.226+0000 7f2c44f22800 20 add_watcher() i=6 2024-09-22T08:38:00.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.228+0000 7f2c44f22800 20 add_watcher() i=7 2024-09-22T08:38:00.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.228+0000 7f2c44f22800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:00.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.230+0000 7f2af6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.230+0000 7f2c44f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.230+0000 7f2c44f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.230+0000 7f2c44f22800 5 note: GC not initialized 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.230+0000 7f2af5fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2c44f22800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2c44f22800 20 Filter name: none 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2a677fe640 20 reqs_thread_entry: start 2024-09-22T08:38:00.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:38:00.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.231+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:38:00.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.232+0000 7f2c44f22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:00.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.234+0000 7f2af6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.236+0000 7f2c44f22800 20 remove_watcher() i=0 2024-09-22T08:38:00.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.236+0000 7f2c44f22800 2 removed watcher, disabling cache 2024-09-22T08:38:00.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.237+0000 7f2c44f22800 20 remove_watcher() i=1 2024-09-22T08:38:00.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.238+0000 7f2c44f22800 20 remove_watcher() i=2 2024-09-22T08:38:00.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.239+0000 7f2c44f22800 20 remove_watcher() i=3 2024-09-22T08:38:00.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.240+0000 7f2c44f22800 20 remove_watcher() i=4 2024-09-22T08:38:00.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.241+0000 7f2c44f22800 20 remove_watcher() i=5 2024-09-22T08:38:00.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.242+0000 7f2c44f22800 20 remove_watcher() i=6 2024-09-22T08:38:00.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.243+0000 7f2c44f22800 20 remove_watcher() i=7 2024-09-22T08:38:00.254 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:00.254 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:00.254 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:00.254 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:00.255 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-22T08:38:00.291 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:00.291 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:00.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.327+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 realm 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.329+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.330+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.330+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.331+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.331+0000 7fb8db12c800 20 searching for the correct realm 2024-09-22T08:38:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.331+0000 7fb8d6e4f640 0 -- 172.21.15.78:0/3193003864 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55cf413e21a0 msgr2=0x55cf413e4590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.334+0000 7fb8d6e4f640 0 -- 172.21.15.78:0/3193003864 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fb8c806aac0 msgr2=0x7fb8c8073680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.342+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 zone default found 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 4 Realm: () 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 zonegroup default 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 started sync module instance, tier type = 2024-09-22T08:38:00.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.343+0000 7fb8db12c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:00.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=0 2024-09-22T08:38:00.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=1 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=2 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=3 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=4 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=5 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.353+0000 7fb8db12c800 20 add_watcher() i=6 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.354+0000 7fb8db12c800 20 add_watcher() i=7 2024-09-22T08:38:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.354+0000 7fb8db12c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:00.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb78d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb8db12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb8db12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb8db12c800 5 note: GC not initialized 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb707fff640 20 reqs_thread_entry: start 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb8db12c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.356+0000 7fb8db12c800 20 Filter name: none 2024-09-22T08:38:00.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb705ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 : miss 2024-09-22T08:38:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 info.flags=0x17 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 to cache LRU end 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.357+0000 7fb8db12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.358+0000 7fb8db12c800 -1 Injecting error=-95 at location=init_index 2024-09-22T08:38:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.358+0000 7fb8db12c800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb8db12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 info.flags=0x17 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb8db12c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 to cache LRU end 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb8db12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb8db12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21, ofs0, ns] 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb7ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94348641210960 notifier 6468 bl.length()=995 2024-09-22T08:38:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb7ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 info.flags=0x17 2024-09-22T08:38:00.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb7ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 to cache LRU end 2024-09-22T08:38:00.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.362+0000 7fb7ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.364+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): orig_sources= new_sources= 2024-09-22T08:38:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.364+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): potential sources added=[] removed=[] 2024-09-22T08:38:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.364+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): orig_dests= new_dests= 2024-09-22T08:38:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.364+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): potential dests added=[] removed=[] 2024-09-22T08:38:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.0 2024-09-22T08:38:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.0 2024-09-22T08:38:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.1 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.1 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.2 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.2 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.3 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.3 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.4 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.4 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.5 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.5 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.6 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.6 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.7 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.7 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.8 2024-09-22T08:38:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.8 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.9 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.9 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.10 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.10 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.11 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1.11 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.0 2024-09-22T08:38:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.366+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.1 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.367+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.2 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.368+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.3 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.368+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.4 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.369+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.5 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.369+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.6 2024-09-22T08:38:00.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.369+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.7 2024-09-22T08:38:00.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.370+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.8 2024-09-22T08:38:00.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.371+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.9 2024-09-22T08:38:00.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.371+0000 7fb8db12c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21.10 2024-09-22T08:38:00.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.375+0000 7fb8db12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:00.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.375+0000 7fb8db12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.376+0000 7fb8db12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 info.flags=0x17 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.376+0000 7fb8db12c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 to cache LRU end 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.376+0000 7fb8db12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.376+0000 7fb8db12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21, ofs0, ns] 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.377+0000 7fb7b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562466 cookie 94348641210960 notifier 6468 bl.length()=963 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.377+0000 7fb7b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 info.flags=0x17 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.377+0000 7fb7b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 to cache LRU end 2024-09-22T08:38:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.377+0000 7fb7b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:00.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.379+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): orig_sources= new_sources= 2024-09-22T08:38:00.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.379+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): potential sources added=[] removed=[] 2024-09-22T08:38:00.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.379+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): orig_dests= new_dests= 2024-09-22T08:38:00.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.379+0000 7fb8db12c800 20 handle_bi_update(): bucket=:error-at-init-index[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21]): potential dests added=[] removed=[] 2024-09-22T08:38:00.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.381+0000 7fb8db12c800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-22T08:38:00.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.382+0000 7fb78d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.384+0000 7fb8db12c800 20 remove_watcher() i=0 2024-09-22T08:38:00.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.384+0000 7fb8db12c800 2 removed watcher, disabling cache 2024-09-22T08:38:00.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.385+0000 7fb8db12c800 20 remove_watcher() i=1 2024-09-22T08:38:00.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.386+0000 7fb8db12c800 20 remove_watcher() i=2 2024-09-22T08:38:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.388+0000 7fb8db12c800 20 remove_watcher() i=3 2024-09-22T08:38:00.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.389+0000 7fb8db12c800 20 remove_watcher() i=4 2024-09-22T08:38:00.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.390+0000 7fb8db12c800 20 remove_watcher() i=5 2024-09-22T08:38:00.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.390+0000 7fb8db12c800 20 remove_watcher() i=6 2024-09-22T08:38:00.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.391+0000 7fb8db12c800 20 remove_watcher() i=7 2024-09-22T08:38:00.404 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T08:38:00.433 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:00.433 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:00.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.468+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 20 realm 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.470+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.471+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.471+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.471+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.471+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.472+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:00.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.472+0000 7f28134bb800 20 searching for the correct realm 2024-09-22T08:38:00.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.474+0000 7f28117a6640 0 -- 172.21.15.78:0/2228649575 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f27f803b070 msgr2=0x7f27f803c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.478+0000 7f28087a4640 0 -- 172.21.15.78:0/2228649575 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f280c046040 msgr2=0x7f280c011960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.482+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 zone default found 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 4 Realm: () 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 zonegroup default 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.483+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.484+0000 7f28134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:00.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.484+0000 7f28134bb800 20 started sync module instance, tier type = 2024-09-22T08:38:00.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.484+0000 7f28134bb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:00.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=0 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=1 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=2 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=3 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=4 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=5 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=6 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 20 add_watcher() i=7 2024-09-22T08:38:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.492+0000 7f28134bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:00.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.494+0000 7f26c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:00.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:00.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 5 note: GC not initialized 2024-09-22T08:38:00.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f26c67e4640 20 reqs_thread_entry: start 2024-09-22T08:38:00.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:00.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 20 Filter name: none 2024-09-22T08:38:00.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f26bf7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:00.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.495+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.496+0000 7f28134bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.497+0000 7f28134bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:38:00.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.497+0000 7f28134bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:00.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.499+0000 7f26c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:00.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.500+0000 7f28134bb800 20 remove_watcher() i=0 2024-09-22T08:38:00.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.500+0000 7f28134bb800 2 removed watcher, disabling cache 2024-09-22T08:38:00.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.502+0000 7f28134bb800 20 remove_watcher() i=1 2024-09-22T08:38:00.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.503+0000 7f28134bb800 20 remove_watcher() i=2 2024-09-22T08:38:00.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.503+0000 7f28134bb800 20 remove_watcher() i=3 2024-09-22T08:38:00.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.505+0000 7f28134bb800 20 remove_watcher() i=4 2024-09-22T08:38:00.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.506+0000 7f28134bb800 20 remove_watcher() i=5 2024-09-22T08:38:00.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.507+0000 7f28134bb800 20 remove_watcher() i=6 2024-09-22T08:38:00.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:00.508+0000 7f28134bb800 20 remove_watcher() i=7 2024-09-22T08:38:00.519 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:00.519 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:00.519 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:38:00.519 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:00.894 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at init_index 2024-09-22T08:38:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:01.718 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:38:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:01.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.781+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 20 realm 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.783+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.784+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:01.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.784+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.784+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:01.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.784+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.785+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:01.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.785+0000 7f765d0bb800 20 searching for the correct realm 2024-09-22T08:38:01.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.787+0000 7f765b3a6640 0 -- 172.21.15.78:0/3935363953 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f76440729d0 msgr2=0x7f76440681a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:01.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.992+0000 7f76523a4640 0 -- 172.21.15.78:0/3935363953 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f765402c070 msgr2=0x7f765405e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:01.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:01.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:01.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:01.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.997+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 zone default found 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 4 Realm: () 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:02.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 zonegroup default 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.998+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.999+0000 7f765d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.999+0000 7f765d0bb800 20 started sync module instance, tier type = 2024-09-22T08:38:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:01.999+0000 7f765d0bb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=0 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=1 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=2 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=3 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=4 2024-09-22T08:38:02.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=5 2024-09-22T08:38:02.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.007+0000 7f765d0bb800 20 add_watcher() i=6 2024-09-22T08:38:02.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.008+0000 7f765d0bb800 20 add_watcher() i=7 2024-09-22T08:38:02.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.008+0000 7f765d0bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:02.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.009+0000 7f75117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:02.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:02.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 5 note: GC not initialized 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f748bfff640 20 reqs_thread_entry: start 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 20 Filter name: none 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f7489ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:02.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.010+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.011+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.011+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:02.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.012+0000 7f765d0bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:02.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.014+0000 7f75117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:02.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.016+0000 7f765d0bb800 20 remove_watcher() i=0 2024-09-22T08:38:02.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.016+0000 7f765d0bb800 2 removed watcher, disabling cache 2024-09-22T08:38:02.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.017+0000 7f765d0bb800 20 remove_watcher() i=1 2024-09-22T08:38:02.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.018+0000 7f765d0bb800 20 remove_watcher() i=2 2024-09-22T08:38:02.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.019+0000 7f765d0bb800 20 remove_watcher() i=3 2024-09-22T08:38:02.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.020+0000 7f765d0bb800 20 remove_watcher() i=4 2024-09-22T08:38:02.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.021+0000 7f765d0bb800 20 remove_watcher() i=5 2024-09-22T08:38:02.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.022+0000 7f765d0bb800 20 remove_watcher() i=6 2024-09-22T08:38:02.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.023+0000 7f765d0bb800 20 remove_watcher() i=7 2024-09-22T08:38:02.034 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.034 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:02.034 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:02.034 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.035 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-22T08:38:02.069 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:02.069 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:02.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.106+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 realm 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.109+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.109+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.110+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:02.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.110+0000 7fe390524800 20 searching for the correct realm 2024-09-22T08:38:02.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.110+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55f5fe49ac70 msgr2=0x55f5fe49d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:02.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.314+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fe37c028040 msgr2=0x7fe37c027410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.723+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 zone default found 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 4 Realm: () 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 zonegroup default 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 started sync module instance, tier type = 2024-09-22T08:38:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.725+0000 7fe390524800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:02.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=0 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=1 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=2 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=3 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=4 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=5 2024-09-22T08:38:02.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=6 2024-09-22T08:38:02.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.735+0000 7fe390524800 20 add_watcher() i=7 2024-09-22T08:38:02.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.735+0000 7fe390524800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:02.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.737+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 5 note: GC not initialized 2024-09-22T08:38:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe241fdb640 20 reqs_thread_entry: start 2024-09-22T08:38:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:02.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 20 Filter name: none 2024-09-22T08:38:02.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe1b37fe640 20 reqs_thread_entry: start 2024-09-22T08:38:02.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:38:02.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.738+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : miss 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.739+0000 7fe390524800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe390524800 time 2024-09-22T08:38:02.741532+0000 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe391b8c748] 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.742 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe390524800 thread_name:radosgw-admin 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.741+0000 7fe390524800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe390524800 time 2024-09-22T08:38:02.741532+0000 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe391b8c748] 2024-09-22T08:38:02.743 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:02.744 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe39083e6f0] 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe39088b99c] 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:02.758 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe391b8c7a2] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.742+0000 7fe390524800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe390524800 thread_name:radosgw-admin 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe39083e6f0] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe39088b99c] 2024-09-22T08:38:02.759 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe391b8c7a2] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:38:02.760 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:38:02.088+0000 7fe38c102640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:38:02.088+0000 7fe38c102640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:38:02.088+0000 7fe38c102640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: dump: 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.761 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:38:02.088+0000 7fe390524800 5 monclient: authenticate success, global_id 6086 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: dump: 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:38:02.088+0000 7fe390524800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:38:02.088+0000 7fe390524800 4 set_mon_vals no callback set 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: shutdown 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:38:02.089+0000 7fe390524800 5 asok(0x55f5fe17c0f0) unregister_commands rotate-key 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:38:02.089+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.764 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:38:02.089+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:38:02.089+0000 7fe390524800 1 librados: starting msgr at 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:38:02.089+0000 7fe390524800 1 librados: starting objecter 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:38:02.090+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests hook 0x55f5fe3c9c20 2024-09-22T08:38:02.765 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:38:02.090+0000 7fe390524800 1 librados: setting wanted keys 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:38:02.090+0000 7fe390524800 1 librados: calling monclient init 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.766 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:38:02.090+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:38:02.090+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.767 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:38:02.090+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key hook 0x55f5fe3a0948 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe3ca500 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe3cae60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x7fe3780030f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.879648s 2024-09-22T08:38:02.768 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe3cae60 auth_method 0 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x7fe3780030f0 auth_method 0 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe3ca500 auth_method 0 2024-09-22T08:38:02.769 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6089 payload 824 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:38:02.091+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:38:02.091+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:38:02.091+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: dump: 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.770 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: dump: 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.771 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:38:02.091+0000 7fe390524800 5 monclient: authenticate success, global_id 6089 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:38:02.091+0000 7fe27a60c640 4 set_mon_vals no callback set 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:38:02.091+0000 7fe390524800 1 librados: init done 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.772 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:38:02.093+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe274077570 auth_method 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:38:02.093+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe3c92e0 auth_method 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:38:02.094+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe3ec4e0 auth_method 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:38:02.095+0000 7fe383901640 10 monclient: get_auth_request con 0x55f5fe3f0970 auth_method 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:38:02.096+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe3efda0 auth_method 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:38:02.097+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.774 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:38:02.097+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:38:02.097+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5fe3fc000 EEXIST 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.775 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:38:02.097+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:38:02.098+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:38:02.098+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x55f5fe3f7bc0 EEXIST 2024-09-22T08:38:02.776 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe420320 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe420700 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe41f030 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.887139s 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe420700 auth_method 0 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.777 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe420320 auth_method 0 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe41f030 auth_method 0 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.778 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_done global_id 6092 payload 824 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:38:02.098+0000 7fe38c903640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: dump: 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.780 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: dump: 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:38:02.098+0000 7fe390524800 5 monclient: authenticate success, global_id 6092 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.781 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:38:02.098+0000 7fe38d104640 4 set_mon_vals no callback set 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:38:02.100+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe264077480 auth_method 0 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: get_monmap_and_config 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.782 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:38:02.101+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.783 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.784 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.785 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:38:02.102+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf80c3938 EEXIST 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe474870 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe4651c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe46fca0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.786 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.891073s 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe474870 auth_method 0 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe46fca0 auth_method 0 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.787 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe4651c0 auth_method 0 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6095 payload 274 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:38:02.102+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.788 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: dump: 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.789 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:38:02.102+0000 7fe390524800 5 monclient: authenticate success, global_id 6095 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:38:02.102+0000 7fe390524800 4 set_mon_vals no callback set 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: dump: 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: shutdown 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:38:02.103+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.792 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:38:02.103+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: starting msgr at 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: starting objecter 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:38:02.103+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5fe444900 EEXIST 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: setting wanted keys 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: calling monclient init 2024-09-22T08:38:02.793 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.794 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:38:02.103+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:38:02.104+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:38:02.104+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x55f5fe434d28 EEXIST 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.795 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe4651c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe46fca0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe474870 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.893269s 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe4651c0 auth_method 0 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.796 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe474870 auth_method 0 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe46fca0 auth_method 0 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.797 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6098 payload 824 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:38:02.104+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: dump: 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.798 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: dump: 2024-09-22T08:38:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:38:02.104+0000 7fe2637fe640 4 set_mon_vals no callback set 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:38:02.104+0000 7fe390524800 5 monclient: authenticate success, global_id 6098 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.800 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:38:02.104+0000 7fe390524800 1 librados: init done 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:38:02.104+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cr dump hook 0x55f5fe46a598 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:38:02.106+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:38:02.107+0000 7fe38c903640 10 monclient: get_auth_request con 0x7fe2540775a0 auth_method 0 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:38:02.107+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe48e3f0 auth_method 0 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:38:02.108+0000 7fe390524800 20 realm 2024-09-22T08:38:02.801 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:38:02.108+0000 7fe390524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:38:02.108+0000 7fe383901640 10 monclient: get_auth_request con 0x55f5fe4927d0 auth_method 0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:38:02.109+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:38:02.109+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:38:02.109+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe495ef0 auth_method 0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:38:02.110+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:38:02.110+0000 7fe390524800 20 searching for the correct realm 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:38:02.110+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe49ac70 auth_method 0 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:38:02.110+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55f5fe49ac70 msgr2=0x55f5fe49d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:02.802 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:38:02.110+0000 7fe261ffb640 1 client.6098.objecter ms_handle_reset 0x55f5fe49ac70 session 0x55f5fe49a5f0 osd.4 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:38:02.111+0000 7fe261ffb640 10 monclient: _renew_subs 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:38:02.111+0000 7fe261ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:38:02.111+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe37c03b040 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:38:02.111+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe2540878c0 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:38:02.112+0000 7fe38c903640 10 monclient: get_auth_request con 0x7fe3740b8070 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:38:02.113+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:38:02.314+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:38:02.314+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fe37c028040 msgr2=0x7fe37c027410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:38:02.715+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:38:02.718+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe384018040 auth_method 0 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:02.803 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:38:02.723+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:38:02.724+0000 7fe390524800 20 zone default found 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:38:02.724+0000 7fe390524800 4 Realm: () 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:38:02.724+0000 7fe390524800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:38:02.724+0000 7fe390524800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:38:02.724+0000 7fe390524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:38:02.724+0000 7fe390524800 20 zonegroup default 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.804 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:38:02.725+0000 7fe390524800 20 started sync module instance, tier type = 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:38:02.725+0000 7fe390524800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=0 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=1 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=2 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=3 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=4 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=5 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=6 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:38:02.735+0000 7fe390524800 20 add_watcher() i=7 2024-09-22T08:38:02.805 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:38:02.735+0000 7fe390524800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.806 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:38:02.737+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:38:02.738+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache list hook 0x55f5fe46d200 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache inspect hook 0x55f5fe46d200 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache erase hook 0x55f5fe46d200 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache zap hook 0x55f5fe46d200 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:38:02.738+0000 7fe390524800 5 note: GC not initialized 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:38:02.738+0000 7fe241fdb640 20 reqs_thread_entry: start 2024-09-22T08:38:02.807 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace show hook 0x7fe3740aa040 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace history hook 0x7fe3740aa040 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace active hook 0x7fe3740aa040 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace active_short hook 0x7fe3740aa040 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:38:02.738+0000 7fe390524800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:38:02.738+0000 7fe390524800 20 Filter name: none 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:38:02.738+0000 7fe1b37fe640 20 reqs_thread_entry: start 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:38:02.738+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:38:02.808 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : miss 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:38:02.739+0000 7fe390524800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:38:02.741+0000 7fe390524800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe390524800 time 2024-09-22T08:38:02.741532+0000 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe391b8c748] 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:38:02.742+0000 7fe390524800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe390524800 thread_name:radosgw-admin 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe39083e6f0] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe39088b99c] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe391b8c7a2] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.811 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:02.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:02.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:38:02.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:38:02.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:38:02.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:02.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:02.818 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe1b37fe640 / http_manager 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe241fdb640 / http_manager 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe242fdd640 / rgw_dt_lg_renew 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe261ffb640 / ms_dispatch 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe2637fe640 / io_context_pool 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe271ffb640 / ms_dispatch 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe278e09640 / ms_dispatch 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe27a60c640 / io_context_pool 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe383901640 / msgr-worker-2 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38c102640 / msgr-worker-1 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38c903640 / msgr-worker-0 2024-09-22T08:38:02.819 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38d104640 / io_context_pool 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe390524800 / radosgw-admin 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.92760.log 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:38:02.088+0000 7fe38c102640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:38:02.088+0000 7fe38c102640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:38:02.088+0000 7fe38c102640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: dump: 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:38:02.088+0000 7fe390524800 5 monclient: authenticate success, global_id 6086 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.821 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:38:02.088+0000 7fe27a60c640 10 monclient: dump: 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:38:02.088+0000 7fe390524800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:38:02.088+0000 7fe390524800 4 set_mon_vals no callback set 2024-09-22T08:38:02.822 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: shutdown 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:38:02.089+0000 7fe390524800 5 asok(0x55f5fe17c0f0) unregister_commands rotate-key 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:38:02.089+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:38:02.089+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.823 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding auth protocol: cephx 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: crc 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:38:02.089+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a5ea0) adding con mode: secure 2024-09-22T08:38:02.824 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:38:02.089+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:38:02.089+0000 7fe390524800 1 librados: starting msgr at 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:38:02.089+0000 7fe390524800 1 librados: starting objecter 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:38:02.090+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests hook 0x55f5fe3c9c20 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:38:02.090+0000 7fe390524800 1 librados: setting wanted keys 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:38:02.090+0000 7fe390524800 1 librados: calling monclient init 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding auth protocol: cephx 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.825 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: crc 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:38:02.090+0000 7fe390524800 5 AuthRegistry(0x55f5fe3a0800) adding con mode: secure 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:38:02.090+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:38:02.090+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.826 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:38:02.090+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key hook 0x55f5fe3a0948 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe3ca500 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe3cae60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x7fe3780030f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:38:02.090+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.879648s 2024-09-22T08:38:02.827 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe3cae60 auth_method 0 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x7fe3780030f0 auth_method 0 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.828 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:38:02.090+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe3ca500 auth_method 0 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:38:02.090+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:38:02.090+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6089 payload 824 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:38:02.091+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:38:02.091+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:38:02.091+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.829 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: dump: 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.830 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:38:02.091+0000 7fe278e09640 10 monclient: dump: 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:38:02.091+0000 7fe390524800 5 monclient: authenticate success, global_id 6089 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.831 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:38:02.091+0000 7fe27a60c640 4 set_mon_vals no callback set 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:38:02.091+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:38:02.091+0000 7fe390524800 1 librados: init done 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:38:02.093+0000 7fe278e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:38:02.093+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe274077570 auth_method 0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:38:02.093+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe3c92e0 auth_method 0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:38:02.094+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe3ec4e0 auth_method 0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:38:02.095+0000 7fe383901640 10 monclient: get_auth_request con 0x55f5fe3f0970 auth_method 0 2024-09-22T08:38:02.832 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:38:02.096+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe3efda0 auth_method 0 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:38:02.097+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.833 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding auth protocol: cephx 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.834 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: crc 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f8b30) adding con mode: secure 2024-09-22T08:38:02.835 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:38:02.097+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:38:02.097+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5fe3fc000 EEXIST 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:38:02.097+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding auth protocol: cephx 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.836 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.837 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: crc 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:38:02.097+0000 7fe390524800 5 AuthRegistry(0x55f5fe3f7a78) adding con mode: secure 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:38:02.097+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:38:02.098+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:38:02.098+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x55f5fe3f7bc0 EEXIST 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:02.838 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe420320 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe420700 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe41f030 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.887139s 2024-09-22T08:38:02.839 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe420700 auth_method 0 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe420320 auth_method 0 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.840 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:38:02.098+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe41f030 auth_method 0 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.841 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:38:02.098+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient(hunting): handle_auth_done global_id 6092 payload 824 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:38:02.098+0000 7fe38c903640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:38:02.098+0000 7fe38c903640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: dump: 2024-09-22T08:38:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.843 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:38:02.098+0000 7fe271ffb640 10 monclient: dump: 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:38:02.098+0000 7fe390524800 5 monclient: authenticate success, global_id 6092 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:38:02.098+0000 7fe38d104640 4 set_mon_vals no callback set 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:38:02.098+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.845 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:38:02.100+0000 7fe271ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:38:02.100+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe264077480 auth_method 0 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: get_monmap_and_config 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:38:02.101+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding auth protocol: cephx 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.847 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: crc 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x55f5fe440250) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:38:02.101+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding auth protocol: cephx 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.848 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: crc 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:38:02.101+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c37f0) adding con mode: secure 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:38:02.101+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:38:02.102+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf80c3938 EEXIST 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe474870 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe4651c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe46fca0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.849 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.891073s 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe474870 auth_method 0 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe46fca0 auth_method 0 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.850 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:38:02.102+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe4651c0 auth_method 0 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:38:02.102+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6095 payload 274 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.851 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:38:02.102+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:38:02.102+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: dump: 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.852 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:38:02.102+0000 7fe390524800 5 monclient: authenticate success, global_id 6095 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:38:02.102+0000 7fe390524800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:38:02.102+0000 7fe390524800 4 set_mon_vals no callback set 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.853 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:38:02.102+0000 7fe2637fe640 10 monclient: dump: 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: shutdown 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: build_initial_monmap 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:38:02.103+0000 7fe390524800 1 build_initial for_mkfs: 0 2024-09-22T08:38:02.854 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: monmap: 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding auth protocol: cephx 2024-09-22T08:38:02.855 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: crc 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe443dd0) adding con mode: secure 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:38:02.103+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: starting msgr at 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: starting objecter 2024-09-22T08:38:02.856 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:38:02.103+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5fe444900 EEXIST 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: setting wanted keys 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:38:02.103+0000 7fe390524800 1 librados: calling monclient init 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:38:02.103+0000 7fe390524800 10 monclient: init 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding auth protocol: cephx 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.857 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: crc 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:38:02.103+0000 7fe390524800 5 AuthRegistry(0x55f5fe434be0) adding con mode: secure 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:38:02.103+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:38:02.104+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:38:02.104+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command rotate-key cmddesc rotate-key hook 0x55f5fe434d28 EEXIST 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-c con 0x55f5fe4651c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-b con 0x55f5fe46fca0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): picked mon.noname-a con 0x55f5fe474870 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:02.858 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient(hunting): authenticate will time out at 1997.893269s 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): get_auth_request con 0x55f5fe4651c0 auth_method 0 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): get_auth_request con 0x55f5fe474870 auth_method 0 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.859 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): get_auth_request con 0x55f5fe46fca0 auth_method 0 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:38:02.104+0000 7fe38c102640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:38:02.104+0000 7fe38c903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient(hunting): handle_auth_done global_id 6098 payload 824 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient: _finish_hunting 0 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:38:02.104+0000 7fe383901640 1 monclient: found mon.noname-c 2024-09-22T08:38:02.860 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:38:02.104+0000 7fe383901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: dump: 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: _finish_auth 0 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:38:02.861 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:38:02.104+0000 7fe261ffb640 10 monclient: dump: 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:02.862 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:38:02.104+0000 7fe2637fe640 4 set_mon_vals no callback set 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:38:02.104+0000 7fe390524800 5 monclient: authenticate success, global_id 6098 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _renew_subs 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:38:02.104+0000 7fe390524800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:38:02.104+0000 7fe390524800 1 librados: init done 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:38:02.104+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cr dump hook 0x55f5fe46a598 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:38:02.106+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:38:02.106+0000 7fe261ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:38:02.107+0000 7fe38c903640 10 monclient: get_auth_request con 0x7fe2540775a0 auth_method 0 2024-09-22T08:38:02.863 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:38:02.107+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe48e3f0 auth_method 0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:38:02.108+0000 7fe390524800 20 realm 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:38:02.108+0000 7fe390524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:38:02.108+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:38:02.108+0000 7fe383901640 10 monclient: get_auth_request con 0x55f5fe4927d0 auth_method 0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:38:02.109+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:38:02.109+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:38:02.109+0000 7fe38c903640 10 monclient: get_auth_request con 0x55f5fe495ef0 auth_method 0 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:38:02.110+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:38:02.110+0000 7fe390524800 20 searching for the correct realm 2024-09-22T08:38:02.864 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:38:02.110+0000 7fe38c102640 10 monclient: get_auth_request con 0x55f5fe49ac70 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:38:02.110+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55f5fe49ac70 msgr2=0x55f5fe49d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:38:02.110+0000 7fe261ffb640 1 client.6098.objecter ms_handle_reset 0x55f5fe49ac70 session 0x55f5fe49a5f0 osd.4 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:38:02.111+0000 7fe261ffb640 10 monclient: _renew_subs 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:38:02.111+0000 7fe261ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:38:02.111+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe37c03b040 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:38:02.111+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe2540878c0 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:38:02.112+0000 7fe38c903640 10 monclient: get_auth_request con 0x7fe3740b8070 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:38:02.113+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:38:02.314+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:38:02.314+0000 7fe38c102640 0 -- 172.21.15.78:0/3740713949 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fe37c028040 msgr2=0x7fe37c027410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:38:02.715+0000 7fe38c102640 10 monclient: get_auth_request con 0x7fe37c028040 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:38:02.718+0000 7fe383901640 10 monclient: get_auth_request con 0x7fe384018040 auth_method 0 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:02.865 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:38:02.723+0000 7fe390524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:38:02.723+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:02.866 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:38:02.724+0000 7fe390524800 20 zone default found 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:38:02.724+0000 7fe390524800 4 Realm: () 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:38:02.724+0000 7fe390524800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:38:02.724+0000 7fe390524800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:38:02.724+0000 7fe390524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:38:02.724+0000 7fe390524800 20 zonegroup default 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:38:02.724+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:38:02.725+0000 7fe390524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:38:02.725+0000 7fe390524800 20 started sync module instance, tier type = 2024-09-22T08:38:02.867 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:38:02.725+0000 7fe390524800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=0 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=1 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=2 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=3 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=4 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=5 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:38:02.734+0000 7fe390524800 20 add_watcher() i=6 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:38:02.735+0000 7fe390524800 20 add_watcher() i=7 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:38:02.735+0000 7fe390524800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding auth protocol: cephx 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: crc 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:38:02.737+0000 7fe390524800 5 AuthRegistry(0x7ffdf80c3cc0) adding con mode: secure 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:38:02.737+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:38:02.738+0000 7fe390524800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:02.869 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache list hook 0x55f5fe46d200 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache inspect hook 0x55f5fe46d200 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache erase hook 0x55f5fe46d200 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command cache zap hook 0x55f5fe46d200 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:38:02.738+0000 7fe390524800 5 note: GC not initialized 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:38:02.738+0000 7fe241fdb640 20 reqs_thread_entry: start 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace show hook 0x7fe3740aa040 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace history hook 0x7fe3740aa040 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace active hook 0x7fe3740aa040 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:38:02.738+0000 7fe390524800 5 asok(0x55f5fe17c0f0) register_command sync trace active_short hook 0x7fe3740aa040 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:38:02.738+0000 7fe390524800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:02.870 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:38:02.738+0000 7fe390524800 20 Filter name: none 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:38:02.738+0000 7fe1b37fe640 20 reqs_thread_entry: start 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:38:02.738+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:38:02.738+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : miss 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:38:02.739+0000 7fe390524800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:38:02.739+0000 7fe390524800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:38:02.739+0000 7fe390524800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:38:02.739+0000 7fe390524800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:38:02.739+0000 7fe390524800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:02.871 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:38:02.741+0000 7fe390524800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe390524800 time 2024-09-22T08:38:02.741532+0000 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe391b8c748] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:38:02.742+0000 7fe390524800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe390524800 thread_name:radosgw-admin 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe39083e6f0] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe39088b99c] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe391b8c7a2] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe391b8c906] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5fc930e01] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80ac4) [0x55f5fce42ac4] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5fc940c9d] 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:02.873 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe390829590] 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:38:02.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:38:02.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:38:02.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:38:02.877 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:38:02.878 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:02.879 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe1b37fe640 / http_manager 2024-09-22T08:38:02.880 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe241fdb640 / http_manager 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe242fdd640 / rgw_dt_lg_renew 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe261ffb640 / ms_dispatch 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe2637fe640 / io_context_pool 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe271ffb640 / ms_dispatch 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe278e09640 / ms_dispatch 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe27a60c640 / io_context_pool 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe383901640 / msgr-worker-2 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38c102640 / msgr-worker-1 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38c903640 / msgr-worker-0 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe38d104640 / io_context_pool 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe390524800 / radosgw-admin 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:38:02.743161Z_4e994430-c9ab-4eb6-9989-e679481af964/log 2024-09-22T08:38:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:38:02.882 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:38:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.817+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 20 realm 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.819+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.820+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.820+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.820+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.820+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.821+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.821+0000 7f87e3146800 20 searching for the correct realm 2024-09-22T08:38:02.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:02.823+0000 7f87e1438640 0 -- 172.21.15.78:0/1858913492 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f87c800e070 msgr2=0x7f87c8084400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:03.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.028+0000 7f87d8436640 0 -- 172.21.15.78:0/1858913492 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f87dc047040 msgr2=0x7f87dc048430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.033+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 zone default found 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 4 Realm: () 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 zonegroup default 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.034+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.035+0000 7f87e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.035+0000 7f87e3146800 20 started sync module instance, tier type = 2024-09-22T08:38:03.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.035+0000 7f87e3146800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:03.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=0 2024-09-22T08:38:03.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=1 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=2 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=3 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=4 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=5 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.043+0000 7f87e3146800 20 add_watcher() i=6 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.044+0000 7f87e3146800 20 add_watcher() i=7 2024-09-22T08:38:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.044+0000 7f87e3146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:03.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.046+0000 7f86977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:03.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:03.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:03.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 5 note: GC not initialized 2024-09-22T08:38:03.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f86967e4640 20 reqs_thread_entry: start 2024-09-22T08:38:03.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:03.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 20 Filter name: none 2024-09-22T08:38:03.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f868f7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:03.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.047+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.048+0000 7f87e3146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.049+0000 7f87e3146800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:03.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.049+0000 7f87e3146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:03.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.050+0000 7f86977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:03.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.053+0000 7f87e3146800 20 remove_watcher() i=0 2024-09-22T08:38:03.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.053+0000 7f87e3146800 2 removed watcher, disabling cache 2024-09-22T08:38:03.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.054+0000 7f87e3146800 20 remove_watcher() i=1 2024-09-22T08:38:03.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.055+0000 7f87e3146800 20 remove_watcher() i=2 2024-09-22T08:38:03.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.056+0000 7f87e3146800 20 remove_watcher() i=3 2024-09-22T08:38:03.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.057+0000 7f87e3146800 20 remove_watcher() i=4 2024-09-22T08:38:03.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.058+0000 7f87e3146800 20 remove_watcher() i=5 2024-09-22T08:38:03.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.059+0000 7f87e3146800 20 remove_watcher() i=6 2024-09-22T08:38:03.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.060+0000 7f87e3146800 20 remove_watcher() i=7 2024-09-22T08:38:03.071 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:03.071 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:03.071 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:03.072 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:03.160 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:38:03.191 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:03.192 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:03.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.229+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 20 realm 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.230+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.231+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.231+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.231+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.231+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.232+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.232+0000 7f393d92c800 20 searching for the correct realm 2024-09-22T08:38:03.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.233+0000 7f393953e640 0 -- 172.21.15.78:0/1197858707 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x563ef4eadd90 msgr2=0x563ef4eb0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:03.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.236+0000 7f393953e640 0 -- 172.21.15.78:0/1197858707 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f392c0883f0 msgr2=0x7f392c088870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:03.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.242+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 zone default found 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 4 Realm: () 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 zonegroup default 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.243+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.244+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.244+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.244+0000 7f393d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.244+0000 7f393d92c800 20 started sync module instance, tier type = 2024-09-22T08:38:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.244+0000 7f393d92c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=0 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=1 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=2 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=3 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=4 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=5 2024-09-22T08:38:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=6 2024-09-22T08:38:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 20 add_watcher() i=7 2024-09-22T08:38:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.253+0000 7f393d92c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.255+0000 7f37effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.255+0000 7f393d92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.255+0000 7f393d92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.255+0000 7f393d92c800 5 note: GC not initialized 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f37eefe5640 20 reqs_thread_entry: start 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 20 Filter name: none 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f37ecfe1640 20 reqs_thread_entry: start 2024-09-22T08:38:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:38:03.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:03.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:38:03.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : miss 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.256+0000 7f393d92c800 20 rados->read ofs=0 len=0 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.257+0000 7f393d92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.258+0000 7f393d92c800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to be held by another RGW process; skipping for now 2024-09-22T08:38:03.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.259+0000 7f37effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.261+0000 7f393d92c800 20 remove_watcher() i=0 2024-09-22T08:38:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.261+0000 7f393d92c800 2 removed watcher, disabling cache 2024-09-22T08:38:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.262+0000 7f393d92c800 20 remove_watcher() i=1 2024-09-22T08:38:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.263+0000 7f393d92c800 20 remove_watcher() i=2 2024-09-22T08:38:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.264+0000 7f393d92c800 20 remove_watcher() i=3 2024-09-22T08:38:03.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.265+0000 7f393d92c800 20 remove_watcher() i=4 2024-09-22T08:38:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.266+0000 7f393d92c800 20 remove_watcher() i=5 2024-09-22T08:38:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.266+0000 7f393d92c800 20 remove_watcher() i=6 2024-09-22T08:38:03.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:03.267+0000 7f393d92c800 20 remove_watcher() i=7 2024-09-22T08:38:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:38:33.310 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:38:33.344 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:33.345 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:33.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.386+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.388+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.388+0000 7f72ac146800 20 realm 2024-09-22T08:38:33.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.388+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.389+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.389+0000 7f72ac146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.389+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.389+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.389+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.390+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:33.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.390+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.391+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:33.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.391+0000 7f72ac146800 20 searching for the correct realm 2024-09-22T08:38:33.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.393+0000 7f72aa431640 0 -- 172.21.15.78:0/674537930 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f729405a060 msgr2=0x7f729402e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:33.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.600+0000 7f72a142f640 0 -- 172.21.15.78:0/674537930 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f72a4033040 msgr2=0x7f72a4033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:33.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:33.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:33.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:33.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.606+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 zone default found 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 4 Realm: () 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:33.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 zonegroup default 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.607+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.608+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.608+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.608+0000 7f72ac146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.608+0000 7f72ac146800 20 started sync module instance, tier type = 2024-09-22T08:38:33.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.608+0000 7f72ac146800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=0 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=1 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=2 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=3 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=4 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=5 2024-09-22T08:38:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.618+0000 7f72ac146800 20 add_watcher() i=6 2024-09-22T08:38:33.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.619+0000 7f72ac146800 20 add_watcher() i=7 2024-09-22T08:38:33.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.619+0000 7f72ac146800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.621+0000 7f715b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 5 note: GC not initialized 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f715a7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 20 Filter name: none 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f70cbfff640 20 reqs_thread_entry: start 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.622+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.623+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.623+0000 7f72ac146800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.623+0000 7f72ac146800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.623+0000 7f72ac146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : miss 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.623+0000 7f72ac146800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:33.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.624+0000 7f72ac146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:33.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f72ac146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f72ac146800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f72ac146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f72ac146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22, ofs0, ns] 2024-09-22T08:38:33.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f718d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562470 cookie 94403947117104 notifier 6576 bl.length()=997 2024-09-22T08:38:33.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f718d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f718d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.629+0000 7f718d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.631+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_sources= new_sources= 2024-09-22T08:38:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.631+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential sources added=[] removed=[] 2024-09-22T08:38:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.631+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_dests= new_dests= 2024-09-22T08:38:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.631+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential dests added=[] removed=[] 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.0 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.0 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.1 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.1 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.2 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.2 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.3 2024-09-22T08:38:33.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.3 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.4 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.4 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.5 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.5 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.6 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.6 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.7 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.7 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.8 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.8 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.9 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.9 2024-09-22T08:38:33.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.10 2024-09-22T08:38:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.10 2024-09-22T08:38:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.11 2024-09-22T08:38:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1.11 2024-09-22T08:38:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.0 2024-09-22T08:38:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.636+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1 2024-09-22T08:38:33.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.637+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.2 2024-09-22T08:38:33.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.637+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.3 2024-09-22T08:38:33.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.638+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.4 2024-09-22T08:38:33.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.638+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.5 2024-09-22T08:38:33.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.639+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.6 2024-09-22T08:38:33.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.640+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.7 2024-09-22T08:38:33.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.640+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.8 2024-09-22T08:38:33.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.640+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.9 2024-09-22T08:38:33.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.641+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.10 2024-09-22T08:38:33.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.644+0000 7f72ac146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:33.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.644+0000 7f72ac146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f72ac146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f72ac146800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f72ac146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f72ac146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22, ofs0, ns] 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f718d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562471 cookie 94403947117104 notifier 6576 bl.length()=997 2024-09-22T08:38:33.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f718d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f718d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.646+0000 7f718d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.648+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_sources= new_sources= 2024-09-22T08:38:33.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.648+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential sources added=[] removed=[] 2024-09-22T08:38:33.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.648+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_dests= new_dests= 2024-09-22T08:38:33.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.648+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential dests added=[] removed=[] 2024-09-22T08:38:33.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.650+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.0 2024-09-22T08:38:33.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.650+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.1 2024-09-22T08:38:33.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.651+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.2 2024-09-22T08:38:33.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.651+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.3 2024-09-22T08:38:33.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.651+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.4 2024-09-22T08:38:33.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.652+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.5 2024-09-22T08:38:33.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.652+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.6 2024-09-22T08:38:33.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.653+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.7 2024-09-22T08:38:33.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.653+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.8 2024-09-22T08:38:33.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.653+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.9 2024-09-22T08:38:33.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.654+0000 7f72ac146800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22.10 2024-09-22T08:38:33.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.654+0000 7f72ac146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:33.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.654+0000 7f72ac146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 2024-09-22T08:38:33.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.655+0000 7f72ac146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.655+0000 7f72ac146800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.655+0000 7f72ac146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.655+0000 7f72ac146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22, ofs0, ns] 2024-09-22T08:38:33.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.656+0000 7f718cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562472 cookie 94403947117104 notifier 6576 bl.length()=965 2024-09-22T08:38:33.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.656+0000 7f718cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 info.flags=0x17 2024-09-22T08:38:33.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.656+0000 7f718cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 to cache LRU end 2024-09-22T08:38:33.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.656+0000 7f718cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:33.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.658+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_sources= new_sources= 2024-09-22T08:38:33.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.658+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential sources added=[] removed=[] 2024-09-22T08:38:33.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.658+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): orig_dests= new_dests= 2024-09-22T08:38:33.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.658+0000 7f72ac146800 20 handle_bi_update(): bucket=:abort-at-init-indext[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22]): potential dests added=[] removed=[] 2024-09-22T08:38:33.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.660+0000 7f72ac146800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-22T08:38:33.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.662+0000 7f715b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:33.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.664+0000 7f72ac146800 20 remove_watcher() i=0 2024-09-22T08:38:33.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.664+0000 7f72ac146800 2 removed watcher, disabling cache 2024-09-22T08:38:33.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.665+0000 7f72ac146800 20 remove_watcher() i=1 2024-09-22T08:38:33.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.666+0000 7f72ac146800 20 remove_watcher() i=2 2024-09-22T08:38:33.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.667+0000 7f72ac146800 20 remove_watcher() i=3 2024-09-22T08:38:33.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.668+0000 7f72ac146800 20 remove_watcher() i=4 2024-09-22T08:38:33.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.669+0000 7f72ac146800 20 remove_watcher() i=5 2024-09-22T08:38:33.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.670+0000 7f72ac146800 20 remove_watcher() i=6 2024-09-22T08:38:33.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.671+0000 7f72ac146800 20 remove_watcher() i=7 2024-09-22T08:38:33.684 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T08:38:33.713 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:33.713 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:33.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.748+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 20 realm 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.750+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.751+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.751+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.751+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:33.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.751+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.752+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:33.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.752+0000 7effa6f3b800 20 searching for the correct realm 2024-09-22T08:38:33.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.754+0000 7effa3426640 0 -- 172.21.15.78:0/3504994113 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7eff8c043970 msgr2=0x7eff8c01b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:33.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.959+0000 7eff9a424640 0 -- 172.21.15.78:0/3504994113 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7eff9c040040 msgr2=0x7eff9c030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:33.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.964+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 zone default found 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 4 Realm: () 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 zonegroup default 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.965+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.966+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.966+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.966+0000 7effa6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.966+0000 7effa6f3b800 20 started sync module instance, tier type = 2024-09-22T08:38:33.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.966+0000 7effa6f3b800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:33.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=0 2024-09-22T08:38:33.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=1 2024-09-22T08:38:33.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=2 2024-09-22T08:38:33.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=3 2024-09-22T08:38:33.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=4 2024-09-22T08:38:33.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=5 2024-09-22T08:38:33.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.975+0000 7effa6f3b800 20 add_watcher() i=6 2024-09-22T08:38:33.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.976+0000 7effa6f3b800 20 add_watcher() i=7 2024-09-22T08:38:33.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.976+0000 7effa6f3b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:33.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7efe597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7effa6f3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7effa6f3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7effa6f3b800 5 note: GC not initialized 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7efdd3fff640 20 reqs_thread_entry: start 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.978+0000 7effa6f3b800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.979+0000 7effa6f3b800 20 Filter name: none 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.979+0000 7efdd1ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:33.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.979+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.979+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:33.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.979+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:33.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:33.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=212 2024-09-22T08:38:33.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 rados->read ofs=0 len=0 2024-09-22T08:38:33.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 rados_obj.operate() r=0 bl.length=434 2024-09-22T08:38:33.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.980+0000 7effa6f3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:33.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.982+0000 7efe597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:33.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.984+0000 7effa6f3b800 20 remove_watcher() i=0 2024-09-22T08:38:33.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.984+0000 7effa6f3b800 2 removed watcher, disabling cache 2024-09-22T08:38:33.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.985+0000 7effa6f3b800 20 remove_watcher() i=1 2024-09-22T08:38:33.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.986+0000 7effa6f3b800 20 remove_watcher() i=2 2024-09-22T08:38:33.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.987+0000 7effa6f3b800 20 remove_watcher() i=3 2024-09-22T08:38:33.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.988+0000 7effa6f3b800 20 remove_watcher() i=4 2024-09-22T08:38:33.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.989+0000 7effa6f3b800 20 remove_watcher() i=5 2024-09-22T08:38:33.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.990+0000 7effa6f3b800 20 remove_watcher() i=6 2024-09-22T08:38:33.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:33.991+0000 7effa6f3b800 20 remove_watcher() i=7 2024-09-22T08:38:34.003 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:34.003 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:34.003 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:38:34.003 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:34.383 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-22T08:38:34.383 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:35.200 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:38:35.228 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:35.228 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:35.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.263+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 realm 2024-09-22T08:38:35.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.265+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.266+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.266+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.267+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:35.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.267+0000 7fa1f6c20800 20 searching for the correct realm 2024-09-22T08:38:35.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.269+0000 7fa1f4f0b640 0 -- 172.21.15.78:0/3870709283 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa1dc01f060 msgr2=0x7fa1dc07ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:35.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.474+0000 7fa1ebf09640 0 -- 172.21.15.78:0/3870709283 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa1ec02d040 msgr2=0x7fa1ec044430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:35.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:35.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.479+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:35.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 zone default found 2024-09-22T08:38:35.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 4 Realm: () 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 zonegroup default 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.480+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.481+0000 7fa1f6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.481+0000 7fa1f6c20800 20 started sync module instance, tier type = 2024-09-22T08:38:35.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.481+0000 7fa1f6c20800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:35.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=0 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=1 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=2 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=3 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=4 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=5 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.489+0000 7fa1f6c20800 20 add_watcher() i=6 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.490+0000 7fa1f6c20800 20 add_watcher() i=7 2024-09-22T08:38:35.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.490+0000 7fa1f6c20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:35.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa0aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa1f6c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa1f6c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa1f6c20800 5 note: GC not initialized 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa0a9fdb640 20 reqs_thread_entry: start 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa1f6c20800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa1f6c20800 20 Filter name: none 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.492+0000 7fa01b7fe640 20 reqs_thread_entry: start 2024-09-22T08:38:35.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.493+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.493+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.493+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.494+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.494+0000 7fa1f6c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.494+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.494+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:35.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.494+0000 7fa1f6c20800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.495+0000 7fa1f6c20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:35.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.495+0000 7fa1f6c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:35.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.496+0000 7fa0aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.498+0000 7fa1f6c20800 20 remove_watcher() i=0 2024-09-22T08:38:35.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.498+0000 7fa1f6c20800 2 removed watcher, disabling cache 2024-09-22T08:38:35.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.499+0000 7fa1f6c20800 20 remove_watcher() i=1 2024-09-22T08:38:35.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.500+0000 7fa1f6c20800 20 remove_watcher() i=2 2024-09-22T08:38:35.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.501+0000 7fa1f6c20800 20 remove_watcher() i=3 2024-09-22T08:38:35.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.502+0000 7fa1f6c20800 20 remove_watcher() i=4 2024-09-22T08:38:35.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.503+0000 7fa1f6c20800 20 remove_watcher() i=5 2024-09-22T08:38:35.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.503+0000 7fa1f6c20800 20 remove_watcher() i=6 2024-09-22T08:38:35.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.504+0000 7fa1f6c20800 20 remove_watcher() i=7 2024-09-22T08:38:35.516 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:35.516 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:35.516 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:35.516 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:35.517 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-22T08:38:35.551 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:35.551 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:35.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.586+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 20 realm 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.588+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.589+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.589+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.589+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.589+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.590+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:35.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.590+0000 7f485d940800 20 searching for the correct realm 2024-09-22T08:38:35.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.593+0000 7f4859686640 0 -- 172.21.15.78:0/2624420128 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f484c0beba0 msgr2=0x7f484c0de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:35.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.799+0000 7f4859686640 0 -- 172.21.15.78:0/2624420128 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55c10bbcd8a0 msgr2=0x55c10bbcfd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.802+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.803+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.803+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.803+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.803+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 zone default found 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 4 Realm: () 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 zonegroup default 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 started sync module instance, tier type = 2024-09-22T08:38:35.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.804+0000 7f485d940800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=0 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=1 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=2 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=3 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=4 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=5 2024-09-22T08:38:35.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.813+0000 7f485d940800 20 add_watcher() i=6 2024-09-22T08:38:35.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.814+0000 7f485d940800 20 add_watcher() i=7 2024-09-22T08:38:35.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.814+0000 7f485d940800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:35.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.815+0000 7f470f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:35.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 5 note: GC not initialized 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f470e7e4640 20 reqs_thread_entry: start 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 20 Filter name: none 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f467ffff640 20 reqs_thread_entry: start 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:38:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.816+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 : miss 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:35.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.817+0000 7f485d940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 2024-09-22T08:38:35.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.821+0000 7f485d940800 -1 Injecting error=-5 at location=set_target_layout 2024-09-22T08:38:35.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.821+0000 7f485d940800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-22T08:38:35.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.826+0000 7f470f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.827+0000 7f485d940800 20 remove_watcher() i=0 2024-09-22T08:38:35.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.827+0000 7f485d940800 2 removed watcher, disabling cache 2024-09-22T08:38:35.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.829+0000 7f485d940800 20 remove_watcher() i=1 2024-09-22T08:38:35.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.830+0000 7f485d940800 20 remove_watcher() i=2 2024-09-22T08:38:35.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.831+0000 7f485d940800 20 remove_watcher() i=3 2024-09-22T08:38:35.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.832+0000 7f485d940800 20 remove_watcher() i=4 2024-09-22T08:38:35.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.833+0000 7f485d940800 20 remove_watcher() i=5 2024-09-22T08:38:35.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.834+0000 7f485d940800 20 remove_watcher() i=6 2024-09-22T08:38:35.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.835+0000 7f485d940800 20 remove_watcher() i=7 2024-09-22T08:38:35.848 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:38:35.877 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:35.877 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:35.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.912+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 20 realm 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.914+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.915+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.915+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.915+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.915+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.916+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:35.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.916+0000 7f29d4728800 20 searching for the correct realm 2024-09-22T08:38:35.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.918+0000 7f29d0c70640 0 -- 172.21.15.78:0/3267878883 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f29c40a9040 msgr2=0x7f29c40a5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:35.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.922+0000 7f29cfc6e640 0 -- 172.21.15.78:0/3267878883 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f29c8037060 msgr2=0x7f29c8068600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:35.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:35.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:35.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 zone default found 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 4 Realm: () 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 zonegroup default 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.926+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 started sync module instance, tier type = 2024-09-22T08:38:35.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.927+0000 7f29d4728800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=0 2024-09-22T08:38:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=1 2024-09-22T08:38:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=2 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=3 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=4 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=5 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.935+0000 7f29d4728800 20 add_watcher() i=6 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.936+0000 7f29d4728800 20 add_watcher() i=7 2024-09-22T08:38:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.936+0000 7f29d4728800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.937+0000 7f2886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:35.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:35.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 5 note: GC not initialized 2024-09-22T08:38:35.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f2885fdb640 20 reqs_thread_entry: start 2024-09-22T08:38:35.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:35.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 20 Filter name: none 2024-09-22T08:38:35.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f27f77fe640 20 reqs_thread_entry: start 2024-09-22T08:38:35.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.938+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.939+0000 7f29d4728800 20 rados->read ofs=0 len=0 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.940+0000 7f29d4728800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:35.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.940+0000 7f29d4728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:35.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.941+0000 7f2886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:35.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.943+0000 7f29d4728800 20 remove_watcher() i=0 2024-09-22T08:38:35.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.943+0000 7f29d4728800 2 removed watcher, disabling cache 2024-09-22T08:38:35.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.944+0000 7f29d4728800 20 remove_watcher() i=1 2024-09-22T08:38:35.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.945+0000 7f29d4728800 20 remove_watcher() i=2 2024-09-22T08:38:35.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.946+0000 7f29d4728800 20 remove_watcher() i=3 2024-09-22T08:38:35.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.947+0000 7f29d4728800 20 remove_watcher() i=4 2024-09-22T08:38:35.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.948+0000 7f29d4728800 20 remove_watcher() i=5 2024-09-22T08:38:35.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.949+0000 7f29d4728800 20 remove_watcher() i=6 2024-09-22T08:38:35.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:35.950+0000 7f29d4728800 20 remove_watcher() i=7 2024-09-22T08:38:35.962 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:35.962 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:35.962 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:35.962 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:36.051 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:38:36.083 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:36.083 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:36.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.119+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.120+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.120+0000 7f2253522800 20 realm 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.120+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.121+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.121+0000 7f2253522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.121+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.121+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.121+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.122+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:36.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.122+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.123+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:36.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.123+0000 7f2253522800 20 searching for the correct realm 2024-09-22T08:38:36.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.125+0000 7f224f9af640 0 -- 172.21.15.78:0/1400596872 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f223801bc20 msgr2=0x7f2238069740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:36.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.128+0000 7f22469ad640 0 -- 172.21.15.78:0/1400596872 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f22480aea90 msgr2=0x7f22480afb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:36.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.133+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 zone default found 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 4 Realm: () 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 zonegroup default 2024-09-22T08:38:36.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.134+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.135+0000 7f2253522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.135+0000 7f2253522800 20 started sync module instance, tier type = 2024-09-22T08:38:36.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.135+0000 7f2253522800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=0 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=1 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=2 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=3 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=4 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=5 2024-09-22T08:38:36.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.143+0000 7f2253522800 20 add_watcher() i=6 2024-09-22T08:38:36.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.144+0000 7f2253522800 20 add_watcher() i=7 2024-09-22T08:38:36.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.144+0000 7f2253522800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:36.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.145+0000 7f2105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:36.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.145+0000 7f2253522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:36.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.145+0000 7f2253522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:36.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.145+0000 7f2253522800 5 note: GC not initialized 2024-09-22T08:38:36.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f2104fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f2253522800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f2253522800 20 Filter name: none 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f207e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f2253522800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.146+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 : miss 2024-09-22T08:38:36.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.147+0000 7f2253522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f2253522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f2253522800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f2253522800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f2253522800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23, ofs0, ns] 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f21327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562463 cookie 94629716230768 notifier 6666 bl.length()=1009 2024-09-22T08:38:36.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f21327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f21327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.152+0000 7f21327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.154+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_sources= new_sources= 2024-09-22T08:38:36.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.154+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential sources added=[] removed=[] 2024-09-22T08:38:36.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.154+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_dests= new_dests= 2024-09-22T08:38:36.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.154+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential dests added=[] removed=[] 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.0 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.0 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.1 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.1 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.2 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.2 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.3 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.3 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.4 2024-09-22T08:38:36.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.4 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.5 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.5 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.6 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.6 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.7 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.7 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.8 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.8 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.9 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.9 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.10 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.10 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.11 2024-09-22T08:38:36.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1.11 2024-09-22T08:38:36.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.158+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.0 2024-09-22T08:38:36.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.159+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1 2024-09-22T08:38:36.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.159+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.2 2024-09-22T08:38:36.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.160+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.3 2024-09-22T08:38:36.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.160+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.4 2024-09-22T08:38:36.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.161+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.5 2024-09-22T08:38:36.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.161+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.6 2024-09-22T08:38:36.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.161+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.7 2024-09-22T08:38:36.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.162+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.8 2024-09-22T08:38:36.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.163+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.9 2024-09-22T08:38:36.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.163+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.10 2024-09-22T08:38:36.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.166+0000 7f2253522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:36.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.166+0000 7f2253522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 2024-09-22T08:38:36.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f2253522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f2253522800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f2253522800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f2253522800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23, ofs0, ns] 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f21327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94629716230768 notifier 6666 bl.length()=1009 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f21327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f21327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.167+0000 7f21327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.169+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_sources= new_sources= 2024-09-22T08:38:36.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.169+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential sources added=[] removed=[] 2024-09-22T08:38:36.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.169+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_dests= new_dests= 2024-09-22T08:38:36.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.169+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential dests added=[] removed=[] 2024-09-22T08:38:36.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.173+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.0 2024-09-22T08:38:36.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.174+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.1 2024-09-22T08:38:36.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.174+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.2 2024-09-22T08:38:36.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.174+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.3 2024-09-22T08:38:36.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.174+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.4 2024-09-22T08:38:36.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.175+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.5 2024-09-22T08:38:36.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.175+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.6 2024-09-22T08:38:36.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.175+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.7 2024-09-22T08:38:36.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.176+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.8 2024-09-22T08:38:36.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.176+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.9 2024-09-22T08:38:36.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.176+0000 7f2253522800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23.10 2024-09-22T08:38:36.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.177+0000 7f2253522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:36.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.177+0000 7f2253522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2253522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2253522800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2253522800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2253522800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23, ofs0, ns] 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2132ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94629716230768 notifier 6666 bl.length()=977 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2132ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 info.flags=0x17 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2132ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 to cache LRU end 2024-09-22T08:38:36.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.178+0000 7f2132ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:36.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.179+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_sources= new_sources= 2024-09-22T08:38:36.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.179+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential sources added=[] removed=[] 2024-09-22T08:38:36.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.179+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): orig_dests= new_dests= 2024-09-22T08:38:36.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.179+0000 7f2253522800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23]): potential dests added=[] removed=[] 2024-09-22T08:38:36.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.182+0000 7f2253522800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:38:36.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.184+0000 7f2105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:36.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.186+0000 7f2253522800 20 remove_watcher() i=0 2024-09-22T08:38:36.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.186+0000 7f2253522800 2 removed watcher, disabling cache 2024-09-22T08:38:36.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.187+0000 7f2253522800 20 remove_watcher() i=1 2024-09-22T08:38:36.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.188+0000 7f2253522800 20 remove_watcher() i=2 2024-09-22T08:38:36.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.188+0000 7f2253522800 20 remove_watcher() i=3 2024-09-22T08:38:36.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.189+0000 7f2253522800 20 remove_watcher() i=4 2024-09-22T08:38:36.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.190+0000 7f2253522800 20 remove_watcher() i=5 2024-09-22T08:38:36.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.191+0000 7f2253522800 20 remove_watcher() i=6 2024-09-22T08:38:36.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.192+0000 7f2253522800 20 remove_watcher() i=7 2024-09-22T08:38:36.205 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:38:36.234 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:36.234 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:36.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.270+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 realm 2024-09-22T08:38:36.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:36.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.272+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.273+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:36.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.273+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.274+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:36.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.274+0000 7f4e16d1f800 20 searching for the correct realm 2024-09-22T08:38:36.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.276+0000 7f4e132a3640 0 -- 172.21.15.78:0/990726185 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f4e0808bc40 msgr2=0x7f4e080940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:36.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.482+0000 7f4e122a1640 0 -- 172.21.15.78:0/990726185 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f4e0c0cd0a0 msgr2=0x7f4e0c0b5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 zone default found 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 4 Realm: () 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 zonegroup default 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.487+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:36.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 started sync module instance, tier type = 2024-09-22T08:38:36.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.488+0000 7f4e16d1f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=0 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=1 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=2 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=3 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=4 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=5 2024-09-22T08:38:36.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.497+0000 7f4e16d1f800 20 add_watcher() i=6 2024-09-22T08:38:36.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.498+0000 7f4e16d1f800 20 add_watcher() i=7 2024-09-22T08:38:36.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.498+0000 7f4e16d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:36.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4e16d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4e16d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4e16d1f800 5 note: GC not initialized 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4c43fff640 20 reqs_thread_entry: start 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.500+0000 7f4e16d1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.501+0000 7f4e16d1f800 20 Filter name: none 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.501+0000 7f4c41ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:36.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.501+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.501+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:36.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.501+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:36.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:36.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:36.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:38:36.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:36.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.502+0000 7f4e16d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:36.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.504+0000 7f4cc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:36.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.506+0000 7f4e16d1f800 20 remove_watcher() i=0 2024-09-22T08:38:36.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.506+0000 7f4e16d1f800 2 removed watcher, disabling cache 2024-09-22T08:38:36.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.507+0000 7f4e16d1f800 20 remove_watcher() i=1 2024-09-22T08:38:36.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.508+0000 7f4e16d1f800 20 remove_watcher() i=2 2024-09-22T08:38:36.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.510+0000 7f4e16d1f800 20 remove_watcher() i=3 2024-09-22T08:38:36.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.510+0000 7f4e16d1f800 20 remove_watcher() i=4 2024-09-22T08:38:36.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.511+0000 7f4e16d1f800 20 remove_watcher() i=5 2024-09-22T08:38:36.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.512+0000 7f4e16d1f800 20 remove_watcher() i=6 2024-09-22T08:38:36.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:36.513+0000 7f4e16d1f800 20 remove_watcher() i=7 2024-09-22T08:38:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:36.524 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:36.524 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:38:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:36.894 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-22T08:38:36.894 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:37.713 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:38:37.741 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:37.741 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:37.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.776+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.777+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.777+0000 7f68bed32800 20 realm 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.777+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:37.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.778+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.779+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:37.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.779+0000 7f68bed32800 20 searching for the correct realm 2024-09-22T08:38:37.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.782+0000 7f68bb1bd640 0 -- 172.21.15.78:0/1643460008 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f68a406d040 msgr2=0x7f68a4096450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:37.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.785+0000 7f68b21bb640 0 -- 172.21.15.78:0/1643460008 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f68b408b040 msgr2=0x7f68b403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:37.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:37.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 zone default found 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 4 Realm: () 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 zonegroup default 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.789+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 started sync module instance, tier type = 2024-09-22T08:38:37.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.790+0000 7f68bed32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=0 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=1 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=2 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=3 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=4 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=5 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=6 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 20 add_watcher() i=7 2024-09-22T08:38:37.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.799+0000 7f68bed32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.801+0000 7f67717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.801+0000 7f68bed32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.801+0000 7f68bed32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.801+0000 7f68bed32800 5 note: GC not initialized 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.801+0000 7f66ebfff640 20 reqs_thread_entry: start 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.802+0000 7f68bed32800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.802+0000 7f68bed32800 20 Filter name: none 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.802+0000 7f66e9ffb640 20 reqs_thread_entry: start 2024-09-22T08:38:37.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.802+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:37.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.803+0000 7f68bed32800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.804+0000 7f68bed32800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:37.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.804+0000 7f68bed32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:37.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.805+0000 7f67717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:37.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.807+0000 7f68bed32800 20 remove_watcher() i=0 2024-09-22T08:38:37.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.807+0000 7f68bed32800 2 removed watcher, disabling cache 2024-09-22T08:38:37.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.808+0000 7f68bed32800 20 remove_watcher() i=1 2024-09-22T08:38:37.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.809+0000 7f68bed32800 20 remove_watcher() i=2 2024-09-22T08:38:37.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.810+0000 7f68bed32800 20 remove_watcher() i=3 2024-09-22T08:38:37.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.811+0000 7f68bed32800 20 remove_watcher() i=4 2024-09-22T08:38:37.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.812+0000 7f68bed32800 20 remove_watcher() i=5 2024-09-22T08:38:37.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.813+0000 7f68bed32800 20 remove_watcher() i=6 2024-09-22T08:38:37.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.814+0000 7f68bed32800 20 remove_watcher() i=7 2024-09-22T08:38:37.825 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:37.825 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:37.825 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:37.825 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:37.827 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-22T08:38:37.863 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:37.863 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:37.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.899+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 20 realm 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.900+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.901+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:37.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.901+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.901+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:37.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.901+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:37.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.902+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:37.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.902+0000 7f7cf7335800 20 searching for the correct realm 2024-09-22T08:38:37.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:37.904+0000 7f7cf3822640 0 -- 172.21.15.78:0/4287594410 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f7cdc082020 msgr2=0x7f7cdc0ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:38.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.108+0000 7f7cea820640 0 -- 172.21.15.78:0/4287594410 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7cec043040 msgr2=0x7f7cec033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:38.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.113+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 zone default found 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 4 Realm: () 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 zonegroup default 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.114+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.115+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.115+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.115+0000 7f7cf7335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.115+0000 7f7cf7335800 20 started sync module instance, tier type = 2024-09-22T08:38:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.115+0000 7f7cf7335800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:38.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=0 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=1 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=2 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=3 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=4 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=5 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.123+0000 7f7cf7335800 20 add_watcher() i=6 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.124+0000 7f7cf7335800 20 add_watcher() i=7 2024-09-22T08:38:38.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.124+0000 7f7cf7335800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:38.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.126+0000 7f7ba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:38.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 5 note: GC not initialized 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7ba8fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 20 Filter name: none 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7b227fc640 20 reqs_thread_entry: start 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T08:38:38.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.127+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 : miss 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:38.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.128+0000 7f7cf7335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 2024-09-22T08:38:38.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.132+0000 7f7cf7335800 -1 Injecting error=-125 at location=set_target_layout 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.133+0000 7f7cf7335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.133+0000 7f7cf7335800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.133+0000 7f7cf7335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.133+0000 7f7cf7335800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24, ofs0, ns] 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.134+0000 7f7bd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562468 cookie 94347282114624 notifier 6281 bl.length()=1009 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.134+0000 7f7bd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.134+0000 7f7bd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.134+0000 7f7bd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.135+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_sources= new_sources= 2024-09-22T08:38:38.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.135+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential sources added=[] removed=[] 2024-09-22T08:38:38.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.135+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_dests= new_dests= 2024-09-22T08:38:38.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.135+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential dests added=[] removed=[] 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.0 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.0 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.1 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.1 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.2 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.2 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.3 2024-09-22T08:38:38.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.3 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.4 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.4 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.5 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.5 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.6 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.6 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.7 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.7 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.8 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.8 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.9 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.9 2024-09-22T08:38:38.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.10 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.10 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.11 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1.11 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.0 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.140+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1 2024-09-22T08:38:38.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.141+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.2 2024-09-22T08:38:38.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.142+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.3 2024-09-22T08:38:38.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.142+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.4 2024-09-22T08:38:38.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.143+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.5 2024-09-22T08:38:38.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.143+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.6 2024-09-22T08:38:38.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.144+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.7 2024-09-22T08:38:38.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.145+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.8 2024-09-22T08:38:38.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.145+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.9 2024-09-22T08:38:38.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.146+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.10 2024-09-22T08:38:38.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.149+0000 7f7cf7335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:38.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.149+0000 7f7cf7335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 2024-09-22T08:38:38.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7cf7335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7cf7335800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7cf7335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7cf7335800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24, ofs0, ns] 2024-09-22T08:38:38.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7bd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562469 cookie 94347282114624 notifier 6281 bl.length()=1009 2024-09-22T08:38:38.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7bd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7bd6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.150+0000 7f7bd6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.152+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_sources= new_sources= 2024-09-22T08:38:38.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.152+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential sources added=[] removed=[] 2024-09-22T08:38:38.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.152+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_dests= new_dests= 2024-09-22T08:38:38.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.152+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential dests added=[] removed=[] 2024-09-22T08:38:38.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.154+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.0 2024-09-22T08:38:38.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.154+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.1 2024-09-22T08:38:38.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.155+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.2 2024-09-22T08:38:38.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.155+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.3 2024-09-22T08:38:38.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.155+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.4 2024-09-22T08:38:38.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.156+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.5 2024-09-22T08:38:38.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.156+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.6 2024-09-22T08:38:38.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.156+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.7 2024-09-22T08:38:38.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.157+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.8 2024-09-22T08:38:38.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.157+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.9 2024-09-22T08:38:38.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.157+0000 7f7cf7335800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24.10 2024-09-22T08:38:38.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.158+0000 7f7cf7335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 : hit (requested=0x17, cached=0x17) 2024-09-22T08:38:38.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.158+0000 7f7cf7335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 2024-09-22T08:38:38.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7cf7335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7cf7335800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7cf7335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7cf7335800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24, ofs0, ns] 2024-09-22T08:38:38.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7bd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562470 cookie 94347282114624 notifier 6281 bl.length()=977 2024-09-22T08:38:38.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.159+0000 7f7bd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 info.flags=0x17 2024-09-22T08:38:38.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.160+0000 7f7bd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 to cache LRU end 2024-09-22T08:38:38.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.160+0000 7f7bd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:38.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.161+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_sources= new_sources= 2024-09-22T08:38:38.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.161+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential sources added=[] removed=[] 2024-09-22T08:38:38.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.161+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): orig_dests= new_dests= 2024-09-22T08:38:38.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.161+0000 7f7cf7335800 20 handle_bi_update(): bucket=:error-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24]): potential dests added=[] removed=[] 2024-09-22T08:38:38.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.163+0000 7f7cf7335800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:38:38.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.165+0000 7f7ba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:38.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.167+0000 7f7cf7335800 20 remove_watcher() i=0 2024-09-22T08:38:38.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.167+0000 7f7cf7335800 2 removed watcher, disabling cache 2024-09-22T08:38:38.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.168+0000 7f7cf7335800 20 remove_watcher() i=1 2024-09-22T08:38:38.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.169+0000 7f7cf7335800 20 remove_watcher() i=2 2024-09-22T08:38:38.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.170+0000 7f7cf7335800 20 remove_watcher() i=3 2024-09-22T08:38:38.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.171+0000 7f7cf7335800 20 remove_watcher() i=4 2024-09-22T08:38:38.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.172+0000 7f7cf7335800 20 remove_watcher() i=5 2024-09-22T08:38:38.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.173+0000 7f7cf7335800 20 remove_watcher() i=6 2024-09-22T08:38:38.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.174+0000 7f7cf7335800 20 remove_watcher() i=7 2024-09-22T08:38:38.187 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T08:38:38.215 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:38.215 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:38.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.250+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.252+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.252+0000 7f4f51f46800 20 realm 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.252+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:38.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.253+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.254+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:38.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.254+0000 7f4f51f46800 20 searching for the correct realm 2024-09-22T08:38:38.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.256+0000 7f4f50238640 0 -- 172.21.15.78:0/2422180797 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f4f4406d060 msgr2=0x7f4f440ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:38.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.461+0000 7f4f4f236640 0 -- 172.21.15.78:0/2422180797 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f4f48034030 msgr2=0x7f4f48076c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:38.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:38.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:38.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:38.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:38.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:38.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:38.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.466+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 zone default found 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 4 Realm: () 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:38.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 zonegroup default 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.467+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.468+0000 7f4f51f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.468+0000 7f4f51f46800 20 started sync module instance, tier type = 2024-09-22T08:38:38.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.468+0000 7f4f51f46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=0 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=1 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=2 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=3 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=4 2024-09-22T08:38:38.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=5 2024-09-22T08:38:38.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.476+0000 7f4f51f46800 20 add_watcher() i=6 2024-09-22T08:38:38.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.477+0000 7f4f51f46800 20 add_watcher() i=7 2024-09-22T08:38:38.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.477+0000 7f4f51f46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:38.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4e05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4f51f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4f51f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4f51f46800 5 note: GC not initialized 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4e04fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4f51f46800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.479+0000 7f4f51f46800 20 Filter name: none 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.480+0000 7f4d7e7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:38.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.480+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.480+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.480+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:38.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 rados->read ofs=0 len=0 2024-09-22T08:38:38.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:38.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.481+0000 7f4f51f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:38.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.483+0000 7f4e05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:38.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.485+0000 7f4f51f46800 20 remove_watcher() i=0 2024-09-22T08:38:38.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.485+0000 7f4f51f46800 2 removed watcher, disabling cache 2024-09-22T08:38:38.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.486+0000 7f4f51f46800 20 remove_watcher() i=1 2024-09-22T08:38:38.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.487+0000 7f4f51f46800 20 remove_watcher() i=2 2024-09-22T08:38:38.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.488+0000 7f4f51f46800 20 remove_watcher() i=3 2024-09-22T08:38:38.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.489+0000 7f4f51f46800 20 remove_watcher() i=4 2024-09-22T08:38:38.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.490+0000 7f4f51f46800 20 remove_watcher() i=5 2024-09-22T08:38:38.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.491+0000 7f4f51f46800 20 remove_watcher() i=6 2024-09-22T08:38:38.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:38.492+0000 7f4f51f46800 20 remove_watcher() i=7 2024-09-22T08:38:38.503 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:38.503 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:38.503 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:38:38.503 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:38.889 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-22T08:38:38.889 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:38:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:39.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.768+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.770+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.770+0000 7f5b1d892800 20 realm 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.770+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.771+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.772+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.772+0000 7f5b1d892800 20 searching for the correct realm 2024-09-22T08:38:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.774+0000 7f5b1bb7d640 0 -- 172.21.15.78:0/159625820 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5b040460b0 msgr2=0x7f5b04048200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:39.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.979+0000 7f5b12b7b640 0 -- 172.21.15.78:0/159625820 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5b140a9430 msgr2=0x7f5b140a98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.984+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 zone default found 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 4 Realm: () 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 zonegroup default 2024-09-22T08:38:39.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.985+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.986+0000 7f5b1d892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:39.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.986+0000 7f5b1d892800 20 started sync module instance, tier type = 2024-09-22T08:38:39.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.986+0000 7f5b1d892800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=0 2024-09-22T08:38:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=1 2024-09-22T08:38:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=2 2024-09-22T08:38:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=3 2024-09-22T08:38:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=4 2024-09-22T08:38:39.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=5 2024-09-22T08:38:39.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.994+0000 7f5b1d892800 20 add_watcher() i=6 2024-09-22T08:38:39.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.995+0000 7f5b1d892800 20 add_watcher() i=7 2024-09-22T08:38:39.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.995+0000 7f5b1d892800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:39.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f59d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:39.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f5b1d892800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:39.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f5b1d892800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:39.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f5b1d892800 5 note: GC not initialized 2024-09-22T08:38:39.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f59d0fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:39.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.997+0000 7f5b1d892800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:40.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.998+0000 7f5b1d892800 20 Filter name: none 2024-09-22T08:38:40.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.998+0000 7f594a7fc640 20 reqs_thread_entry: start 2024-09-22T08:38:40.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.998+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.998+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.998+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.999+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.999+0000 7f5b1d892800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.999+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.999+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:39.999+0000 7f5b1d892800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.000+0000 7f5b1d892800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.000+0000 7f5b1d892800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:40.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.001+0000 7f59d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.003+0000 7f5b1d892800 20 remove_watcher() i=0 2024-09-22T08:38:40.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.003+0000 7f5b1d892800 2 removed watcher, disabling cache 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.004+0000 7f5b1d892800 20 remove_watcher() i=1 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.005+0000 7f5b1d892800 20 remove_watcher() i=2 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.006+0000 7f5b1d892800 20 remove_watcher() i=3 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.007+0000 7f5b1d892800 20 remove_watcher() i=4 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.008+0000 7f5b1d892800 20 remove_watcher() i=5 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.009+0000 7f5b1d892800 20 remove_watcher() i=6 2024-09-22T08:38:40.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.010+0000 7f5b1d892800 20 remove_watcher() i=7 2024-09-22T08:38:40.021 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.021 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:40.021 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:40.021 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.023 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-22T08:38:40.056 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:40.057 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:40.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.092+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 20 realm 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.095+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.095+0000 7feeccd3e800 20 searching for the correct realm 2024-09-22T08:38:40.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.097+0000 7feec8aed640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x559ca1a74660 msgr2=0x559ca1a76af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.100+0000 7feec02ec640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x559ca1a78890 msgr2=0x559ca1a7ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zone default found 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Realm: () 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zonegroup default 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started sync module instance, tier type = 2024-09-22T08:38:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=0 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=1 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=2 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=3 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=4 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=5 2024-09-22T08:38:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=6 2024-09-22T08:38:40.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.115+0000 7feeccd3e800 20 add_watcher() i=7 2024-09-22T08:38:40.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.115+0000 7feeccd3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:40.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7fed7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 5 note: GC not initialized 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7fed7e7e4640 20 reqs_thread_entry: start 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 20 Filter name: none 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7fed77fff640 20 reqs_thread_entry: start 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:38:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : miss 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:40.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.118+0000 7feeccd3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:38:40.123 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feeccd3e800 time 2024-09-22T08:38:40.123118+0000 2024-09-22T08:38:40.123 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feece58c748] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:38:40.124 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7feeccd3e800 thread_name:radosgw-admin 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feeccd3e800 time 2024-09-22T08:38:40.123118+0000 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feece58c748] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:40.125 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feecd23e6f0] 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feecd28b99c] 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feece58c7a2] 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.140 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7feeccd3e800 thread_name:radosgw-admin 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feecd23e6f0] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feecd28b99c] 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:40.141 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feece58c7a2] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.142 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: dump: 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:38:40.075+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6768 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:38:40.075+0000 7feeccd3e800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:38:40.075+0000 7feeccd3e800 4 set_mon_vals no callback set 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:38:40.075+0000 7feeccd3e800 10 monclient: shutdown 2024-09-22T08:38:40.143 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:38:40.075+0000 7feeccd3e800 5 asok(0x559ca17650f0) unregister_commands rotate-key 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.144 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.145 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: starting msgr at 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: starting objecter 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests hook 0x559ca198ed60 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: setting wanted keys 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: calling monclient init 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.146 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key hook 0x559ca1987a88 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca17ff7e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.147 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca18ca020 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca18d03b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.866036s 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca18ca020 auth_method 0 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca17ff7e0 auth_method 0 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.148 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca18d03b0 auth_method 0 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6323 payload 824 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:38:40.077+0000 7feec02ec640 1 monclient: found mon.noname-c 2024-09-22T08:38:40.149 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: dump: 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.150 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: dump: 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.151 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:38:40.077+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6323 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:38:40.077+0000 7fedb6e0d640 4 set_mon_vals no callback set 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:38:40.077+0000 7feeccd3e800 1 librados: init done 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:38:40.079+0000 7feec8aed640 10 monclient: get_auth_request con 0x7fedb0077710 auth_method 0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:38:40.080+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca19c96f0 auth_method 0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:38:40.080+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca19d2ec0 auth_method 0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:38:40.081+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca19d7140 auth_method 0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:38:40.082+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca19d67a0 auth_method 0 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.152 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:38:40.083+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.153 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ca19e2770 EEXIST 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.154 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.155 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:38:40.084+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x559ca19de3b0 EEXIST 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a06a90 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a06e70 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a057a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.873087s 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a06a90 auth_method 0 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.156 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a057a0 auth_method 0 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a06e70 auth_method 0 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.157 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6326 payload 824 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:38:40.084+0000 7feec02ec640 1 monclient: found mon.noname-c 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: dump: 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.158 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: dump: 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.159 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:38:40.084+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6326 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:38:40.084+0000 7feec9aef640 4 set_mon_vals no callback set 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.160 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:38:40.086+0000 7feec92ee640 10 monclient: get_auth_request con 0x7feda0077480 auth_method 0 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: get_monmap_and_config 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:38:40.086+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.161 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.162 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.163 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x7fffac9e9348 EEXIST 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a5a8a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a2a6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a55c60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.164 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.876660s 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a2a6b0 auth_method 0 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a5a8a0 auth_method 0 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a55c60 auth_method 0 2024-09-22T08:38:40.165 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_done global_id 6777 payload 274 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:38:40.087+0000 7feec92ee640 1 monclient: found mon.noname-a 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:40.166 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: dump: 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6777 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.167 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: dump: 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:38:40.088+0000 7feeccd3e800 4 set_mon_vals no callback set 2024-09-22T08:38:40.168 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: shutdown 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:38:40.088+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.169 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.170 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: starting msgr at 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: starting objecter 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ca1a28c10 EEXIST 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: setting wanted keys 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: calling monclient init 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.171 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x559ca1a1b498 EEXIST 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a2a6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a55c60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a5a8a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.172 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.878960s 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a2a6b0 auth_method 0 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a55c60 auth_method 0 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.173 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a5a8a0 auth_method 0 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6780 payload 824 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:38:40.090+0000 7feec02ec640 1 monclient: found mon.noname-a 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.174 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: dump: 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.175 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: dump: 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.176 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:38:40.090+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6780 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:38:40.090+0000 7fed9ffff640 4 set_mon_vals no callback set 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:38:40.090+0000 7feeccd3e800 1 librados: init done 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:38:40.090+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cr dump hook 0x559ca1a68e18 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:38:40.092+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:38:40.092+0000 7feec92ee640 10 monclient: get_auth_request con 0x7fed94077570 auth_method 0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:38:40.093+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca1a74660 auth_method 0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.177 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 realm 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:38:40.093+0000 7feeccd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:38:40.094+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca1a78890 auth_method 0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:38:40.094+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca1a7c110 auth_method 0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:38:40.095+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:38:40.095+0000 7feeccd3e800 20 searching for the correct realm 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:38:40.095+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca1a80ed0 auth_method 0 2024-09-22T08:38:40.178 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:38:40.096+0000 7feec02ec640 10 monclient: get_auth_request con 0x7feeb8026040 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:38:40.097+0000 7feec8aed640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x559ca1a74660 msgr2=0x559ca1a76af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 1 client.6780.objecter ms_handle_reset 0x559ca1a74660 session 0x559ca1a73f90 osd.6 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 10 monclient: _renew_subs 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:38:40.097+0000 7feec8aed640 10 monclient: get_auth_request con 0x7fed94087890 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:38:40.097+0000 7feec92ee640 10 monclient: get_auth_request con 0x7feeb00f0040 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:38:40.098+0000 7feec8aed640 10 monclient: get_auth_request con 0x7feeb8036040 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:38:40.100+0000 7feec02ec640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x559ca1a78890 msgr2=0x559ca1a7ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:38:40.100+0000 7fed9e7fc640 1 client.6780.objecter ms_handle_reset 0x559ca1a78890 session 0x559ca1a78210 osd.1 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:38:40.100+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca1a74660 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:38:40.100+0000 7feec02ec640 10 monclient: get_auth_request con 0x7feec4018040 auth_method 0 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:40.179 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zone default found 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Realm: () 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:38:40.105+0000 7feeccd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zonegroup default 2024-09-22T08:38:40.180 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started sync module instance, tier type = 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=0 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=1 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=2 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=3 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=4 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=5 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=6 2024-09-22T08:38:40.181 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:38:40.115+0000 7feeccd3e800 20 add_watcher() i=7 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:38:40.115+0000 7feeccd3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:38:40.117+0000 7fed7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.182 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:38:40.117+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache list hook 0x559ca1a50ba0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache inspect hook 0x559ca1a50ba0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache erase hook 0x559ca1a50ba0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache zap hook 0x559ca1a50ba0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 note: GC not initialized 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:38:40.117+0000 7fed7e7e4640 20 reqs_thread_entry: start 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace show hook 0x7feec40016f0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace history hook 0x7feec40016f0 2024-09-22T08:38:40.183 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace active hook 0x7feec40016f0 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace active_short hook 0x7feec40016f0 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 Filter name: none 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:38:40.117+0000 7fed77fff640 20 reqs_thread_entry: start 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:38:40.117+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : miss 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:38:40.184 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feeccd3e800 time 2024-09-22T08:38:40.123118+0000 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feece58c748] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:40.185 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7feeccd3e800 thread_name:radosgw-admin 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feecd23e6f0] 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feecd28b99c] 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feece58c7a2] 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.186 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:38:40.187 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:38:40.188 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:38:40.189 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:38:40.190 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:38:40.191 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:40.192 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed77fff640 / http_manager 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed7e7e4640 / http_manager 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed7f7e6640 / rgw_dt_lg_renew 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed9e7fc640 / ms_dispatch 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed9ffff640 / io_context_pool 2024-09-22T08:38:40.193 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedae7fc640 / ms_dispatch 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedb560a640 / ms_dispatch 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedb6e0d640 / io_context_pool 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec02ec640 / msgr-worker-2 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec8aed640 / msgr-worker-1 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec92ee640 / msgr-worker-0 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec9aef640 / io_context_pool 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: 7feeccd3e800 / radosgw-admin 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.101006.log 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.194 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:38:40.075+0000 7fedb6e0d640 10 monclient: dump: 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:38:40.075+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6768 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:38:40.075+0000 7feeccd3e800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:40.195 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:38:40.075+0000 7feeccd3e800 4 set_mon_vals no callback set 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:38:40.075+0000 7feeccd3e800 10 monclient: shutdown 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:38:40.075+0000 7feeccd3e800 5 asok(0x559ca17650f0) unregister_commands rotate-key 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.196 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding auth protocol: cephx 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.197 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: crc 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1989710) adding con mode: secure 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: starting msgr at 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: starting objecter 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests hook 0x559ca198ed60 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: setting wanted keys 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:38:40.076+0000 7feeccd3e800 1 librados: calling monclient init 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding auth protocol: cephx 2024-09-22T08:38:40.198 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: crc 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 AuthRegistry(0x559ca1987940) adding con mode: secure 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:38:40.076+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:38:40.076+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key hook 0x559ca1987a88 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.199 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:38:40.076+0000 7feeccd3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca17ff7e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca18ca020 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca18d03b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.866036s 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca18ca020 auth_method 0 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca17ff7e0 auth_method 0 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.200 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:38:40.077+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca18d03b0 auth_method 0 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:38:40.077+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.201 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6323 payload 824 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:38:40.077+0000 7feec02ec640 1 monclient: found mon.noname-c 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:38:40.077+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: dump: 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.202 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:38:40.077+0000 7fedb560a640 10 monclient: dump: 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.203 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:38:40.077+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6323 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:38:40.077+0000 7fedb6e0d640 4 set_mon_vals no callback set 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:38:40.077+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:38:40.077+0000 7feeccd3e800 1 librados: init done 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:38:40.079+0000 7fedb560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:38:40.079+0000 7feec8aed640 10 monclient: get_auth_request con 0x7fedb0077710 auth_method 0 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:38:40.080+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca19c96f0 auth_method 0 2024-09-22T08:38:40.204 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:38:40.080+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca19d2ec0 auth_method 0 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:38:40.081+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca19d7140 auth_method 0 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:38:40.082+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca19d67a0 auth_method 0 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:38:40.083+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.205 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding auth protocol: cephx 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: crc 2024-09-22T08:38:40.206 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19df320) adding con mode: secure 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ca19e2770 EEXIST 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:38:40.083+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding auth protocol: cephx 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.207 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: crc 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:38:40.083+0000 7feeccd3e800 5 AuthRegistry(0x559ca19de268) adding con mode: secure 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:38:40.083+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:38:40.084+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x559ca19de3b0 EEXIST 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a06a90 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a06e70 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a057a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.208 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.873087s 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a06a90 auth_method 0 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a057a0 auth_method 0 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a06e70 auth_method 0 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.209 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:38:40.084+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:38:40.084+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6326 payload 824 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:38:40.084+0000 7feec02ec640 1 monclient: found mon.noname-c 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:38:40.084+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.210 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: dump: 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.211 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:38:40.084+0000 7fedae7fc640 10 monclient: dump: 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:38:40.084+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6326 2024-09-22T08:38:40.212 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:38:40.084+0000 7feec9aef640 4 set_mon_vals no callback set 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:38:40.084+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:38:40.086+0000 7fedae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:38:40.086+0000 7feec92ee640 10 monclient: get_auth_request con 0x7feda0077480 auth_method 0 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: get_monmap_and_config 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:38:40.086+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:38:40.086+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.213 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding auth protocol: cephx 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.214 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: crc 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:38:40.086+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a26260) adding con mode: secure 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding auth protocol: cephx 2024-09-22T08:38:40.215 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: crc 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e9200) adding con mode: secure 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:38:40.087+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:38:40.087+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x7fffac9e9348 EEXIST 2024-09-22T08:38:40.216 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a5a8a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a2a6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a55c60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:38:40.087+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.876660s 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a2a6b0 auth_method 0 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.217 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a5a8a0 auth_method 0 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a55c60 auth_method 0 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:38:40.087+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.218 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:38:40.087+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient(hunting): handle_auth_done global_id 6777 payload 274 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:38:40.087+0000 7feec92ee640 1 monclient: found mon.noname-a 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:38:40.087+0000 7feec92ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: dump: 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.219 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6777 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:38:40.088+0000 7fed9ffff640 10 monclient: dump: 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.220 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: get_monmap_and_config success 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:38:40.088+0000 7feeccd3e800 4 set_mon_vals no callback set 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: shutdown 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: build_initial_monmap 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:38:40.088+0000 7feeccd3e800 1 build_initial for_mkfs: 0 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:38:40.088+0000 7feeccd3e800 10 monclient: monmap: 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:38:40.221 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding auth protocol: cephx 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:38:40.088+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.222 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: crc 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a2b4f0) adding con mode: secure 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: starting msgr at 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: starting objecter 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command objecter_requests cmddesc objecter_requests hook 0x559ca1a28c10 EEXIST 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: setting wanted keys 2024-09-22T08:38:40.223 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:38:40.089+0000 7feeccd3e800 1 librados: calling monclient init 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: init 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding auth protocol: cephx 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.224 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: crc 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 AuthRegistry(0x559ca1a1b350) adding con mode: secure 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:38:40.089+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:38:40.089+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command rotate-key cmddesc rotate-key hook 0x559ca1a1b498 EEXIST 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: _reopen_session rank -1 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-a con 0x559ca1a2a6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-c con 0x559ca1a55c60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): picked mon.noname-b con 0x559ca1a5a8a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): _renew_subs 2024-09-22T08:38:40.225 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:38:40.089+0000 7feeccd3e800 10 monclient(hunting): authenticate will time out at 2035.878960s 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): get_auth_request con 0x559ca1a2a6b0 auth_method 0 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): get_auth_request con 0x559ca1a55c60 auth_method 0 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): get_auth_request con 0x559ca1a5a8a0 auth_method 0 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:38:40.226 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:38:40.090+0000 7feec92ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:38:40.090+0000 7feec8aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient(hunting): handle_auth_done global_id 6780 payload 824 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient: _finish_hunting 0 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:38:40.090+0000 7feec02ec640 1 monclient: found mon.noname-a 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:38:40.090+0000 7feec02ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: dump: 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.227 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:38:40.090+0000 7fed9e7fc640 10 monclient: dump: 2024-09-22T08:38:40.228 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:38:40.090+0000 7feeccd3e800 5 monclient: authenticate success, global_id 6780 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:38:40.090+0000 7fed9ffff640 4 set_mon_vals no callback set 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _renew_subs 2024-09-22T08:38:40.229 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:38:40.090+0000 7feeccd3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:38:40.090+0000 7feeccd3e800 1 librados: init done 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:38:40.090+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cr dump hook 0x559ca1a68e18 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:38:40.092+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:38:40.092+0000 7fed9e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:38:40.092+0000 7feec92ee640 10 monclient: get_auth_request con 0x7fed94077570 auth_method 0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:38:40.093+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca1a74660 auth_method 0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 realm 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:38:40.093+0000 7feeccd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:38:40.093+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.230 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:38:40.094+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca1a78890 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:38:40.094+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:38:40.094+0000 7feec92ee640 10 monclient: get_auth_request con 0x559ca1a7c110 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:38:40.095+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:38:40.095+0000 7feeccd3e800 20 searching for the correct realm 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:38:40.095+0000 7feec8aed640 10 monclient: get_auth_request con 0x559ca1a80ed0 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:38:40.096+0000 7feec02ec640 10 monclient: get_auth_request con 0x7feeb8026040 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:38:40.097+0000 7feec8aed640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x559ca1a74660 msgr2=0x559ca1a76af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 1 client.6780.objecter ms_handle_reset 0x559ca1a74660 session 0x559ca1a73f90 osd.6 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 10 monclient: _renew_subs 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:38:40.097+0000 7fed9e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:38:40.097+0000 7feec8aed640 10 monclient: get_auth_request con 0x7fed94087890 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:38:40.097+0000 7feec92ee640 10 monclient: get_auth_request con 0x7feeb00f0040 auth_method 0 2024-09-22T08:38:40.231 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:38:40.098+0000 7feec8aed640 10 monclient: get_auth_request con 0x7feeb8036040 auth_method 0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:38:40.100+0000 7feec02ec640 0 -- 172.21.15.78:0/4253937573 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x559ca1a78890 msgr2=0x559ca1a7ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:38:40.100+0000 7fed9e7fc640 1 client.6780.objecter ms_handle_reset 0x559ca1a78890 session 0x559ca1a78210 osd.1 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:38:40.100+0000 7feec02ec640 10 monclient: get_auth_request con 0x559ca1a74660 auth_method 0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:38:40.100+0000 7feec02ec640 10 monclient: get_auth_request con 0x7feec4018040 auth_method 0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.232 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zone default found 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Realm: () 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:38:40.105+0000 7feeccd3e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:38:40.105+0000 7feeccd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 zonegroup default 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:38:40.105+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.233 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started sync module instance, tier type = 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:38:40.106+0000 7feeccd3e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=0 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=1 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=2 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=3 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=4 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=5 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:38:40.114+0000 7feeccd3e800 20 add_watcher() i=6 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:38:40.115+0000 7feeccd3e800 20 add_watcher() i=7 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:38:40.115+0000 7feeccd3e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding auth protocol: cephx 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.234 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:38:40.117+0000 7fed7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: crc 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 AuthRegistry(0x7fffac9e96d0) adding con mode: secure 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:38:40.117+0000 7feeccd3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:40.235 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache list hook 0x559ca1a50ba0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache inspect hook 0x559ca1a50ba0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache erase hook 0x559ca1a50ba0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command cache zap hook 0x559ca1a50ba0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 note: GC not initialized 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:38:40.117+0000 7fed7e7e4640 20 reqs_thread_entry: start 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace show hook 0x7feec40016f0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace history hook 0x7feec40016f0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace active hook 0x7feec40016f0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:38:40.117+0000 7feeccd3e800 5 asok(0x559ca17650f0) register_command sync trace active_short hook 0x7feec40016f0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 Filter name: none 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:38:40.117+0000 7fed77fff640 20 reqs_thread_entry: start 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:38:40.117+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:38:40.117+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.236 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : miss 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:38:40.118+0000 7feeccd3e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:38:40.118+0000 7feeccd3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feeccd3e800 time 2024-09-22T08:38:40.123118+0000 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.237 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feece58c748] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:38:40.123+0000 7feeccd3e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7feeccd3e800 thread_name:radosgw-admin 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:38:40.238 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feecd23e6f0] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feecd28b99c] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feece58c7a2] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7feece58c906] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559ca04dde01] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd80c08) [0x559ca09efc08] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559ca04edc9d] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feecd229590] 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:38:40.239 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:38:40.240 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:38:40.241 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:38:40.242 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:38:40.243 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:38:40.244 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:38:40.245 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed77fff640 / http_manager 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed7e7e4640 / http_manager 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed7f7e6640 / rgw_dt_lg_renew 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed9e7fc640 / ms_dispatch 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fed9ffff640 / io_context_pool 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedae7fc640 / ms_dispatch 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedb560a640 / ms_dispatch 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7fedb6e0d640 / io_context_pool 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec02ec640 / msgr-worker-2 2024-09-22T08:38:40.246 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec8aed640 / msgr-worker-1 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec92ee640 / msgr-worker-0 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: 7feec9aef640 / io_context_pool 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: 7feeccd3e800 / radosgw-admin 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:38:40.124771Z_87a0f088-7f24-4edd-89a0-399f12ede0c3/log 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:38:40.247 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.198+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 realm 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.200+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.201+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.201+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.202+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:40.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.202+0000 7fdb143ad800 20 searching for the correct realm 2024-09-22T08:38:40.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.203+0000 7fdb11696640 0 -- 172.21.15.78:0/1588121048 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fdb0406c020 msgr2=0x7fdb040622b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.408+0000 7fdb11e97640 0 -- 172.21.15.78:0/1588121048 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55d3953b13b0 msgr2=0x55d3953b3820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:40.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:40.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:40.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:40.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.414+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:40.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 zone default found 2024-09-22T08:38:40.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 4 Realm: () 2024-09-22T08:38:40.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:40.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 zonegroup default 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 started sync module instance, tier type = 2024-09-22T08:38:40.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.415+0000 7fdb143ad800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:40.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=0 2024-09-22T08:38:40.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=1 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=2 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=3 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=4 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=5 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.424+0000 7fdb143ad800 20 add_watcher() i=6 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.425+0000 7fdb143ad800 20 add_watcher() i=7 2024-09-22T08:38:40.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.425+0000 7fdb143ad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:40.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.427+0000 7fd9c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.427+0000 7fdb143ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:40.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.427+0000 7fdb143ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:40.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.427+0000 7fdb143ad800 5 note: GC not initialized 2024-09-22T08:38:40.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fd9c6fe5640 20 reqs_thread_entry: start 2024-09-22T08:38:40.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fdb143ad800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:40.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fdb143ad800 20 Filter name: none 2024-09-22T08:38:40.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fd9c4fe1640 20 reqs_thread_entry: start 2024-09-22T08:38:40.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.428+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:40.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.429+0000 7fdb143ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:38:40.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.431+0000 7fd9c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:40.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.433+0000 7fdb143ad800 20 remove_watcher() i=0 2024-09-22T08:38:40.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.433+0000 7fdb143ad800 2 removed watcher, disabling cache 2024-09-22T08:38:40.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.434+0000 7fdb143ad800 20 remove_watcher() i=1 2024-09-22T08:38:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.435+0000 7fdb143ad800 20 remove_watcher() i=2 2024-09-22T08:38:40.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.436+0000 7fdb143ad800 20 remove_watcher() i=3 2024-09-22T08:38:40.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.437+0000 7fdb143ad800 20 remove_watcher() i=4 2024-09-22T08:38:40.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.438+0000 7fdb143ad800 20 remove_watcher() i=5 2024-09-22T08:38:40.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.439+0000 7fdb143ad800 20 remove_watcher() i=6 2024-09-22T08:38:40.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.440+0000 7fdb143ad800 20 remove_watcher() i=7 2024-09-22T08:38:40.451 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.451 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:38:40.451 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:38:40.451 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:38:40.541 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:38:40.572 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:38:40.572 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:38:40.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.608+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 realm 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:38:40.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:40.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.610+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.611+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:40.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.611+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:40.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.612+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:38:40.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.612+0000 7f565f420800 20 searching for the correct realm 2024-09-22T08:38:40.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.614+0000 7f565d70b640 0 -- 172.21.15.78:0/2379347584 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5648087030 msgr2=0x7f5648064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:38:40.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:40.819+0000 7f5657fff640 0 -- 172.21.15.78:0/2379347584 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5658098aa0 msgr2=0x7f5658097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:38:41.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:38:41.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:38:41.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:38:41.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:38:41.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:38:41.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:38:41.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:41.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.027+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 zone default found 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 4 Realm: () 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:38:41.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 zonegroup default 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.028+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.029+0000 7f565f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.029+0000 7f565f420800 20 started sync module instance, tier type = 2024-09-22T08:38:41.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.029+0000 7f565f420800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=0 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=1 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=2 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=3 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=4 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=5 2024-09-22T08:38:41.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.038+0000 7f565f420800 20 add_watcher() i=6 2024-09-22T08:38:41.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.039+0000 7f565f420800 20 add_watcher() i=7 2024-09-22T08:38:41.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.039+0000 7f565f420800 2 all 8 watchers are set, enabling cache 2024-09-22T08:38:41.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f5512fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f565f420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f565f420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f565f420800 5 note: GC not initialized 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f5511fe3640 20 reqs_thread_entry: start 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f565f420800 20 init_complete bucket index max shards: 11 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.041+0000 7f565f420800 20 Filter name: none 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f54837fe640 20 reqs_thread_entry: start 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:38:41.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:38:41.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:38:41.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:38:41.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : miss 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 20 rados->read ofs=0 len=0 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:38:41.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.042+0000 7f565f420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:38:41.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.044+0000 7f565f420800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to be held by another RGW process; skipping for now 2024-09-22T08:38:41.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.045+0000 7f5512fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:38:41.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.047+0000 7f565f420800 20 remove_watcher() i=0 2024-09-22T08:38:41.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.047+0000 7f565f420800 2 removed watcher, disabling cache 2024-09-22T08:38:41.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.047+0000 7f565f420800 20 remove_watcher() i=1 2024-09-22T08:38:41.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.049+0000 7f565f420800 20 remove_watcher() i=2 2024-09-22T08:38:41.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.049+0000 7f565f420800 20 remove_watcher() i=3 2024-09-22T08:38:41.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.050+0000 7f565f420800 20 remove_watcher() i=4 2024-09-22T08:38:41.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.052+0000 7f565f420800 20 remove_watcher() i=5 2024-09-22T08:38:41.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.053+0000 7f565f420800 20 remove_watcher() i=6 2024-09-22T08:38:41.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:38:41.054+0000 7f565f420800 20 remove_watcher() i=7 2024-09-22T08:38:41.065 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:39:11.095 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:11.129 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:11.129 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.170+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 realm 2024-09-22T08:39:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.172+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.173+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.173+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.174+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:11.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.174+0000 7f43ddb0c800 20 searching for the correct realm 2024-09-22T08:39:11.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.177+0000 7f43dbdf7640 0 -- 172.21.15.78:0/579087682 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f43c4036060 msgr2=0x7f43c40676f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:11.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.383+0000 7f43d3fff640 0 -- 172.21.15.78:0/579087682 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f43d4083070 msgr2=0x7f43d4060470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:11.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:11.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:11.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.389+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 zone default found 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 4 Realm: () 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:11.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 zonegroup default 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.390+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.391+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.391+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.391+0000 7f43ddb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.391+0000 7f43ddb0c800 20 started sync module instance, tier type = 2024-09-22T08:39:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.391+0000 7f43ddb0c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=0 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=1 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=2 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=3 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=4 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=5 2024-09-22T08:39:11.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.401+0000 7f43ddb0c800 20 add_watcher() i=6 2024-09-22T08:39:11.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.402+0000 7f43ddb0c800 20 add_watcher() i=7 2024-09-22T08:39:11.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.402+0000 7f43ddb0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:11.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.403+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:11.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:11.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 5 note: GC not initialized 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f4290fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 20 Filter name: none 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f420a7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T08:39:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.404+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : miss 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.405+0000 7f43ddb0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:39:11.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f43ddb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f43ddb0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f43ddb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f43ddb0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25, ofs0, ns] 2024-09-22T08:39:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f42beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562473 cookie 94849291039552 notifier 6834 bl.length()=1009 2024-09-22T08:39:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f42beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f42beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.410+0000 7f42beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.412+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_sources= new_sources= 2024-09-22T08:39:11.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.412+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential sources added=[] removed=[] 2024-09-22T08:39:11.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.412+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_dests= new_dests= 2024-09-22T08:39:11.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.412+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential dests added=[] removed=[] 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.0 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.0 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.1 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.1 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.2 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.2 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.3 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.3 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.4 2024-09-22T08:39:11.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.4 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.5 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.5 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.6 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.6 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.7 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.7 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.8 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.8 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.9 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.9 2024-09-22T08:39:11.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.10 2024-09-22T08:39:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.10 2024-09-22T08:39:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.11 2024-09-22T08:39:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1.11 2024-09-22T08:39:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.417+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.0 2024-09-22T08:39:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.418+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.418+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.2 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.419+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.3 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.419+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.4 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.420+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.5 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.420+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.6 2024-09-22T08:39:11.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.421+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.7 2024-09-22T08:39:11.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.421+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.8 2024-09-22T08:39:11.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.422+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.9 2024-09-22T08:39:11.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.422+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.10 2024-09-22T08:39:11.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.426+0000 7f43ddb0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:11.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.426+0000 7f43ddb0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.427+0000 7f43ddb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.427+0000 7f43ddb0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.427+0000 7f43ddb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.427+0000 7f43ddb0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25, ofs0, ns] 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.428+0000 7f42beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562474 cookie 94849291039552 notifier 6834 bl.length()=1009 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.428+0000 7f42beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.428+0000 7f42beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.428+0000 7f42beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.429+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_sources= new_sources= 2024-09-22T08:39:11.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.429+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential sources added=[] removed=[] 2024-09-22T08:39:11.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.429+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_dests= new_dests= 2024-09-22T08:39:11.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.429+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential dests added=[] removed=[] 2024-09-22T08:39:11.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.432+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.0 2024-09-22T08:39:11.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.432+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.1 2024-09-22T08:39:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.432+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.2 2024-09-22T08:39:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.433+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.3 2024-09-22T08:39:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.433+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.4 2024-09-22T08:39:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.433+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.5 2024-09-22T08:39:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.434+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.6 2024-09-22T08:39:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.434+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.7 2024-09-22T08:39:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.434+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.8 2024-09-22T08:39:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.435+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.9 2024-09-22T08:39:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.435+0000 7f43ddb0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25.10 2024-09-22T08:39:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.435+0000 7f43ddb0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.435+0000 7f43ddb0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.436+0000 7f43ddb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.436+0000 7f43ddb0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.436+0000 7f43ddb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.436+0000 7f43ddb0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25, ofs0, ns] 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.437+0000 7f42be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562475 cookie 94849291039552 notifier 6834 bl.length()=977 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.437+0000 7f42be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 info.flags=0x17 2024-09-22T08:39:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.437+0000 7f42be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 to cache LRU end 2024-09-22T08:39:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.437+0000 7f42be7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.438+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_sources= new_sources= 2024-09-22T08:39:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.438+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential sources added=[] removed=[] 2024-09-22T08:39:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.438+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): orig_dests= new_dests= 2024-09-22T08:39:11.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.438+0000 7f43ddb0c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25]): potential dests added=[] removed=[] 2024-09-22T08:39:11.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.441+0000 7f43ddb0c800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.442+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:11.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.445+0000 7f43ddb0c800 20 remove_watcher() i=0 2024-09-22T08:39:11.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.445+0000 7f43ddb0c800 2 removed watcher, disabling cache 2024-09-22T08:39:11.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.446+0000 7f43ddb0c800 20 remove_watcher() i=1 2024-09-22T08:39:11.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.447+0000 7f43ddb0c800 20 remove_watcher() i=2 2024-09-22T08:39:11.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.448+0000 7f43ddb0c800 20 remove_watcher() i=3 2024-09-22T08:39:11.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.449+0000 7f43ddb0c800 20 remove_watcher() i=4 2024-09-22T08:39:11.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.450+0000 7f43ddb0c800 20 remove_watcher() i=5 2024-09-22T08:39:11.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.451+0000 7f43ddb0c800 20 remove_watcher() i=6 2024-09-22T08:39:11.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.452+0000 7f43ddb0c800 20 remove_watcher() i=7 2024-09-22T08:39:11.465 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T08:39:11.495 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:11.495 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:11.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.530+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 20 realm 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.532+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.533+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.533+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.533+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:11.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.533+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.534+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:11.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.534+0000 7f762e12c800 20 searching for the correct realm 2024-09-22T08:39:11.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.536+0000 7f762a6db640 0 -- 172.21.15.78:0/4025480779 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f7614033bf0 msgr2=0x7f7614040930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:11.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.741+0000 7f76216d9640 0 -- 172.21.15.78:0/4025480779 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7624095ea0 msgr2=0x7f762404dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.747+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 zone default found 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 4 Realm: () 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:11.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 zonegroup default 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.748+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.749+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.749+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.749+0000 7f762e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:11.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.749+0000 7f762e12c800 20 started sync module instance, tier type = 2024-09-22T08:39:11.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.749+0000 7f762e12c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=0 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=1 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=2 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=3 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=4 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=5 2024-09-22T08:39:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.758+0000 7f762e12c800 20 add_watcher() i=6 2024-09-22T08:39:11.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.759+0000 7f762e12c800 20 add_watcher() i=7 2024-09-22T08:39:11.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.759+0000 7f762e12c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:11.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.760+0000 7f74dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:11.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:11.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 5 note: GC not initialized 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f74defe5640 20 reqs_thread_entry: start 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 20 Filter name: none 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f74dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:39:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.761+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.762+0000 7f762e12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.763+0000 7f762e12c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-22T08:39:11.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.763+0000 7f762e12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:11.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.764+0000 7f74dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:11.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.766+0000 7f762e12c800 20 remove_watcher() i=0 2024-09-22T08:39:11.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.766+0000 7f762e12c800 2 removed watcher, disabling cache 2024-09-22T08:39:11.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.767+0000 7f762e12c800 20 remove_watcher() i=1 2024-09-22T08:39:11.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.768+0000 7f762e12c800 20 remove_watcher() i=2 2024-09-22T08:39:11.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.769+0000 7f762e12c800 20 remove_watcher() i=3 2024-09-22T08:39:11.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.770+0000 7f762e12c800 20 remove_watcher() i=4 2024-09-22T08:39:11.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.771+0000 7f762e12c800 20 remove_watcher() i=5 2024-09-22T08:39:11.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.772+0000 7f762e12c800 20 remove_watcher() i=6 2024-09-22T08:39:11.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:11.773+0000 7f762e12c800 20 remove_watcher() i=7 2024-09-22T08:39:11.785 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:11.786 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:11.786 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:39:11.786 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:12.155 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-22T08:39:12.155 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:39:13.025 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:13.025 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:13.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.062+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 realm 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.064+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.065+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.065+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.065+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:13.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.065+0000 7fd5f5d42800 20 searching for the correct realm 2024-09-22T08:39:13.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.068+0000 7fd5f22ee640 0 -- 172.21.15.78:0/2435372692 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd5e80e9040 msgr2=0x7fd5e80aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:13.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.273+0000 7fd5f12ec640 0 -- 172.21.15.78:0/2435372692 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd5ec06b4e0 msgr2=0x7fd5ec064950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:13.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:13.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.278+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:13.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 zone default found 2024-09-22T08:39:13.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 4 Realm: () 2024-09-22T08:39:13.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:13.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 zonegroup default 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.279+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.280+0000 7fd5f5d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.280+0000 7fd5f5d42800 20 started sync module instance, tier type = 2024-09-22T08:39:13.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.280+0000 7fd5f5d42800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:13.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=0 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=1 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=2 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=3 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=4 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=5 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.289+0000 7fd5f5d42800 20 add_watcher() i=6 2024-09-22T08:39:13.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.290+0000 7fd5f5d42800 20 add_watcher() i=7 2024-09-22T08:39:13.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.290+0000 7fd5f5d42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:13.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.291+0000 7fd48b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.291+0000 7fd5f5d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.291+0000 7fd5f5d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd5f5d42800 5 note: GC not initialized 2024-09-22T08:39:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd48a7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:13.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd5f5d42800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:13.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd5f5d42800 20 Filter name: none 2024-09-22T08:39:13.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd417fff640 20 reqs_thread_entry: start 2024-09-22T08:39:13.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.292+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.293+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.293+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.293+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.293+0000 7fd5f5d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.293+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.294+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:13.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.294+0000 7fd5f5d42800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.294+0000 7fd5f5d42800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:13.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.294+0000 7fd5f5d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:13.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.296+0000 7fd48b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.298+0000 7fd5f5d42800 20 remove_watcher() i=0 2024-09-22T08:39:13.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.298+0000 7fd5f5d42800 2 removed watcher, disabling cache 2024-09-22T08:39:13.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.299+0000 7fd5f5d42800 20 remove_watcher() i=1 2024-09-22T08:39:13.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.300+0000 7fd5f5d42800 20 remove_watcher() i=2 2024-09-22T08:39:13.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.301+0000 7fd5f5d42800 20 remove_watcher() i=3 2024-09-22T08:39:13.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.301+0000 7fd5f5d42800 20 remove_watcher() i=4 2024-09-22T08:39:13.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.302+0000 7fd5f5d42800 20 remove_watcher() i=5 2024-09-22T08:39:13.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.303+0000 7fd5f5d42800 20 remove_watcher() i=6 2024-09-22T08:39:13.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.304+0000 7fd5f5d42800 20 remove_watcher() i=7 2024-09-22T08:39:13.316 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:13.316 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:13.316 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:13.316 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:13.317 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-22T08:39:13.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:13.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:13.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.388+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 20 realm 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.389+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.390+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.390+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.390+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.390+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.391+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:13.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.391+0000 7f670e81d800 20 searching for the correct realm 2024-09-22T08:39:13.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.393+0000 7f67097f1640 0 -- 172.21.15.78:0/146604906 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55a129223230 msgr2=0x55a129225620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:13.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.396+0000 7f67097f1640 0 -- 172.21.15.78:0/146604906 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f6704025040 msgr2=0x7f670406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.602+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 zone default found 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 4 Realm: () 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 zonegroup default 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.603+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 started sync module instance, tier type = 2024-09-22T08:39:13.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.604+0000 7f670e81d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=0 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=1 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=2 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=3 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=4 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=5 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.612+0000 7f670e81d800 20 add_watcher() i=6 2024-09-22T08:39:13.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.613+0000 7f670e81d800 20 add_watcher() i=7 2024-09-22T08:39:13.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.613+0000 7f670e81d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:13.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.615+0000 7f65bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 5 note: GC not initialized 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f65ba7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 20 Filter name: none 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f652bfff640 20 reqs_thread_entry: start 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:39:13.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.616+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:13.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:13.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:13.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 : miss 2024-09-22T08:39:13.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:13.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.617+0000 7f670e81d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 2024-09-22T08:39:13.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f670e81d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:13.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f670e81d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:13.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f670e81d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:13.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f670e81d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26, ofs0, ns] 2024-09-22T08:39:13.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f65ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94150668251520 notifier 6437 bl.length()=1023 2024-09-22T08:39:13.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f65ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:13.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f65ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:13.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.622+0000 7f65ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_sources= new_sources= 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential sources added=[] removed=[] 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_dests= new_dests= 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential dests added=[] removed=[] 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-22T08:39:13.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.624+0000 7f670e81d800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-22T08:39:13.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.626+0000 7f65bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.629+0000 7f670e81d800 20 remove_watcher() i=0 2024-09-22T08:39:13.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.629+0000 7f670e81d800 2 removed watcher, disabling cache 2024-09-22T08:39:13.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.630+0000 7f670e81d800 20 remove_watcher() i=1 2024-09-22T08:39:13.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.631+0000 7f670e81d800 20 remove_watcher() i=2 2024-09-22T08:39:13.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.632+0000 7f670e81d800 20 remove_watcher() i=3 2024-09-22T08:39:13.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.633+0000 7f670e81d800 20 remove_watcher() i=4 2024-09-22T08:39:13.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.634+0000 7f670e81d800 20 remove_watcher() i=5 2024-09-22T08:39:13.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.635+0000 7f670e81d800 20 remove_watcher() i=6 2024-09-22T08:39:13.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.636+0000 7f670e81d800 20 remove_watcher() i=7 2024-09-22T08:39:13.648 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:39:13.677 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:13.677 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.712+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 20 realm 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.714+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.715+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.715+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.715+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.715+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.716+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.716+0000 7f2a6f946800 20 searching for the correct realm 2024-09-22T08:39:13.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.718+0000 7f2a6dc38640 0 -- 172.21.15.78:0/1197932333 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2a6401f060 msgr2=0x7f2a6407cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:13.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.923+0000 7f2a6cc36640 0 -- 172.21.15.78:0/1197932333 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2a680b1030 msgr2=0x7f2a680acd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:13.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:13.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.928+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:13.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:13.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 zone default found 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 4 Realm: () 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 zonegroup default 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.929+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.930+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.930+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.930+0000 7f2a6f946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.930+0000 7f2a6f946800 20 started sync module instance, tier type = 2024-09-22T08:39:13.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.930+0000 7f2a6f946800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=0 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=1 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=2 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=3 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=4 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=5 2024-09-22T08:39:13.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=6 2024-09-22T08:39:13.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 20 add_watcher() i=7 2024-09-22T08:39:13.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.939+0000 7f2a6f946800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:13.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.941+0000 7f2923fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.941+0000 7f2a6f946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.941+0000 7f2a6f946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.941+0000 7f2a6f946800 5 note: GC not initialized 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2922fe5640 20 reqs_thread_entry: start 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2a6f946800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2a6f946800 20 Filter name: none 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2920fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:13.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:13.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.942+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.943+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.943+0000 7f2a6f946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.943+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.943+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.943+0000 7f2a6f946800 20 rados->read ofs=0 len=0 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.944+0000 7f2a6f946800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:13.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.944+0000 7f2a6f946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:13.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.945+0000 7f2923fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:13.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.947+0000 7f2a6f946800 20 remove_watcher() i=0 2024-09-22T08:39:13.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.947+0000 7f2a6f946800 2 removed watcher, disabling cache 2024-09-22T08:39:13.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.948+0000 7f2a6f946800 20 remove_watcher() i=1 2024-09-22T08:39:13.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.949+0000 7f2a6f946800 20 remove_watcher() i=2 2024-09-22T08:39:13.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.950+0000 7f2a6f946800 20 remove_watcher() i=3 2024-09-22T08:39:13.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.951+0000 7f2a6f946800 20 remove_watcher() i=4 2024-09-22T08:39:13.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.952+0000 7f2a6f946800 20 remove_watcher() i=5 2024-09-22T08:39:13.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.953+0000 7f2a6f946800 20 remove_watcher() i=6 2024-09-22T08:39:13.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:13.954+0000 7f2a6f946800 20 remove_watcher() i=7 2024-09-22T08:39:13.965 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:13.965 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:13.965 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:13.965 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:14.057 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:14.088 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:14.088 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:14.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.124+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 realm 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.126+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.127+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:14.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.127+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.128+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:14.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.128+0000 7f5754121800 20 searching for the correct realm 2024-09-22T08:39:14.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.130+0000 7f5750645640 0 -- 172.21.15.78:0/1351472322 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f573800b040 msgr2=0x7f573803b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:14.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.335+0000 7f574f643640 0 -- 172.21.15.78:0/1351472322 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5748025920 msgr2=0x7f5748040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 zone default found 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 4 Realm: () 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 zonegroup default 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.341+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 started sync module instance, tier type = 2024-09-22T08:39:14.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.342+0000 7f5754121800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=0 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=1 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=2 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=3 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=4 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=5 2024-09-22T08:39:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.351+0000 7f5754121800 20 add_watcher() i=6 2024-09-22T08:39:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.352+0000 7f5754121800 20 add_watcher() i=7 2024-09-22T08:39:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.352+0000 7f5754121800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.353+0000 7f5605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 5 note: GC not initialized 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5604fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 20 Filter name: none 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f557e7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:39:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.354+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 : miss 2024-09-22T08:39:14.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.355+0000 7f5754121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 2024-09-22T08:39:14.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.356+0000 7f5754121800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:39:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f5754121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f5754121800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f5754121800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f5754121800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26, ofs0, ns] 2024-09-22T08:39:14.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f562e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94777816684416 notifier 6470 bl.length()=1023 2024-09-22T08:39:14.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f562e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f562e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.362+0000 7f562e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.364+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_sources= new_sources= 2024-09-22T08:39:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.364+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential sources added=[] removed=[] 2024-09-22T08:39:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.364+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_dests= new_dests= 2024-09-22T08:39:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.364+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential dests added=[] removed=[] 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.0 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.0 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.1 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.1 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.2 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.2 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.3 2024-09-22T08:39:14.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.3 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.4 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.4 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.5 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.5 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.6 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.6 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.7 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.7 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.8 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.8 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.9 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.9 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.10 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.10 2024-09-22T08:39:14.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.11 2024-09-22T08:39:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2.11 2024-09-22T08:39:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.368+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.0 2024-09-22T08:39:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.369+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.1 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.369+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.370+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.3 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.370+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.4 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.371+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.5 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.371+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.6 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.371+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.7 2024-09-22T08:39:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.372+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.8 2024-09-22T08:39:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.372+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.9 2024-09-22T08:39:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.373+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.10 2024-09-22T08:39:14.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.376+0000 7f5754121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:14.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.376+0000 7f5754121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 2024-09-22T08:39:14.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f5754121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f5754121800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f5754121800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f5754121800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26, ofs0, ns] 2024-09-22T08:39:14.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f562e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94777816684416 notifier 6470 bl.length()=1023 2024-09-22T08:39:14.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f562e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f562e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.377+0000 7f562e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.379+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_sources= new_sources= 2024-09-22T08:39:14.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.379+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential sources added=[] removed=[] 2024-09-22T08:39:14.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.379+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_dests= new_dests= 2024-09-22T08:39:14.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.379+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential dests added=[] removed=[] 2024-09-22T08:39:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.381+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.0 2024-09-22T08:39:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.381+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.1 2024-09-22T08:39:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.382+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.2 2024-09-22T08:39:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.382+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.3 2024-09-22T08:39:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.382+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.4 2024-09-22T08:39:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.382+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.5 2024-09-22T08:39:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.383+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.6 2024-09-22T08:39:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.383+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.7 2024-09-22T08:39:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.383+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.8 2024-09-22T08:39:14.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.384+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.9 2024-09-22T08:39:14.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.384+0000 7f5754121800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26.10 2024-09-22T08:39:14.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.384+0000 7f5754121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:14.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.384+0000 7f5754121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f5754121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f5754121800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f5754121800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f5754121800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26, ofs0, ns] 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f562e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94777816684416 notifier 6470 bl.length()=991 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f562e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 info.flags=0x17 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f562e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 to cache LRU end 2024-09-22T08:39:14.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.386+0000 7f562e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:14.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.387+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_sources= new_sources= 2024-09-22T08:39:14.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.387+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential sources added=[] removed=[] 2024-09-22T08:39:14.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.387+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): orig_dests= new_dests= 2024-09-22T08:39:14.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.387+0000 7f5754121800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26]): potential dests added=[] removed=[] 2024-09-22T08:39:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.389+0000 7f5754121800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:14.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.391+0000 7f5605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:14.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.393+0000 7f5754121800 20 remove_watcher() i=0 2024-09-22T08:39:14.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.393+0000 7f5754121800 2 removed watcher, disabling cache 2024-09-22T08:39:14.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.394+0000 7f5754121800 20 remove_watcher() i=1 2024-09-22T08:39:14.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.396+0000 7f5754121800 20 remove_watcher() i=2 2024-09-22T08:39:14.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.397+0000 7f5754121800 20 remove_watcher() i=3 2024-09-22T08:39:14.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.398+0000 7f5754121800 20 remove_watcher() i=4 2024-09-22T08:39:14.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.399+0000 7f5754121800 20 remove_watcher() i=5 2024-09-22T08:39:14.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.399+0000 7f5754121800 20 remove_watcher() i=6 2024-09-22T08:39:14.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.401+0000 7f5754121800 20 remove_watcher() i=7 2024-09-22T08:39:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:39:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:14.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.478+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 20 realm 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.480+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.481+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.481+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.481+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:14.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.481+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.482+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:14.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.482+0000 7f23fad46800 20 searching for the correct realm 2024-09-22T08:39:14.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.484+0000 7f23f9031640 0 -- 172.21.15.78:0/3660522372 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f23e4001c20 msgr2=0x7f23e4075500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.689+0000 7f23f3fff640 0 -- 172.21.15.78:0/3660522372 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f23f40b3070 msgr2=0x7f23f40a5540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:14.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:14.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.693+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:14.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:14.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 zone default found 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 4 Realm: () 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 zonegroup default 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.694+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.695+0000 7f23fad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.695+0000 7f23fad46800 20 started sync module instance, tier type = 2024-09-22T08:39:14.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.695+0000 7f23fad46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:14.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=0 2024-09-22T08:39:14.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=1 2024-09-22T08:39:14.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=2 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=3 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=4 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=5 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.703+0000 7f23fad46800 20 add_watcher() i=6 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.704+0000 7f23fad46800 20 add_watcher() i=7 2024-09-22T08:39:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.704+0000 7f23fad46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:14.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f22aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f23fad46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f23fad46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f23fad46800 5 note: GC not initialized 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f22adfe3640 20 reqs_thread_entry: start 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f23fad46800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f23fad46800 20 Filter name: none 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.706+0000 7f221f7fe640 20 reqs_thread_entry: start 2024-09-22T08:39:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.707+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.707+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:14.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.707+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.707+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.707+0000 7f23fad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.708+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.708+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.708+0000 7f23fad46800 20 rados->read ofs=0 len=0 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.708+0000 7f23fad46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.708+0000 7f23fad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:14.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.710+0000 7f22aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:14.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.712+0000 7f23fad46800 20 remove_watcher() i=0 2024-09-22T08:39:14.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.712+0000 7f23fad46800 2 removed watcher, disabling cache 2024-09-22T08:39:14.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.713+0000 7f23fad46800 20 remove_watcher() i=1 2024-09-22T08:39:14.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.714+0000 7f23fad46800 20 remove_watcher() i=2 2024-09-22T08:39:14.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.715+0000 7f23fad46800 20 remove_watcher() i=3 2024-09-22T08:39:14.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.715+0000 7f23fad46800 20 remove_watcher() i=4 2024-09-22T08:39:14.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.716+0000 7f23fad46800 20 remove_watcher() i=5 2024-09-22T08:39:14.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.717+0000 7f23fad46800 20 remove_watcher() i=6 2024-09-22T08:39:14.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:14.718+0000 7f23fad46800 20 remove_watcher() i=7 2024-09-22T08:39:14.729 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:14.729 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:14.729 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:39:14.730 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:15.088 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-22T08:39:15.088 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:15.928 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:39:15.956 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:15.956 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:15.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.991+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 realm 2024-09-22T08:39:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.993+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.994+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.994+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.995+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.995+0000 7f922b12c800 20 searching for the correct realm 2024-09-22T08:39:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:15.997+0000 7f921e560640 0 -- 172.21.15.78:0/2288370984 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55f8e1155aa0 msgr2=0x55f8e1157e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.000+0000 7f9227562640 0 -- 172.21.15.78:0/2288370984 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x55f8e1159310 msgr2=0x55f8e115b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:16.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 zone default found 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 4 Realm: () 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:16.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 zonegroup default 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.005+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 started sync module instance, tier type = 2024-09-22T08:39:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.006+0000 7f922b12c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:16.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=0 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=1 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=2 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=3 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=4 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=5 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.014+0000 7f922b12c800 20 add_watcher() i=6 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.015+0000 7f922b12c800 20 add_watcher() i=7 2024-09-22T08:39:16.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.015+0000 7f922b12c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:16.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f90dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f922b12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f922b12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f922b12c800 5 note: GC not initialized 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f9057fff640 20 reqs_thread_entry: start 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.017+0000 7f922b12c800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.018+0000 7f922b12c800 20 Filter name: none 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.018+0000 7f9055ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.018+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.018+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.018+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:16.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.019+0000 7f922b12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:16.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.021+0000 7f90dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.023+0000 7f922b12c800 20 remove_watcher() i=0 2024-09-22T08:39:16.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.023+0000 7f922b12c800 2 removed watcher, disabling cache 2024-09-22T08:39:16.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.024+0000 7f922b12c800 20 remove_watcher() i=1 2024-09-22T08:39:16.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.025+0000 7f922b12c800 20 remove_watcher() i=2 2024-09-22T08:39:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.026+0000 7f922b12c800 20 remove_watcher() i=3 2024-09-22T08:39:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.027+0000 7f922b12c800 20 remove_watcher() i=4 2024-09-22T08:39:16.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.028+0000 7f922b12c800 20 remove_watcher() i=5 2024-09-22T08:39:16.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.029+0000 7f922b12c800 20 remove_watcher() i=6 2024-09-22T08:39:16.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.029+0000 7f922b12c800 20 remove_watcher() i=7 2024-09-22T08:39:16.041 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:16.041 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:16.041 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:16.041 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:16.042 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-22T08:39:16.078 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:16.079 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.311+0000 7f7e34cba640 0 --2- 172.21.15.78:0/4000536833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562eb7961cf0 0x562eb7931890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:39:16.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.316+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 realm 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.317+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.318+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.318+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.319+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:16.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.319+0000 7f7e4173a800 20 searching for the correct realm 2024-09-22T08:39:16.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.320+0000 7f7e34cba640 0 -- 172.21.15.78:0/827311359 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f7e3006b020 msgr2=0x7f7e300a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.525+0000 7f7e3dcbc640 0 -- 172.21.15.78:0/827311359 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x562eb797c590 msgr2=0x562eb797ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:16.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:16.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.530+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:16.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 zone default found 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 4 Realm: () 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 zonegroup default 2024-09-22T08:39:16.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.531+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 started sync module instance, tier type = 2024-09-22T08:39:16.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.532+0000 7f7e4173a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:16.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=0 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=1 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=2 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=3 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=4 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=5 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.541+0000 7f7e4173a800 20 add_watcher() i=6 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.542+0000 7f7e4173a800 20 add_watcher() i=7 2024-09-22T08:39:16.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.542+0000 7f7e4173a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:16.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7cf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7e4173a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7e4173a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7e4173a800 5 note: GC not initialized 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7cf2fe5640 20 reqs_thread_entry: start 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7e4173a800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.544+0000 7f7e4173a800 20 Filter name: none 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7cf0fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T08:39:16.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 : miss 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:16.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 info.flags=0x17 2024-09-22T08:39:16.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 to cache LRU end 2024-09-22T08:39:16.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:16.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:16.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.545+0000 7f7e4173a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 2024-09-22T08:39:16.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.550+0000 7f7e4173a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 info.flags=0x17 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.550+0000 7f7e4173a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 to cache LRU end 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.550+0000 7f7e4173a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.550+0000 7f7e4173a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27, ofs0, ns] 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.551+0000 7f7d0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94758648726768 notifier 6987 bl.length()=1023 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.551+0000 7f7d0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 info.flags=0x17 2024-09-22T08:39:16.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.551+0000 7f7d0ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 to cache LRU end 2024-09-22T08:39:16.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.551+0000 7f7d0ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): orig_sources= new_sources= 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): potential sources added=[] removed=[] 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): orig_dests= new_dests= 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): potential dests added=[] removed=[] 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-22T08:39:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.552+0000 7f7e4173a800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-22T08:39:16.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.0 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.0 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.1 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.1 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.2 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.2 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.3 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.3 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.4 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.4 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.5 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.5 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.6 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.6 2024-09-22T08:39:16.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.7 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.7 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.8 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.8 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.9 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.9 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.10 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.10 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.11 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1.11 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.0 2024-09-22T08:39:16.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.555+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.1 2024-09-22T08:39:16.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.556+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.2 2024-09-22T08:39:16.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.557+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.3 2024-09-22T08:39:16.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.557+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.4 2024-09-22T08:39:16.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.558+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.5 2024-09-22T08:39:16.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.558+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.6 2024-09-22T08:39:16.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.559+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.7 2024-09-22T08:39:16.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.559+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.8 2024-09-22T08:39:16.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.560+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.9 2024-09-22T08:39:16.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.560+0000 7f7e4173a800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27.10 2024-09-22T08:39:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.563+0000 7f7e4173a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.563+0000 7f7e4173a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 2024-09-22T08:39:16.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7e4173a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 info.flags=0x17 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7e4173a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 to cache LRU end 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7e4173a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7e4173a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27, ofs0, ns] 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7d0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 94758648726768 notifier 6987 bl.length()=991 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7d0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 info.flags=0x17 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7d0ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 to cache LRU end 2024-09-22T08:39:16.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.564+0000 7f7d0ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.566+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): orig_sources= new_sources= 2024-09-22T08:39:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.566+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): potential sources added=[] removed=[] 2024-09-22T08:39:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.566+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): orig_dests= new_dests= 2024-09-22T08:39:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.566+0000 7f7e4173a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27]): potential dests added=[] removed=[] 2024-09-22T08:39:16.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.571+0000 7f7e4173a800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.572+0000 7f7cf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.575+0000 7f7e4173a800 20 remove_watcher() i=0 2024-09-22T08:39:16.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.575+0000 7f7e4173a800 2 removed watcher, disabling cache 2024-09-22T08:39:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.576+0000 7f7e4173a800 20 remove_watcher() i=1 2024-09-22T08:39:16.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.577+0000 7f7e4173a800 20 remove_watcher() i=2 2024-09-22T08:39:16.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.578+0000 7f7e4173a800 20 remove_watcher() i=3 2024-09-22T08:39:16.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.579+0000 7f7e4173a800 20 remove_watcher() i=4 2024-09-22T08:39:16.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.580+0000 7f7e4173a800 20 remove_watcher() i=5 2024-09-22T08:39:16.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.581+0000 7f7e4173a800 20 remove_watcher() i=6 2024-09-22T08:39:16.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.582+0000 7f7e4173a800 20 remove_watcher() i=7 2024-09-22T08:39:16.594 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T08:39:16.624 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:16.624 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:16.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.659+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 realm 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.661+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.662+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:16.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.662+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.663+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:16.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.663+0000 7f5d7da10800 20 searching for the correct realm 2024-09-22T08:39:16.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.665+0000 7f5d799bd640 0 -- 172.21.15.78:0/3127340384 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5d70044c20 msgr2=0x7f5d70060670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.669+0000 7f5d789bb640 0 -- 172.21.15.78:0/3127340384 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5d74057960 msgr2=0x7f5d74033460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:16.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.673+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:16.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:16.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 zone default found 2024-09-22T08:39:16.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 4 Realm: () 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 zonegroup default 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.674+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.675+0000 7f5d7da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.675+0000 7f5d7da10800 20 started sync module instance, tier type = 2024-09-22T08:39:16.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.675+0000 7f5d7da10800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:16.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=0 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=1 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=2 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=3 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=4 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=5 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.684+0000 7f5d7da10800 20 add_watcher() i=6 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.685+0000 7f5d7da10800 20 add_watcher() i=7 2024-09-22T08:39:16.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.685+0000 7f5d7da10800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:16.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5c2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:16.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:16.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 5 note: GC not initialized 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5c2e7e4640 20 reqs_thread_entry: start 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 20 Filter name: none 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5b9ffff640 20 reqs_thread_entry: start 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.687+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.688+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.688+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.688+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:16.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.688+0000 7f5d7da10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:16.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.688+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.689+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:16.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.689+0000 7f5d7da10800 20 rados->read ofs=0 len=0 2024-09-22T08:39:16.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.689+0000 7f5d7da10800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:16.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.689+0000 7f5d7da10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:16.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.690+0000 7f5c2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:16.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.692+0000 7f5d7da10800 20 remove_watcher() i=0 2024-09-22T08:39:16.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.692+0000 7f5d7da10800 2 removed watcher, disabling cache 2024-09-22T08:39:16.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.693+0000 7f5d7da10800 20 remove_watcher() i=1 2024-09-22T08:39:16.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.695+0000 7f5d7da10800 20 remove_watcher() i=2 2024-09-22T08:39:16.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.695+0000 7f5d7da10800 20 remove_watcher() i=3 2024-09-22T08:39:16.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.696+0000 7f5d7da10800 20 remove_watcher() i=4 2024-09-22T08:39:16.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.698+0000 7f5d7da10800 20 remove_watcher() i=5 2024-09-22T08:39:16.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.698+0000 7f5d7da10800 20 remove_watcher() i=6 2024-09-22T08:39:16.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:16.699+0000 7f5d7da10800 20 remove_watcher() i=7 2024-09-22T08:39:16.710 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:16.710 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:16.710 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:39:16.710 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:17.085 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-22T08:39:17.085 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:17.905 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:39:17.933 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:17.933 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:17.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.968+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 realm 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.970+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.971+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.971+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.972+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:17.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.972+0000 7f86d4e40800 20 searching for the correct realm 2024-09-22T08:39:17.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.974+0000 7f86d292a640 0 -- 172.21.15.78:0/1099874461 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x559b62ecb2f0 msgr2=0x559b62ecd7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:17.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.978+0000 7f86d292a640 0 -- 172.21.15.78:0/1099874461 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x559b62ebefe0 msgr2=0x559b62ec13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:17.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:17.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.981+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 zone default found 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 4 Realm: () 2024-09-22T08:39:17.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 zonegroup default 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.982+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.983+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.983+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.983+0000 7f86d4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.983+0000 7f86d4e40800 20 started sync module instance, tier type = 2024-09-22T08:39:17.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.983+0000 7f86d4e40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:17.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=0 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=1 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=2 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=3 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=4 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=5 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.991+0000 7f86d4e40800 20 add_watcher() i=6 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.992+0000 7f86d4e40800 20 add_watcher() i=7 2024-09-22T08:39:17.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.992+0000 7f86d4e40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:17.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f85897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f86d4e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f86d4e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f86d4e40800 5 note: GC not initialized 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f8503fff640 20 reqs_thread_entry: start 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.994+0000 7f86d4e40800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.995+0000 7f86d4e40800 20 Filter name: none 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.995+0000 7f8501ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:17.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.995+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.996+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:17.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.996+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.997+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:17.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.997+0000 7f86d4e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:17.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.997+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.997+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:17.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.997+0000 7f86d4e40800 20 rados->read ofs=0 len=0 2024-09-22T08:39:17.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.998+0000 7f86d4e40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:17.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.998+0000 7f86d4e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:18.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:17.999+0000 7f85897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.001+0000 7f86d4e40800 20 remove_watcher() i=0 2024-09-22T08:39:18.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.001+0000 7f86d4e40800 2 removed watcher, disabling cache 2024-09-22T08:39:18.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.002+0000 7f86d4e40800 20 remove_watcher() i=1 2024-09-22T08:39:18.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.003+0000 7f86d4e40800 20 remove_watcher() i=2 2024-09-22T08:39:18.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.004+0000 7f86d4e40800 20 remove_watcher() i=3 2024-09-22T08:39:18.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.005+0000 7f86d4e40800 20 remove_watcher() i=4 2024-09-22T08:39:18.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.006+0000 7f86d4e40800 20 remove_watcher() i=5 2024-09-22T08:39:18.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.007+0000 7f86d4e40800 20 remove_watcher() i=6 2024-09-22T08:39:18.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.008+0000 7f86d4e40800 20 remove_watcher() i=7 2024-09-22T08:39:18.019 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:18.019 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.021 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-22T08:39:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:18.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.091+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 realm 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.095+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:18.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.095+0000 7f728ed2a800 20 searching for the correct realm 2024-09-22T08:39:18.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.097+0000 7f728b218640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f728005ec40 msgr2=0x7f7280069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.301+0000 7f728a216640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7284018040 msgr2=0x7f7284065ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:18.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zone default found 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Realm: () 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:18.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zonegroup default 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.308+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started sync module instance, tier type = 2024-09-22T08:39:18.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=0 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=1 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=2 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=3 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=4 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=5 2024-09-22T08:39:18.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=6 2024-09-22T08:39:18.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.321+0000 7f728ed2a800 20 add_watcher() i=7 2024-09-22T08:39:18.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.321+0000 7f728ed2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:18.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f71417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 5 note: GC not initialized 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f70bbfff640 20 reqs_thread_entry: start 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 20 Filter name: none 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f70b9ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:39:18.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : miss 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:18.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.324+0000 7f728ed2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f728ed2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f728ed2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562478 cookie 94760803290128 notifier 7044 bl.length()=1023 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.333 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f728ed2a800 time 2024-09-22T08:39:18.333361+0000 2024-09-22T08:39:18.333 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:18.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:18.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f729038c748] 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.334 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.333+0000 7f728ed2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f728ed2a800 time 2024-09-22T08:39:18.333361+0000 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f729038c748] 2024-09-22T08:39:18.335 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:39:18.336 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f728ed2a800 thread_name:radosgw-admin 2024-09-22T08:39:18.356 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f728f03e6f0] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f728f08b99c] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f729038c7a2] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:18.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.334+0000 7f728ed2a800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f728ed2a800 thread_name:radosgw-admin 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f728f03e6f0] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f728f08b99c] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f729038c7a2] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.358 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) unregister_commands rotate-key 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:39:18.074+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:39:18.074+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:39:18.074+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.359 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.360 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: starting msgr at 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: starting objecter 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests hook 0x562f37f7f990 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: setting wanted keys 2024-09-22T08:39:18.361 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: calling monclient init 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.362 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key hook 0x562f37f4e8c8 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f37dff870 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f37dffc50 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37e944d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.363 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.864815s 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37dffc50 auth_method 0 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f37dff870 auth_method 0 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.364 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:39:18.076+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37e944d0 auth_method 0 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:39:18.076+0000 7f728a216640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: dump: 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.365 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:39:18.076+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7035 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.366 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: dump: 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:39:18.076+0000 7f7178e09640 4 set_mon_vals no callback set 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.367 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:39:18.076+0000 7f728ed2a800 1 librados: init done 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:39:18.078+0000 7f728aa17640 10 monclient: get_auth_request con 0x7f7170077570 auth_method 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:39:18.079+0000 7f728b218640 10 monclient: get_auth_request con 0x562f37f76f20 auth_method 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:39:18.079+0000 7f728aa17640 10 monclient: get_auth_request con 0x562f37f99a60 auth_method 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:39:18.080+0000 7f728a216640 10 monclient: get_auth_request con 0x562f37f9dc50 auth_method 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:39:18.081+0000 7f728b218640 10 monclient: get_auth_request con 0x562f37f9d310 auth_method 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:39:18.082+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.368 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.369 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:39:18.082+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562f37fa92b0 EEXIST 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.370 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:39:18.082+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:39:18.083+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:39:18.083+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x562f37fa4e70 EEXIST 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.371 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37fcd5d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f37fcd9b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f37fcc2e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.872202s 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37fcd9b0 auth_method 0 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f37fcc2e0 auth_method 0 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.372 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37fcd5d0 auth_method 0 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:39:18.083+0000 7f728b218640 1 monclient: found mon.noname-c 2024-09-22T08:39:18.373 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: dump: 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.374 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: dump: 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.375 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:39:18.083+0000 7f728ed2a800 5 monclient: authenticate success, global_id 6560 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:39:18.083+0000 7f728ba19640 4 set_mon_vals no callback set 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:39:18.085+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7164077480 auth_method 0 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: get_monmap_and_config 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:39:18.086+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.376 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.377 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.378 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:39:18.087+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd748cb508 EEXIST 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:39:18.379 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f38021b00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37ff2b10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f3801cfe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.876090s 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f38021b00 auth_method 0 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f3801cfe0 auth_method 0 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.380 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37ff2b10 auth_method 0 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_done global_id 7041 payload 274 2024-09-22T08:39:18.381 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:39:18.087+0000 7f728a216640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: dump: 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.382 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:39:18.087+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7041 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: dump: 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.383 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:39:18.087+0000 7f728ed2a800 4 set_mon_vals no callback set 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: shutdown 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.384 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.385 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:39:18.088+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: starting msgr at 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: starting objecter 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562f37fed190 EEXIST 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: setting wanted keys 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: calling monclient init 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.386 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:39:18.088+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.387 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:39:18.089+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:39:18.089+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x562f37fe1fd8 EEXIST 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37ff2b10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f3801cfe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f38021b00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.878295s 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f38021b00 auth_method 0 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.388 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f3801cfe0 auth_method 0 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37ff2b10 auth_method 0 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.389 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_done global_id 7044 payload 824 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:39:18.089+0000 7f728aa17640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: dump: 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.390 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: dump: 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.391 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:39:18.089+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7044 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:39:18.089+0000 7f716e7fc640 4 set_mon_vals no callback set 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:39:18.090+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:39:18.090+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:39:18.090+0000 7f728ed2a800 1 librados: init done 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:39:18.090+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cr dump hook 0x562f3800fc28 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:39:18.091+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.392 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:39:18.092+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7154077570 auth_method 0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:39:18.092+0000 7f728b218640 10 monclient: get_auth_request con 0x562f3803c200 auth_method 0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 realm 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:39:18.093+0000 7f728ed2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:39:18.093+0000 7f728a216640 10 monclient: get_auth_request con 0x562f380404c0 auth_method 0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:39:18.094+0000 7f728b218640 10 monclient: get_auth_request con 0x562f38043d20 auth_method 0 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:39:18.095+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:39:18.095+0000 7f728ed2a800 20 searching for the correct realm 2024-09-22T08:39:18.393 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:39:18.095+0000 7f728aa17640 10 monclient: get_auth_request con 0x562f38048a00 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:39:18.096+0000 7f728a216640 10 monclient: get_auth_request con 0x7f727c0aea10 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:39:18.097+0000 7f728b218640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f728005ec40 msgr2=0x7f7280069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:39:18.298+0000 7f728b218640 10 monclient: get_auth_request con 0x7f728005ec40 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:39:18.298+0000 7f728aa17640 10 monclient: get_auth_request con 0x7f727c0b7c00 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:39:18.300+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7284018040 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:39:18.301+0000 7f728a216640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7284018040 msgr2=0x7f7284065ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:39:18.301+0000 7f716cff9640 1 client.7044.objecter ms_handle_reset 0x7f7284018040 session 0x7f7284076040 osd.3 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:39:18.301+0000 7f716cff9640 10 monclient: _renew_subs 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:39:18.301+0000 7f716cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:39:18.301+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7154087890 auth_method 0 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:18.394 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zone default found 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Realm: () 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:39:18.307+0000 7f728ed2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zonegroup default 2024-09-22T08:39:18.395 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started sync module instance, tier type = 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=0 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=1 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=2 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=3 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=4 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=5 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=6 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:39:18.321+0000 7f728ed2a800 20 add_watcher() i=7 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:39:18.321+0000 7f728ed2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:18.396 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:39:18.323+0000 7f71417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.397 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:39:18.323+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache list hook 0x562f38012cd0 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache inspect hook 0x562f38012cd0 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache erase hook 0x562f38012cd0 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache zap hook 0x562f38012cd0 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 note: GC not initialized 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:39:18.323+0000 7f70bbfff640 20 reqs_thread_entry: start 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace show hook 0x7f728001d070 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace history hook 0x7f728001d070 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace active hook 0x7f728001d070 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace active_short hook 0x7f728001d070 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 Filter name: none 2024-09-22T08:39:18.398 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:39:18.323+0000 7f70b9ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:39:18.323+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : miss 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.399 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562478 cookie 94760803290128 notifier 7044 bl.length()=1023 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:39:18.333+0000 7f728ed2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f728ed2a800 time 2024-09-22T08:39:18.333361+0000 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f729038c748] 2024-09-22T08:39:18.400 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:39:18.334+0000 7f728ed2a800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f728ed2a800 thread_name:radosgw-admin 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f728f03e6f0] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f728f08b99c] 2024-09-22T08:39:18.401 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f729038c7a2] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:39:18.402 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:39:18.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:39:18.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:18.405 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:39:18.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:18.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 7f70b9ffb640 / http_manager 2024-09-22T08:39:18.408 INFO:tasks.workunit.client.0.smithi078.stderr: 7f70bbfff640 / http_manager 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f71417e2640 / rgw_dt_lg_renew 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716cff9640 / ms_dispatch 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716dffb640 / io_context_pool 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716e7fc640 / io_context_pool 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7174e01640 / ms_dispatch 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7177606640 / ms_dispatch 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7178e09640 / io_context_pool 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728a216640 / msgr-worker-2 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728aa17640 / msgr-worker-1 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728b218640 / msgr-worker-0 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728ba19640 / io_context_pool 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728ed2a800 / radosgw-admin 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:39:18.409 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.109252.log 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) unregister_commands rotate-key 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:39:18.074+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:39:18.074+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:39:18.074+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.410 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding auth protocol: cephx 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.411 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: crc 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:39:18.074+0000 7f728ed2a800 5 AuthRegistry(0x562f37f53e80) adding con mode: secure 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: starting msgr at 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: starting objecter 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests hook 0x562f37f7f990 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: setting wanted keys 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:39:18.075+0000 7f728ed2a800 1 librados: calling monclient init 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding auth protocol: cephx 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.412 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: crc 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 AuthRegistry(0x562f37f4e780) adding con mode: secure 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:39:18.075+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:39:18.075+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key hook 0x562f37f4e8c8 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f37dff870 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.413 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f37dffc50 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37e944d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:39:18.075+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.864815s 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37dffc50 auth_method 0 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f37dff870 auth_method 0 2024-09-22T08:39:18.414 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:39:18.075+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:39:18.075+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:39:18.076+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37e944d0 auth_method 0 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:39:18.076+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.415 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:39:18.076+0000 7f728a216640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:39:18.076+0000 7f728a216640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: dump: 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.416 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:39:18.076+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7035 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:39:18.076+0000 7f7177606640 10 monclient: dump: 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.417 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:39:18.076+0000 7f7178e09640 4 set_mon_vals no callback set 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:39:18.076+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:39:18.076+0000 7f728ed2a800 1 librados: init done 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:39:18.078+0000 7f7177606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:39:18.078+0000 7f728aa17640 10 monclient: get_auth_request con 0x7f7170077570 auth_method 0 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:39:18.079+0000 7f728b218640 10 monclient: get_auth_request con 0x562f37f76f20 auth_method 0 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:39:18.079+0000 7f728aa17640 10 monclient: get_auth_request con 0x562f37f99a60 auth_method 0 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:39:18.080+0000 7f728a216640 10 monclient: get_auth_request con 0x562f37f9dc50 auth_method 0 2024-09-22T08:39:18.418 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:39:18.081+0000 7f728b218640 10 monclient: get_auth_request con 0x562f37f9d310 auth_method 0 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:39:18.082+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.419 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding auth protocol: cephx 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: crc 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa5de0) adding con mode: secure 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:39:18.082+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562f37fa92b0 EEXIST 2024-09-22T08:39:18.420 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:39:18.082+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding auth protocol: cephx 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: crc 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:39:18.082+0000 7f728ed2a800 5 AuthRegistry(0x562f37fa4d28) adding con mode: secure 2024-09-22T08:39:18.421 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:39:18.082+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:39:18.083+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:39:18.083+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x562f37fa4e70 EEXIST 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37fcd5d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f37fcd9b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f37fcc2e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.872202s 2024-09-22T08:39:18.422 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37fcd9b0 auth_method 0 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f37fcc2e0 auth_method 0 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37fcd5d0 auth_method 0 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.423 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:39:18.083+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:39:18.083+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:39:18.083+0000 7f728b218640 1 monclient: found mon.noname-c 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:39:18.083+0000 7f728b218640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: dump: 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.424 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:39:18.083+0000 7f7174e01640 10 monclient: dump: 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.425 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:39:18.083+0000 7f728ed2a800 5 monclient: authenticate success, global_id 6560 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:39:18.083+0000 7f728ba19640 4 set_mon_vals no callback set 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:39:18.083+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:18.426 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:39:18.085+0000 7f7174e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:39:18.085+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7164077480 auth_method 0 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: get_monmap_and_config 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:39:18.086+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.427 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding auth protocol: cephx 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.428 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: crc 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x562f37fed4a0) adding con mode: secure 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:39:18.086+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding auth protocol: cephx 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.429 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: crc 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:39:18.086+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb3c0) adding con mode: secure 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:39:18.086+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:39:18.087+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd748cb508 EEXIST 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f38021b00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.430 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37ff2b10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f3801cfe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.876090s 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f38021b00 auth_method 0 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f3801cfe0 auth_method 0 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.431 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f37ff2b10 auth_method 0 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:39:18.087+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:39:18.087+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient(hunting): handle_auth_done global_id 7041 payload 274 2024-09-22T08:39:18.432 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:39:18.087+0000 7f728a216640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:39:18.087+0000 7f728a216640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: dump: 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.433 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:39:18.087+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7041 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:39:18.087+0000 7f716e7fc640 10 monclient: dump: 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.434 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:39:18.087+0000 7f728ed2a800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:39:18.087+0000 7f728ed2a800 4 set_mon_vals no callback set 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: shutdown 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: build_initial_monmap 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 build_initial for_mkfs: 0 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: monmap: 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:18.435 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding auth protocol: cephx 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.436 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: crc 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f38013730) adding con mode: secure 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:39:18.088+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: starting msgr at 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: starting objecter 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x562f37fed190 EEXIST 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: setting wanted keys 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:39:18.088+0000 7f728ed2a800 1 librados: calling monclient init 2024-09-22T08:39:18.437 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:39:18.088+0000 7f728ed2a800 10 monclient: init 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding auth protocol: cephx 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.438 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: crc 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:39:18.088+0000 7f728ed2a800 5 AuthRegistry(0x562f37fe1e90) adding con mode: secure 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:39:18.088+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:39:18.089+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:39:18.089+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command rotate-key cmddesc rotate-key hook 0x562f37fe1fd8 EEXIST 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-b con 0x562f37ff2b10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-c con 0x562f3801cfe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): picked mon.noname-a con 0x562f38021b00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:18.439 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient(hunting): authenticate will time out at 2073.878295s 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): get_auth_request con 0x562f38021b00 auth_method 0 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): get_auth_request con 0x562f3801cfe0 auth_method 0 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.440 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:39:18.089+0000 7f728b218640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): get_auth_request con 0x562f37ff2b10 auth_method 0 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:39:18.089+0000 7f728a216640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient(hunting): handle_auth_done global_id 7044 payload 824 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient: _finish_hunting 0 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:39:18.089+0000 7f728aa17640 1 monclient: found mon.noname-a 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:39:18.089+0000 7f728aa17640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:18.441 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: dump: 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:18.442 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:39:18.089+0000 7f716cff9640 10 monclient: dump: 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:39:18.089+0000 7f728ed2a800 5 monclient: authenticate success, global_id 7044 2024-09-22T08:39:18.443 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:39:18.089+0000 7f716e7fc640 4 set_mon_vals no callback set 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:39:18.089+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:39:18.090+0000 7f728ed2a800 10 monclient: _renew_subs 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:39:18.090+0000 7f728ed2a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:39:18.090+0000 7f728ed2a800 1 librados: init done 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:39:18.090+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cr dump hook 0x562f3800fc28 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:39:18.091+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:39:18.092+0000 7f716cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:39:18.092+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7154077570 auth_method 0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:39:18.092+0000 7f728b218640 10 monclient: get_auth_request con 0x562f3803c200 auth_method 0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 realm 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.444 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:39:18.093+0000 7f728ed2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:39:18.093+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:39:18.093+0000 7f728a216640 10 monclient: get_auth_request con 0x562f380404c0 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:39:18.094+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:39:18.094+0000 7f728b218640 10 monclient: get_auth_request con 0x562f38043d20 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:39:18.095+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:39:18.095+0000 7f728ed2a800 20 searching for the correct realm 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:39:18.095+0000 7f728aa17640 10 monclient: get_auth_request con 0x562f38048a00 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:39:18.096+0000 7f728a216640 10 monclient: get_auth_request con 0x7f727c0aea10 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:39:18.097+0000 7f728b218640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f728005ec40 msgr2=0x7f7280069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:39:18.298+0000 7f728b218640 10 monclient: get_auth_request con 0x7f728005ec40 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:39:18.298+0000 7f728aa17640 10 monclient: get_auth_request con 0x7f727c0b7c00 auth_method 0 2024-09-22T08:39:18.445 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:39:18.300+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7284018040 auth_method 0 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:39:18.301+0000 7f728a216640 0 -- 172.21.15.78:0/562353246 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7284018040 msgr2=0x7f7284065ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:39:18.301+0000 7f716cff9640 1 client.7044.objecter ms_handle_reset 0x7f7284018040 session 0x7f7284076040 osd.3 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:39:18.301+0000 7f716cff9640 10 monclient: _renew_subs 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:39:18.301+0000 7f716cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:39:18.301+0000 7f728a216640 10 monclient: get_auth_request con 0x7f7154087890 auth_method 0 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.446 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:39:18.306+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zone default found 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Realm: () 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:39:18.307+0000 7f728ed2a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:39:18.307+0000 7f728ed2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 zonegroup default 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:39:18.307+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.447 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started sync module instance, tier type = 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:39:18.308+0000 7f728ed2a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=0 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=1 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=2 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=3 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=4 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=5 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:39:18.320+0000 7f728ed2a800 20 add_watcher() i=6 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:39:18.321+0000 7f728ed2a800 20 add_watcher() i=7 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:39:18.321+0000 7f728ed2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding auth protocol: cephx 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.448 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:39:18.323+0000 7f71417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: crc 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 AuthRegistry(0x7ffd748cb890) adding con mode: secure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:39:18.323+0000 7f728ed2a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache list hook 0x562f38012cd0 2024-09-22T08:39:18.449 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache inspect hook 0x562f38012cd0 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache erase hook 0x562f38012cd0 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command cache zap hook 0x562f38012cd0 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 note: GC not initialized 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:39:18.323+0000 7f70bbfff640 20 reqs_thread_entry: start 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace show hook 0x7f728001d070 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace history hook 0x7f728001d070 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace active hook 0x7f728001d070 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:39:18.323+0000 7f728ed2a800 5 asok(0x562f37d2c0f0) register_command sync trace active_short hook 0x7f728001d070 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 Filter name: none 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:39:18.323+0000 7f70b9ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:39:18.323+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:39:18.323+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:18.450 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : miss 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:39:18.324+0000 7f728ed2a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:39:18.324+0000 7f728ed2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:39:18.330+0000 7f728ed2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:18.451 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562478 cookie 94760803290128 notifier 7044 bl.length()=1023 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:39:18.330+0000 7f716dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:39:18.332+0000 7f728ed2a800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:39:18.333+0000 7f728ed2a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f728ed2a800 time 2024-09-22T08:39:18.333361+0000 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f729038c748] 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.452 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:39:18.334+0000 7f728ed2a800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f728ed2a800 thread_name:radosgw-admin 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f728f03e6f0] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f728f08b99c] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f729038c7a2] 2024-09-22T08:39:18.453 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f729038c906] 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f3574ee01] 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd817fe) [0x562f35c617fe] 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562f3575ec9d] 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f728f029590] 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:39:18.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:39:18.455 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:39:18.456 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:18.457 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:39:18.458 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:39:18.459 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:18.460 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f70b9ffb640 / http_manager 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f70bbfff640 / http_manager 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f71417e2640 / rgw_dt_lg_renew 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716cff9640 / ms_dispatch 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716dffb640 / io_context_pool 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f716e7fc640 / io_context_pool 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7174e01640 / ms_dispatch 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7177606640 / ms_dispatch 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7178e09640 / io_context_pool 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728a216640 / msgr-worker-2 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728aa17640 / msgr-worker-1 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728b218640 / msgr-worker-0 2024-09-22T08:39:18.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728ba19640 / io_context_pool 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr: 7f728ed2a800 / radosgw-admin 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:39:18.335160Z_82278172-92ac-47cd-896c-d04227ab1880/log 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:39:18.462 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:39:18.463 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:18.463 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:18.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.411+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 realm 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.413+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.414+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.414+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.415+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.415+0000 7fde28973800 20 searching for the correct realm 2024-09-22T08:39:18.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.417+0000 7fde26c5e640 0 -- 172.21.15.78:0/1484194979 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fde100ab870 msgr2=0x7fde100b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:18.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.621+0000 7fde1ffff640 0 -- 172.21.15.78:0/1484194979 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fde20022c10 msgr2=0x7fde2002c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:18.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.627+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 zone default found 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 4 Realm: () 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 zonegroup default 2024-09-22T08:39:18.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.628+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.629+0000 7fde28973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.629+0000 7fde28973800 20 started sync module instance, tier type = 2024-09-22T08:39:18.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.629+0000 7fde28973800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=0 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=1 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=2 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=3 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=4 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=5 2024-09-22T08:39:18.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.638+0000 7fde28973800 20 add_watcher() i=6 2024-09-22T08:39:18.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.639+0000 7fde28973800 20 add_watcher() i=7 2024-09-22T08:39:18.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.639+0000 7fde28973800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:18.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fdcdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fde28973800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fde28973800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fde28973800 5 note: GC not initialized 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fdc577fe640 20 reqs_thread_entry: start 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fde28973800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fde28973800 20 Filter name: none 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.641+0000 7fdc557fa640 20 reqs_thread_entry: start 2024-09-22T08:39:18.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.642+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.643+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:18.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.643+0000 7fde28973800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.643+0000 7fde28973800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:18.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.643+0000 7fde28973800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:18.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.645+0000 7fdcdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:18.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.647+0000 7fde28973800 20 remove_watcher() i=0 2024-09-22T08:39:18.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.647+0000 7fde28973800 2 removed watcher, disabling cache 2024-09-22T08:39:18.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.648+0000 7fde28973800 20 remove_watcher() i=1 2024-09-22T08:39:18.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.649+0000 7fde28973800 20 remove_watcher() i=2 2024-09-22T08:39:18.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.650+0000 7fde28973800 20 remove_watcher() i=3 2024-09-22T08:39:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.651+0000 7fde28973800 20 remove_watcher() i=4 2024-09-22T08:39:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.652+0000 7fde28973800 20 remove_watcher() i=5 2024-09-22T08:39:18.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.653+0000 7fde28973800 20 remove_watcher() i=6 2024-09-22T08:39:18.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.654+0000 7fde28973800 20 remove_watcher() i=7 2024-09-22T08:39:18.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.665 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:18.665 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:18.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:18.756 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:18.788 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:18.789 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:18.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.825+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 realm 2024-09-22T08:39:18.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.827+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.828+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:18.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.828+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:18.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.829+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:18.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.829+0000 7f4238411800 20 searching for the correct realm 2024-09-22T08:39:18.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:18.829+0000 7f422b347640 0 -- 172.21.15.78:0/2061804313 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f422409e040 msgr2=0x7f42240573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:19.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.035+0000 7f4233b48640 0 -- 172.21.15.78:0/2061804313 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x564e2b39ce40 msgr2=0x564e2b39f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:19.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:19.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:19.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.040+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:19.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 zone default found 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 4 Realm: () 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 zonegroup default 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.041+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.042+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.042+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.042+0000 7f4238411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.042+0000 7f4238411800 20 started sync module instance, tier type = 2024-09-22T08:39:19.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.042+0000 7f4238411800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:19.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=0 2024-09-22T08:39:19.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=1 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=2 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=3 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=4 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=5 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.050+0000 7f4238411800 20 add_watcher() i=6 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.051+0000 7f4238411800 20 add_watcher() i=7 2024-09-22T08:39:19.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.051+0000 7f4238411800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:19.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.053+0000 7f40e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.053+0000 7f4238411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.053+0000 7f4238411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.053+0000 7f4238411800 5 note: GC not initialized 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.053+0000 7f40e8fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 20 Filter name: none 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f40627fc640 20 reqs_thread_entry: start 2024-09-22T08:39:19.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:39:19.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:19.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:19.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : miss 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.054+0000 7f4238411800 20 rados->read ofs=0 len=0 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:19.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.055+0000 7f4238411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:19.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.056+0000 7f4238411800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to be held by another RGW process; skipping for now 2024-09-22T08:39:19.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.057+0000 7f40e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:19.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.059+0000 7f4238411800 20 remove_watcher() i=0 2024-09-22T08:39:19.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.059+0000 7f4238411800 2 removed watcher, disabling cache 2024-09-22T08:39:19.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.060+0000 7f4238411800 20 remove_watcher() i=1 2024-09-22T08:39:19.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.061+0000 7f4238411800 20 remove_watcher() i=2 2024-09-22T08:39:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.062+0000 7f4238411800 20 remove_watcher() i=3 2024-09-22T08:39:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.062+0000 7f4238411800 20 remove_watcher() i=4 2024-09-22T08:39:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.063+0000 7f4238411800 20 remove_watcher() i=5 2024-09-22T08:39:19.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.064+0000 7f4238411800 20 remove_watcher() i=6 2024-09-22T08:39:19.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:19.065+0000 7f4238411800 20 remove_watcher() i=7 2024-09-22T08:39:19.076 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:39:49.109 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:49.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.184+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.186+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.186+0000 7f70d282f800 20 realm 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.186+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.187+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.187+0000 7f70d282f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.187+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.187+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.187+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.188+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:49.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.188+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.189+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:49.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.189+0000 7f70d282f800 20 searching for the correct realm 2024-09-22T08:39:49.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.191+0000 7f70d0b21640 0 -- 172.21.15.78:0/3237472297 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f70c4018070 msgr2=0x7f70c4074590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:49.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.397+0000 7f70cfb1f640 0 -- 172.21.15.78:0/3237472297 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f70c809e020 msgr2=0x7f70c8077980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.403+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:49.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 zone default found 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 4 Realm: () 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 zonegroup default 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.404+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.405+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.405+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.405+0000 7f70d282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.405+0000 7f70d282f800 20 started sync module instance, tier type = 2024-09-22T08:39:49.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.405+0000 7f70d282f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=0 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=1 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=2 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=3 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=4 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=5 2024-09-22T08:39:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.415+0000 7f70d282f800 20 add_watcher() i=6 2024-09-22T08:39:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.416+0000 7f70d282f800 20 add_watcher() i=7 2024-09-22T08:39:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.416+0000 7f70d282f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:49.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f6f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f70d282f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f70d282f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f70d282f800 5 note: GC not initialized 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f6f85fe3640 20 reqs_thread_entry: start 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f70d282f800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.418+0000 7f70d282f800 20 Filter name: none 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f6f7effd640 20 reqs_thread_entry: start 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T08:39:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T08:39:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T08:39:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : miss 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 20 rados_obj.operate() r=0 bl.length=479 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.419+0000 7f70d282f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:49.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.421+0000 7f70d282f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:39:49.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.428+0000 7f70d282f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.428+0000 7f70d282f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.428+0000 7f70d282f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.428+0000 7f70d282f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.429+0000 7f6fa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562479 cookie 94771653905488 notifier 6617 bl.length()=1023 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.429+0000 7f6fa6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.429+0000 7f6fa6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.429+0000 7f6fa6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.430+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.430+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.430+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:49.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.430+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:49.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.0 2024-09-22T08:39:49.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.0 2024-09-22T08:39:49.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.1 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.1 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.2 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.2 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.3 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.3 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.4 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.4 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.5 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.5 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.6 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.6 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.7 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.7 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.8 2024-09-22T08:39:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.8 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.9 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.9 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.10 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.10 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.11 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2.11 2024-09-22T08:39:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.0 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.435+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.1 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.436+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.436+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.3 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.437+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.4 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.437+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.5 2024-09-22T08:39:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.438+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.6 2024-09-22T08:39:49.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.438+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.7 2024-09-22T08:39:49.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.439+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.8 2024-09-22T08:39:49.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.439+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.9 2024-09-22T08:39:49.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.440+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.10 2024-09-22T08:39:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.443+0000 7f70d282f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.443+0000 7f70d282f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:49.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.444+0000 7f70d282f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.444+0000 7f70d282f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.444+0000 7f70d282f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.444+0000 7f70d282f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.445+0000 7f6fa77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94771653905488 notifier 6617 bl.length()=1023 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.445+0000 7f6fa77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.445+0000 7f6fa77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.445+0000 7f6fa77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.446+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:49.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.446+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:49.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.446+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:49.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.446+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:49.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.448+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.0 2024-09-22T08:39:49.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.449+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.1 2024-09-22T08:39:49.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.449+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.2 2024-09-22T08:39:49.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.449+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.3 2024-09-22T08:39:49.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.450+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.4 2024-09-22T08:39:49.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.450+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.5 2024-09-22T08:39:49.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.450+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.6 2024-09-22T08:39:49.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.451+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.7 2024-09-22T08:39:49.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.451+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.8 2024-09-22T08:39:49.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.451+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.9 2024-09-22T08:39:49.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.452+0000 7f70d282f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28.10 2024-09-22T08:39:49.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.452+0000 7f70d282f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:49.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.452+0000 7f70d282f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.453+0000 7f70d282f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.453+0000 7f70d282f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.453+0000 7f70d282f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.453+0000 7f70d282f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28, ofs0, ns] 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.454+0000 7f6fa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562481 cookie 94771653905488 notifier 6617 bl.length()=991 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.454+0000 7f6fa6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 info.flags=0x17 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.454+0000 7f6fa6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 to cache LRU end 2024-09-22T08:39:49.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.454+0000 7f6fa6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:49.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.455+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_sources= new_sources= 2024-09-22T08:39:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.455+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential sources added=[] removed=[] 2024-09-22T08:39:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.455+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): orig_dests= new_dests= 2024-09-22T08:39:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.455+0000 7f70d282f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28]): potential dests added=[] removed=[] 2024-09-22T08:39:49.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.457+0000 7f70d282f800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:49.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.459+0000 7f6f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:49.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.461+0000 7f70d282f800 20 remove_watcher() i=0 2024-09-22T08:39:49.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.461+0000 7f70d282f800 2 removed watcher, disabling cache 2024-09-22T08:39:49.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.462+0000 7f70d282f800 20 remove_watcher() i=1 2024-09-22T08:39:49.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.463+0000 7f70d282f800 20 remove_watcher() i=2 2024-09-22T08:39:49.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.464+0000 7f70d282f800 20 remove_watcher() i=3 2024-09-22T08:39:49.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.466+0000 7f70d282f800 20 remove_watcher() i=4 2024-09-22T08:39:49.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.467+0000 7f70d282f800 20 remove_watcher() i=5 2024-09-22T08:39:49.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.468+0000 7f70d282f800 20 remove_watcher() i=6 2024-09-22T08:39:49.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.469+0000 7f70d282f800 20 remove_watcher() i=7 2024-09-22T08:39:49.482 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T08:39:49.511 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:49.511 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:49.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.547+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 realm 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.549+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.550+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:49.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.550+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.551+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:49.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.551+0000 7f8908324800 20 searching for the correct realm 2024-09-22T08:39:49.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.554+0000 7f8904703640 0 -- 172.21.15.78:0/2235503509 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f88f8048c20 msgr2=0x7f88f8099a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.557+0000 7f8903701640 0 -- 172.21.15.78:0/2235503509 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f88fc020050 msgr2=0x7f88fc020430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.561+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:49.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 zone default found 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 4 Realm: () 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 zonegroup default 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.562+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:49.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 started sync module instance, tier type = 2024-09-22T08:39:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.563+0000 7f8908324800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:49.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=0 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=1 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=2 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=3 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=4 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=5 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.572+0000 7f8908324800 20 add_watcher() i=6 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.573+0000 7f8908324800 20 add_watcher() i=7 2024-09-22T08:39:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.573+0000 7f8908324800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:49.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.575+0000 7f87ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.575+0000 7f8908324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.575+0000 7f8908324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.575+0000 7f8908324800 5 note: GC not initialized 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f87b97e2640 20 reqs_thread_entry: start 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f8908324800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f8908324800 20 Filter name: none 2024-09-22T08:39:49.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f87b27fc640 20 reqs_thread_entry: start 2024-09-22T08:39:49.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.576+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 rados->read ofs=0 len=0 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T08:39:49.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.577+0000 7f8908324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:49.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.579+0000 7f87ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:49.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.581+0000 7f8908324800 20 remove_watcher() i=0 2024-09-22T08:39:49.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.581+0000 7f8908324800 2 removed watcher, disabling cache 2024-09-22T08:39:49.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.582+0000 7f8908324800 20 remove_watcher() i=1 2024-09-22T08:39:49.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.583+0000 7f8908324800 20 remove_watcher() i=2 2024-09-22T08:39:49.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.584+0000 7f8908324800 20 remove_watcher() i=3 2024-09-22T08:39:49.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.585+0000 7f8908324800 20 remove_watcher() i=4 2024-09-22T08:39:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.586+0000 7f8908324800 20 remove_watcher() i=5 2024-09-22T08:39:49.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.587+0000 7f8908324800 20 remove_watcher() i=6 2024-09-22T08:39:49.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:49.588+0000 7f8908324800 20 remove_watcher() i=7 2024-09-22T08:39:49.599 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:49.600 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:49.600 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:39:49.600 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:49.964 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-22T08:39:49.964 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:39:50.802 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:50.802 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:50.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.837+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.838+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.838+0000 7f907ef26800 20 realm 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.838+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.839+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.839+0000 7f907ef26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.839+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.839+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.839+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:50.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.840+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:50.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.840+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:50.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.840+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:50.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.840+0000 7f907ef26800 20 searching for the correct realm 2024-09-22T08:39:50.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:50.842+0000 7f907b44c640 0 -- 172.21.15.78:0/2236841887 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9064099420 msgr2=0x7f9064099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:51.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.047+0000 7f907244a640 0 -- 172.21.15.78:0/2236841887 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f9074028bb0 msgr2=0x7f9074036950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:51.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.052+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:51.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 zone default found 2024-09-22T08:39:51.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 4 Realm: () 2024-09-22T08:39:51.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 zonegroup default 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.053+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.054+0000 7f907ef26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.054+0000 7f907ef26800 20 started sync module instance, tier type = 2024-09-22T08:39:51.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.054+0000 7f907ef26800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=0 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=1 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=2 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=3 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=4 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=5 2024-09-22T08:39:51.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.062+0000 7f907ef26800 20 add_watcher() i=6 2024-09-22T08:39:51.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.063+0000 7f907ef26800 20 add_watcher() i=7 2024-09-22T08:39:51.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.063+0000 7f907ef26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:51.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.064+0000 7f8f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.064+0000 7f907ef26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.064+0000 7f907ef26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f907ef26800 5 note: GC not initialized 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f8eabfff640 20 reqs_thread_entry: start 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f907ef26800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:51.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f907ef26800 20 Filter name: none 2024-09-22T08:39:51.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f8ea9ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:51.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.065+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:51.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.066+0000 7f907ef26800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.067+0000 7f907ef26800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.067+0000 7f907ef26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:51.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.068+0000 7f8f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.070+0000 7f907ef26800 20 remove_watcher() i=0 2024-09-22T08:39:51.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.070+0000 7f907ef26800 2 removed watcher, disabling cache 2024-09-22T08:39:51.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.071+0000 7f907ef26800 20 remove_watcher() i=1 2024-09-22T08:39:51.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.072+0000 7f907ef26800 20 remove_watcher() i=2 2024-09-22T08:39:51.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.073+0000 7f907ef26800 20 remove_watcher() i=3 2024-09-22T08:39:51.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.074+0000 7f907ef26800 20 remove_watcher() i=4 2024-09-22T08:39:51.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.075+0000 7f907ef26800 20 remove_watcher() i=5 2024-09-22T08:39:51.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.076+0000 7f907ef26800 20 remove_watcher() i=6 2024-09-22T08:39:51.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.077+0000 7f907ef26800 20 remove_watcher() i=7 2024-09-22T08:39:51.089 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:51.089 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:51.089 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:51.089 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:51.090 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-22T08:39:51.124 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:51.124 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:51.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.160+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.161+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.161+0000 7fa00d0bb800 20 realm 2024-09-22T08:39:51.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.161+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.162+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.162+0000 7fa00d0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:51.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.162+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.162+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.162+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.163+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.163+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.163+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:51.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.163+0000 7fa00d0bb800 20 searching for the correct realm 2024-09-22T08:39:51.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.165+0000 7fa00b3a6640 0 -- 172.21.15.78:0/3020261359 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9ff400b040 msgr2=0x7f9ff406d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:51.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.370+0000 7fa003fff640 0 -- 172.21.15.78:0/3020261359 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa004077920 msgr2=0x7fa00408e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:51.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.375+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 zone default found 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 4 Realm: () 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 zonegroup default 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.376+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 started sync module instance, tier type = 2024-09-22T08:39:51.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.377+0000 7fa00d0bb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=0 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=1 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=2 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=3 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=4 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=5 2024-09-22T08:39:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.386+0000 7fa00d0bb800 20 add_watcher() i=6 2024-09-22T08:39:51.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.387+0000 7fa00d0bb800 20 add_watcher() i=7 2024-09-22T08:39:51.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.387+0000 7fa00d0bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7f9ec17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7fa00d0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7fa00d0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7fa00d0bb800 5 note: GC not initialized 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7f9e3bfff640 20 reqs_thread_entry: start 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.389+0000 7fa00d0bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 20 Filter name: none 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7f9e39ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : miss 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.390+0000 7fa00d0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:51.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7fa00d0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7fa00d0bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7fa00d0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7fa00d0bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7f9eee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562408 cookie 94459027982576 notifier 6668 bl.length()=999 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7f9eee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7f9eee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.395+0000 7f9eee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.397+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:51.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.397+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:51.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.397+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:51.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.397+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.0 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.0 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.1 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.1 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.2 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.2 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.3 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.3 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.4 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.4 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.5 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.5 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.6 2024-09-22T08:39:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.6 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.7 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.7 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.8 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.8 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.9 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.9 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.10 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.10 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.11 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.11 2024-09-22T08:39:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.401+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.0 2024-09-22T08:39:51.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.402+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1 2024-09-22T08:39:51.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.402+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.2 2024-09-22T08:39:51.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.403+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.3 2024-09-22T08:39:51.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.403+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.4 2024-09-22T08:39:51.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.404+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.5 2024-09-22T08:39:51.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.405+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.6 2024-09-22T08:39:51.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.405+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.7 2024-09-22T08:39:51.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.405+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.8 2024-09-22T08:39:51.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.406+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.9 2024-09-22T08:39:51.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.407+0000 7fa00d0bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.10 2024-09-22T08:39:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.410+0000 7fa00d0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.410+0000 7fa00d0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7fa00d0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7fa00d0bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7fa00d0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7fa00d0bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7f9eee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562409 cookie 94459027982576 notifier 6668 bl.length()=999 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7f9eee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7f9eee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.411+0000 7f9eee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 -1 Injecting error=-5 at location=block_writes 2024-09-22T08:39:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.413+0000 7fa00d0bb800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-22T08:39:51.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.418+0000 7fa00d0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:51.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.418+0000 7fa00d0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:51.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7fa00d0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7fa00d0bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7fa00d0bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7fa00d0bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:51.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7f9eedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562410 cookie 94459027982576 notifier 6668 bl.length()=967 2024-09-22T08:39:51.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7f9eedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:51.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7f9eedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:51.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.419+0000 7f9eedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:51.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.421+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:51.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.421+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:51.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.421+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:51.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.421+0000 7fa00d0bb800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:51.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.423+0000 7fa00d0bb800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-22T08:39:51.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.425+0000 7f9ec17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.427+0000 7fa00d0bb800 20 remove_watcher() i=0 2024-09-22T08:39:51.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.427+0000 7fa00d0bb800 2 removed watcher, disabling cache 2024-09-22T08:39:51.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.428+0000 7fa00d0bb800 20 remove_watcher() i=1 2024-09-22T08:39:51.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.429+0000 7fa00d0bb800 20 remove_watcher() i=2 2024-09-22T08:39:51.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.430+0000 7fa00d0bb800 20 remove_watcher() i=3 2024-09-22T08:39:51.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.431+0000 7fa00d0bb800 20 remove_watcher() i=4 2024-09-22T08:39:51.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.432+0000 7fa00d0bb800 20 remove_watcher() i=5 2024-09-22T08:39:51.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.432+0000 7fa00d0bb800 20 remove_watcher() i=6 2024-09-22T08:39:51.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.433+0000 7fa00d0bb800 20 remove_watcher() i=7 2024-09-22T08:39:51.447 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:39:51.475 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:51.475 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:51.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.512+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 realm 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.514+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.515+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.515+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.516+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:51.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.516+0000 7f0f5011f800 20 searching for the correct realm 2024-09-22T08:39:51.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.517+0000 7f0f4358a640 0 -- 172.21.15.78:0/1911235658 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f0f3c01d040 msgr2=0x7f0f3c030430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:51.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.722+0000 7f0f4bd8b640 0 -- 172.21.15.78:0/1911235658 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5559dece1160 msgr2=0x5559dece35c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.728+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 zone default found 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 4 Realm: () 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 zonegroup default 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.729+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 started sync module instance, tier type = 2024-09-22T08:39:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.730+0000 7f0f5011f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=0 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=1 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=2 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=3 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=4 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=5 2024-09-22T08:39:51.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.739+0000 7f0f5011f800 20 add_watcher() i=6 2024-09-22T08:39:51.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.740+0000 7f0f5011f800 20 add_watcher() i=7 2024-09-22T08:39:51.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.740+0000 7f0f5011f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:51.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.742+0000 7f0e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.742+0000 7f0f5011f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:51.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.742+0000 7f0f5011f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:51.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0f5011f800 5 note: GC not initialized 2024-09-22T08:39:51.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0e00fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:51.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0f5011f800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:51.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0f5011f800 20 Filter name: none 2024-09-22T08:39:51.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0d7a7fc640 20 reqs_thread_entry: start 2024-09-22T08:39:51.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.743+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.744+0000 7f0f5011f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.745+0000 7f0f5011f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.745+0000 7f0f5011f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:51.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.746+0000 7f0e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:51.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.749+0000 7f0f5011f800 20 remove_watcher() i=0 2024-09-22T08:39:51.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.749+0000 7f0f5011f800 2 removed watcher, disabling cache 2024-09-22T08:39:51.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.750+0000 7f0f5011f800 20 remove_watcher() i=1 2024-09-22T08:39:51.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.751+0000 7f0f5011f800 20 remove_watcher() i=2 2024-09-22T08:39:51.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.752+0000 7f0f5011f800 20 remove_watcher() i=3 2024-09-22T08:39:51.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.753+0000 7f0f5011f800 20 remove_watcher() i=4 2024-09-22T08:39:51.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.754+0000 7f0f5011f800 20 remove_watcher() i=5 2024-09-22T08:39:51.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.755+0000 7f0f5011f800 20 remove_watcher() i=6 2024-09-22T08:39:51.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.756+0000 7f0f5011f800 20 remove_watcher() i=7 2024-09-22T08:39:51.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:51.767 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:51.767 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:51.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:51.858 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:51.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.925+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 realm 2024-09-22T08:39:51.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.927+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.928+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.928+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:51.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.929+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:51.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.929+0000 7f82e5723800 20 searching for the correct realm 2024-09-22T08:39:51.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:51.930+0000 7f82d8c0b640 0 -- 172.21.15.78:0/3491408636 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f82d4063960 msgr2=0x7f82d4082450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.135+0000 7f82e140c640 0 -- 172.21.15.78:0/3491408636 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5601ef2087c0 msgr2=0x5601ef20ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.141+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 zone default found 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 4 Realm: () 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 zonegroup default 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 started sync module instance, tier type = 2024-09-22T08:39:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.142+0000 7f82e5723800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=0 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=1 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=2 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=3 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=4 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=5 2024-09-22T08:39:52.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.151+0000 7f82e5723800 20 add_watcher() i=6 2024-09-22T08:39:52.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.152+0000 7f82e5723800 20 add_watcher() i=7 2024-09-22T08:39:52.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.152+0000 7f82e5723800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:52.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.153+0000 7f81977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 5 note: GC not initialized 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f81967e4640 20 reqs_thread_entry: start 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 Filter name: none 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f8107fff640 20 reqs_thread_entry: start 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T08:39:52.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T08:39:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : miss 2024-09-22T08:39:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.154+0000 7f82e5723800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:52.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.155+0000 7f82e5723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.159+0000 7f82e5723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.159+0000 7f82e5723800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.159+0000 7f82e5723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.159+0000 7f82e5723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.160+0000 7f81c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562411 cookie 94566306909616 notifier 7188 bl.length()=999 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.160+0000 7f81c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.160+0000 7f81c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.160+0000 7f81c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.161+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:52.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.161+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:52.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.161+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:52.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.161+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:52.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.0 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.0 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.1 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.1 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.2 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.2 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.3 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.3 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.4 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.4 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.5 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.5 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.6 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.6 2024-09-22T08:39:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.7 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.7 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.8 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.8 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.9 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.9 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.10 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.10 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.11 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1.11 2024-09-22T08:39:52.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.166+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.0 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.167+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.167+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.2 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.168+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.3 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.168+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.4 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.169+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.5 2024-09-22T08:39:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.169+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.6 2024-09-22T08:39:52.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.169+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.7 2024-09-22T08:39:52.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.170+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.8 2024-09-22T08:39:52.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.171+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.9 2024-09-22T08:39:52.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.171+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.10 2024-09-22T08:39:52.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.176+0000 7f82e5723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:52.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.176+0000 7f82e5723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f82e5723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f82e5723800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f82e5723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f82e5723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f81b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562412 cookie 94566306909616 notifier 7188 bl.length()=999 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f81b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f81b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.177+0000 7f81b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.179+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:52.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.179+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:52.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.179+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:52.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.179+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:52.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.181+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.0 2024-09-22T08:39:52.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.181+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.1 2024-09-22T08:39:52.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.182+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.2 2024-09-22T08:39:52.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.182+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.3 2024-09-22T08:39:52.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.182+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.4 2024-09-22T08:39:52.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.182+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.5 2024-09-22T08:39:52.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.183+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.6 2024-09-22T08:39:52.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.183+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.7 2024-09-22T08:39:52.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.183+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.8 2024-09-22T08:39:52.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.184+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.9 2024-09-22T08:39:52.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.184+0000 7f82e5723800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29.10 2024-09-22T08:39:52.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.184+0000 7f82e5723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:52.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.184+0000 7f82e5723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.185+0000 7f82e5723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.185+0000 7f82e5723800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.185+0000 7f82e5723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.185+0000 7f82e5723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29, ofs0, ns] 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.186+0000 7f81b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562413 cookie 94566306909616 notifier 7188 bl.length()=967 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.186+0000 7f81b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 info.flags=0x17 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.186+0000 7f81b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 to cache LRU end 2024-09-22T08:39:52.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.186+0000 7f81b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:52.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.187+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_sources= new_sources= 2024-09-22T08:39:52.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.187+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential sources added=[] removed=[] 2024-09-22T08:39:52.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.187+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): orig_dests= new_dests= 2024-09-22T08:39:52.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.187+0000 7f82e5723800 20 handle_bi_update(): bucket=:error-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29]): potential dests added=[] removed=[] 2024-09-22T08:39:52.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.189+0000 7f82e5723800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:39:52.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.191+0000 7f81977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:52.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.193+0000 7f82e5723800 20 remove_watcher() i=0 2024-09-22T08:39:52.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.193+0000 7f82e5723800 2 removed watcher, disabling cache 2024-09-22T08:39:52.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.194+0000 7f82e5723800 20 remove_watcher() i=1 2024-09-22T08:39:52.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.195+0000 7f82e5723800 20 remove_watcher() i=2 2024-09-22T08:39:52.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.196+0000 7f82e5723800 20 remove_watcher() i=3 2024-09-22T08:39:52.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.197+0000 7f82e5723800 20 remove_watcher() i=4 2024-09-22T08:39:52.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.198+0000 7f82e5723800 20 remove_watcher() i=5 2024-09-22T08:39:52.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.199+0000 7f82e5723800 20 remove_watcher() i=6 2024-09-22T08:39:52.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.200+0000 7f82e5723800 20 remove_watcher() i=7 2024-09-22T08:39:52.212 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T08:39:52.241 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:52.241 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:52.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.277+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 realm 2024-09-22T08:39:52.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:52.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.279+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.280+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:52.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.280+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.281+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:52.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.281+0000 7fea44725800 20 searching for the correct realm 2024-09-22T08:39:52.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.282+0000 7fea37ca1640 0 -- 172.21.15.78:0/2086266588 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fea30040040 msgr2=0x7fea30040420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:52.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.487+0000 7fea404a2640 0 -- 172.21.15.78:0/2086266588 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55a4fcfc9350 msgr2=0x55a4fcfcb770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:52.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.493+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 zone default found 2024-09-22T08:39:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 4 Realm: () 2024-09-22T08:39:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 zonegroup default 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.494+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.495+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.495+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.495+0000 7fea44725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.495+0000 7fea44725800 20 started sync module instance, tier type = 2024-09-22T08:39:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.495+0000 7fea44725800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:52.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=0 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=1 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=2 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=3 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=4 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=5 2024-09-22T08:39:52.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.504+0000 7fea44725800 20 add_watcher() i=6 2024-09-22T08:39:52.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.505+0000 7fea44725800 20 add_watcher() i=7 2024-09-22T08:39:52.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.505+0000 7fea44725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.507+0000 7fe8f77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 5 note: GC not initialized 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fe8f67dc640 20 reqs_thread_entry: start 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 Filter name: none 2024-09-22T08:39:52.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fe8ef7fe640 20 reqs_thread_entry: start 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.508+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.509+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.509+0000 7fea44725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.509+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.509+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.509+0000 7fea44725800 20 rados->read ofs=0 len=0 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.510+0000 7fea44725800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.510+0000 7fea44725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.511+0000 7fe8f77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:52.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.513+0000 7fea44725800 20 remove_watcher() i=0 2024-09-22T08:39:52.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.513+0000 7fea44725800 2 removed watcher, disabling cache 2024-09-22T08:39:52.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.514+0000 7fea44725800 20 remove_watcher() i=1 2024-09-22T08:39:52.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.515+0000 7fea44725800 20 remove_watcher() i=2 2024-09-22T08:39:52.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.516+0000 7fea44725800 20 remove_watcher() i=3 2024-09-22T08:39:52.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.517+0000 7fea44725800 20 remove_watcher() i=4 2024-09-22T08:39:52.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.518+0000 7fea44725800 20 remove_watcher() i=5 2024-09-22T08:39:52.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.519+0000 7fea44725800 20 remove_watcher() i=6 2024-09-22T08:39:52.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:52.520+0000 7fea44725800 20 remove_watcher() i=7 2024-09-22T08:39:52.532 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:52.532 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:52.532 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:39:52.532 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:52.906 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at block_writes 2024-09-22T08:39:52.906 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:53.738 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:39:53.766 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:53.766 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:53.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.801+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 realm 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.803+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.804+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.804+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.805+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:53.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.805+0000 7f24ff132800 20 searching for the correct realm 2024-09-22T08:39:53.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.806+0000 7f24faeb0640 0 -- 172.21.15.78:0/2190952764 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5633514993f0 msgr2=0x56335149b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:53.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.810+0000 7f24fa6af640 0 -- 172.21.15.78:0/2190952764 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x56335149d4d0 msgr2=0x56335149f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:53.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:53.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:53.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.815+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:53.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 zone default found 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 4 Realm: () 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 zonegroup default 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 started sync module instance, tier type = 2024-09-22T08:39:53.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.816+0000 7f24ff132800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:53.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=0 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=1 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=2 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=3 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=4 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=5 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.824+0000 7f24ff132800 20 add_watcher() i=6 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.825+0000 7f24ff132800 20 add_watcher() i=7 2024-09-22T08:39:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.825+0000 7f24ff132800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:53.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.827+0000 7f23b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.827+0000 7f24ff132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.827+0000 7f24ff132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.827+0000 7f24ff132800 5 note: GC not initialized 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.828+0000 7f232bfff640 20 reqs_thread_entry: start 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.828+0000 7f24ff132800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.828+0000 7f24ff132800 20 Filter name: none 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.828+0000 7f2329ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:53.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.828+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.829+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:53.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.829+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.829+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.829+0000 7f24ff132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.829+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.830+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.830+0000 7f24ff132800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.830+0000 7f24ff132800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:53.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.830+0000 7f24ff132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:53.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.832+0000 7f23b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:53.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.833+0000 7f24ff132800 20 remove_watcher() i=0 2024-09-22T08:39:53.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.833+0000 7f24ff132800 2 removed watcher, disabling cache 2024-09-22T08:39:53.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.834+0000 7f24ff132800 20 remove_watcher() i=1 2024-09-22T08:39:53.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.835+0000 7f24ff132800 20 remove_watcher() i=2 2024-09-22T08:39:53.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.836+0000 7f24ff132800 20 remove_watcher() i=3 2024-09-22T08:39:53.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.837+0000 7f24ff132800 20 remove_watcher() i=4 2024-09-22T08:39:53.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.838+0000 7f24ff132800 20 remove_watcher() i=5 2024-09-22T08:39:53.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.839+0000 7f24ff132800 20 remove_watcher() i=6 2024-09-22T08:39:53.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.840+0000 7f24ff132800 20 remove_watcher() i=7 2024-09-22T08:39:53.851 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:53.851 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:53.852 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:53.852 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:53.853 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-22T08:39:53.886 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:53.886 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:53.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.922+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 realm 2024-09-22T08:39:53.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:53.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:53.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.926+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:53.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.926+0000 7fcaa3326800 20 searching for the correct realm 2024-09-22T08:39:53.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:53.927+0000 7fca967d8640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fca900b71b0 msgr2=0x7fca900b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:54.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.133+0000 7fca9f7da640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55e481f24f60 msgr2=0x55e481f27370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zone default found 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Realm: () 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zonegroup default 2024-09-22T08:39:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started sync module instance, tier type = 2024-09-22T08:39:54.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:54.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=0 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=1 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=2 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=3 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=4 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=5 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=6 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.150+0000 7fcaa3326800 20 add_watcher() i=7 2024-09-22T08:39:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.150+0000 7fcaa3326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:54.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fc9557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fcaa3326800 5 note: GC not initialized 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fc8cffff640 20 reqs_thread_entry: start 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fcaa3326800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.153+0000 7fcaa3326800 20 Filter name: none 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fc8cdffb640 20 reqs_thread_entry: start 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:39:54.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:39:54.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:39:54.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : miss 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.154+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.0 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.3 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.4 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.5 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.6 2024-09-22T08:39:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.169+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.7 2024-09-22T08:39:54.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.8 2024-09-22T08:39:54.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.9 2024-09-22T08:39:54.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.171+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.10 2024-09-22T08:39:54.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.174+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:54.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.174+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562485 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.178 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcaa3326800 time 2024-09-22T08:39:54.178283+0000 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcaa498c748] 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.179 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.178+0000 7fcaa3326800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcaa3326800 time 2024-09-22T08:39:54.178283+0000 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcaa498c748] 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.180 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:39:54.181 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fcaa3326800 thread_name:radosgw-admin 2024-09-22T08:39:54.200 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcaa363e6f0] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcaa368b99c] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcaa498c7a2] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:54.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.179+0000 7fcaa3326800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fcaa3326800 thread_name:radosgw-admin 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcaa363e6f0] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcaa368b99c] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcaa498c7a2] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.202 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.695896s 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481d7f1b0 auth_method 0 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.203 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481e63120 auth_method 0 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481ce57c0 auth_method 0 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.204 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 7239 payload 824 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:39:53.907+0000 7fca967d8640 1 monclient: found mon.noname-a 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: dump: 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.205 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: dump: 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.206 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:39:53.907+0000 7fcaa3326800 5 monclient: authenticate success, global_id 7239 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.207 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:39:53.907+0000 7fc98ce09640 4 set_mon_vals no callback set 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:39:53.907+0000 7fcaa3326800 1 librados: init done 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.208 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:39:53.909+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fc984077570 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:39:53.910+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481e61c80 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:39:53.910+0000 7fca9efd9640 10 monclient: get_auth_request con 0x55e481e84e00 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:39:53.911+0000 7fca967d8640 10 monclient: get_auth_request con 0x55e481e89230 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:39:53.912+0000 7fc98b606640 1 client.7239.objecter ms_handle_reset 0x55e481e84e00 session 0x55e481e62060 osd.1 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:39:53.912+0000 7fc98b606640 10 monclient: _renew_subs 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:39:53.912+0000 7fc98b606640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:39:53.912+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fc9840878f0 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:39:53.913+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481e88660 auth_method 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:39:53.913+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:39:53.913+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:39:53.913+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.209 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.210 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:39:53.913+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e481e92310 EEXIST 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.211 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:39:53.914+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:39:53.914+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x55e481e854b0 EEXIST 2024-09-22T08:39:54.212 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481eb6630 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481eb6a10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481eb5340 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.703660s 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481eb6630 auth_method 0 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.213 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481eb5340 auth_method 0 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481eb6a10 auth_method 0 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.214 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 6743 payload 824 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:39:53.915+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:39:53.915+0000 7fca967d8640 1 monclient: found mon.noname-c 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:39:53.915+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:54.215 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: dump: 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.216 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: dump: 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.217 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:39:53.915+0000 7fcaa3326800 5 monclient: authenticate success, global_id 6743 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:39:53.915+0000 7fca9ffdb640 4 set_mon_vals no callback set 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:39:53.917+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fc978077480 auth_method 0 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: get_monmap_and_config 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.218 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:39:53.917+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.219 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.220 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:39:53.917+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.221 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:39:53.918+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:39:53.918+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:39:53.918+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe796b3a08 EEXIST 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481f0ab20 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481edbb30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481f06000 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.222 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.707354s 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481f0ab20 auth_method 0 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481f06000 auth_method 0 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.223 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481edbb30 auth_method 0 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 6746 payload 274 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:39:53.918+0000 7fca967d8640 1 monclient: found mon.noname-c 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: dump: 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.224 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: dump: 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:39:53.918+0000 7fcaa3326800 5 monclient: authenticate success, global_id 6746 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:39:53.918+0000 7fcaa3326800 4 set_mon_vals no callback set 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: shutdown 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.226 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.227 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:39:53.919+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.228 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 librados: starting msgr at 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 librados: starting objecter 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e481edc260 EEXIST 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:39:53.920+0000 7fcaa3326800 1 librados: setting wanted keys 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:39:53.920+0000 7fcaa3326800 1 librados: calling monclient init 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.229 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:39:53.920+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:39:53.920+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x55e481ecb038 EEXIST 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481edbb30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.230 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481f06000 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481f0ab20 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.709592s 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481f06000 auth_method 0 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481f0ab20 auth_method 0 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.231 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481edbb30 auth_method 0 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_done global_id 7248 payload 824 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:39:53.920+0000 7fca9efd9640 1 monclient: found mon.noname-a 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.232 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: dump: 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.233 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: dump: 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.234 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:39:53.921+0000 7fcaa3326800 5 monclient: authenticate success, global_id 7248 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:39:53.921+0000 7fc9827fc640 4 set_mon_vals no callback set 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:39:53.921+0000 7fcaa3326800 1 librados: init done 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:39:53.921+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cr dump hook 0x7fca88060da8 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:39:53.922+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.235 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:39:53.923+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fc968077570 auth_method 0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:39:53.923+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481f24f60 auth_method 0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 realm 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:39:53.924+0000 7fcaa3326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:39:53.925+0000 7fca967d8640 10 monclient: get_auth_request con 0x55e481f29170 auth_method 0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:39:53.925+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481f2c9d0 auth_method 0 2024-09-22T08:39:54.236 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:39:53.926+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:39:53.926+0000 7fcaa3326800 20 searching for the correct realm 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:39:53.926+0000 7fca9efd9640 10 monclient: get_auth_request con 0x55e481f31480 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:39:53.927+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca900b71b0 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:39:53.927+0000 7fca967d8640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fca900b71b0 msgr2=0x7fca900b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:39:54.129+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca900b71b0 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:39:54.130+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fca8801f060 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:39:54.131+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fca900e4730 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:39:54.133+0000 7fca9f7da640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55e481f24f60 msgr2=0x55e481f27370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:39:54.133+0000 7fc980ff9640 1 client.7248.objecter ms_handle_reset 0x55e481f24f60 session 0x55e481f248e0 osd.6 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:39:54.133+0000 7fc980ff9640 10 monclient: _renew_subs 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:39:54.133+0000 7fc980ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:39:54.133+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fc968087810 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:39:54.134+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca98040040 auth_method 0 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:54.237 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zone default found 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Realm: () 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:54.238 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:39:54.139+0000 7fcaa3326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zonegroup default 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started sync module instance, tier type = 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=0 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=1 2024-09-22T08:39:54.239 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=2 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=3 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=4 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=5 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=6 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:39:54.150+0000 7fcaa3326800 20 add_watcher() i=7 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:39:54.150+0000 7fcaa3326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.240 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:39:54.153+0000 7fc9557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:39:54.153+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache list hook 0x55e481efc250 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache inspect hook 0x55e481efc250 2024-09-22T08:39:54.241 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache erase hook 0x55e481efc250 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache zap hook 0x55e481efc250 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 note: GC not initialized 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:39:54.153+0000 7fc8cffff640 20 reqs_thread_entry: start 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace show hook 0x7fca9004e600 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace history hook 0x7fca9004e600 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace active hook 0x7fca9004e600 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace active_short hook 0x7fca9004e600 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 Filter name: none 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:39:54.154+0000 7fc8cdffb640 20 reqs_thread_entry: start 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:39:54.242 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : miss 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.243 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.244 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.0 2024-09-22T08:39:54.245 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.3 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.4 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.5 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.6 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:39:54.169+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.7 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.8 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.9 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:39:54.171+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.10 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:39:54.174+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:39:54.174+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.246 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562485 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:39:54.178+0000 7fcaa3326800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcaa3326800 time 2024-09-22T08:39:54.178283+0000 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcaa498c748] 2024-09-22T08:39:54.247 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:39:54.179+0000 7fcaa3326800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fcaa3326800 thread_name:radosgw-admin 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcaa363e6f0] 2024-09-22T08:39:54.248 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcaa368b99c] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcaa498c7a2] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:39:54.249 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:39:54.250 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:39:54.251 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:54.252 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:39:54.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:39:54.254 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:54.255 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc8cdffb640 / http_manager 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc8cffff640 / http_manager 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc9557e2640 / rgw_dt_lg_renew 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc980ff9640 / ms_dispatch 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc981ffb640 / io_context_pool 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc9827fc640 / io_context_pool 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc988e01640 / ms_dispatch 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc98b606640 / ms_dispatch 2024-09-22T08:39:54.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc98ce09640 / io_context_pool 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca967d8640 / msgr-worker-2 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9efd9640 / msgr-worker-1 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9f7da640 / msgr-worker-0 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9ffdb640 / io_context_pool 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: 7fcaa3326800 / radosgw-admin 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.115733.log 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:39:53.906+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.695896s 2024-09-22T08:39:54.257 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481d7f1b0 auth_method 0 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481e63120 auth_method 0 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481ce57c0 auth_method 0 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.258 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:39:53.907+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:39:53.907+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 7239 payload 824 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:39:53.907+0000 7fca967d8640 1 monclient: found mon.noname-a 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:39:53.907+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:54.259 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: dump: 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.260 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:39:53.907+0000 7fc98b606640 10 monclient: dump: 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:39:53.907+0000 7fcaa3326800 5 monclient: authenticate success, global_id 7239 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.261 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:39:53.907+0000 7fc98ce09640 4 set_mon_vals no callback set 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:39:53.907+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:39:53.907+0000 7fcaa3326800 1 librados: init done 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:39:53.909+0000 7fc98b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:39:53.909+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fc984077570 auth_method 0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:39:53.910+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481e61c80 auth_method 0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:39:53.910+0000 7fca9efd9640 10 monclient: get_auth_request con 0x55e481e84e00 auth_method 0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:39:53.911+0000 7fca967d8640 10 monclient: get_auth_request con 0x55e481e89230 auth_method 0 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:39:53.912+0000 7fc98b606640 1 client.7239.objecter ms_handle_reset 0x55e481e84e00 session 0x55e481e62060 osd.1 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:39:53.912+0000 7fc98b606640 10 monclient: _renew_subs 2024-09-22T08:39:54.262 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:39:53.912+0000 7fc98b606640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:39:53.912+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fc9840878f0 auth_method 0 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:39:53.913+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481e88660 auth_method 0 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:39:53.913+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:39:53.913+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:39:53.913+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.263 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding auth protocol: cephx 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.264 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: crc 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:39:53.913+0000 7fcaa3326800 5 AuthRegistry(0x55e481e8ee60) adding con mode: secure 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:39:53.913+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e481e92310 EEXIST 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding auth protocol: cephx 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.265 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: crc 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 AuthRegistry(0x55e481e85368) adding con mode: secure 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:39:53.914+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:39:53.914+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:39:53.914+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x55e481e854b0 EEXIST 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481eb6630 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481eb6a10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481eb5340 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.266 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:39:53.914+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.703660s 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481eb6630 auth_method 0 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481eb5340 auth_method 0 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.267 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481eb6a10 auth_method 0 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:39:53.914+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:39:53.914+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:39:53.914+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 6743 payload 824 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:39:53.915+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.268 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:39:53.915+0000 7fca967d8640 1 monclient: found mon.noname-c 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:39:53.915+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: dump: 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.269 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:39:53.915+0000 7fc988e01640 10 monclient: dump: 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.270 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:39:53.915+0000 7fcaa3326800 5 monclient: authenticate success, global_id 6743 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:39:53.915+0000 7fca9ffdb640 4 set_mon_vals no callback set 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:39:53.915+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.271 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:39:53.917+0000 7fc988e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:39:53.917+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fc978077480 auth_method 0 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: get_monmap_and_config 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:39:53.917+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.272 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding auth protocol: cephx 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.273 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: crc 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x55e481ed64c0) adding con mode: secure 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:39:53.917+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:39:53.917+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding auth protocol: cephx 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.274 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: crc 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:39:53.917+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b38c0) adding con mode: secure 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:39:53.918+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:39:53.918+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:39:53.918+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe796b3a08 EEXIST 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481f0ab20 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.275 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481edbb30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481f06000 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.707354s 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481f0ab20 auth_method 0 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481f06000 auth_method 0 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.276 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481edbb30 auth_method 0 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:39:53.918+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:39:53.918+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient(hunting): handle_auth_done global_id 6746 payload 274 2024-09-22T08:39:54.277 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:39:53.918+0000 7fca967d8640 1 monclient: found mon.noname-c 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:39:53.918+0000 7fca967d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: dump: 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.279 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:39:53.918+0000 7fc9827fc640 10 monclient: dump: 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.280 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:39:53.918+0000 7fcaa3326800 5 monclient: authenticate success, global_id 6746 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:39:53.918+0000 7fcaa3326800 10 monclient: get_monmap_and_config success 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:39:53.918+0000 7fcaa3326800 4 set_mon_vals no callback set 2024-09-22T08:39:54.281 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: shutdown 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: build_initial_monmap 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 build_initial for_mkfs: 0 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:39:53.919+0000 7fcaa3326800 10 monclient: monmap: 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:39:54.282 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding auth protocol: cephx 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: crc 2024-09-22T08:39:54.283 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 AuthRegistry(0x55e481f06be0) adding con mode: secure 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:39:53.919+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 librados: starting msgr at 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:39:53.919+0000 7fcaa3326800 1 librados: starting objecter 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:39:53.919+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command objecter_requests cmddesc objecter_requests hook 0x55e481edc260 EEXIST 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:39:53.920+0000 7fcaa3326800 1 librados: setting wanted keys 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:39:53.920+0000 7fcaa3326800 1 librados: calling monclient init 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: init 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding auth protocol: cephx 2024-09-22T08:39:54.284 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: crc 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 AuthRegistry(0x55e481ecaef0) adding con mode: secure 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:39:53.920+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:39:53.920+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.285 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:39:53.920+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command rotate-key cmddesc rotate-key hook 0x55e481ecb038 EEXIST 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: _reopen_session rank -1 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-b con 0x55e481edbb30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-c con 0x55e481f06000 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): picked mon.noname-a con 0x55e481f0ab20 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): start opening mon connection 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): _renew_subs 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:39:53.920+0000 7fcaa3326800 10 monclient(hunting): authenticate will time out at 2109.709592s 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): get_auth_request con 0x55e481f06000 auth_method 0 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.286 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): get_auth_request con 0x55e481f0ab20 auth_method 0 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:39:53.920+0000 7fca9f7da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): get_auth_request con 0x55e481edbb30 auth_method 0 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:39:53.920+0000 7fca967d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient(hunting): handle_auth_done global_id 7248 payload 824 2024-09-22T08:39:54.287 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient: _finish_hunting 0 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:39:53.920+0000 7fca9efd9640 1 monclient: found mon.noname-a 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:39:53.920+0000 7fca9efd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: dump: 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.288 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: _finish_auth 0 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:39:53.921+0000 7fc980ff9640 10 monclient: dump: 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:39:54.289 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:39:53.921+0000 7fcaa3326800 5 monclient: authenticate success, global_id 7248 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:39:53.921+0000 7fc9827fc640 4 set_mon_vals no callback set 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _renew_subs 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:39:53.921+0000 7fcaa3326800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:39:53.921+0000 7fcaa3326800 1 librados: init done 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:39:53.921+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cr dump hook 0x7fca88060da8 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:39:53.922+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:39:54.290 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:39:53.923+0000 7fc980ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:39:53.923+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fc968077570 auth_method 0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:39:53.923+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481f24f60 auth_method 0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 realm 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:39:53.924+0000 7fcaa3326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:39:53.924+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:39:53.925+0000 7fca967d8640 10 monclient: get_auth_request con 0x55e481f29170 auth_method 0 2024-09-22T08:39:54.291 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:39:53.925+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:39:53.925+0000 7fca9f7da640 10 monclient: get_auth_request con 0x55e481f2c9d0 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:39:53.926+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:39:53.926+0000 7fcaa3326800 20 searching for the correct realm 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:39:53.926+0000 7fca9efd9640 10 monclient: get_auth_request con 0x55e481f31480 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:39:53.927+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca900b71b0 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:39:53.927+0000 7fca967d8640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fca900b71b0 msgr2=0x7fca900b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:39:54.129+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca900b71b0 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:39:54.130+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fca8801f060 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:39:54.131+0000 7fca9efd9640 10 monclient: get_auth_request con 0x7fca900e4730 auth_method 0 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:39:54.133+0000 7fca9f7da640 0 -- 172.21.15.78:0/810278440 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55e481f24f60 msgr2=0x55e481f27370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:39:54.133+0000 7fc980ff9640 1 client.7248.objecter ms_handle_reset 0x55e481f24f60 session 0x55e481f248e0 osd.6 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:39:54.133+0000 7fc980ff9640 10 monclient: _renew_subs 2024-09-22T08:39:54.292 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:39:54.133+0000 7fc980ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:39:54.133+0000 7fca9f7da640 10 monclient: get_auth_request con 0x7fc968087810 auth_method 0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:39:54.134+0000 7fca967d8640 10 monclient: get_auth_request con 0x7fca98040040 auth_method 0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.293 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zone default found 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Realm: () 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:39:54.139+0000 7fcaa3326800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:39:54.139+0000 7fcaa3326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 zonegroup default 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:39:54.139+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.294 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started sync module instance, tier type = 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:39:54.140+0000 7fcaa3326800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=0 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=1 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=2 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=3 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=4 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=5 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:39:54.149+0000 7fcaa3326800 20 add_watcher() i=6 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:39:54.150+0000 7fcaa3326800 20 add_watcher() i=7 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:39:54.150+0000 7fcaa3326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.295 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding auth protocol: cephx 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:39:54.153+0000 7fc9557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: crc 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 AuthRegistry(0x7ffe796b3d90) adding con mode: secure 2024-09-22T08:39:54.296 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:39:54.153+0000 7fcaa3326800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache list hook 0x55e481efc250 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache inspect hook 0x55e481efc250 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache erase hook 0x55e481efc250 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command cache zap hook 0x55e481efc250 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 note: GC not initialized 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:39:54.153+0000 7fc8cffff640 20 reqs_thread_entry: start 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace show hook 0x7fca9004e600 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace history hook 0x7fca9004e600 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace active hook 0x7fca9004e600 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:39:54.153+0000 7fcaa3326800 5 asok(0x55e481c170f0) register_command sync trace active_short hook 0x7fca9004e600 2024-09-22T08:39:54.297 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:39:54.153+0000 7fcaa3326800 20 Filter name: none 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:39:54.154+0000 7fc8cdffb640 20 reqs_thread_entry: start 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : miss 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:39:54.154+0000 7fcaa3326800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:39:54.298 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:39:54.154+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:39:54.159+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.299 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:39:54.159+0000 7fc9827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:39:54.161+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.0 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.1 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.2 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.3 2024-09-22T08:39:54.300 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.4 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.5 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.6 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.7 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.8 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.9 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.301 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.10 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:39:54.166+0000 7fcaa3326800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1.11 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.0 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:39:54.166+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:39:54.167+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.3 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.4 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.5 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:39:54.168+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.6 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:39:54.169+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.7 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.8 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:39:54.170+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.9 2024-09-22T08:39:54.302 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:39:54.171+0000 7fcaa3326800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.10 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:39:54.174+0000 7fcaa3326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:39:54.174+0000 7fcaa3326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:39:54.175+0000 7fcaa3326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562485 cookie 94439921108576 notifier 7248 bl.length()=999 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:39:54.175+0000 7fc981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:39:54.303 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:39:54.177+0000 7fcaa3326800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:39:54.178+0000 7fcaa3326800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcaa3326800 time 2024-09-22T08:39:54.178283+0000 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcaa498c748] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:39:54.179+0000 7fcaa3326800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:39:54.304 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fcaa3326800 thread_name:radosgw-admin 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcaa363e6f0] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcaa368b99c] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcaa498c7a2] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fcaa498c906] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e480558e01] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55e480567f02] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e480568d64] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcaa3629590] 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:39:54.305 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:39:54.306 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:39:54.307 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:39:54.308 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:39:54.309 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:39:54.310 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:39:54.311 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc8cdffb640 / http_manager 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc8cffff640 / http_manager 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc9557e2640 / rgw_dt_lg_renew 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc980ff9640 / ms_dispatch 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc981ffb640 / io_context_pool 2024-09-22T08:39:54.312 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc9827fc640 / io_context_pool 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc988e01640 / ms_dispatch 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc98b606640 / ms_dispatch 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc98ce09640 / io_context_pool 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca967d8640 / msgr-worker-2 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9efd9640 / msgr-worker-1 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9f7da640 / msgr-worker-0 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fca9ffdb640 / io_context_pool 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: 7fcaa3326800 / radosgw-admin 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:39:54.179909Z_aaf0d373-bcff-495f-a4fa-92c3d5d9317f/log 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:39:54.313 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:39:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:54.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.253+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 20 realm 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.255+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.256+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.256+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.256+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.256+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.257+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.258+0000 7f7cbab28800 20 searching for the correct realm 2024-09-22T08:39:54.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.260+0000 7f7cb7070640 0 -- 172.21.15.78:0/1240954402 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f7ca0018020 msgr2=0x7f7ca0048500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.263+0000 7f7cae06e640 0 -- 172.21.15.78:0/1240954402 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7cb0017040 msgr2=0x7f7cb0030910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.267+0000 7f7cbab28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 zone default found 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 4 Realm: () 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 zonegroup default 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.268+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 started sync module instance, tier type = 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.269+0000 7f7cbab28800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=0 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=1 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=2 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=3 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=4 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=5 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.277+0000 7f7cbab28800 20 add_watcher() i=6 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.278+0000 7f7cbab28800 20 add_watcher() i=7 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.278+0000 7f7cbab28800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.280+0000 7f7b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.280+0000 7f7cbab28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.280+0000 7f7cbab28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.280+0000 7f7cbab28800 5 note: GC not initialized 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7ae7fff640 20 reqs_thread_entry: start 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7cbab28800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7cbab28800 20 Filter name: none 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7ae5ffb640 20 reqs_thread_entry: start 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.281+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.282+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=467 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.282+0000 7f7cbab28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.282+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.282+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.282+0000 7f7cbab28800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.283+0000 7f7cbab28800 20 rados_obj.operate() r=0 bl.length=467 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.283+0000 7f7cbab28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.284+0000 7f7b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.286+0000 7f7cbab28800 20 remove_watcher() i=0 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.286+0000 7f7cbab28800 2 removed watcher, disabling cache 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.287+0000 7f7cbab28800 20 remove_watcher() i=1 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.288+0000 7f7cbab28800 20 remove_watcher() i=2 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.289+0000 7f7cbab28800 20 remove_watcher() i=3 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.290+0000 7f7cbab28800 20 remove_watcher() i=4 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.291+0000 7f7cbab28800 20 remove_watcher() i=5 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.292+0000 7f7cbab28800 20 remove_watcher() i=6 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.293+0000 7f7cbab28800 20 remove_watcher() i=7 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.325 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:39:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:39:54.326 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:39:54.394 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:39:54.426 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:39:54.426 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:39:54.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.462+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.463+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.463+0000 7f4ea3e2f800 20 realm 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.464+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.465+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.465+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.465+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:39:54.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.465+0000 7f4ea3e2f800 20 searching for the correct realm 2024-09-22T08:39:54.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.468+0000 7f4ea2121640 0 -- 172.21.15.78:0/445201457 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f4e8c024020 msgr2=0x7f4e8c07b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.673+0000 7f4e9911f640 0 -- 172.21.15.78:0/445201457 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f4e9c061040 msgr2=0x7f4e9c08e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:39:54.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:39:54.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.678+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 zone default found 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 4 Realm: () 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:39:54.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 zonegroup default 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.679+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.680+0000 7f4ea3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.680+0000 7f4ea3e2f800 20 started sync module instance, tier type = 2024-09-22T08:39:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.680+0000 7f4ea3e2f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:39:54.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=0 2024-09-22T08:39:54.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=1 2024-09-22T08:39:54.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=2 2024-09-22T08:39:54.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=3 2024-09-22T08:39:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=4 2024-09-22T08:39:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=5 2024-09-22T08:39:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.688+0000 7f4ea3e2f800 20 add_watcher() i=6 2024-09-22T08:39:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.689+0000 7f4ea3e2f800 20 add_watcher() i=7 2024-09-22T08:39:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.689+0000 7f4ea3e2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:39:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4d57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4ea3e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4ea3e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4ea3e2f800 5 note: GC not initialized 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4d56fe5640 20 reqs_thread_entry: start 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.691+0000 7f4ea3e2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 20 Filter name: none 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4d54fe1640 20 reqs_thread_entry: start 2024-09-22T08:39:54.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:39:54.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : miss 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.692+0000 7f4ea3e2f800 20 rados->read ofs=0 len=0 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:39:54.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.693+0000 7f4ea3e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:39:54.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.694+0000 7f4ea3e2f800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to be held by another RGW process; skipping for now 2024-09-22T08:39:54.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.695+0000 7f4d57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:39:54.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.697+0000 7f4ea3e2f800 20 remove_watcher() i=0 2024-09-22T08:39:54.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.697+0000 7f4ea3e2f800 2 removed watcher, disabling cache 2024-09-22T08:39:54.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.698+0000 7f4ea3e2f800 20 remove_watcher() i=1 2024-09-22T08:39:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.699+0000 7f4ea3e2f800 20 remove_watcher() i=2 2024-09-22T08:39:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.699+0000 7f4ea3e2f800 20 remove_watcher() i=3 2024-09-22T08:39:54.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.700+0000 7f4ea3e2f800 20 remove_watcher() i=4 2024-09-22T08:39:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.701+0000 7f4ea3e2f800 20 remove_watcher() i=5 2024-09-22T08:39:54.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.702+0000 7f4ea3e2f800 20 remove_watcher() i=6 2024-09-22T08:39:54.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:39:54.703+0000 7f4ea3e2f800 20 remove_watcher() i=7 2024-09-22T08:39:54.714 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:40:24.746 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:40:24.781 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:24.781 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:24.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.822+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.823+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.823+0000 7f67b42bb800 20 realm 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.823+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.824+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.824+0000 7f67b42bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.824+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.824+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:24.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.824+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:24.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.825+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:24.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.825+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:24.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.826+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:24.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.826+0000 7f67b42bb800 20 searching for the correct realm 2024-09-22T08:40:24.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:24.828+0000 7f67b25a6640 0 -- 172.21.15.78:0/4144891226 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f67a8045940 msgr2=0x7f67a80513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:25.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.033+0000 7f67b15a4640 0 -- 172.21.15.78:0/4144891226 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f67ac061040 msgr2=0x7f67ac0a9eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:25.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:25.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:25.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:25.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.040+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 zone default found 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 4 Realm: () 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 zonegroup default 2024-09-22T08:40:25.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.041+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 started sync module instance, tier type = 2024-09-22T08:40:25.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.042+0000 7f67b42bb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:25.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=0 2024-09-22T08:40:25.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=1 2024-09-22T08:40:25.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=2 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=3 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=4 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=5 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.052+0000 7f67b42bb800 20 add_watcher() i=6 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.053+0000 7f67b42bb800 20 add_watcher() i=7 2024-09-22T08:40:25.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.053+0000 7f67b42bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:25.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.055+0000 7f6663fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:25.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 5 note: GC not initialized 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f6662ffd640 20 reqs_thread_entry: start 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 20 Filter name: none 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f6660ff9640 20 reqs_thread_entry: start 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T08:40:25.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.056+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.057+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.057+0000 7f67b42bb800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.057+0000 7f67b42bb800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.057+0000 7f67b42bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : miss 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.057+0000 7f67b42bb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 20 rados_obj.operate() r=0 bl.length=467 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.058+0000 7f67b42bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:40:25.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.059+0000 7f67b42bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f67b42bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f67b42bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f67b42bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f67b42bb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f66957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562486 cookie 94282423180112 notifier 7308 bl.length()=999 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f66957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f66957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.066+0000 7f66957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.068+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:40:25.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.068+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:40:25.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.068+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:40:25.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.068+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:40:25.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.0 2024-09-22T08:40:25.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.0 2024-09-22T08:40:25.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.1 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.1 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.2 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.2 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.3 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.3 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.4 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.4 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.5 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.5 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.6 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.6 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.7 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.7 2024-09-22T08:40:25.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.8 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.8 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.9 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.9 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.10 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.10 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.11 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2.11 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.0 2024-09-22T08:40:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.074+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1 2024-09-22T08:40:25.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.075+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2 2024-09-22T08:40:25.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.075+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.3 2024-09-22T08:40:25.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.076+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.4 2024-09-22T08:40:25.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.076+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.5 2024-09-22T08:40:25.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.077+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.6 2024-09-22T08:40:25.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.077+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.7 2024-09-22T08:40:25.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.078+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.8 2024-09-22T08:40:25.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.078+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.9 2024-09-22T08:40:25.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.079+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.10 2024-09-22T08:40:25.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.082+0000 7f67b42bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:25.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.082+0000 7f67b42bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.083+0000 7f67b42bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.083+0000 7f67b42bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.083+0000 7f67b42bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.083+0000 7f67b42bb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.084+0000 7f66957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562487 cookie 94282423180112 notifier 7308 bl.length()=999 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.084+0000 7f66957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.084+0000 7f66957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.084+0000 7f66957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.085+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:40:25.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.085+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:40:25.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.085+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:40:25.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.085+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:40:25.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.088+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.0 2024-09-22T08:40:25.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.088+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.1 2024-09-22T08:40:25.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.089+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.2 2024-09-22T08:40:25.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.089+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.3 2024-09-22T08:40:25.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.089+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.4 2024-09-22T08:40:25.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.090+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.5 2024-09-22T08:40:25.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.090+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.6 2024-09-22T08:40:25.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.090+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.7 2024-09-22T08:40:25.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.091+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.8 2024-09-22T08:40:25.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.091+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.9 2024-09-22T08:40:25.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.091+0000 7f67b42bb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30.10 2024-09-22T08:40:25.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.092+0000 7f67b42bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:25.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.092+0000 7f67b42bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.093+0000 7f67b42bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.093+0000 7f67b42bb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.093+0000 7f67b42bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.093+0000 7f67b42bb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30, ofs0, ns] 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.094+0000 7f66957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562488 cookie 94282423180112 notifier 7308 bl.length()=967 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.094+0000 7f66957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 info.flags=0x17 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.094+0000 7f66957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 to cache LRU end 2024-09-22T08:40:25.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.094+0000 7f66957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:25.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.095+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_sources= new_sources= 2024-09-22T08:40:25.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.095+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential sources added=[] removed=[] 2024-09-22T08:40:25.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.095+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): orig_dests= new_dests= 2024-09-22T08:40:25.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.095+0000 7f67b42bb800 20 handle_bi_update(): bucket=:abort-at-block-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30]): potential dests added=[] removed=[] 2024-09-22T08:40:25.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.099+0000 7f67b42bb800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:40:25.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.100+0000 7f6663fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:25.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.103+0000 7f67b42bb800 20 remove_watcher() i=0 2024-09-22T08:40:25.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.103+0000 7f67b42bb800 2 removed watcher, disabling cache 2024-09-22T08:40:25.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.104+0000 7f67b42bb800 20 remove_watcher() i=1 2024-09-22T08:40:25.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.105+0000 7f67b42bb800 20 remove_watcher() i=2 2024-09-22T08:40:25.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.106+0000 7f67b42bb800 20 remove_watcher() i=3 2024-09-22T08:40:25.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.107+0000 7f67b42bb800 20 remove_watcher() i=4 2024-09-22T08:40:25.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.108+0000 7f67b42bb800 20 remove_watcher() i=5 2024-09-22T08:40:25.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.109+0000 7f67b42bb800 20 remove_watcher() i=6 2024-09-22T08:40:25.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.110+0000 7f67b42bb800 20 remove_watcher() i=7 2024-09-22T08:40:25.124 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T08:40:25.152 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:25.153 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:25.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.188+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 realm 2024-09-22T08:40:25.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:25.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.191+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.192+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:25.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.192+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.193+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:25.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.193+0000 7fc5daabb800 20 searching for the correct realm 2024-09-22T08:40:25.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.193+0000 7fc5cfda4640 0 -- 172.21.15.78:0/456404049 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fc5c802f040 msgr2=0x7fc5c8030530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:25.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.398+0000 7fc5d85a5640 0 -- 172.21.15.78:0/456404049 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x56074469e2a0 msgr2=0x5607446a0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.404+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 zone default found 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 4 Realm: () 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 zonegroup default 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.405+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:25.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 started sync module instance, tier type = 2024-09-22T08:40:25.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.406+0000 7fc5daabb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=0 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=1 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=2 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=3 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=4 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=5 2024-09-22T08:40:25.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.416+0000 7fc5daabb800 20 add_watcher() i=6 2024-09-22T08:40:25.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.418+0000 7fc5daabb800 20 add_watcher() i=7 2024-09-22T08:40:25.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.418+0000 7fc5daabb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:25.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc48efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:25.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 5 note: GC not initialized 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc48dfdb640 20 reqs_thread_entry: start 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 20 Filter name: none 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc3ff7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:25.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.420+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.422+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:40:25.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.422+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.422+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:40:25.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.422+0000 7fc5daabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:25.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.422+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.423+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-22T08:40:25.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.423+0000 7fc5daabb800 20 rados->read ofs=0 len=0 2024-09-22T08:40:25.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.423+0000 7fc5daabb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-22T08:40:25.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.423+0000 7fc5daabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:25.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.425+0000 7fc48efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.427+0000 7fc5daabb800 20 remove_watcher() i=0 2024-09-22T08:40:25.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.427+0000 7fc5daabb800 2 removed watcher, disabling cache 2024-09-22T08:40:25.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.428+0000 7fc5daabb800 20 remove_watcher() i=1 2024-09-22T08:40:25.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.429+0000 7fc5daabb800 20 remove_watcher() i=2 2024-09-22T08:40:25.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.430+0000 7fc5daabb800 20 remove_watcher() i=3 2024-09-22T08:40:25.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.431+0000 7fc5daabb800 20 remove_watcher() i=4 2024-09-22T08:40:25.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.432+0000 7fc5daabb800 20 remove_watcher() i=5 2024-09-22T08:40:25.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.434+0000 7fc5daabb800 20 remove_watcher() i=6 2024-09-22T08:40:25.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:25.435+0000 7fc5daabb800 20 remove_watcher() i=7 2024-09-22T08:40:25.446 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:25.446 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:25.446 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:40:25.446 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:25.813 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-22T08:40:25.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:26.639 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:40:26.667 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:26.667 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:26.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.702+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 realm 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.704+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.705+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:26.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.705+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.706+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:26.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.706+0000 7f8a14f2e800 20 searching for the correct realm 2024-09-22T08:40:26.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.708+0000 7f8a114de640 0 -- 172.21.15.78:0/3869706223 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f89f809bb90 msgr2=0x7f89f8070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:26.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.912+0000 7f8a084dc640 0 -- 172.21.15.78:0/3869706223 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f8a0c096b10 msgr2=0x7f8a0c08e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.917+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 zone default found 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 4 Realm: () 2024-09-22T08:40:26.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 zonegroup default 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.918+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.919+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.919+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.919+0000 7f8a14f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.919+0000 7f8a14f2e800 20 started sync module instance, tier type = 2024-09-22T08:40:26.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.919+0000 7f8a14f2e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=0 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=1 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=2 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=3 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=4 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=5 2024-09-22T08:40:26.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.928+0000 7f8a14f2e800 20 add_watcher() i=6 2024-09-22T08:40:26.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.929+0000 7f8a14f2e800 20 add_watcher() i=7 2024-09-22T08:40:26.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.929+0000 7f8a14f2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:26.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.930+0000 7f88c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:26.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:26.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 5 note: GC not initialized 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f88c5fe3640 20 reqs_thread_entry: start 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 20 Filter name: none 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f88377fe640 20 reqs_thread_entry: start 2024-09-22T08:40:26.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.931+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.932+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.933+0000 7f8a14f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.933+0000 7f8a14f2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:26.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.933+0000 7f8a14f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:26.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.934+0000 7f88c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.936+0000 7f8a14f2e800 20 remove_watcher() i=0 2024-09-22T08:40:26.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.936+0000 7f8a14f2e800 2 removed watcher, disabling cache 2024-09-22T08:40:26.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.938+0000 7f8a14f2e800 20 remove_watcher() i=1 2024-09-22T08:40:26.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.939+0000 7f8a14f2e800 20 remove_watcher() i=2 2024-09-22T08:40:26.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.940+0000 7f8a14f2e800 20 remove_watcher() i=3 2024-09-22T08:40:26.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.940+0000 7f8a14f2e800 20 remove_watcher() i=4 2024-09-22T08:40:26.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.942+0000 7f8a14f2e800 20 remove_watcher() i=5 2024-09-22T08:40:26.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.943+0000 7f8a14f2e800 20 remove_watcher() i=6 2024-09-22T08:40:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:26.944+0000 7f8a14f2e800 20 remove_watcher() i=7 2024-09-22T08:40:26.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:26.956 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:26.956 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:40:26.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:26.957 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-22T08:40:26.991 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:26.992 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:27.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.028+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.029+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.029+0000 7fa0ea932800 20 realm 2024-09-22T08:40:27.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.029+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.030+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.030+0000 7fa0ea932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.030+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.030+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.030+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.031+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.031+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.031+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.031+0000 7fa0ea932800 20 searching for the correct realm 2024-09-22T08:40:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.032+0000 7fa0e66b0640 0 -- 172.21.15.78:0/1671466643 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55eaf60a7eb0 msgr2=0x55eaf60aa370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:27.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.237+0000 7fa0e66b0640 0 -- 172.21.15.78:0/1671466643 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fa0d80998f0 msgr2=0x7fa0d807b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.244+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 zone default found 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 4 Realm: () 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 zonegroup default 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.245+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.246+0000 7fa0ea932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.246+0000 7fa0ea932800 20 started sync module instance, tier type = 2024-09-22T08:40:27.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.246+0000 7fa0ea932800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=0 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=1 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=2 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=3 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=4 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=5 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.254+0000 7fa0ea932800 20 add_watcher() i=6 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.255+0000 7fa0ea932800 20 add_watcher() i=7 2024-09-22T08:40:27.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.255+0000 7fa0ea932800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:27.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.257+0000 7f9f9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:27.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:27.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:27.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 5 note: GC not initialized 2024-09-22T08:40:27.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7f9f177fe640 20 reqs_thread_entry: start 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 20 Filter name: none 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7f9f157fa640 20 reqs_thread_entry: start 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.258+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 : miss 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:27.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.259+0000 7fa0ea932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7fa0ea932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7fa0ea932800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7fa0ea932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7fa0ea932800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31, ofs0, ns] 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7f9fc9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562475 cookie 94467638624464 notifier 7362 bl.length()=1015 2024-09-22T08:40:27.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7f9fc9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:27.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7f9fc9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:27.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.264+0000 7f9fc9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:27.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.265+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_sources= new_sources= 2024-09-22T08:40:27.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.265+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential sources added=[] removed=[] 2024-09-22T08:40:27.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.265+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_dests= new_dests= 2024-09-22T08:40:27.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.265+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential dests added=[] removed=[] 2024-09-22T08:40:27.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.0 2024-09-22T08:40:27.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.0 2024-09-22T08:40:27.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.1 2024-09-22T08:40:27.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.1 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.2 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.2 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.3 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.3 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.4 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.4 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.5 2024-09-22T08:40:27.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.5 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.6 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.6 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.7 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.7 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.8 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.8 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.9 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.9 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.10 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.10 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.11 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1.11 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.0 2024-09-22T08:40:27.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.270+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1 2024-09-22T08:40:27.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.271+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2 2024-09-22T08:40:27.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.271+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.3 2024-09-22T08:40:27.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.272+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.4 2024-09-22T08:40:27.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.272+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.5 2024-09-22T08:40:27.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.273+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.6 2024-09-22T08:40:27.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.273+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.7 2024-09-22T08:40:27.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.274+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.8 2024-09-22T08:40:27.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.274+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.9 2024-09-22T08:40:27.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.274+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.10 2024-09-22T08:40:27.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.278+0000 7fa0ea932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:27.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.278+0000 7fa0ea932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 2024-09-22T08:40:27.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7fa0ea932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:27.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7fa0ea932800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:27.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7fa0ea932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:27.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7fa0ea932800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31, ofs0, ns] 2024-09-22T08:40:27.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7f9fc9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562476 cookie 94467638624464 notifier 7362 bl.length()=1015 2024-09-22T08:40:27.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7f9fc9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:27.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7f9fc9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:27.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.279+0000 7f9fc9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:27.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.281+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_sources= new_sources= 2024-09-22T08:40:27.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.281+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential sources added=[] removed=[] 2024-09-22T08:40:27.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.281+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_dests= new_dests= 2024-09-22T08:40:27.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.281+0000 7fa0ea932800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential dests added=[] removed=[] 2024-09-22T08:40:27.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.283+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.0 2024-09-22T08:40:27.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.283+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1 2024-09-22T08:40:27.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.284+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2 2024-09-22T08:40:27.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.284+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.3 2024-09-22T08:40:27.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.284+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.4 2024-09-22T08:40:27.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.284+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.5 2024-09-22T08:40:27.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.285+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.6 2024-09-22T08:40:27.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.285+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.7 2024-09-22T08:40:27.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.285+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.8 2024-09-22T08:40:27.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.286+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.9 2024-09-22T08:40:27.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.286+0000 7fa0ea932800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.10 2024-09-22T08:40:27.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.286+0000 7fa0ea932800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-22T08:40:27.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.286+0000 7fa0ea932800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-22T08:40:27.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.290+0000 7f9f9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.292+0000 7fa0ea932800 20 remove_watcher() i=0 2024-09-22T08:40:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.292+0000 7fa0ea932800 2 removed watcher, disabling cache 2024-09-22T08:40:27.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.293+0000 7fa0ea932800 20 remove_watcher() i=1 2024-09-22T08:40:27.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.294+0000 7fa0ea932800 20 remove_watcher() i=2 2024-09-22T08:40:27.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.294+0000 7fa0ea932800 20 remove_watcher() i=3 2024-09-22T08:40:27.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.295+0000 7fa0ea932800 20 remove_watcher() i=4 2024-09-22T08:40:27.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.296+0000 7fa0ea932800 20 remove_watcher() i=5 2024-09-22T08:40:27.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.297+0000 7fa0ea932800 20 remove_watcher() i=6 2024-09-22T08:40:27.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.298+0000 7fa0ea932800 20 remove_watcher() i=7 2024-09-22T08:40:27.311 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:40:27.340 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:27.340 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:27.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.375+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 realm 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.377+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.378+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:27.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.378+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.379+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:27.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.379+0000 7fc2eca0e800 20 searching for the correct realm 2024-09-22T08:40:27.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.381+0000 7fc2e896c640 0 -- 172.21.15.78:0/2820736255 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fc2d00b5870 msgr2=0x7fc2d00ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:27.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.586+0000 7fc2df96a640 0 -- 172.21.15.78:0/2820736255 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc2e0033040 msgr2=0x7fc2e0052450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:27.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:27.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:27.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:27.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.591+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 zone default found 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 4 Realm: () 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:27.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 zonegroup default 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 started sync module instance, tier type = 2024-09-22T08:40:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.592+0000 7fc2eca0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:27.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=0 2024-09-22T08:40:27.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=1 2024-09-22T08:40:27.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=2 2024-09-22T08:40:27.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=3 2024-09-22T08:40:27.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=4 2024-09-22T08:40:27.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=5 2024-09-22T08:40:27.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.601+0000 7fc2eca0e800 20 add_watcher() i=6 2024-09-22T08:40:27.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.602+0000 7fc2eca0e800 20 add_watcher() i=7 2024-09-22T08:40:27.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.602+0000 7fc2eca0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc19f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc2eca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc2eca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc2eca0e800 5 note: GC not initialized 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc19e7dc640 20 reqs_thread_entry: start 2024-09-22T08:40:27.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc2eca0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:27.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.604+0000 7fc2eca0e800 20 Filter name: none 2024-09-22T08:40:27.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc1977fe640 20 reqs_thread_entry: start 2024-09-22T08:40:27.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:27.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.605+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.606+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.606+0000 7fc2eca0e800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.606+0000 7fc2eca0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:40:27.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.606+0000 7fc2eca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:27.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.608+0000 7fc19f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:27.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.610+0000 7fc2eca0e800 20 remove_watcher() i=0 2024-09-22T08:40:27.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.610+0000 7fc2eca0e800 2 removed watcher, disabling cache 2024-09-22T08:40:27.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.611+0000 7fc2eca0e800 20 remove_watcher() i=1 2024-09-22T08:40:27.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.612+0000 7fc2eca0e800 20 remove_watcher() i=2 2024-09-22T08:40:27.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.613+0000 7fc2eca0e800 20 remove_watcher() i=3 2024-09-22T08:40:27.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.614+0000 7fc2eca0e800 20 remove_watcher() i=4 2024-09-22T08:40:27.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.615+0000 7fc2eca0e800 20 remove_watcher() i=5 2024-09-22T08:40:27.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.615+0000 7fc2eca0e800 20 remove_watcher() i=6 2024-09-22T08:40:27.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.616+0000 7fc2eca0e800 20 remove_watcher() i=7 2024-09-22T08:40:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:27.628 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:27.628 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:40:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:27.721 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:40:27.753 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:27.753 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:27.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.788+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 realm 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:27.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.790+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.791+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:27.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.791+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:27.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.792+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:27.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.792+0000 7fcb17614800 20 searching for the correct realm 2024-09-22T08:40:27.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.794+0000 7fcb134cc640 0 -- 172.21.15.78:0/2633629525 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fcb08026070 msgr2=0x7fcb08027400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:28.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:27.998+0000 7fcb124ca640 0 -- 172.21.15.78:0/2633629525 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fcb0c06bd80 msgr2=0x7fcb0c086400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:28.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:28.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:28.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:28.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:28.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.003+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 zone default found 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 4 Realm: () 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:28.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 zonegroup default 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.004+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.005+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.005+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.005+0000 7fcb17614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.005+0000 7fcb17614800 20 started sync module instance, tier type = 2024-09-22T08:40:28.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.005+0000 7fcb17614800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=0 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=1 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=2 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=3 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=4 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=5 2024-09-22T08:40:28.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.014+0000 7fcb17614800 20 add_watcher() i=6 2024-09-22T08:40:28.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.015+0000 7fcb17614800 20 add_watcher() i=7 2024-09-22T08:40:28.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.015+0000 7fcb17614800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:28.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.016+0000 7fc9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:28.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 5 note: GC not initialized 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fc943fff640 20 reqs_thread_entry: start 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 20 Filter name: none 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fc941ffb640 20 reqs_thread_entry: start 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:40:28.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.017+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 : miss 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:28.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.018+0000 7fcb17614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 2024-09-22T08:40:28.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.019+0000 7fcb17614800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:40:28.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fcb17614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fcb17614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fcb17614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fcb17614800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31, ofs0, ns] 2024-09-22T08:40:28.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fc9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562477 cookie 94377926957968 notifier 6881 bl.length()=1015 2024-09-22T08:40:28.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fc9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fc9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.026+0000 7fc9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.028+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_sources= new_sources= 2024-09-22T08:40:28.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.028+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential sources added=[] removed=[] 2024-09-22T08:40:28.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.028+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_dests= new_dests= 2024-09-22T08:40:28.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.028+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential dests added=[] removed=[] 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.0 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.0 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.1 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.1 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.2 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.2 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.3 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.3 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.4 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.4 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.5 2024-09-22T08:40:28.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.5 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.6 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.6 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.7 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.7 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.8 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.8 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.9 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.9 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.10 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.10 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.11 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2.11 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.033+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.0 2024-09-22T08:40:28.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.034+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1 2024-09-22T08:40:28.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.034+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2 2024-09-22T08:40:28.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.035+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.3 2024-09-22T08:40:28.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.035+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.4 2024-09-22T08:40:28.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.036+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.5 2024-09-22T08:40:28.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.036+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.6 2024-09-22T08:40:28.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.037+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.7 2024-09-22T08:40:28.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.037+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.8 2024-09-22T08:40:28.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.038+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.9 2024-09-22T08:40:28.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.038+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.10 2024-09-22T08:40:28.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.041+0000 7fcb17614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:28.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.041+0000 7fcb17614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 2024-09-22T08:40:28.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fcb17614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fcb17614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fcb17614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fcb17614800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31, ofs0, ns] 2024-09-22T08:40:28.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fc9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562478 cookie 94377926957968 notifier 6881 bl.length()=1015 2024-09-22T08:40:28.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fc9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fc9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.042+0000 7fc9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.044+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_sources= new_sources= 2024-09-22T08:40:28.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.044+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential sources added=[] removed=[] 2024-09-22T08:40:28.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.044+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_dests= new_dests= 2024-09-22T08:40:28.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.044+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential dests added=[] removed=[] 2024-09-22T08:40:28.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.046+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.0 2024-09-22T08:40:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.047+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.1 2024-09-22T08:40:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.047+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.2 2024-09-22T08:40:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.047+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.3 2024-09-22T08:40:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.048+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.4 2024-09-22T08:40:28.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.048+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.5 2024-09-22T08:40:28.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.048+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.6 2024-09-22T08:40:28.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.048+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.7 2024-09-22T08:40:28.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.049+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.8 2024-09-22T08:40:28.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.049+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.9 2024-09-22T08:40:28.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.049+0000 7fcb17614800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31.10 2024-09-22T08:40:28.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.050+0000 7fcb17614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:28.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.050+0000 7fcb17614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 2024-09-22T08:40:28.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fcb17614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fcb17614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fcb17614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fcb17614800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31, ofs0, ns] 2024-09-22T08:40:28.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fc9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562479 cookie 94377926957968 notifier 6881 bl.length()=983 2024-09-22T08:40:28.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fc9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 info.flags=0x17 2024-09-22T08:40:28.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fc9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 to cache LRU end 2024-09-22T08:40:28.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.051+0000 7fc9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:28.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.053+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_sources= new_sources= 2024-09-22T08:40:28.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.053+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential sources added=[] removed=[] 2024-09-22T08:40:28.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.053+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): orig_dests= new_dests= 2024-09-22T08:40:28.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.053+0000 7fcb17614800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31]): potential dests added=[] removed=[] 2024-09-22T08:40:28.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.055+0000 7fcb17614800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:40:28.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.056+0000 7fc9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.058+0000 7fcb17614800 20 remove_watcher() i=0 2024-09-22T08:40:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.058+0000 7fcb17614800 2 removed watcher, disabling cache 2024-09-22T08:40:28.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.059+0000 7fcb17614800 20 remove_watcher() i=1 2024-09-22T08:40:28.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.060+0000 7fcb17614800 20 remove_watcher() i=2 2024-09-22T08:40:28.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.061+0000 7fcb17614800 20 remove_watcher() i=3 2024-09-22T08:40:28.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.062+0000 7fcb17614800 20 remove_watcher() i=4 2024-09-22T08:40:28.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.063+0000 7fcb17614800 20 remove_watcher() i=5 2024-09-22T08:40:28.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.064+0000 7fcb17614800 20 remove_watcher() i=6 2024-09-22T08:40:28.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.065+0000 7fcb17614800 20 remove_watcher() i=7 2024-09-22T08:40:28.078 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:40:28.107 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:28.107 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:28.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.143+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 realm 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.145+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.146+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:28.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.146+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.147+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:28.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.147+0000 7f4fae32c800 20 searching for the correct realm 2024-09-22T08:40:28.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.147+0000 7f4fa9f45640 0 -- 172.21.15.78:0/3893506721 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x559abb999750 msgr2=0x559abb99bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:28.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.351+0000 7f4fa9f45640 0 -- 172.21.15.78:0/3893506721 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f4f98003450 msgr2=0x7f4fa4088190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.560+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:28.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 zone default found 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 4 Realm: () 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 zonegroup default 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.561+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.562+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.562+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.562+0000 7f4fae32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:28.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.562+0000 7f4fae32c800 20 started sync module instance, tier type = 2024-09-22T08:40:28.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.562+0000 7f4fae32c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:28.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=0 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=1 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=2 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=3 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=4 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=5 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.571+0000 7f4fae32c800 20 add_watcher() i=6 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.572+0000 7f4fae32c800 20 add_watcher() i=7 2024-09-22T08:40:28.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.572+0000 7f4fae32c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:28.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.574+0000 7f4e5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:28.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:28.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:28.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 5 note: GC not initialized 2024-09-22T08:40:28.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4e5a7fc640 20 reqs_thread_entry: start 2024-09-22T08:40:28.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:28.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 20 Filter name: none 2024-09-22T08:40:28.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4dcbfff640 20 reqs_thread_entry: start 2024-09-22T08:40:28.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.575+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.576+0000 7f4fae32c800 20 rados->read ofs=0 len=0 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.577+0000 7f4fae32c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:28.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.577+0000 7f4fae32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:28.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.578+0000 7f4e5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:28.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.580+0000 7f4fae32c800 20 remove_watcher() i=0 2024-09-22T08:40:28.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.580+0000 7f4fae32c800 2 removed watcher, disabling cache 2024-09-22T08:40:28.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.581+0000 7f4fae32c800 20 remove_watcher() i=1 2024-09-22T08:40:28.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.582+0000 7f4fae32c800 20 remove_watcher() i=2 2024-09-22T08:40:28.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.588+0000 7f4fae32c800 20 remove_watcher() i=3 2024-09-22T08:40:28.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.589+0000 7f4fae32c800 20 remove_watcher() i=4 2024-09-22T08:40:28.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.590+0000 7f4fae32c800 20 remove_watcher() i=5 2024-09-22T08:40:28.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.591+0000 7f4fae32c800 20 remove_watcher() i=6 2024-09-22T08:40:28.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:28.592+0000 7f4fae32c800 20 remove_watcher() i=7 2024-09-22T08:40:28.603 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:28.603 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:28.603 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:40:28.603 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:28.975 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-22T08:40:28.976 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:40:29.820 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:29.820 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:29.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.854+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 realm 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.856+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.857+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:29.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.857+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.858+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:29.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.858+0000 7f571e12a800 20 searching for the correct realm 2024-09-22T08:40:29.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.860+0000 7f571a650640 0 -- 172.21.15.78:0/4085019018 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f570406d060 msgr2=0x7f57040a2c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:29.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.864+0000 7f5713fff640 0 -- 172.21.15.78:0/4085019018 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f571405c040 msgr2=0x7f5714032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:29.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:29.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:29.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:29.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.868+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 zone default found 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 4 Realm: () 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:29.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 zonegroup default 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.869+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.870+0000 7f571e12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.870+0000 7f571e12a800 20 started sync module instance, tier type = 2024-09-22T08:40:29.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.870+0000 7f571e12a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:29.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=0 2024-09-22T08:40:29.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=1 2024-09-22T08:40:29.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=2 2024-09-22T08:40:29.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=3 2024-09-22T08:40:29.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=4 2024-09-22T08:40:29.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=5 2024-09-22T08:40:29.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.878+0000 7f571e12a800 20 add_watcher() i=6 2024-09-22T08:40:29.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.879+0000 7f571e12a800 20 add_watcher() i=7 2024-09-22T08:40:29.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.879+0000 7f571e12a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:29.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.880+0000 7f55cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:29.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:29.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:29.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 5 note: GC not initialized 2024-09-22T08:40:29.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f55ca7fc640 20 reqs_thread_entry: start 2024-09-22T08:40:29.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:29.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 20 Filter name: none 2024-09-22T08:40:29.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f553bfff640 20 reqs_thread_entry: start 2024-09-22T08:40:29.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.881+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.882+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.882+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.882+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.882+0000 7f571e12a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.882+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.883+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:29.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.883+0000 7f571e12a800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.883+0000 7f571e12a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:29.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.883+0000 7f571e12a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:29.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.885+0000 7f55cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.887+0000 7f571e12a800 20 remove_watcher() i=0 2024-09-22T08:40:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.887+0000 7f571e12a800 2 removed watcher, disabling cache 2024-09-22T08:40:29.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.888+0000 7f571e12a800 20 remove_watcher() i=1 2024-09-22T08:40:29.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.889+0000 7f571e12a800 20 remove_watcher() i=2 2024-09-22T08:40:29.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.890+0000 7f571e12a800 20 remove_watcher() i=3 2024-09-22T08:40:29.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.890+0000 7f571e12a800 20 remove_watcher() i=4 2024-09-22T08:40:29.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.891+0000 7f571e12a800 20 remove_watcher() i=5 2024-09-22T08:40:29.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.892+0000 7f571e12a800 20 remove_watcher() i=6 2024-09-22T08:40:29.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.893+0000 7f571e12a800 20 remove_watcher() i=7 2024-09-22T08:40:29.905 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:29.906 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:29.906 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:40:29.906 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:29.907 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-22T08:40:29.943 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:29.943 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:29.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.979+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 realm 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:29.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.981+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.982+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:29.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.982+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:29.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.983+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:29.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.983+0000 7f4f97a20800 20 searching for the correct realm 2024-09-22T08:40:29.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:29.983+0000 7f4f94d09640 0 -- 172.21.15.78:0/488102535 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f4f880a9040 msgr2=0x7f4f880a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:30.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.188+0000 7f4f9550a640 0 -- 172.21.15.78:0/488102535 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x56365bba7660 msgr2=0x56365bba9a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:30.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:30.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.194+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:30.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 zone default found 2024-09-22T08:40:30.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 4 Realm: () 2024-09-22T08:40:30.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 zonegroup default 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.195+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.196+0000 7f4f97a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.196+0000 7f4f97a20800 20 started sync module instance, tier type = 2024-09-22T08:40:30.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.196+0000 7f4f97a20800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=0 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=1 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=2 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=3 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=4 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=5 2024-09-22T08:40:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.205+0000 7f4f97a20800 20 add_watcher() i=6 2024-09-22T08:40:30.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.206+0000 7f4f97a20800 20 add_watcher() i=7 2024-09-22T08:40:30.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.206+0000 7f4f97a20800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:30.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.207+0000 7f4e4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 5 note: GC not initialized 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4e4a7e4640 20 reqs_thread_entry: start 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 20 Filter name: none 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4dbbfff640 20 reqs_thread_entry: start 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T08:40:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.208+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 : miss 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.209+0000 7f4f97a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 2024-09-22T08:40:30.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.214+0000 7f4f97a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.214+0000 7f4f97a20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.214+0000 7f4f97a20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.214+0000 7f4f97a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32, ofs0, ns] 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.214+0000 7f4e67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562482 cookie 94791467178448 notifier 6929 bl.length()=1015 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.215+0000 7f4e67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.215+0000 7f4e67fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.215+0000 7f4e67fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.216+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_sources= new_sources= 2024-09-22T08:40:30.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.216+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential sources added=[] removed=[] 2024-09-22T08:40:30.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.216+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_dests= new_dests= 2024-09-22T08:40:30.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.216+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential dests added=[] removed=[] 2024-09-22T08:40:30.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.0 2024-09-22T08:40:30.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.0 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.1 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.1 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.2 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.2 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.3 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.3 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.4 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.4 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.5 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.5 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.6 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.6 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.7 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.7 2024-09-22T08:40:30.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.8 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.8 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.9 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.9 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.10 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.10 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.11 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1.11 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.220+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.0 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.221+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1 2024-09-22T08:40:30.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.221+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.2 2024-09-22T08:40:30.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.222+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.3 2024-09-22T08:40:30.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.222+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.4 2024-09-22T08:40:30.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.223+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.5 2024-09-22T08:40:30.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.223+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.6 2024-09-22T08:40:30.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.224+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.7 2024-09-22T08:40:30.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.224+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.8 2024-09-22T08:40:30.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.224+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.9 2024-09-22T08:40:30.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.225+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.10 2024-09-22T08:40:30.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.228+0000 7f4f97a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:30.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.228+0000 7f4f97a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4f97a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4f97a20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4f97a20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4f97a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32, ofs0, ns] 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4e67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562483 cookie 94791467178448 notifier 6929 bl.length()=1015 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4e67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4e67fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.230+0000 7f4e67fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.232+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_sources= new_sources= 2024-09-22T08:40:30.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.232+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential sources added=[] removed=[] 2024-09-22T08:40:30.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.232+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_dests= new_dests= 2024-09-22T08:40:30.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.232+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential dests added=[] removed=[] 2024-09-22T08:40:30.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.234+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.0 2024-09-22T08:40:30.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.234+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.1 2024-09-22T08:40:30.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.234+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.2 2024-09-22T08:40:30.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.235+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.3 2024-09-22T08:40:30.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.235+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.4 2024-09-22T08:40:30.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.235+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.5 2024-09-22T08:40:30.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.235+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.6 2024-09-22T08:40:30.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.236+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.7 2024-09-22T08:40:30.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.236+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.8 2024-09-22T08:40:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.237+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.9 2024-09-22T08:40:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.237+0000 7f4f97a20800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32.10 2024-09-22T08:40:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.237+0000 7f4f97a20800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-22T08:40:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.237+0000 7f4f97a20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.237+0000 7f4f97a20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 2024-09-22T08:40:30.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.238+0000 7f4f97a20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.238+0000 7f4f97a20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.238+0000 7f4f97a20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.238+0000 7f4f97a20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32, ofs0, ns] 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.239+0000 7f4e78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94791467178448 notifier 6929 bl.length()=983 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.239+0000 7f4e78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 info.flags=0x17 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.239+0000 7f4e78ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 to cache LRU end 2024-09-22T08:40:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.239+0000 7f4e78ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.241+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_sources= new_sources= 2024-09-22T08:40:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.241+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential sources added=[] removed=[] 2024-09-22T08:40:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.241+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): orig_dests= new_dests= 2024-09-22T08:40:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.241+0000 7f4f97a20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32]): potential dests added=[] removed=[] 2024-09-22T08:40:30.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.242+0000 7f4f97a20800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:40:30.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.244+0000 7f4e4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:30.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.246+0000 7f4f97a20800 20 remove_watcher() i=0 2024-09-22T08:40:30.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.246+0000 7f4f97a20800 2 removed watcher, disabling cache 2024-09-22T08:40:30.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.247+0000 7f4f97a20800 20 remove_watcher() i=1 2024-09-22T08:40:30.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.248+0000 7f4f97a20800 20 remove_watcher() i=2 2024-09-22T08:40:30.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.249+0000 7f4f97a20800 20 remove_watcher() i=3 2024-09-22T08:40:30.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.250+0000 7f4f97a20800 20 remove_watcher() i=4 2024-09-22T08:40:30.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.251+0000 7f4f97a20800 20 remove_watcher() i=5 2024-09-22T08:40:30.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.252+0000 7f4f97a20800 20 remove_watcher() i=6 2024-09-22T08:40:30.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.253+0000 7f4f97a20800 20 remove_watcher() i=7 2024-09-22T08:40:30.267 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T08:40:30.295 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:30.296 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:30.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.330+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.331+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.331+0000 7fdb04492800 20 realm 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.331+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:30.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.332+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.333+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:30.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.333+0000 7fdb04492800 20 searching for the correct realm 2024-09-22T08:40:30.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.335+0000 7fdb0277d640 0 -- 172.21.15.78:0/2299507189 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fdaec037020 msgr2=0x7fdaec069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:30.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.539+0000 7fdaf977b640 0 -- 172.21.15.78:0/2299507189 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fdafc018040 msgr2=0x7fdafc02b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:30.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.544+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 zone default found 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 4 Realm: () 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 zonegroup default 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.545+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.546+0000 7fdb04492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.546+0000 7fdb04492800 20 started sync module instance, tier type = 2024-09-22T08:40:30.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.546+0000 7fdb04492800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=0 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=1 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=2 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=3 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=4 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=5 2024-09-22T08:40:30.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.554+0000 7fdb04492800 20 add_watcher() i=6 2024-09-22T08:40:30.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.555+0000 7fdb04492800 20 add_watcher() i=7 2024-09-22T08:40:30.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.555+0000 7fdb04492800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:30.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.556+0000 7fd9b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:30.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:30.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 5 note: GC not initialized 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fd9b27fc640 20 reqs_thread_entry: start 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 20 Filter name: none 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fd923fff640 20 reqs_thread_entry: start 2024-09-22T08:40:30.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.557+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.558+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.558+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:30.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 rados->read ofs=0 len=0 2024-09-22T08:40:30.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:30.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.559+0000 7fdb04492800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:30.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.561+0000 7fd9b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:30.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.563+0000 7fdb04492800 20 remove_watcher() i=0 2024-09-22T08:40:30.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.563+0000 7fdb04492800 2 removed watcher, disabling cache 2024-09-22T08:40:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.564+0000 7fdb04492800 20 remove_watcher() i=1 2024-09-22T08:40:30.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.565+0000 7fdb04492800 20 remove_watcher() i=2 2024-09-22T08:40:30.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.566+0000 7fdb04492800 20 remove_watcher() i=3 2024-09-22T08:40:30.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.567+0000 7fdb04492800 20 remove_watcher() i=4 2024-09-22T08:40:30.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.568+0000 7fdb04492800 20 remove_watcher() i=5 2024-09-22T08:40:30.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.569+0000 7fdb04492800 20 remove_watcher() i=6 2024-09-22T08:40:30.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:30.570+0000 7fdb04492800 20 remove_watcher() i=7 2024-09-22T08:40:30.582 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:30.583 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:30.583 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:40:30.583 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:30.991 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-22T08:40:30.991 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:31.815 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:40:31.843 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:31.843 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:31.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.877+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 realm 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:31.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.879+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.880+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:31.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.880+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:31.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.881+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:31.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.881+0000 7fd4c3323800 20 searching for the correct realm 2024-09-22T08:40:31.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.883+0000 7fd4b680b640 0 -- 172.21.15.78:0/107466768 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55694fe16e50 msgr2=0x55694fe19240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:31.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:31.886+0000 7fd4b680b640 0 -- 172.21.15.78:0/107466768 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd4b804ab80 msgr2=0x7fd4b8057440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:32.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:32.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:32.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.092+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 zone default found 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 4 Realm: () 2024-09-22T08:40:32.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:32.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:32.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 zonegroup default 2024-09-22T08:40:32.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.093+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.094+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.094+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.094+0000 7fd4c3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.094+0000 7fd4c3323800 20 started sync module instance, tier type = 2024-09-22T08:40:32.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.094+0000 7fd4c3323800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:32.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=0 2024-09-22T08:40:32.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=1 2024-09-22T08:40:32.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=2 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=3 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=4 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=5 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.103+0000 7fd4c3323800 20 add_watcher() i=6 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.104+0000 7fd4c3323800 20 add_watcher() i=7 2024-09-22T08:40:32.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.104+0000 7fd4c3323800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd4c3323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd4c3323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd4c3323800 5 note: GC not initialized 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd374fe1640 20 reqs_thread_entry: start 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd4c3323800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd4c3323800 20 Filter name: none 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.106+0000 7fd2ee7fc640 20 reqs_thread_entry: start 2024-09-22T08:40:32.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.107+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.107+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.107+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:32.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.108+0000 7fd4c3323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:32.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.110+0000 7fd375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.112+0000 7fd4c3323800 20 remove_watcher() i=0 2024-09-22T08:40:32.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.112+0000 7fd4c3323800 2 removed watcher, disabling cache 2024-09-22T08:40:32.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.113+0000 7fd4c3323800 20 remove_watcher() i=1 2024-09-22T08:40:32.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.114+0000 7fd4c3323800 20 remove_watcher() i=2 2024-09-22T08:40:32.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.115+0000 7fd4c3323800 20 remove_watcher() i=3 2024-09-22T08:40:32.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.116+0000 7fd4c3323800 20 remove_watcher() i=4 2024-09-22T08:40:32.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.117+0000 7fd4c3323800 20 remove_watcher() i=5 2024-09-22T08:40:32.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.118+0000 7fd4c3323800 20 remove_watcher() i=6 2024-09-22T08:40:32.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.119+0000 7fd4c3323800 20 remove_watcher() i=7 2024-09-22T08:40:32.131 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.131 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:32.131 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:40:32.131 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.133 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-22T08:40:32.166 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:32.166 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:32.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.201+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.202+0000 7fadc6c40800 20 realm 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.202+0000 7fadc6c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.204+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.204+0000 7fadc6c40800 20 searching for the correct realm 2024-09-22T08:40:32.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.206+0000 7fadc4f2b640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fadb80a2720 msgr2=0x7fadb80a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.411+0000 7fadc3f29640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fadbc03f070 msgr2=0x7fadbc06bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.415+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zone default found 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Realm: () 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zonegroup default 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started sync module instance, tier type = 2024-09-22T08:40:32.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=0 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=1 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=2 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=3 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=4 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=5 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=6 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.426+0000 7fadc6c40800 20 add_watcher() i=7 2024-09-22T08:40:32.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.426+0000 7fadc6c40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.428+0000 7fac7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.428+0000 7fadc6c40800 5 note: GC not initialized 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fac79fdb640 20 reqs_thread_entry: start 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 20 Filter name: none 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fabeb7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : miss 2024-09-22T08:40:32.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.430+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562496 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.448+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:32.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.448+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562497 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.459 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fadc6c40800 time 2024-09-22T08:40:32.459655+0000 2024-09-22T08:40:32.459 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fadca18c748] 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:40:32.460 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.458+0000 7fadc6c40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fadc6c40800 time 2024-09-22T08:40:32.459655+0000 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fadca18c748] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.461 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:40:32.462 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:40:32.462 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.462 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:40:32.462 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fadc6c40800 thread_name:radosgw-admin 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fadc8e3e6f0] 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fadc8e8b99c] 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fadca18c7a2] 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.476 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.459+0000 7fadc6c40800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fadc6c40800 thread_name:radosgw-admin 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fadc8e3e6f0] 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fadc8e8b99c] 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fadca18c7a2] 2024-09-22T08:40:32.477 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806ded7e0 auth_method 0 2024-09-22T08:40:32.478 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806d297e0 auth_method 0 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.479 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:40:32.186+0000 7fadc3f29640 1 monclient: found mon.noname-a 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: dump: 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.480 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: dump: 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.481 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:40:32.186+0000 7fadc6c40800 5 monclient: authenticate success, global_id 7503 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:40:32.186+0000 7facb260c640 4 set_mon_vals no callback set 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:40:32.186+0000 7fadc6c40800 1 librados: init done 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.482 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:40:32.188+0000 7fadc472a640 10 monclient: get_auth_request con 0x7facac077570 auth_method 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:40:32.189+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806e0ebb0 auth_method 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:40:32.189+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806e31be0 auth_method 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:40:32.190+0000 7fadc3f29640 10 monclient: get_auth_request con 0x561806e35f40 auth_method 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:40:32.191+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806e354c0 auth_method 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:40:32.192+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.483 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.484 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:40:32.192+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command objecter_requests cmddesc objecter_requests hook 0x561806e41670 EEXIST 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.485 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:40:32.192+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:40:32.193+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:40:32.193+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x561806e3d150 EEXIST 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806e65990 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806e65d70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.486 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e646a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.983150s 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e65990 auth_method 0 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806e65d70 auth_method 0 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.487 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_done global_id 6974 payload 824 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:40:32.193+0000 7fadc3f29640 1 monclient: found mon.noname-c 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:40:32.193+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806e646a0 auth_method 0 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: dump: 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.488 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.489 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: dump: 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:40:32.193+0000 7fadc6c40800 5 monclient: authenticate success, global_id 6974 2024-09-22T08:40:32.490 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:40:32.193+0000 7fadc572c640 4 set_mon_vals no callback set 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:40:32.195+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fac9c077480 auth_method 0 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: get_monmap_and_config 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:40:32.195+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.491 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.492 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.493 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdaf79c2c8 EEXIST 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e89300 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.494 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806eb3d70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806eb5120 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.986723s 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806eb5120 auth_method 0 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806eb3d70 auth_method 0 2024-09-22T08:40:32.495 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e89300 auth_method 0 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_done global_id 7509 payload 274 2024-09-22T08:40:32.496 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:40:32.197+0000 7fadc472a640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:40:32.197+0000 7fadc472a640 1 monclient: found mon.noname-a 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:40:32.197+0000 7fadc472a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: dump: 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.497 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: dump: 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.498 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:40:32.197+0000 7fadc6c40800 5 monclient: authenticate success, global_id 7509 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:40:32.197+0000 7fadc6c40800 10 monclient: get_monmap_and_config success 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:40:32.197+0000 7fadc6c40800 4 set_mon_vals no callback set 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:40:32.197+0000 7fadc6c40800 10 monclient: shutdown 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.499 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.500 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: starting msgr at 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: starting objecter 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command objecter_requests cmddesc objecter_requests hook 0x561806e67770 EEXIST 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: setting wanted keys 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: calling monclient init 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.501 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.502 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x561806e7a398 EEXIST 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806e89300 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806eb5120 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e855e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.988951s 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806eb5120 auth_method 0 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.503 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e89300 auth_method 0 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806e855e0 auth_method 0 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.504 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_done global_id 6980 payload 824 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 1 monclient: found mon.noname-c 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: dump: 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.505 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: dump: 2024-09-22T08:40:32.506 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:40:32.199+0000 7fadc6c40800 5 monclient: authenticate success, global_id 6980 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:40:32.199+0000 7fac9b7fe640 4 set_mon_vals no callback set 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.507 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:40:32.199+0000 7fadc6c40800 1 librados: init done 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:40:32.199+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cr dump hook 0x561806ebcba8 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:40:32.201+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:40:32.201+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fac8c0775a0 auth_method 0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:40:32.202+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806ed4170 auth_method 0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 realm 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:40:32.202+0000 7fadc6c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.508 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:40:32.203+0000 7fadc3f29640 10 monclient: get_auth_request con 0x561806ed8380 auth_method 0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:40:32.204+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806edbbe0 auth_method 0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:40:32.204+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:40:32.204+0000 7fadc6c40800 20 searching for the correct realm 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:40:32.204+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806ee09a0 auth_method 0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:40:32.205+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fadb401a040 auth_method 0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:40:32.206+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fadb80a2720 auth_method 0 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:40:32.206+0000 7fadc4f2b640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fadb80a2720 msgr2=0x7fadb80a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.509 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:40:32.407+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fadb80a2720 auth_method 0 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:40:32.408+0000 7fadc472a640 10 monclient: get_auth_request con 0x7fadb4041a80 auth_method 0 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:40:32.410+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fadbc03f070 auth_method 0 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:40:32.411+0000 7fadc3f29640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fadbc03f070 msgr2=0x7fadbc06bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:40:32.411+0000 7fac99ffb640 1 client.6980.objecter ms_handle_reset 0x7fadbc03f070 session 0x7fadbc015040 osd.3 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:40:32.411+0000 7fac99ffb640 10 monclient: _renew_subs 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:40:32.411+0000 7fac99ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:40:32.411+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fac8c0878c0 auth_method 0 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.510 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zone default found 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Realm: () 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:40:32.416+0000 7fadc6c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zonegroup default 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.511 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started sync module instance, tier type = 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=0 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=1 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=2 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=3 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=4 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=5 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=6 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:40:32.426+0000 7fadc6c40800 20 add_watcher() i=7 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:40:32.426+0000 7fadc6c40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.512 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.513 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:40:32.428+0000 7fac7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:40:32.428+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache list hook 0x561806ebf150 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache inspect hook 0x561806ebf150 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache erase hook 0x561806ebf150 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache zap hook 0x561806ebf150 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 note: GC not initialized 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:40:32.429+0000 7fac79fdb640 20 reqs_thread_entry: start 2024-09-22T08:40:32.514 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace show hook 0x7fadb401f040 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace history hook 0x7fadb401f040 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace active hook 0x7fadb401f040 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace active_short hook 0x7fadb401f040 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 Filter name: none 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:40:32.429+0000 7fabeb7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : miss 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.515 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:40:32.430+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562496 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.516 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.517 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.518 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.519 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:40:32.448+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:40:32.448+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562497 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.520 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.521 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:40:32.458+0000 7fadc6c40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fadc6c40800 time 2024-09-22T08:40:32.459655+0000 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fadca18c748] 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.522 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:40:32.459+0000 7fadc6c40800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fadc6c40800 thread_name:radosgw-admin 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fadc8e3e6f0] 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fadc8e8b99c] 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:40:32.523 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fadca18c7a2] 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:40:32.524 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:40:32.525 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:40:32.526 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:40:32.527 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:40:32.528 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:40:32.529 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:40:32.530 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fabeb7fe640 / http_manager 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac79fdb640 / http_manager 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac7afdd640 / rgw_dt_lg_renew 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac99ffb640 / ms_dispatch 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac9affd640 / io_context_pool 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac9b7fe640 / io_context_pool 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7faca9ffb640 / ms_dispatch 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7facb0e09640 / ms_dispatch 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7facb260c640 / io_context_pool 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc3f29640 / msgr-worker-2 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc472a640 / msgr-worker-1 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc4f2b640 / msgr-worker-0 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc572c640 / io_context_pool 2024-09-22T08:40:32.531 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc6c40800 / radosgw-admin 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.123981.log 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806ded7e0 auth_method 0 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.532 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806d297e0 auth_method 0 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:40:32.186+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:40:32.186+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-22T08:40:32.533 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:40:32.186+0000 7fadc3f29640 1 monclient: found mon.noname-a 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:40:32.186+0000 7fadc3f29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: dump: 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.534 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:40:32.186+0000 7facb0e09640 10 monclient: dump: 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.535 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:40:32.186+0000 7fadc6c40800 5 monclient: authenticate success, global_id 7503 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:40:32.186+0000 7facb260c640 4 set_mon_vals no callback set 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:40:32.186+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:40:32.186+0000 7fadc6c40800 1 librados: init done 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.536 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:40:32.188+0000 7facb0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:40:32.188+0000 7fadc472a640 10 monclient: get_auth_request con 0x7facac077570 auth_method 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:40:32.189+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806e0ebb0 auth_method 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:40:32.189+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806e31be0 auth_method 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:40:32.190+0000 7fadc3f29640 10 monclient: get_auth_request con 0x561806e35f40 auth_method 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:40:32.191+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806e354c0 auth_method 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:40:32.192+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.537 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding auth protocol: cephx 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.538 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: crc 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3e160) adding con mode: secure 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:40:32.192+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command objecter_requests cmddesc objecter_requests hook 0x561806e41670 EEXIST 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:40:32.192+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding auth protocol: cephx 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.539 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: crc 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:40:32.192+0000 7fadc6c40800 5 AuthRegistry(0x561806e3d008) adding con mode: secure 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:40:32.192+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:40:32.193+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:40:32.193+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x561806e3d150 EEXIST 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806e65990 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806e65d70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.540 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e646a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.983150s 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e65990 auth_method 0 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806e65d70 auth_method 0 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.541 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:40:32.193+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient(hunting): handle_auth_done global_id 6974 payload 824 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:40:32.193+0000 7fadc3f29640 1 monclient: found mon.noname-c 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:40:32.193+0000 7fadc3f29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:40:32.193+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806e646a0 auth_method 0 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: dump: 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.542 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:40:32.543 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:40:32.193+0000 7faca9ffb640 10 monclient: dump: 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:40:32.193+0000 7fadc6c40800 5 monclient: authenticate success, global_id 6974 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.544 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:40:32.193+0000 7fadc572c640 4 set_mon_vals no callback set 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:40:32.193+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:40:32.195+0000 7faca9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:40:32.195+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fac9c077480 auth_method 0 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: get_monmap_and_config 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:40:32.195+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:40:32.195+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.545 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding auth protocol: cephx 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.546 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: crc 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:40:32.195+0000 7fadc6c40800 5 AuthRegistry(0x561806e851f0) adding con mode: secure 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.547 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding auth protocol: cephx 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.548 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: crc 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c180) adding con mode: secure 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:40:32.196+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:40:32.196+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdaf79c2c8 EEXIST 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e89300 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806eb3d70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806eb5120 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.549 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:40:32.196+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.986723s 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806eb5120 auth_method 0 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806eb3d70 auth_method 0 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.550 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:40:32.196+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e89300 auth_method 0 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:40:32.196+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:40:32.196+0000 7fadc472a640 10 monclient(hunting): handle_auth_done global_id 7509 payload 274 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:40:32.197+0000 7fadc472a640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:40:32.197+0000 7fadc472a640 1 monclient: found mon.noname-a 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:40:32.197+0000 7fadc472a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: dump: 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.551 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:40:32.197+0000 7fac9b7fe640 10 monclient: dump: 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.552 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:40:32.197+0000 7fadc6c40800 5 monclient: authenticate success, global_id 7509 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:40:32.197+0000 7fadc6c40800 10 monclient: get_monmap_and_config success 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:40:32.197+0000 7fadc6c40800 4 set_mon_vals no callback set 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:40:32.197+0000 7fadc6c40800 10 monclient: shutdown 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: build_initial_monmap 2024-09-22T08:40:32.553 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 build_initial for_mkfs: 0 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: monmap: 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.554 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding auth protocol: cephx 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: crc 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806ea9f20) adding con mode: secure 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: starting msgr at 2024-09-22T08:40:32.555 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: starting objecter 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command objecter_requests cmddesc objecter_requests hook 0x561806e67770 EEXIST 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: setting wanted keys 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:40:32.198+0000 7fadc6c40800 1 librados: calling monclient init 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: init 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding auth protocol: cephx 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.556 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: crc 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 AuthRegistry(0x561806e7a250) adding con mode: secure 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:40:32.198+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:40:32.198+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command rotate-key cmddesc rotate-key hook 0x561806e7a398 EEXIST 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: _reopen_session rank -1 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-a con 0x561806e89300 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-c con 0x561806eb5120 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): picked mon.noname-b con 0x561806e855e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.557 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): start opening mon connection 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): _renew_subs 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:40:32.198+0000 7fadc6c40800 10 monclient(hunting): authenticate will time out at 2147.988951s 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request con 0x561806eb5120 auth_method 0 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): get_auth_request con 0x561806e89300 auth_method 0 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.558 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): get_auth_request con 0x561806e855e0 auth_method 0 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:40:32.199+0000 7fadc3f29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:40:32.199+0000 7fadc472a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient(hunting): handle_auth_done global_id 6980 payload 824 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient: _finish_hunting 0 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 1 monclient: found mon.noname-c 2024-09-22T08:40:32.559 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:40:32.199+0000 7fadc4f2b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: dump: 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: _finish_auth 0 2024-09-22T08:40:32.560 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:40:32.199+0000 7fac99ffb640 10 monclient: dump: 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.561 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:40:32.199+0000 7fadc6c40800 5 monclient: authenticate success, global_id 6980 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:40:32.199+0000 7fac9b7fe640 4 set_mon_vals no callback set 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _renew_subs 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:40:32.199+0000 7fadc6c40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:40:32.199+0000 7fadc6c40800 1 librados: init done 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:40:32.199+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cr dump hook 0x561806ebcba8 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:40:32.201+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:40:32.201+0000 7fac99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:40:32.201+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fac8c0775a0 auth_method 0 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:40:32.202+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806ed4170 auth_method 0 2024-09-22T08:40:32.562 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 realm 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:40:32.202+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:40:32.202+0000 7fadc6c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:40:32.203+0000 7fadc3f29640 10 monclient: get_auth_request con 0x561806ed8380 auth_method 0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:40:32.203+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:40:32.204+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x561806edbbe0 auth_method 0 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:40:32.204+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:40:32.204+0000 7fadc6c40800 20 searching for the correct realm 2024-09-22T08:40:32.563 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:40:32.204+0000 7fadc472a640 10 monclient: get_auth_request con 0x561806ee09a0 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:40:32.205+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fadb401a040 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:40:32.206+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fadb80a2720 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:40:32.206+0000 7fadc4f2b640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fadb80a2720 msgr2=0x7fadb80a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:40:32.407+0000 7fadc4f2b640 10 monclient: get_auth_request con 0x7fadb80a2720 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:40:32.408+0000 7fadc472a640 10 monclient: get_auth_request con 0x7fadb4041a80 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:40:32.410+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fadbc03f070 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:40:32.411+0000 7fadc3f29640 0 -- 172.21.15.78:0/4051099953 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fadbc03f070 msgr2=0x7fadbc06bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:40:32.411+0000 7fac99ffb640 1 client.6980.objecter ms_handle_reset 0x7fadbc03f070 session 0x7fadbc015040 osd.3 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:40:32.411+0000 7fac99ffb640 10 monclient: _renew_subs 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:40:32.411+0000 7fac99ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:40:32.411+0000 7fadc3f29640 10 monclient: get_auth_request con 0x7fac8c0878c0 auth_method 0 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:32.564 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:40:32.415+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zone default found 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Realm: () 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:40:32.416+0000 7fadc6c40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:40:32.416+0000 7fadc6c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.565 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 zonegroup default 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:40:32.416+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started sync module instance, tier type = 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:40:32.417+0000 7fadc6c40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=0 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=1 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=2 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=3 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=4 2024-09-22T08:40:32.566 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=5 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:40:32.425+0000 7fadc6c40800 20 add_watcher() i=6 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:40:32.426+0000 7fadc6c40800 20 add_watcher() i=7 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:40:32.426+0000 7fadc6c40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding auth protocol: cephx 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.567 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: crc 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 AuthRegistry(0x7ffdaf79c650) adding con mode: secure 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:40:32.428+0000 7fac7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:40:32.428+0000 7fadc6c40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:40:32.428+0000 7fadc6c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache list hook 0x561806ebf150 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache inspect hook 0x561806ebf150 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache erase hook 0x561806ebf150 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command cache zap hook 0x561806ebf150 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:40:32.428+0000 7fadc6c40800 5 note: GC not initialized 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:40:32.429+0000 7fac79fdb640 20 reqs_thread_entry: start 2024-09-22T08:40:32.568 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace show hook 0x7fadb401f040 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace history hook 0x7fadb401f040 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace active hook 0x7fadb401f040 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:40:32.429+0000 7fadc6c40800 5 asok(0x561806bc40f0) register_command sync trace active_short hook 0x7fadb401f040 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 Filter name: none 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:40:32.429+0000 7fabeb7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:40:32.429+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : miss 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:40:32.429+0000 7fadc6c40800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.569 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:40:32.430+0000 7fadc6c40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:40:32.430+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:40:32.435+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562496 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:40:32.435+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.570 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:40:32.437+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:40:32.571 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:40:32.441+0000 7fadc6c40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:40:32.572 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:40:32.441+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:40:32.442+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:40:32.443+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:40:32.444+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:40:32.445+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:40:32.448+0000 7fadc6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:40:32.448+0000 7fadc6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.573 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:40:32.450+0000 7fadc6c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562497 cookie 94661195500496 notifier 6980 bl.length()=1015 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:40:32.450+0000 7fac9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:40:32.451+0000 7fadc6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:40:32.454+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:40:32.574 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:40:32.455+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:40:32.456+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:40:32.457+0000 7fadc6c40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:40:32.458+0000 7fadc6c40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fadc6c40800 time 2024-09-22T08:40:32.459655+0000 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fadca18c748] 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.575 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:40:32.459+0000 7fadc6c40800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fadc6c40800 thread_name:radosgw-admin 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fadc8e3e6f0] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fadc8e8b99c] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fadca18c7a2] 2024-09-22T08:40:32.576 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fadca18c906] 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561804914e01] 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x561804924fb7] 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fadc8e29590] 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:40:32.577 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:40:32.578 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:40:32.579 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:40:32.580 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:40:32.581 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:40:32.582 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 7fabeb7fe640 / http_manager 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac79fdb640 / http_manager 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac7afdd640 / rgw_dt_lg_renew 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac99ffb640 / ms_dispatch 2024-09-22T08:40:32.583 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac9affd640 / io_context_pool 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fac9b7fe640 / io_context_pool 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7faca9ffb640 / ms_dispatch 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7facb0e09640 / ms_dispatch 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7facb260c640 / io_context_pool 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc3f29640 / msgr-worker-2 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc472a640 / msgr-worker-1 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc4f2b640 / msgr-worker-0 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc572c640 / io_context_pool 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7fadc6c40800 / radosgw-admin 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:40:32.461035Z_d3610235-f7ac-4158-913f-1f7c999ffa8b/log 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:40:32.584 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:40:32.585 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:32.585 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:32.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.726+0000 7fba2a7ae640 0 --2- 172.21.15.78:0/515660326 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55b1fefec520 0x55b1fefefaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:40:32.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.734+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 realm 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.736+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.737+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.737+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.738+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:40:32.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.738+0000 7fba2eb22800 20 searching for the correct realm 2024-09-22T08:40:32.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.739+0000 7fba21fad640 0 -- 172.21.15.78:0/2974208443 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fba1c03b040 msgr2=0x7fba1c03b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:40:32.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.944+0000 7fba2a7ae640 0 -- 172.21.15.78:0/2974208443 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55b1ff0551c0 msgr2=0x55b1ff057660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.949+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:40:32.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 zone default found 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 4 Realm: () 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 zonegroup default 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.950+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.951+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.951+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.951+0000 7fba2eb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:40:32.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.951+0000 7fba2eb22800 20 started sync module instance, tier type = 2024-09-22T08:40:32.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.951+0000 7fba2eb22800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=0 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=1 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=2 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=3 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=4 2024-09-22T08:40:32.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=5 2024-09-22T08:40:32.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.960+0000 7fba2eb22800 20 add_watcher() i=6 2024-09-22T08:40:32.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.961+0000 7fba2eb22800 20 add_watcher() i=7 2024-09-22T08:40:32.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.961+0000 7fba2eb22800 2 all 8 watchers are set, enabling cache 2024-09-22T08:40:32.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.962+0000 7fb8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:40:32.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 5 note: GC not initialized 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fb85b7fe640 20 reqs_thread_entry: start 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 init_complete bucket index max shards: 11 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 Filter name: none 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fb8597fa640 20 reqs_thread_entry: start 2024-09-22T08:40:32.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.963+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.964+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:40:32.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.964+0000 7fba2eb22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:32.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.964+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.964+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:40:32.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.964+0000 7fba2eb22800 20 rados->read ofs=0 len=0 2024-09-22T08:40:32.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.965+0000 7fba2eb22800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:40:32.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.965+0000 7fba2eb22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:40:32.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.966+0000 7fb8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:40:32.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.969+0000 7fba2eb22800 20 remove_watcher() i=0 2024-09-22T08:40:32.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.969+0000 7fba2eb22800 2 removed watcher, disabling cache 2024-09-22T08:40:32.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.970+0000 7fba2eb22800 20 remove_watcher() i=1 2024-09-22T08:40:32.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.971+0000 7fba2eb22800 20 remove_watcher() i=2 2024-09-22T08:40:32.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.972+0000 7fba2eb22800 20 remove_watcher() i=3 2024-09-22T08:40:32.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.973+0000 7fba2eb22800 20 remove_watcher() i=4 2024-09-22T08:40:32.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.974+0000 7fba2eb22800 20 remove_watcher() i=5 2024-09-22T08:40:32.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.975+0000 7fba2eb22800 20 remove_watcher() i=6 2024-09-22T08:40:32.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:40:32.976+0000 7fba2eb22800 20 remove_watcher() i=7 2024-09-22T08:40:32.988 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:40:32.988 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:40:32.988 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:40:32.988 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:03.203 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:03.236 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:03.236 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:03.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.274+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 realm 2024-09-22T08:41:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.276+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.277+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.277+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.278+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.278+0000 7f011d339800 20 searching for the correct realm 2024-09-22T08:41:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.280+0000 7f01197c8640 0 -- 172.21.15.78:0/2277978342 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f0104046040 msgr2=0x7f0104037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:03.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.485+0000 7f0113fff640 0 -- 172.21.15.78:0/2277978342 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f011406a4d0 msgr2=0x7f0114068f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 zone default found 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 4 Realm: () 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.491+0000 7f011d339800 20 zonegroup default 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.492+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.492+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.492+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.492+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.492+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.493+0000 7f011d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.493+0000 7f011d339800 20 started sync module instance, tier type = 2024-09-22T08:41:03.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.493+0000 7f011d339800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:03.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=0 2024-09-22T08:41:03.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=1 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=2 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=3 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=4 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=5 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.502+0000 7f011d339800 20 add_watcher() i=6 2024-09-22T08:41:03.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.503+0000 7f011d339800 20 add_watcher() i=7 2024-09-22T08:41:03.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.503+0000 7f011d339800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:03.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.505+0000 7effcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 5 note: GC not initialized 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7effcdfe3640 20 reqs_thread_entry: start 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 20 Filter name: none 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7eff3f7fe640 20 reqs_thread_entry: start 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.506+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : miss 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.507+0000 7f011d339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:41:03.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7f011d339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7f011d339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7f011d339800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7f011d339800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:41:03.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7effeffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562499 cookie 94445901805904 notifier 7013 bl.length()=1015 2024-09-22T08:41:03.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7effeffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7effeffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.513+0000 7effeffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.515+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:41:03.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.515+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:41:03.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.515+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:41:03.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.515+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.0 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.1 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.2 2024-09-22T08:41:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.3 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.4 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.5 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.6 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.7 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.8 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.9 2024-09-22T08:41:03.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:41:03.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.10 2024-09-22T08:41:03.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:41:03.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1.11 2024-09-22T08:41:03.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.520+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.521+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.521+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.522+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.522+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.522+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:41:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.523+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:41:03.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.523+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:41:03.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.524+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:41:03.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.525+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:41:03.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.531+0000 7f011d339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:03.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.531+0000 7f011d339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7f011d339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7f011d339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7f011d339800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7f011d339800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7effef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562500 cookie 94445901805904 notifier 7013 bl.length()=1015 2024-09-22T08:41:03.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7effef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7effef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.532+0000 7effef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.533+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:41:03.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.533+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:41:03.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.533+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:41:03.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.533+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:41:03.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.536+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.0 2024-09-22T08:41:03.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.537+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.1 2024-09-22T08:41:03.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.537+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.2 2024-09-22T08:41:03.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.537+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.3 2024-09-22T08:41:03.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.537+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.4 2024-09-22T08:41:03.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.538+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.5 2024-09-22T08:41:03.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.538+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.6 2024-09-22T08:41:03.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.538+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.7 2024-09-22T08:41:03.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.539+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.8 2024-09-22T08:41:03.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.539+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.9 2024-09-22T08:41:03.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.539+0000 7f011d339800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33.10 2024-09-22T08:41:03.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.540+0000 7f011d339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:03.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.540+0000 7f011d339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 2024-09-22T08:41:03.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7f011d339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7f011d339800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7f011d339800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7f011d339800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33, ofs0, ns] 2024-09-22T08:41:03.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7effeffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562501 cookie 94445901805904 notifier 7013 bl.length()=983 2024-09-22T08:41:03.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7effeffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 info.flags=0x17 2024-09-22T08:41:03.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7effeffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 to cache LRU end 2024-09-22T08:41:03.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.541+0000 7effeffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:03.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.543+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_sources= new_sources= 2024-09-22T08:41:03.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.543+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential sources added=[] removed=[] 2024-09-22T08:41:03.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.543+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): orig_dests= new_dests= 2024-09-22T08:41:03.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.543+0000 7f011d339800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33]): potential dests added=[] removed=[] 2024-09-22T08:41:03.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.545+0000 7f011d339800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-22T08:41:03.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.547+0000 7effcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:03.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.550+0000 7f011d339800 20 remove_watcher() i=0 2024-09-22T08:41:03.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.550+0000 7f011d339800 2 removed watcher, disabling cache 2024-09-22T08:41:03.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.551+0000 7f011d339800 20 remove_watcher() i=1 2024-09-22T08:41:03.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.552+0000 7f011d339800 20 remove_watcher() i=2 2024-09-22T08:41:03.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.553+0000 7f011d339800 20 remove_watcher() i=3 2024-09-22T08:41:03.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.554+0000 7f011d339800 20 remove_watcher() i=4 2024-09-22T08:41:03.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.555+0000 7f011d339800 20 remove_watcher() i=5 2024-09-22T08:41:03.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.556+0000 7f011d339800 20 remove_watcher() i=6 2024-09-22T08:41:03.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.557+0000 7f011d339800 20 remove_watcher() i=7 2024-09-22T08:41:03.570 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T08:41:03.599 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:03.599 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.634+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 realm 2024-09-22T08:41:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.636+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.637+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.637+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.638+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:03.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.638+0000 7f873b896800 20 searching for the correct realm 2024-09-22T08:41:03.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.641+0000 7f8739b81640 0 -- 172.21.15.78:0/813264011 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f8724043040 msgr2=0x7f8724043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:03.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.644+0000 7f8738b7f640 0 -- 172.21.15.78:0/813264011 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f8734068f10 msgr2=0x7f87340679e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.648+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:03.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 zone default found 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 4 Realm: () 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 zonegroup default 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.649+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.650+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.650+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.650+0000 7f873b896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:03.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.650+0000 7f873b896800 20 started sync module instance, tier type = 2024-09-22T08:41:03.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.650+0000 7f873b896800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=0 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=1 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=2 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=3 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=4 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=5 2024-09-22T08:41:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.659+0000 7f873b896800 20 add_watcher() i=6 2024-09-22T08:41:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.660+0000 7f873b896800 20 add_watcher() i=7 2024-09-22T08:41:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.660+0000 7f873b896800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:03.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f85effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f873b896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f873b896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f873b896800 5 note: GC not initialized 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f85eefe5640 20 reqs_thread_entry: start 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f873b896800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f873b896800 20 Filter name: none 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.662+0000 7f85ecfe1640 20 reqs_thread_entry: start 2024-09-22T08:41:03.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.663+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.664+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:41:03.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.664+0000 7f873b896800 20 rados->read ofs=0 len=0 2024-09-22T08:41:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.664+0000 7f873b896800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:41:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.664+0000 7f873b896800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.666+0000 7f85effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.668+0000 7f873b896800 20 remove_watcher() i=0 2024-09-22T08:41:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.668+0000 7f873b896800 2 removed watcher, disabling cache 2024-09-22T08:41:03.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.669+0000 7f873b896800 20 remove_watcher() i=1 2024-09-22T08:41:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.670+0000 7f873b896800 20 remove_watcher() i=2 2024-09-22T08:41:03.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.671+0000 7f873b896800 20 remove_watcher() i=3 2024-09-22T08:41:03.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.672+0000 7f873b896800 20 remove_watcher() i=4 2024-09-22T08:41:03.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.673+0000 7f873b896800 20 remove_watcher() i=5 2024-09-22T08:41:03.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.674+0000 7f873b896800 20 remove_watcher() i=6 2024-09-22T08:41:03.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:03.675+0000 7f873b896800 20 remove_watcher() i=7 2024-09-22T08:41:03.686 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:03.686 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:03.686 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:41:03.686 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:04.050 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-22T08:41:04.050 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:04.901 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:41:04.929 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:04.929 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:04.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.964+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:04.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 realm 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.966+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:04.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.967+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:04.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.967+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:04.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.968+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:04.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.968+0000 7f408f52e800 20 searching for the correct realm 2024-09-22T08:41:04.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:04.970+0000 7f408bade640 0 -- 172.21.15.78:0/412560286 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f40740eb040 msgr2=0x7f40740a4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.175+0000 7f4083fff640 0 -- 172.21.15.78:0/412560286 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f408403b040 msgr2=0x7f4084022410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:05.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:05.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:05.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:05.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 zone default found 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 4 Realm: () 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 zonegroup default 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.180+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 started sync module instance, tier type = 2024-09-22T08:41:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.181+0000 7f408f52e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=0 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=1 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=2 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=3 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=4 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=5 2024-09-22T08:41:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.190+0000 7f408f52e800 20 add_watcher() i=6 2024-09-22T08:41:05.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.191+0000 7f408f52e800 20 add_watcher() i=7 2024-09-22T08:41:05.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.191+0000 7f408f52e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:05.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.192+0000 7f3f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:05.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:05.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 5 note: GC not initialized 2024-09-22T08:41:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f3f40fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 20 Filter name: none 2024-09-22T08:41:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f3eba7fc640 20 reqs_thread_entry: start 2024-09-22T08:41:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.193+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.194+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:05.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.194+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.194+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:05.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.194+0000 7f408f52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:05.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.195+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.195+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:05.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.195+0000 7f408f52e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.196+0000 7f408f52e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:05.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.196+0000 7f408f52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:05.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.197+0000 7f3f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.199+0000 7f408f52e800 20 remove_watcher() i=0 2024-09-22T08:41:05.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.199+0000 7f408f52e800 2 removed watcher, disabling cache 2024-09-22T08:41:05.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.200+0000 7f408f52e800 20 remove_watcher() i=1 2024-09-22T08:41:05.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.201+0000 7f408f52e800 20 remove_watcher() i=2 2024-09-22T08:41:05.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.202+0000 7f408f52e800 20 remove_watcher() i=3 2024-09-22T08:41:05.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.203+0000 7f408f52e800 20 remove_watcher() i=4 2024-09-22T08:41:05.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.204+0000 7f408f52e800 20 remove_watcher() i=5 2024-09-22T08:41:05.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.205+0000 7f408f52e800 20 remove_watcher() i=6 2024-09-22T08:41:05.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.206+0000 7f408f52e800 20 remove_watcher() i=7 2024-09-22T08:41:05.216 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:05.217 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:05.217 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:05.217 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:05.218 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-22T08:41:05.252 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:05.252 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.287+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 realm 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.289+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.290+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.290+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.291+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:05.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.291+0000 7f42f7412800 20 searching for the correct realm 2024-09-22T08:41:05.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.293+0000 7f42f32cc640 0 -- 172.21.15.78:0/4195540516 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f42dc098400 msgr2=0x7f42dc098840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:05.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.297+0000 7f42ea2ca640 0 -- 172.21.15.78:0/4195540516 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f42ec022020 msgr2=0x7f42ec081ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.301+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 zone default found 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 4 Realm: () 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 zonegroup default 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.302+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.303+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.303+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.303+0000 7f42f7412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.303+0000 7f42f7412800 20 started sync module instance, tier type = 2024-09-22T08:41:05.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.303+0000 7f42f7412800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:05.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=0 2024-09-22T08:41:05.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=1 2024-09-22T08:41:05.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=2 2024-09-22T08:41:05.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=3 2024-09-22T08:41:05.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=4 2024-09-22T08:41:05.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=5 2024-09-22T08:41:05.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.311+0000 7f42f7412800 20 add_watcher() i=6 2024-09-22T08:41:05.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.312+0000 7f42f7412800 20 add_watcher() i=7 2024-09-22T08:41:05.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.312+0000 7f42f7412800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:05.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.314+0000 7f41a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.314+0000 7f42f7412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.314+0000 7f42f7412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.314+0000 7f42f7412800 5 note: GC not initialized 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f41a8fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f42f7412800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:05.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f42f7412800 20 Filter name: none 2024-09-22T08:41:05.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f41a1ffb640 20 reqs_thread_entry: start 2024-09-22T08:41:05.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f42f7412800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T08:41:05.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.315+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 : miss 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.316+0000 7f42f7412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 2024-09-22T08:41:05.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f42f7412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:05.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f42f7412800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:05.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f42f7412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:05.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f42f7412800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34, ofs0, ns] 2024-09-22T08:41:05.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f41d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562505 cookie 93977880728320 notifier 7064 bl.length()=995 2024-09-22T08:41:05.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f41d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:05.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f41d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:05.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.321+0000 7f41d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:05.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.323+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_sources= new_sources= 2024-09-22T08:41:05.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.323+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential sources added=[] removed=[] 2024-09-22T08:41:05.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.323+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_dests= new_dests= 2024-09-22T08:41:05.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.323+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential dests added=[] removed=[] 2024-09-22T08:41:05.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.327+0000 7f42f7412800 -1 Injecting error=-5 at location=do_reshard 2024-09-22T08:41:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.333+0000 7f42f7412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.333+0000 7f42f7412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 2024-09-22T08:41:05.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.334+0000 7f42f7412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:05.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.334+0000 7f42f7412800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:05.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.334+0000 7f42f7412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.334+0000 7f42f7412800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34, ofs0, ns] 2024-09-22T08:41:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.335+0000 7f41d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562506 cookie 93977880728320 notifier 7064 bl.length()=963 2024-09-22T08:41:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.335+0000 7f41d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.335+0000 7f41d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.335+0000 7f41d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.336+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_sources= new_sources= 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.336+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential sources added=[] removed=[] 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.336+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_dests= new_dests= 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.336+0000 7f42f7412800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential dests added=[] removed=[] 2024-09-22T08:41:05.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.336+0000 7f42f7412800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-22T08:41:05.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.338+0000 7f41a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.340+0000 7f42f7412800 20 remove_watcher() i=0 2024-09-22T08:41:05.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.340+0000 7f42f7412800 2 removed watcher, disabling cache 2024-09-22T08:41:05.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.341+0000 7f42f7412800 20 remove_watcher() i=1 2024-09-22T08:41:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.342+0000 7f42f7412800 20 remove_watcher() i=2 2024-09-22T08:41:05.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.343+0000 7f42f7412800 20 remove_watcher() i=3 2024-09-22T08:41:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.344+0000 7f42f7412800 20 remove_watcher() i=4 2024-09-22T08:41:05.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.345+0000 7f42f7412800 20 remove_watcher() i=5 2024-09-22T08:41:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.346+0000 7f42f7412800 20 remove_watcher() i=6 2024-09-22T08:41:05.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.347+0000 7f42f7412800 20 remove_watcher() i=7 2024-09-22T08:41:05.360 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:41:05.390 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:05.390 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:05.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.608+0000 7f6e6eba3640 0 --2- 172.21.15.78:0/3809382723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557346841450 0x5573469b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:41:05.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.626+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.627+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.627+0000 7f6e710b9800 20 realm 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.627+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.628+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.629+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.629+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:05.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.629+0000 7f6e710b9800 20 searching for the correct realm 2024-09-22T08:41:05.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.631+0000 7f6e6e3a2640 0 -- 172.21.15.78:0/1382281379 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f6e60017040 msgr2=0x7f6e60032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:05.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.634+0000 7f6e6e3a2640 0 -- 172.21.15.78:0/1382281379 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x557346a7c120 msgr2=0x557346a7e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:05.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:05.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:05.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.639+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 zone default found 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 4 Realm: () 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 zonegroup default 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.640+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.641+0000 7f6e710b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.641+0000 7f6e710b9800 20 started sync module instance, tier type = 2024-09-22T08:41:05.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.641+0000 7f6e710b9800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=0 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=1 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=2 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=3 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=4 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=5 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.649+0000 7f6e710b9800 20 add_watcher() i=6 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.650+0000 7f6e710b9800 20 add_watcher() i=7 2024-09-22T08:41:05.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.650+0000 7f6e710b9800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:05.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6d257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6e710b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6e710b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6e710b9800 5 note: GC not initialized 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6c9ffff640 20 reqs_thread_entry: start 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6e710b9800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.652+0000 7f6e710b9800 20 Filter name: none 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.653+0000 7f6c9dffb640 20 reqs_thread_entry: start 2024-09-22T08:41:05.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.653+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.653+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.653+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.654+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.654+0000 7f6e710b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.654+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.654+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:05.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.654+0000 7f6e710b9800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.655+0000 7f6e710b9800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:05.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.655+0000 7f6e710b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:05.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.656+0000 7f6d257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:05.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.658+0000 7f6e710b9800 20 remove_watcher() i=0 2024-09-22T08:41:05.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.658+0000 7f6e710b9800 2 removed watcher, disabling cache 2024-09-22T08:41:05.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.659+0000 7f6e710b9800 20 remove_watcher() i=1 2024-09-22T08:41:05.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.660+0000 7f6e710b9800 20 remove_watcher() i=2 2024-09-22T08:41:05.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.661+0000 7f6e710b9800 20 remove_watcher() i=3 2024-09-22T08:41:05.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.662+0000 7f6e710b9800 20 remove_watcher() i=4 2024-09-22T08:41:05.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.663+0000 7f6e710b9800 20 remove_watcher() i=5 2024-09-22T08:41:05.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.664+0000 7f6e710b9800 20 remove_watcher() i=6 2024-09-22T08:41:05.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.665+0000 7f6e710b9800 20 remove_watcher() i=7 2024-09-22T08:41:05.676 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:05.676 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:05.676 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:05.677 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:05.768 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:05.799 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:05.799 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:05.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.836+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 realm 2024-09-22T08:41:05.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.838+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.839+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:05.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.839+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:05.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.839+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:05.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.839+0000 7f9f2b130800 20 searching for the correct realm 2024-09-22T08:41:05.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:05.840+0000 7f9f1e5bb640 0 -- 172.21.15.78:0/879860930 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f9f18061930 msgr2=0x7f9f18087410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:06.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.044+0000 7f9f26dbc640 0 -- 172.21.15.78:0/879860930 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x560c3eedf9a0 msgr2=0x560c3eee1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.049+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:06.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 zone default found 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 4 Realm: () 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 zonegroup default 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.050+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 started sync module instance, tier type = 2024-09-22T08:41:06.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.051+0000 7f9f2b130800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:06.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=0 2024-09-22T08:41:06.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=1 2024-09-22T08:41:06.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=2 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=3 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=4 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=5 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.061+0000 7f9f2b130800 20 add_watcher() i=6 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.062+0000 7f9f2b130800 20 add_watcher() i=7 2024-09-22T08:41:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.062+0000 7f9f2b130800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:06.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.064+0000 7f9ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.064+0000 7f9f2b130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.064+0000 7f9f2b130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.064+0000 7f9f2b130800 5 note: GC not initialized 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9d57fff640 20 reqs_thread_entry: start 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 20 Filter name: none 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9d55ffb640 20 reqs_thread_entry: start 2024-09-22T08:41:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T08:41:06.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:06.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T08:41:06.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 : miss 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.065+0000 7f9f2b130800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.066+0000 7f9f2b130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.070+0000 7f9f2b130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.070+0000 7f9f2b130800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.070+0000 7f9f2b130800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.070+0000 7f9f2b130800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34, ofs0, ns] 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.071+0000 7f9e09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562507 cookie 94610595388928 notifier 7647 bl.length()=995 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.071+0000 7f9e09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.071+0000 7f9e09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.071+0000 7f9e09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.072+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_sources= new_sources= 2024-09-22T08:41:06.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.072+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential sources added=[] removed=[] 2024-09-22T08:41:06.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.072+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_dests= new_dests= 2024-09-22T08:41:06.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.072+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential dests added=[] removed=[] 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.0 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.0 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.1 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.1 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.2 2024-09-22T08:41:06.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.2 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.3 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.3 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.4 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.4 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.5 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.5 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.6 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.6 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.7 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.7 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.8 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.8 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.9 2024-09-22T08:41:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.9 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.10 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.10 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.11 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1.11 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.0 2024-09-22T08:41:06.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.077+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.2 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.078+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.3 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.078+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.4 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.079+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.5 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.080+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.6 2024-09-22T08:41:06.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.080+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.7 2024-09-22T08:41:06.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.081+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.8 2024-09-22T08:41:06.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.081+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.9 2024-09-22T08:41:06.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.082+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.10 2024-09-22T08:41:06.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.085+0000 7f9f2b130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:06.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.085+0000 7f9f2b130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 2024-09-22T08:41:06.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9f2b130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9f2b130800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9f2b130800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9f2b130800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34, ofs0, ns] 2024-09-22T08:41:06.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9e0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562508 cookie 94610595388928 notifier 7647 bl.length()=995 2024-09-22T08:41:06.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9e0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9e0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.086+0000 7f9e0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.088+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_sources= new_sources= 2024-09-22T08:41:06.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.088+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential sources added=[] removed=[] 2024-09-22T08:41:06.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.088+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_dests= new_dests= 2024-09-22T08:41:06.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.088+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential dests added=[] removed=[] 2024-09-22T08:41:06.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.090+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.0 2024-09-22T08:41:06.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.090+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.1 2024-09-22T08:41:06.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.090+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.2 2024-09-22T08:41:06.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.091+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.3 2024-09-22T08:41:06.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.091+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.4 2024-09-22T08:41:06.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.091+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.5 2024-09-22T08:41:06.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.092+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.6 2024-09-22T08:41:06.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.092+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.7 2024-09-22T08:41:06.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.092+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.8 2024-09-22T08:41:06.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.093+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.9 2024-09-22T08:41:06.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.093+0000 7f9f2b130800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34.10 2024-09-22T08:41:06.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.093+0000 7f9f2b130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:06.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.093+0000 7f9f2b130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.094+0000 7f9f2b130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.094+0000 7f9f2b130800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.094+0000 7f9f2b130800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.094+0000 7f9f2b130800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34, ofs0, ns] 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.095+0000 7f9e09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562509 cookie 94610595388928 notifier 7647 bl.length()=963 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.095+0000 7f9e09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 info.flags=0x17 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.095+0000 7f9e09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 to cache LRU end 2024-09-22T08:41:06.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.095+0000 7f9e09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:06.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.096+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_sources= new_sources= 2024-09-22T08:41:06.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.096+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential sources added=[] removed=[] 2024-09-22T08:41:06.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.096+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): orig_dests= new_dests= 2024-09-22T08:41:06.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.096+0000 7f9f2b130800 20 handle_bi_update(): bucket=:error-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34]): potential dests added=[] removed=[] 2024-09-22T08:41:06.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.098+0000 7f9f2b130800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-22T08:41:06.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.100+0000 7f9ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:06.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.102+0000 7f9f2b130800 20 remove_watcher() i=0 2024-09-22T08:41:06.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.102+0000 7f9f2b130800 2 removed watcher, disabling cache 2024-09-22T08:41:06.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.104+0000 7f9f2b130800 20 remove_watcher() i=1 2024-09-22T08:41:06.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.105+0000 7f9f2b130800 20 remove_watcher() i=2 2024-09-22T08:41:06.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.106+0000 7f9f2b130800 20 remove_watcher() i=3 2024-09-22T08:41:06.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.108+0000 7f9f2b130800 20 remove_watcher() i=4 2024-09-22T08:41:06.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.109+0000 7f9f2b130800 20 remove_watcher() i=5 2024-09-22T08:41:06.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.109+0000 7f9f2b130800 20 remove_watcher() i=6 2024-09-22T08:41:06.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.110+0000 7f9f2b130800 20 remove_watcher() i=7 2024-09-22T08:41:06.123 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T08:41:06.152 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:06.152 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:06.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.187+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 realm 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.189+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.190+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:06.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.190+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.191+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:06.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.191+0000 7fc7fa723800 20 searching for the correct realm 2024-09-22T08:41:06.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.193+0000 7fc7f6b34640 0 -- 172.21.15.78:0/809062149 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fc7ec02c040 msgr2=0x7fc7ec04f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:06.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.397+0000 7fc7f5b32640 0 -- 172.21.15.78:0/809062149 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc7f0085040 msgr2=0x7fc7f0043270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.402+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:06.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 zone default found 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 4 Realm: () 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 zonegroup default 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.403+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.404+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.404+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.404+0000 7fc7fa723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:06.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.404+0000 7fc7fa723800 20 started sync module instance, tier type = 2024-09-22T08:41:06.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.404+0000 7fc7fa723800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:06.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=0 2024-09-22T08:41:06.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=1 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=2 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=3 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=4 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=5 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.413+0000 7fc7fa723800 20 add_watcher() i=6 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.414+0000 7fc7fa723800 20 add_watcher() i=7 2024-09-22T08:41:06.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.414+0000 7fc7fa723800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:06.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.415+0000 7fc6acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:06.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:06.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 5 note: GC not initialized 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc6277fe640 20 reqs_thread_entry: start 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 20 Filter name: none 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc6257fa640 20 reqs_thread_entry: start 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.416+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.417+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:06.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.417+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.417+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 rados->read ofs=0 len=0 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:06.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.418+0000 7fc7fa723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:06.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.420+0000 7fc6acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:06.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.422+0000 7fc7fa723800 20 remove_watcher() i=0 2024-09-22T08:41:06.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.422+0000 7fc7fa723800 2 removed watcher, disabling cache 2024-09-22T08:41:06.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.423+0000 7fc7fa723800 20 remove_watcher() i=1 2024-09-22T08:41:06.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.424+0000 7fc7fa723800 20 remove_watcher() i=2 2024-09-22T08:41:06.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.425+0000 7fc7fa723800 20 remove_watcher() i=3 2024-09-22T08:41:06.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.426+0000 7fc7fa723800 20 remove_watcher() i=4 2024-09-22T08:41:06.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.427+0000 7fc7fa723800 20 remove_watcher() i=5 2024-09-22T08:41:06.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.428+0000 7fc7fa723800 20 remove_watcher() i=6 2024-09-22T08:41:06.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:06.429+0000 7fc7fa723800 20 remove_watcher() i=7 2024-09-22T08:41:06.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:41:06.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:06.810 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-22T08:41:06.810 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:07.625 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:41:07.652 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:07.653 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:07.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.689+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:07.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:07.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 realm 2024-09-22T08:41:07.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:07.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.691+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.692+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:07.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.692+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:07.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.692+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:07.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.693+0000 7f1040d2c800 20 searching for the correct realm 2024-09-22T08:41:07.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:07.695+0000 7f103d146640 0 -- 172.21.15.78:0/2622397677 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f10240789a0 msgr2=0x7f102400bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.302+0000 7f103c144640 0 -- 172.21.15.78:0/2622397677 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f1034061040 msgr2=0x7f10340cc1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:08.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.510+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 zone default found 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 4 Realm: () 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 zonegroup default 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.511+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.512+0000 7f1040d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.512+0000 7f1040d2c800 20 started sync module instance, tier type = 2024-09-22T08:41:08.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.512+0000 7f1040d2c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=0 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=1 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=2 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=3 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=4 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=5 2024-09-22T08:41:08.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.523+0000 7f1040d2c800 20 add_watcher() i=6 2024-09-22T08:41:08.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.524+0000 7f1040d2c800 20 add_watcher() i=7 2024-09-22T08:41:08.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.524+0000 7f1040d2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:08.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.526+0000 7f0ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:08.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:08.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:08.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 5 note: GC not initialized 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f0ef1fe3640 20 reqs_thread_entry: start 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 20 Filter name: none 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f0e637fe640 20 reqs_thread_entry: start 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.527+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.528+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:08.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.528+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.529+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:08.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.529+0000 7f1040d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:08.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.529+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.530+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:08.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.530+0000 7f1040d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.530+0000 7f1040d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:08.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.530+0000 7f1040d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:08.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.532+0000 7f0ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:08.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.536+0000 7f1040d2c800 20 remove_watcher() i=0 2024-09-22T08:41:08.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.536+0000 7f1040d2c800 2 removed watcher, disabling cache 2024-09-22T08:41:08.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.537+0000 7f1040d2c800 20 remove_watcher() i=1 2024-09-22T08:41:08.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.538+0000 7f1040d2c800 20 remove_watcher() i=2 2024-09-22T08:41:08.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.539+0000 7f1040d2c800 20 remove_watcher() i=3 2024-09-22T08:41:08.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.540+0000 7f1040d2c800 20 remove_watcher() i=4 2024-09-22T08:41:08.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.541+0000 7f1040d2c800 20 remove_watcher() i=5 2024-09-22T08:41:08.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.542+0000 7f1040d2c800 20 remove_watcher() i=6 2024-09-22T08:41:08.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.544+0000 7f1040d2c800 20 remove_watcher() i=7 2024-09-22T08:41:08.556 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.556 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:08.556 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:08.556 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.558 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:41:08.594 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:08.594 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:08.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.632+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 realm 2024-09-22T08:41:08.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:08.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.636+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:08.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.636+0000 7fdc1700e800 20 searching for the correct realm 2024-09-22T08:41:08.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.637+0000 7fdc11e58640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fdc040e7c20 msgr2=0x7fdc040a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.843+0000 7fdc12e5a640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55d9cec4d0f0 msgr2=0x55d9cec4f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:08.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:08.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:08.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:08.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:08.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:08.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zone default found 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Realm: () 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zonegroup default 2024-09-22T08:41:08.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.851+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started sync module instance, tier type = 2024-09-22T08:41:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=0 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=1 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=2 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=3 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=4 2024-09-22T08:41:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=5 2024-09-22T08:41:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=6 2024-09-22T08:41:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.861+0000 7fdc1700e800 20 add_watcher() i=7 2024-09-22T08:41:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.861+0000 7fdc1700e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:08.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fdac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fdc1700e800 5 note: GC not initialized 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fda437fe640 20 reqs_thread_entry: start 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.863+0000 7fdc1700e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 20 Filter name: none 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fda417fa640 20 reqs_thread_entry: start 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:41:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : miss 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.865+0000 7fdc1700e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdc1700e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdc1700e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94393965276176 notifier 7142 bl.length()=995 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:08.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:08.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:08.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:08.879 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdc1700e800 time 2024-09-22T08:41:08.878882+0000 2024-09-22T08:41:08.879 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:08.879 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.879 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdc1818c748] 2024-09-22T08:41:08.879 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdc1700e800 thread_name:radosgw-admin 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.878+0000 7fdc1700e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdc1700e800 time 2024-09-22T08:41:08.878882+0000 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdc1818c748] 2024-09-22T08:41:08.880 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:41:08.881 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdc16e3e6f0] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdc16e8b99c] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdc1818c7a2] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.897 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.879+0000 7fdc1700e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdc1700e800 thread_name:radosgw-admin 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdc16e3e6f0] 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdc16e8b99c] 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdc1818c7a2] 2024-09-22T08:41:08.898 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:41:08.614+0000 7fdc1700e800 1 librados: starting objecter 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests hook 0x55d9ceb6a470 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:41:08.615+0000 7fdc1700e800 1 librados: setting wanted keys 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:41:08.615+0000 7fdc1700e800 1 librados: calling monclient init 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.899 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.900 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:41:08.615+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:41:08.615+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key hook 0x55d9ceb66578 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cea11750 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9ceaa8600 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9ceaae8d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.404687s 2024-09-22T08:41:08.901 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9ceaae8d0 auth_method 0 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cea11750 auth_method 0 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.902 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9ceaa8600 auth_method 0 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:41:08.616+0000 7fdc12659640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:08.903 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: dump: 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.904 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: dump: 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:41:08.616+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7695 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.905 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:41:08.616+0000 7fdb00608640 4 set_mon_vals no callback set 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:41:08.616+0000 7fdc1700e800 1 librados: init done 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:41:08.618+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdaf8077570 auth_method 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:41:08.618+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebae780 auth_method 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:41:08.619+0000 7fdc12659640 10 monclient: get_auth_request con 0x55d9cebb1960 auth_method 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:41:08.620+0000 7fdc11e58640 10 monclient: get_auth_request con 0x55d9cebb5be0 auth_method 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:41:08.621+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebb51c0 auth_method 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:41:08.622+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.906 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.907 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:41:08.622+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d9cebc11b0 EEXIST 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.908 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.909 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:41:08.622+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:41:08.623+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:41:08.623+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x55d9cebbce40 EEXIST 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cebe54d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cebe58b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cebe41e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.412208s 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cebe58b0 auth_method 0 2024-09-22T08:41:08.910 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cebe54d0 auth_method 0 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cebe41e0 auth_method 0 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.911 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_done global_id 7698 payload 824 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: ms_handle_reset current mon [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-a con 0x7fdaec001d90 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-b con 0x55d9cebe41e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.912 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-c con 0x55d9cebe54d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x7fdaec001d90 auth_method 0 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cebe54d0 auth_method 0 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.913 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_done global_id 7698 payload 293 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:41:08.624+0000 7fdc11e58640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: dump: 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.914 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: dump: 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.915 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:41:08.624+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7698 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:41:08.624+0000 7fdc1365b640 4 set_mon_vals no callback set 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.916 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:41:08.626+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebe58b0 auth_method 0 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: get_monmap_and_config 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:41:08.626+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.917 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.918 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.919 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe1bbcc6f8 EEXIST 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cec027c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cec2d230 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cec2e5e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.920 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.416663s 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cec027c0 auth_method 0 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cec2d230 auth_method 0 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.921 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_done global_id 7139 payload 274 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:41:08.627+0000 7fdc11e58640 1 monclient: found mon.noname-c 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: dump: 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.922 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7139 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: dump: 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.923 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: get_monmap_and_config success 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:41:08.628+0000 7fdc1700e800 4 set_mon_vals no callback set 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: shutdown 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:41:08.628+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.925 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: starting msgr at 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: starting objecter 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d9cebe84c0 EEXIST 2024-09-22T08:41:08.926 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: setting wanted keys 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: calling monclient init 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.927 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x55d9cebf9ed8 EEXIST 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cec027c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cec2e5e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cec207b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.928 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.418891s 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cec207b0 auth_method 0 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cec2e5e0 auth_method 0 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.929 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cec027c0 auth_method 0 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_done global_id 7142 payload 824 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:41:08.630+0000 7fdc12659640 1 monclient: found mon.noname-c 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: dump: 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.930 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: dump: 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.931 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:41:08.630+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7142 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:41:08.630+0000 7fdaf5ffb640 4 set_mon_vals no callback set 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:41:08.630+0000 7fdc1700e800 1 librados: init done 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:41:08.630+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cr dump hook 0x55d9cec03d48 2024-09-22T08:41:08.932 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:41:08.632+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:41:08.633+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdadc077570 auth_method 0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:41:08.633+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cec4d0f0 auth_method 0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 realm 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:41:08.634+0000 7fdc1700e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:41:08.634+0000 7fdc11e58640 10 monclient: get_auth_request con 0x55d9cec51300 auth_method 0 2024-09-22T08:41:08.933 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:41:08.635+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cec54b60 auth_method 0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:41:08.636+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:41:08.636+0000 7fdc1700e800 20 searching for the correct realm 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:41:08.636+0000 7fdc12659640 10 monclient: get_auth_request con 0x55d9cec59860 auth_method 0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:41:08.637+0000 7fdc11e58640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fdc040e7c20 msgr2=0x7fdc040a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:41:08.838+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdc040e7c20 auth_method 0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:41:08.840+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x7fdbfc088ad0 auth_method 0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:41:08.841+0000 7fdc12659640 10 monclient: get_auth_request con 0x7fdc040022d0 auth_method 0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:41:08.843+0000 7fdc12e5a640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55d9cec4d0f0 msgr2=0x55d9cec4f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:41:08.843+0000 7fdae3fff640 1 client.7142.objecter ms_handle_reset 0x55d9cec4d0f0 session 0x55d9cec4ca70 osd.6 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:41:08.843+0000 7fdae3fff640 10 monclient: _renew_subs 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:41:08.843+0000 7fdae3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.934 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:41:08.843+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x7fdadc0878f0 auth_method 0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:41:08.844+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdc0c041960 auth_method 0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zone default found 2024-09-22T08:41:08.935 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Realm: () 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:41:08.850+0000 7fdc1700e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zonegroup default 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started sync module instance, tier type = 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=0 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=1 2024-09-22T08:41:08.936 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=2 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=3 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=4 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=5 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=6 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:41:08.861+0000 7fdc1700e800 20 add_watcher() i=7 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:41:08.861+0000 7fdc1700e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.937 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:41:08.863+0000 7fdac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:41:08.863+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache list hook 0x55d9cec20020 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache inspect hook 0x55d9cec20020 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache erase hook 0x55d9cec20020 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache zap hook 0x55d9cec20020 2024-09-22T08:41:08.938 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 note: GC not initialized 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:41:08.863+0000 7fda437fe640 20 reqs_thread_entry: start 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace show hook 0x7fdc0c00d470 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace history hook 0x7fdc0c00d470 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace active hook 0x7fdc0c00d470 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace active_short hook 0x7fdc0c00d470 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 Filter name: none 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:41:08.864+0000 7fda417fa640 20 reqs_thread_entry: start 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:41:08.939 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : miss 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:41:08.865+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94393965276176 notifier 7142 bl.length()=995 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.940 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:41:08.878+0000 7fdc1700e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdc1700e800 time 2024-09-22T08:41:08.878882+0000 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdc1818c748] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:41:08.941 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:41:08.879+0000 7fdc1700e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdc1700e800 thread_name:radosgw-admin 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdc16e3e6f0] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdc16e8b99c] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdc1818c7a2] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.942 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:41:08.943 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:41:08.944 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:41:08.945 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:41:08.946 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:41:08.947 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:41:08.948 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fda417fa640 / http_manager 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fda437fe640 / http_manager 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdac8fe1640 / rgw_dt_lg_renew 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdae3fff640 / ms_dispatch 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf57fa640 / io_context_pool 2024-09-22T08:41:08.949 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf5ffb640 / io_context_pool 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf7fff640 / ms_dispatch 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdafee05640 / ms_dispatch 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdb00608640 / io_context_pool 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc11e58640 / msgr-worker-2 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc12659640 / msgr-worker-1 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc12e5a640 / msgr-worker-0 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc1365b640 / io_context_pool 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc1700e800 / radosgw-admin 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.129872.log 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:41:08.614+0000 7fdc1700e800 1 librados: starting objecter 2024-09-22T08:41:08.950 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests hook 0x55d9ceb6a470 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:41:08.615+0000 7fdc1700e800 1 librados: setting wanted keys 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:41:08.615+0000 7fdc1700e800 1 librados: calling monclient init 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding auth protocol: cephx 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.951 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: crc 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 AuthRegistry(0x55d9ceb66430) adding con mode: secure 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:41:08.615+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:41:08.615+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:41:08.615+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key hook 0x55d9ceb66578 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cea11750 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9ceaa8600 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9ceaae8d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.952 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:41:08.615+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.404687s 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9ceaae8d0 auth_method 0 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cea11750 auth_method 0 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:41:08.615+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:41:08.615+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.953 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9ceaa8600 auth_method 0 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:41:08.615+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:41:08.616+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:41:08.616+0000 7fdc12659640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:41:08.616+0000 7fdc12659640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: dump: 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.954 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:41:08.616+0000 7fdafee05640 10 monclient: dump: 2024-09-22T08:41:08.955 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:41:08.616+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7695 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:41:08.616+0000 7fdb00608640 4 set_mon_vals no callback set 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.956 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:41:08.616+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:41:08.616+0000 7fdc1700e800 1 librados: init done 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:41:08.618+0000 7fdafee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:41:08.618+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdaf8077570 auth_method 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:41:08.618+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebae780 auth_method 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:41:08.619+0000 7fdc12659640 10 monclient: get_auth_request con 0x55d9cebb1960 auth_method 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:41:08.620+0000 7fdc11e58640 10 monclient: get_auth_request con 0x55d9cebb5be0 auth_method 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:41:08.621+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebb51c0 auth_method 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:41:08.622+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.957 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding auth protocol: cephx 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.958 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: crc 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbdd20) adding con mode: secure 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:41:08.622+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d9cebc11b0 EEXIST 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:41:08.622+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding auth protocol: cephx 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.959 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: crc 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:41:08.622+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebbccf8) adding con mode: secure 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:41:08.622+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:41:08.623+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:41:08.623+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x55d9cebbce40 EEXIST 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.960 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cebe54d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cebe58b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cebe41e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:41:08.623+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.412208s 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cebe58b0 auth_method 0 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cebe54d0 auth_method 0 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.961 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cebe41e0 auth_method 0 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.962 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_done global_id 7698 payload 824 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:41:08.623+0000 7fdc12e5a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: ms_handle_reset current mon [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-a con 0x7fdaec001d90 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-b con 0x55d9cebe41e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): picked mon.noname-c con 0x55d9cebe54d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:41:08.623+0000 7fdaf7fff640 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x7fdaec001d90 auth_method 0 2024-09-22T08:41:08.963 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:41:08.623+0000 7fdc11e58640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cebe54d0 auth_method 0 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:41:08.623+0000 7fdc12659640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:41:08.624+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient(hunting): handle_auth_done global_id 7698 payload 293 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.964 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:41:08.624+0000 7fdc11e58640 1 monclient: found mon.noname-a 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:41:08.624+0000 7fdc11e58640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: dump: 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.965 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:41:08.624+0000 7fdaf7fff640 10 monclient: dump: 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.966 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:41:08.624+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7698 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:41:08.624+0000 7fdc1365b640 4 set_mon_vals no callback set 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:41:08.624+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:41:08.626+0000 7fdaf7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:41:08.626+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cebe58b0 auth_method 0 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: get_monmap_and_config 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:41:08.626+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:41:08.626+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.967 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding auth protocol: cephx 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.968 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: crc 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:41:08.626+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebfe710) adding con mode: secure 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding auth protocol: cephx 2024-09-22T08:41:08.969 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: crc 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcc5b0) adding con mode: secure 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:41:08.627+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:41:08.627+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe1bbcc6f8 EEXIST 2024-09-22T08:41:08.970 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cec027c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cec2d230 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cec2e5e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:41:08.627+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.416663s 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cec027c0 auth_method 0 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cec2d230 auth_method 0 2024-09-22T08:41:08.971 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:41:08.627+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient(hunting): handle_auth_done global_id 7139 payload 274 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:41:08.627+0000 7fdc11e58640 1 monclient: found mon.noname-c 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:41:08.627+0000 7fdc11e58640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:08.972 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: dump: 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7139 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.973 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:41:08.628+0000 7fdaf5ffb640 10 monclient: dump: 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: get_monmap_and_config success 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:41:08.628+0000 7fdc1700e800 4 set_mon_vals no callback set 2024-09-22T08:41:08.974 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: shutdown 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: build_initial_monmap 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:41:08.628+0000 7fdc1700e800 1 build_initial for_mkfs: 0 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:41:08.628+0000 7fdc1700e800 10 monclient: monmap: 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.975 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding auth protocol: cephx 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: crc 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:41:08.628+0000 7fdc1700e800 5 AuthRegistry(0x55d9cec25230) adding con mode: secure 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.976 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: starting msgr at 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: starting objecter 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command objecter_requests cmddesc objecter_requests hook 0x55d9cebe84c0 EEXIST 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: setting wanted keys 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:41:08.629+0000 7fdc1700e800 1 librados: calling monclient init 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: init 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding auth protocol: cephx 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.977 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: crc 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 AuthRegistry(0x55d9cebf9d90) adding con mode: secure 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:41:08.629+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:41:08.629+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command rotate-key cmddesc rotate-key hook 0x55d9cebf9ed8 EEXIST 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-b con 0x55d9cec027c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-a con 0x55d9cec2e5e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): picked mon.noname-c con 0x55d9cec207b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.978 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:41:08.629+0000 7fdc1700e800 10 monclient(hunting): authenticate will time out at 2184.418891s 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): get_auth_request con 0x55d9cec207b0 auth_method 0 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request con 0x55d9cec2e5e0 auth_method 0 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.979 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:41:08.630+0000 7fdc12e5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): get_auth_request con 0x55d9cec027c0 auth_method 0 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:41:08.630+0000 7fdc11e58640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient(hunting): handle_auth_done global_id 7142 payload 824 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient: _finish_hunting 0 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:41:08.630+0000 7fdc12659640 1 monclient: found mon.noname-c 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:41:08.630+0000 7fdc12659640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:08.980 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: dump: 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: _finish_auth 0 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:08.981 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:41:08.630+0000 7fdae3fff640 10 monclient: dump: 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:41:08.630+0000 7fdc1700e800 5 monclient: authenticate success, global_id 7142 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:41:08.630+0000 7fdaf5ffb640 4 set_mon_vals no callback set 2024-09-22T08:41:08.982 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _renew_subs 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:41:08.630+0000 7fdc1700e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:41:08.630+0000 7fdc1700e800 1 librados: init done 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:41:08.630+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cr dump hook 0x55d9cec03d48 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:41:08.632+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:41:08.632+0000 7fdae3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:41:08.633+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdadc077570 auth_method 0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:41:08.633+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cec4d0f0 auth_method 0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 realm 2024-09-22T08:41:08.983 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:41:08.634+0000 7fdc1700e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:41:08.634+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:41:08.634+0000 7fdc11e58640 10 monclient: get_auth_request con 0x55d9cec51300 auth_method 0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:41:08.635+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:41:08.635+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x55d9cec54b60 auth_method 0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:41:08.636+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:41:08.636+0000 7fdc1700e800 20 searching for the correct realm 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:41:08.636+0000 7fdc12659640 10 monclient: get_auth_request con 0x55d9cec59860 auth_method 0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:41:08.637+0000 7fdc11e58640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fdc040e7c20 msgr2=0x7fdc040a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:41:08.838+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdc040e7c20 auth_method 0 2024-09-22T08:41:08.984 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:41:08.840+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x7fdbfc088ad0 auth_method 0 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:41:08.841+0000 7fdc12659640 10 monclient: get_auth_request con 0x7fdc040022d0 auth_method 0 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:41:08.843+0000 7fdc12e5a640 0 -- 172.21.15.78:0/845230943 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55d9cec4d0f0 msgr2=0x55d9cec4f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:41:08.843+0000 7fdae3fff640 1 client.7142.objecter ms_handle_reset 0x55d9cec4d0f0 session 0x55d9cec4ca70 osd.6 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:41:08.843+0000 7fdae3fff640 10 monclient: _renew_subs 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:41:08.843+0000 7fdae3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:41:08.843+0000 7fdc12e5a640 10 monclient: get_auth_request con 0x7fdadc0878f0 auth_method 0 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:41:08.844+0000 7fdc11e58640 10 monclient: get_auth_request con 0x7fdc0c041960 auth_method 0 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:08.985 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:41:08.849+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zone default found 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Realm: () 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:41:08.850+0000 7fdc1700e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:41:08.850+0000 7fdc1700e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 zonegroup default 2024-09-22T08:41:08.986 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:41:08.850+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started sync module instance, tier type = 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:41:08.851+0000 7fdc1700e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=0 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=1 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=2 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=3 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=4 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=5 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:41:08.860+0000 7fdc1700e800 20 add_watcher() i=6 2024-09-22T08:41:08.987 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:41:08.861+0000 7fdc1700e800 20 add_watcher() i=7 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:41:08.861+0000 7fdc1700e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding auth protocol: cephx 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.988 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: crc 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 AuthRegistry(0x7ffe1bbcca80) adding con mode: secure 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:41:08.863+0000 7fdac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:41:08.863+0000 7fdc1700e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache list hook 0x55d9cec20020 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache inspect hook 0x55d9cec20020 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache erase hook 0x55d9cec20020 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command cache zap hook 0x55d9cec20020 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 note: GC not initialized 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:41:08.863+0000 7fda437fe640 20 reqs_thread_entry: start 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace show hook 0x7fdc0c00d470 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace history hook 0x7fdc0c00d470 2024-09-22T08:41:08.989 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace active hook 0x7fdc0c00d470 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:41:08.863+0000 7fdc1700e800 5 asok(0x55d9ce9440f0) register_command sync trace active_short hook 0x7fdc0c00d470 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:41:08.863+0000 7fdc1700e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 Filter name: none 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:41:08.864+0000 7fda417fa640 20 reqs_thread_entry: start 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:41:08.864+0000 7fdc1700e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : miss 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:41:08.864+0000 7fdc1700e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:41:08.865+0000 7fdc1700e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.990 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:41:08.865+0000 7fdc1700e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:41:08.871+0000 7fdc1700e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94393965276176 notifier 7142 bl.length()=995 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:41:08.871+0000 7fdaf57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:08.991 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:41:08.873+0000 7fdc1700e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:41:08.878+0000 7fdc1700e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdc1700e800 time 2024-09-22T08:41:08.878882+0000 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdc1818c748] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.992 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:41:08.879+0000 7fdc1700e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdc1700e800 thread_name:radosgw-admin 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdc16e3e6f0] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdc16e8b99c] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdc1818c7a2] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdc1818c906] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d9cd057e01] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d9cd067d0a] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdc16e29590] 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:41:08.993 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:41:08.994 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:41:08.995 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:41:08.996 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:41:08.997 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:41:08.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:41:08.999 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fda417fa640 / http_manager 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fda437fe640 / http_manager 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdac8fe1640 / rgw_dt_lg_renew 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdae3fff640 / ms_dispatch 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf57fa640 / io_context_pool 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf5ffb640 / io_context_pool 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdaf7fff640 / ms_dispatch 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdafee05640 / ms_dispatch 2024-09-22T08:41:09.000 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdb00608640 / io_context_pool 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc11e58640 / msgr-worker-2 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc12659640 / msgr-worker-1 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc12e5a640 / msgr-worker-0 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc1365b640 / io_context_pool 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdc1700e800 / radosgw-admin 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:41:08.880276Z_22f28501-d1ed-4a06-9743-a58a9e9cc401/log 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:41:09.001 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:41:09.005 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.954+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 realm 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.956+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.957+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.957+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.958+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.958+0000 7f2488125800 20 searching for the correct realm 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.960+0000 7f2484534640 0 -- 172.21.15.78:0/2342763501 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2478024040 msgr2=0x7f2478067740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.964+0000 7f2483532640 0 -- 172.21.15.78:0/2342763501 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f247c06c060 msgr2=0x7f247c0a3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.969+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 zone default found 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 4 Realm: () 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 zonegroup default 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.970+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.971+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.971+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.971+0000 7f2488125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.971+0000 7f2488125800 20 started sync module instance, tier type = 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.971+0000 7f2488125800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:09.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=0 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=1 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=2 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=3 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=4 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=5 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.980+0000 7f2488125800 20 add_watcher() i=6 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.981+0000 7f2488125800 20 add_watcher() i=7 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.981+0000 7f2488125800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.982+0000 7f2339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.982+0000 7f2488125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.982+0000 7f2488125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 5 note: GC not initialized 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2338fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:09.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 20 Filter name: none 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f22b27fc640 20 reqs_thread_entry: start 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.983+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.984+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.984+0000 7f2488125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.984+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.984+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.984+0000 7f2488125800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.985+0000 7f2488125800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.985+0000 7f2488125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.986+0000 7f2339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.988+0000 7f2488125800 20 remove_watcher() i=0 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.988+0000 7f2488125800 2 removed watcher, disabling cache 2024-09-22T08:41:09.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.989+0000 7f2488125800 20 remove_watcher() i=1 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.990+0000 7f2488125800 20 remove_watcher() i=2 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.991+0000 7f2488125800 20 remove_watcher() i=3 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.992+0000 7f2488125800 20 remove_watcher() i=4 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.993+0000 7f2488125800 20 remove_watcher() i=5 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.994+0000 7f2488125800 20 remove_watcher() i=6 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:08.995+0000 7f2488125800 20 remove_watcher() i=7 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:09.011 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:09.097 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:09.127 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:09.128 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:09.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.164+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 realm 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.166+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.167+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:09.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.167+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.168+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:09.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.168+0000 7fb9d9b23800 20 searching for the correct realm 2024-09-22T08:41:09.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.171+0000 7fb9d580c640 0 -- 172.21.15.78:0/128410383 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fb9c8015070 msgr2=0x7fb9c8015a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:09.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.377+0000 7fb9d580c640 0 -- 172.21.15.78:0/128410383 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55f2474259a0 msgr2=0x55f247427e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:09.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.380+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:09.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 zone default found 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 4 Realm: () 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:09.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 zonegroup default 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.381+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.382+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.382+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.382+0000 7fb9d9b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.382+0000 7fb9d9b23800 20 started sync module instance, tier type = 2024-09-22T08:41:09.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.382+0000 7fb9d9b23800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=0 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=1 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=2 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=3 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=4 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=5 2024-09-22T08:41:09.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=6 2024-09-22T08:41:09.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.391+0000 7fb9d9b23800 20 add_watcher() i=7 2024-09-22T08:41:09.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.392+0000 7fb9d9b23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:09.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.393+0000 7fb8877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.393+0000 7fb9d9b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.393+0000 7fb9d9b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 5 note: GC not initialized 2024-09-22T08:41:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb8867fc640 20 reqs_thread_entry: start 2024-09-22T08:41:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:09.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 20 Filter name: none 2024-09-22T08:41:09.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb7f7fff640 20 reqs_thread_entry: start 2024-09-22T08:41:09.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:41:09.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : miss 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.394+0000 7fb9d9b23800 20 rados->read ofs=0 len=0 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:09.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.395+0000 7fb9d9b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:09.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.396+0000 7fb9d9b23800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to be held by another RGW process; skipping for now 2024-09-22T08:41:09.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.397+0000 7fb8877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:09.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.399+0000 7fb9d9b23800 20 remove_watcher() i=0 2024-09-22T08:41:09.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.399+0000 7fb9d9b23800 2 removed watcher, disabling cache 2024-09-22T08:41:09.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.400+0000 7fb9d9b23800 20 remove_watcher() i=1 2024-09-22T08:41:09.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.401+0000 7fb9d9b23800 20 remove_watcher() i=2 2024-09-22T08:41:09.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.402+0000 7fb9d9b23800 20 remove_watcher() i=3 2024-09-22T08:41:09.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.403+0000 7fb9d9b23800 20 remove_watcher() i=4 2024-09-22T08:41:09.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.404+0000 7fb9d9b23800 20 remove_watcher() i=5 2024-09-22T08:41:09.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.405+0000 7fb9d9b23800 20 remove_watcher() i=6 2024-09-22T08:41:09.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:09.406+0000 7fb9d9b23800 20 remove_watcher() i=7 2024-09-22T08:41:09.417 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:41:39.434 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:39.471 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:39.471 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:39.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.510+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.512+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.512+0000 7fa82bc0e800 20 realm 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.512+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.513+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.513+0000 7fa82bc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.513+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.513+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.513+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.514+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:39.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.514+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.515+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:39.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.515+0000 7fa82bc0e800 20 searching for the correct realm 2024-09-22T08:41:39.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.518+0000 7fa82736b640 0 -- 172.21.15.78:0/1690369905 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x558fb7167a40 msgr2=0x558fb7169f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:39.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.522+0000 7fa81eb6a640 0 -- 172.21.15.78:0/1690369905 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x558fb7167a40 msgr2=0x7fa6f008c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:39.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:39.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.728+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:39.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 zone default found 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 4 Realm: () 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 zonegroup default 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.729+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.730+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.730+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.730+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.730+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.730+0000 7fa82bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.731+0000 7fa82bc0e800 20 started sync module instance, tier type = 2024-09-22T08:41:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.731+0000 7fa82bc0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:39.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=0 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=1 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=2 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=3 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=4 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=5 2024-09-22T08:41:39.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.741+0000 7fa82bc0e800 20 add_watcher() i=6 2024-09-22T08:41:39.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.743+0000 7fa82bc0e800 20 add_watcher() i=7 2024-09-22T08:41:39.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.743+0000 7fa82bc0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:39.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:39.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa82bc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:39.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa82bc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:39.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa82bc0e800 5 note: GC not initialized 2024-09-22T08:41:39.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa6dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.745+0000 7fa82bc0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 20 Filter name: none 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa6567fc640 20 reqs_thread_entry: start 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : miss 2024-09-22T08:41:39.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.746+0000 7fa82bc0e800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T08:41:39.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:39.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.747+0000 7fa82bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:39.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.748+0000 7fa82bc0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:41:39.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.755+0000 7fa82bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.755+0000 7fa82bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.755+0000 7fa82bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.755+0000 7fa82bc0e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.756+0000 7fa70a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94075740393920 notifier 7755 bl.length()=995 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.756+0000 7fa70a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.756+0000 7fa70a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.756+0000 7fa70a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.757+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:39.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.757+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:39.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.757+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:39.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.757+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.0 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.0 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.1 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.1 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.2 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.2 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.3 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.3 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.4 2024-09-22T08:41:39.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.4 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.5 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.5 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.6 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.6 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.7 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.7 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.8 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.8 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.9 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.9 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.10 2024-09-22T08:41:39.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.10 2024-09-22T08:41:39.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.11 2024-09-22T08:41:39.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2.11 2024-09-22T08:41:39.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.763+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.0 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.764+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.1 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.764+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.765+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.3 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.765+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.4 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.766+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.5 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.766+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.6 2024-09-22T08:41:39.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.767+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.7 2024-09-22T08:41:39.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.767+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.8 2024-09-22T08:41:39.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.767+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.9 2024-09-22T08:41:39.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.768+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.10 2024-09-22T08:41:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.771+0000 7fa82bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:39.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.771+0000 7fa82bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.772+0000 7fa82bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.772+0000 7fa82bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.772+0000 7fa82bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.772+0000 7fa82bc0e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.773+0000 7fa70affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94075740393920 notifier 7755 bl.length()=995 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.773+0000 7fa70affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.773+0000 7fa70affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.773+0000 7fa70affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.774+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:39.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.774+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:39.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.774+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:39.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.774+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.777+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.0 2024-09-22T08:41:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.777+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.1 2024-09-22T08:41:39.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.777+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.2 2024-09-22T08:41:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.778+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.3 2024-09-22T08:41:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.778+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.4 2024-09-22T08:41:39.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.778+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.5 2024-09-22T08:41:39.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.779+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.6 2024-09-22T08:41:39.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.779+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.7 2024-09-22T08:41:39.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.779+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.8 2024-09-22T08:41:39.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.779+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.9 2024-09-22T08:41:39.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.780+0000 7fa82bc0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35.10 2024-09-22T08:41:39.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.780+0000 7fa82bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:39.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.780+0000 7fa82bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.781+0000 7fa82bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.781+0000 7fa82bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.781+0000 7fa82bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.781+0000 7fa82bc0e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35, ofs0, ns] 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.782+0000 7fa70a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94075740393920 notifier 7755 bl.length()=963 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.782+0000 7fa70a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 info.flags=0x17 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.782+0000 7fa70a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 to cache LRU end 2024-09-22T08:41:39.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.782+0000 7fa70a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.783+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_sources= new_sources= 2024-09-22T08:41:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.783+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential sources added=[] removed=[] 2024-09-22T08:41:39.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.783+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): orig_dests= new_dests= 2024-09-22T08:41:39.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.783+0000 7fa82bc0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35]): potential dests added=[] removed=[] 2024-09-22T08:41:39.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.786+0000 7fa82bc0e800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-22T08:41:39.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.788+0000 7fa6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.790+0000 7fa82bc0e800 20 remove_watcher() i=0 2024-09-22T08:41:39.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.790+0000 7fa82bc0e800 2 removed watcher, disabling cache 2024-09-22T08:41:39.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.791+0000 7fa82bc0e800 20 remove_watcher() i=1 2024-09-22T08:41:39.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.792+0000 7fa82bc0e800 20 remove_watcher() i=2 2024-09-22T08:41:39.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.793+0000 7fa82bc0e800 20 remove_watcher() i=3 2024-09-22T08:41:39.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.794+0000 7fa82bc0e800 20 remove_watcher() i=4 2024-09-22T08:41:39.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.795+0000 7fa82bc0e800 20 remove_watcher() i=5 2024-09-22T08:41:39.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.796+0000 7fa82bc0e800 20 remove_watcher() i=6 2024-09-22T08:41:39.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.797+0000 7fa82bc0e800 20 remove_watcher() i=7 2024-09-22T08:41:39.811 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T08:41:39.840 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:39.841 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:39.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.875+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 realm 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:39.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.877+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.878+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:39.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.878+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:39.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.879+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:39.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.879+0000 7f6728a0f800 20 searching for the correct realm 2024-09-22T08:41:39.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:39.882+0000 7f6724923640 0 -- 172.21.15.78:0/2865515232 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f670c063070 msgr2=0x7f670c094940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:40.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.087+0000 7f671b921640 0 -- 172.21.15.78:0/2865515232 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f671c017070 msgr2=0x7f671c072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:40.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.092+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 zone default found 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 4 Realm: () 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 zonegroup default 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.093+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.094+0000 7f6728a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.094+0000 7f6728a0f800 20 started sync module instance, tier type = 2024-09-22T08:41:40.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.094+0000 7f6728a0f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:40.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=0 2024-09-22T08:41:40.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=1 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=2 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=3 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=4 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=5 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.103+0000 7f6728a0f800 20 add_watcher() i=6 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.104+0000 7f6728a0f800 20 add_watcher() i=7 2024-09-22T08:41:40.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.104+0000 7f6728a0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:40.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.106+0000 7f65dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 5 note: GC not initialized 2024-09-22T08:41:40.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f65d9fdb640 20 reqs_thread_entry: start 2024-09-22T08:41:40.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:40.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 20 Filter name: none 2024-09-22T08:41:40.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f654b7fe640 20 reqs_thread_entry: start 2024-09-22T08:41:40.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.107+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.108+0000 7f6728a0f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.109+0000 7f6728a0f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-22T08:41:40.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.109+0000 7f6728a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:40.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.111+0000 7f65dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.113+0000 7f6728a0f800 20 remove_watcher() i=0 2024-09-22T08:41:40.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.113+0000 7f6728a0f800 2 removed watcher, disabling cache 2024-09-22T08:41:40.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.114+0000 7f6728a0f800 20 remove_watcher() i=1 2024-09-22T08:41:40.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.115+0000 7f6728a0f800 20 remove_watcher() i=2 2024-09-22T08:41:40.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.116+0000 7f6728a0f800 20 remove_watcher() i=3 2024-09-22T08:41:40.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.117+0000 7f6728a0f800 20 remove_watcher() i=4 2024-09-22T08:41:40.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.118+0000 7f6728a0f800 20 remove_watcher() i=5 2024-09-22T08:41:40.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.119+0000 7f6728a0f800 20 remove_watcher() i=6 2024-09-22T08:41:40.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:40.121+0000 7f6728a0f800 20 remove_watcher() i=7 2024-09-22T08:41:40.133 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:40.133 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:40.133 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:41:40.133 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:40.501 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-22T08:41:40.502 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:41.317 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:41:41.345 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:41.345 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:41.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.380+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 realm 2024-09-22T08:41:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.382+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.383+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:41.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.383+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.384+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:41.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.384+0000 7f3f96d39800 20 searching for the correct realm 2024-09-22T08:41:41.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.387+0000 7f3f931c8640 0 -- 172.21.15.78:0/1587604188 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3f8407db50 msgr2=0x7f3f840b0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:41.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.591+0000 7f3f921c6640 0 -- 172.21.15.78:0/1587604188 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f3f8c017040 msgr2=0x7f3f8c018940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.596+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:41.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 zone default found 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 4 Realm: () 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 zonegroup default 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.597+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 started sync module instance, tier type = 2024-09-22T08:41:41.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.598+0000 7f3f96d39800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=0 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=1 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=2 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=3 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=4 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=5 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.607+0000 7f3f96d39800 20 add_watcher() i=6 2024-09-22T08:41:41.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.608+0000 7f3f96d39800 20 add_watcher() i=7 2024-09-22T08:41:41.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.608+0000 7f3f96d39800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3e497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3f96d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3f96d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3f96d39800 5 note: GC not initialized 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3dc3fff640 20 reqs_thread_entry: start 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3f96d39800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.610+0000 7f3f96d39800 20 Filter name: none 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.611+0000 7f3dc1ffb640 20 reqs_thread_entry: start 2024-09-22T08:41:41.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.611+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.611+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:41.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.611+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.612+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:41.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.612+0000 7f3f96d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:41.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.612+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.613+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:41.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.613+0000 7f3f96d39800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.613+0000 7f3f96d39800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:41.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.613+0000 7f3f96d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:41.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.615+0000 7f3e497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.617+0000 7f3f96d39800 20 remove_watcher() i=0 2024-09-22T08:41:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.617+0000 7f3f96d39800 2 removed watcher, disabling cache 2024-09-22T08:41:41.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.618+0000 7f3f96d39800 20 remove_watcher() i=1 2024-09-22T08:41:41.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.619+0000 7f3f96d39800 20 remove_watcher() i=2 2024-09-22T08:41:41.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.620+0000 7f3f96d39800 20 remove_watcher() i=3 2024-09-22T08:41:41.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.621+0000 7f3f96d39800 20 remove_watcher() i=4 2024-09-22T08:41:41.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.622+0000 7f3f96d39800 20 remove_watcher() i=5 2024-09-22T08:41:41.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.623+0000 7f3f96d39800 20 remove_watcher() i=6 2024-09-22T08:41:41.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.624+0000 7f3f96d39800 20 remove_watcher() i=7 2024-09-22T08:41:41.637 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:41.637 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:41.637 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:41.637 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:41.638 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-22T08:41:41.672 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:41.673 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:41.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.708+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 realm 2024-09-22T08:41:41.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:41.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.710+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.711+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:41.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.711+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.711+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:41.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.712+0000 7f5af7baf800 20 searching for the correct realm 2024-09-22T08:41:41.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.713+0000 7f5af4e98640 0 -- 172.21.15.78:0/1823634932 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55aaaed6f6f0 msgr2=0x55aaaed71b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:41.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.717+0000 7f5af4e98640 0 -- 172.21.15.78:0/1823634932 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5af007b070 msgr2=0x7f5af0093940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:41.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:41.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:41.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:41.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.922+0000 7f5af7baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:41.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 zone default found 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 4 Realm: () 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:41.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 zonegroup default 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.923+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.924+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.924+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.924+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.924+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.925+0000 7f5af7baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.925+0000 7f5af7baf800 20 started sync module instance, tier type = 2024-09-22T08:41:41.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.925+0000 7f5af7baf800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:41.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=0 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=1 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=2 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=3 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=4 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=5 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.933+0000 7f5af7baf800 20 add_watcher() i=6 2024-09-22T08:41:41.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.935+0000 7f5af7baf800 20 add_watcher() i=7 2024-09-22T08:41:41.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.935+0000 7f5af7baf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:41.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.936+0000 7f59ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 5 note: GC not initialized 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f59aa7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 20 Filter name: none 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f591bfff640 20 reqs_thread_entry: start 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.937+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:41.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 : miss 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 20 rados->read ofs=0 len=0 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:41.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.938+0000 7f5af7baf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f5af7baf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f5af7baf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f5af7baf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f5af7baf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36, ofs0, ns] 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f59c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562513 cookie 94191566184336 notifier 7244 bl.length()=1007 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f59c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f59c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:41.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.945+0000 7f59c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:41.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.947+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_sources= new_sources= 2024-09-22T08:41:41.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.947+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential sources added=[] removed=[] 2024-09-22T08:41:41.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.947+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_dests= new_dests= 2024-09-22T08:41:41.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.947+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential dests added=[] removed=[] 2024-09-22T08:41:41.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.950+0000 7f5af7baf800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-22T08:41:41.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.950+0000 7f5af7baf800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-22T08:41:41.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.956+0000 7f5af7baf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:41.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.956+0000 7f5af7baf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f5af7baf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f5af7baf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f5af7baf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f5af7baf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36, ofs0, ns] 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f59c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562514 cookie 94191566184336 notifier 7244 bl.length()=975 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f59c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f59c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:41.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.958+0000 7f59c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:41.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.959+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_sources= new_sources= 2024-09-22T08:41:41.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.959+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential sources added=[] removed=[] 2024-09-22T08:41:41.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.959+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_dests= new_dests= 2024-09-22T08:41:41.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.959+0000 7f5af7baf800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential dests added=[] removed=[] 2024-09-22T08:41:41.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.961+0000 7f59ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:41.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.963+0000 7f5af7baf800 20 remove_watcher() i=0 2024-09-22T08:41:41.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.963+0000 7f5af7baf800 2 removed watcher, disabling cache 2024-09-22T08:41:41.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.964+0000 7f5af7baf800 20 remove_watcher() i=1 2024-09-22T08:41:41.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.965+0000 7f5af7baf800 20 remove_watcher() i=2 2024-09-22T08:41:41.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.966+0000 7f5af7baf800 20 remove_watcher() i=3 2024-09-22T08:41:41.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.967+0000 7f5af7baf800 20 remove_watcher() i=4 2024-09-22T08:41:41.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.968+0000 7f5af7baf800 20 remove_watcher() i=5 2024-09-22T08:41:41.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.969+0000 7f5af7baf800 20 remove_watcher() i=6 2024-09-22T08:41:41.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:41.970+0000 7f5af7baf800 20 remove_watcher() i=7 2024-09-22T08:41:41.983 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:41:42.012 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:42.012 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:42.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.046+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.048+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.048+0000 7f6e6f72a800 20 realm 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.048+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.048+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.048+0000 7f6e6f72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.049+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.049+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.049+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.250+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:42.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.250+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.251+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:42.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.251+0000 7f6e6f72a800 20 searching for the correct realm 2024-09-22T08:41:42.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.253+0000 7f6e6acd9640 0 -- 172.21.15.78:0/714972984 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x5574a42352e0 msgr2=0x5574a42376d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:42.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.256+0000 7f6e6acd9640 0 -- 172.21.15.78:0/714972984 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f6e6408bbd0 msgr2=0x7f6e640671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:42.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:42.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:42.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:42.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:42.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:42.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:42.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.463+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 zone default found 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 4 Realm: () 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:42.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 zonegroup default 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 started sync module instance, tier type = 2024-09-22T08:41:42.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.464+0000 7f6e6f72a800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=0 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=1 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=2 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=3 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=4 2024-09-22T08:41:42.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=5 2024-09-22T08:41:42.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.473+0000 7f6e6f72a800 20 add_watcher() i=6 2024-09-22T08:41:42.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.474+0000 7f6e6f72a800 20 add_watcher() i=7 2024-09-22T08:41:42.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.474+0000 7f6e6f72a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:42.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.475+0000 7f6d21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:42.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:42.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:42.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 5 note: GC not initialized 2024-09-22T08:41:42.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6d20fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:42.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:42.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 20 Filter name: none 2024-09-22T08:41:42.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6c9a7fc640 20 reqs_thread_entry: start 2024-09-22T08:41:42.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.476+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:42.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.477+0000 7f6e6f72a800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.478+0000 7f6e6f72a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:42.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.478+0000 7f6e6f72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:42.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.479+0000 7f6d21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:42.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.481+0000 7f6e6f72a800 20 remove_watcher() i=0 2024-09-22T08:41:42.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.481+0000 7f6e6f72a800 2 removed watcher, disabling cache 2024-09-22T08:41:42.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.483+0000 7f6e6f72a800 20 remove_watcher() i=1 2024-09-22T08:41:42.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.484+0000 7f6e6f72a800 20 remove_watcher() i=2 2024-09-22T08:41:42.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.485+0000 7f6e6f72a800 20 remove_watcher() i=3 2024-09-22T08:41:42.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.486+0000 7f6e6f72a800 20 remove_watcher() i=4 2024-09-22T08:41:42.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.487+0000 7f6e6f72a800 20 remove_watcher() i=5 2024-09-22T08:41:42.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.487+0000 7f6e6f72a800 20 remove_watcher() i=6 2024-09-22T08:41:42.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.488+0000 7f6e6f72a800 20 remove_watcher() i=7 2024-09-22T08:41:42.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:42.500 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:42.500 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:42.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:42.591 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:42.624 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:42.624 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:42.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.659+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 realm 2024-09-22T08:41:42.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:42.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.661+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.662+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:42.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.662+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.662+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:42.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.662+0000 7f2b2921d800 20 searching for the correct realm 2024-09-22T08:41:42.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.664+0000 7f2b251ec640 0 -- 172.21.15.78:0/2134132426 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2b10029400 msgr2=0x7f2b10029860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:42.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.870+0000 7f2b1ffff640 0 -- 172.21.15.78:0/2134132426 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2b200c0070 msgr2=0x7f2b200ac8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.875+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 zone default found 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 4 Realm: () 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 zonegroup default 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.876+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.877+0000 7f2b2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.877+0000 7f2b2921d800 20 started sync module instance, tier type = 2024-09-22T08:41:42.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.877+0000 7f2b2921d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:42.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=0 2024-09-22T08:41:42.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=1 2024-09-22T08:41:42.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=2 2024-09-22T08:41:42.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=3 2024-09-22T08:41:42.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=4 2024-09-22T08:41:42.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=5 2024-09-22T08:41:42.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.885+0000 7f2b2921d800 20 add_watcher() i=6 2024-09-22T08:41:42.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.886+0000 7f2b2921d800 20 add_watcher() i=7 2024-09-22T08:41:42.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.886+0000 7f2b2921d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:42.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f29db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f2b2921d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f2b2921d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f2b2921d800 5 note: GC not initialized 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f29da7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f2b2921d800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.888+0000 7f2b2921d800 20 Filter name: none 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f29d3fff640 20 reqs_thread_entry: start 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T08:41:42.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 : miss 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.889+0000 7f2b2921d800 20 rados->read ofs=0 len=0 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:42.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.890+0000 7f2b2921d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 2024-09-22T08:41:42.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f2b2921d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f2b2921d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f2b2921d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f2b2921d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36, ofs0, ns] 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f29fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562515 cookie 94173575181040 notifier 7274 bl.length()=1007 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f29fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f29fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.894+0000 7f29fbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.896+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_sources= new_sources= 2024-09-22T08:41:42.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.896+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential sources added=[] removed=[] 2024-09-22T08:41:42.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.896+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_dests= new_dests= 2024-09-22T08:41:42.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.896+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential dests added=[] removed=[] 2024-09-22T08:41:42.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.0 2024-09-22T08:41:42.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.0 2024-09-22T08:41:42.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.1 2024-09-22T08:41:42.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.1 2024-09-22T08:41:42.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.2 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.2 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.3 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.3 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.4 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.4 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.5 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.5 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.6 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.6 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.7 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.7 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.8 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.8 2024-09-22T08:41:42.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.9 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.9 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.10 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.10 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.11 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1.11 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.0 2024-09-22T08:41:42.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.901+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.902+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.2 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.902+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.3 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.903+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.4 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.903+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.5 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.903+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.6 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.904+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.7 2024-09-22T08:41:42.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.904+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.8 2024-09-22T08:41:42.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.905+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.9 2024-09-22T08:41:42.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.905+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.10 2024-09-22T08:41:42.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.908+0000 7f2b2921d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:42.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.908+0000 7f2b2921d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 2024-09-22T08:41:42.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f2b2921d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f2b2921d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f2b2921d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f2b2921d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36, ofs0, ns] 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f29fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562516 cookie 94173575181040 notifier 7274 bl.length()=1007 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f29fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f29fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.909+0000 7f29fbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.911+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_sources= new_sources= 2024-09-22T08:41:42.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.911+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential sources added=[] removed=[] 2024-09-22T08:41:42.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.911+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_dests= new_dests= 2024-09-22T08:41:42.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.911+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential dests added=[] removed=[] 2024-09-22T08:41:42.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.913+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.0 2024-09-22T08:41:42.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.914+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.1 2024-09-22T08:41:42.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.914+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.2 2024-09-22T08:41:42.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.914+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.3 2024-09-22T08:41:42.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.914+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.4 2024-09-22T08:41:42.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.915+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.5 2024-09-22T08:41:42.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.915+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.6 2024-09-22T08:41:42.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.915+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.7 2024-09-22T08:41:42.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.916+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.8 2024-09-22T08:41:42.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.916+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.9 2024-09-22T08:41:42.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.916+0000 7f2b2921d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36.10 2024-09-22T08:41:42.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.917+0000 7f2b2921d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 : hit (requested=0x17, cached=0x17) 2024-09-22T08:41:42.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.917+0000 7f2b2921d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 2024-09-22T08:41:42.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f2b2921d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f2b2921d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f2b2921d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f2b2921d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36, ofs0, ns] 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f29fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562517 cookie 94173575181040 notifier 7274 bl.length()=975 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f29fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 info.flags=0x17 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f29fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 to cache LRU end 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.918+0000 7f29fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.919+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_sources= new_sources= 2024-09-22T08:41:42.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.919+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential sources added=[] removed=[] 2024-09-22T08:41:42.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.919+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): orig_dests= new_dests= 2024-09-22T08:41:42.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.919+0000 7f2b2921d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36]): potential dests added=[] removed=[] 2024-09-22T08:41:42.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.922+0000 7f2b2921d800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:41:42.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.924+0000 7f29db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:42.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.926+0000 7f2b2921d800 20 remove_watcher() i=0 2024-09-22T08:41:42.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.926+0000 7f2b2921d800 2 removed watcher, disabling cache 2024-09-22T08:41:42.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.927+0000 7f2b2921d800 20 remove_watcher() i=1 2024-09-22T08:41:42.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.928+0000 7f2b2921d800 20 remove_watcher() i=2 2024-09-22T08:41:42.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.929+0000 7f2b2921d800 20 remove_watcher() i=3 2024-09-22T08:41:42.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.930+0000 7f2b2921d800 20 remove_watcher() i=4 2024-09-22T08:41:42.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.931+0000 7f2b2921d800 20 remove_watcher() i=5 2024-09-22T08:41:42.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.932+0000 7f2b2921d800 20 remove_watcher() i=6 2024-09-22T08:41:42.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:42.933+0000 7f2b2921d800 20 remove_watcher() i=7 2024-09-22T08:41:42.945 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T08:41:42.973 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:42.974 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:43.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.010+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.012+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.012+0000 7fb165135800 20 realm 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.012+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:43.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.013+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.014+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:43.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.014+0000 7fb165135800 20 searching for the correct realm 2024-09-22T08:41:43.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.014+0000 7fb160e21640 0 -- 172.21.15.78:0/827721574 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55f115afcfb0 msgr2=0x55f115aff470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:43.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.220+0000 7fb160e21640 0 -- 172.21.15.78:0/827721574 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fb1500ac8b0 msgr2=0x7fb1500aeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.428+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 zone default found 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 4 Realm: () 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:43.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 zonegroup default 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.429+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.430+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.430+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.430+0000 7fb165135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.430+0000 7fb165135800 20 started sync module instance, tier type = 2024-09-22T08:41:43.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.430+0000 7fb165135800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=0 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=1 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=2 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=3 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=4 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.438+0000 7fb165135800 20 add_watcher() i=5 2024-09-22T08:41:43.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.439+0000 7fb165135800 20 add_watcher() i=6 2024-09-22T08:41:43.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.439+0000 7fb165135800 20 add_watcher() i=7 2024-09-22T08:41:43.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.439+0000 7fb165135800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:43.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.441+0000 7fb0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:43.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.441+0000 7fb165135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:43.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.441+0000 7fb165135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:43.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.441+0000 7fb165135800 5 note: GC not initialized 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb0167e4640 20 reqs_thread_entry: start 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb165135800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb165135800 20 Filter name: none 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb00f7fe640 20 reqs_thread_entry: start 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:43.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.442+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.443+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.443+0000 7fb165135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.443+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.443+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.443+0000 7fb165135800 20 rados->read ofs=0 len=0 2024-09-22T08:41:43.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.444+0000 7fb165135800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:43.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.444+0000 7fb165135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:43.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.446+0000 7fb0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:43.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.448+0000 7fb165135800 20 remove_watcher() i=0 2024-09-22T08:41:43.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.448+0000 7fb165135800 2 removed watcher, disabling cache 2024-09-22T08:41:43.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.449+0000 7fb165135800 20 remove_watcher() i=1 2024-09-22T08:41:43.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.450+0000 7fb165135800 20 remove_watcher() i=2 2024-09-22T08:41:43.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.451+0000 7fb165135800 20 remove_watcher() i=3 2024-09-22T08:41:43.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.452+0000 7fb165135800 20 remove_watcher() i=4 2024-09-22T08:41:43.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.453+0000 7fb165135800 20 remove_watcher() i=5 2024-09-22T08:41:43.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.454+0000 7fb165135800 20 remove_watcher() i=6 2024-09-22T08:41:43.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:43.455+0000 7fb165135800 20 remove_watcher() i=7 2024-09-22T08:41:43.466 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:43.467 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:43.467 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:41:43.467 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:43.829 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-22T08:41:43.829 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:44.652 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:41:44.679 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:44.679 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:44.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.715+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 realm 2024-09-22T08:41:44.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.717+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.718+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:44.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.718+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.719+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:44.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.719+0000 7fe1e7d1f800 20 searching for the correct realm 2024-09-22T08:41:44.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.721+0000 7fe1db2a1640 0 -- 172.21.15.78:0/144039746 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55a66e3dc620 msgr2=0x55a66e3dea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:44.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.724+0000 7fe1db2a1640 0 -- 172.21.15.78:0/144039746 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fe1dc03f040 msgr2=0x7fe1dc04b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:44.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:44.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:44.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:44.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.931+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:44.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 zone default found 2024-09-22T08:41:44.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 4 Realm: () 2024-09-22T08:41:44.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:44.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 zonegroup default 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 started sync module instance, tier type = 2024-09-22T08:41:44.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.932+0000 7fe1e7d1f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=0 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=1 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=2 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=3 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=4 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=5 2024-09-22T08:41:44.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.941+0000 7fe1e7d1f800 20 add_watcher() i=6 2024-09-22T08:41:44.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.942+0000 7fe1e7d1f800 20 add_watcher() i=7 2024-09-22T08:41:44.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.942+0000 7fe1e7d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:44.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.943+0000 7fe099fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:44.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:44.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 5 note: GC not initialized 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe098fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 20 Filter name: none 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe0127fc640 20 reqs_thread_entry: start 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.944+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.945+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:44.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.945+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:44.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:44.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:44.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 rados->read ofs=0 len=0 2024-09-22T08:41:44.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:44.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.946+0000 7fe1e7d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:44.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.948+0000 7fe099fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:44.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.950+0000 7fe1e7d1f800 20 remove_watcher() i=0 2024-09-22T08:41:44.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.950+0000 7fe1e7d1f800 2 removed watcher, disabling cache 2024-09-22T08:41:44.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.951+0000 7fe1e7d1f800 20 remove_watcher() i=1 2024-09-22T08:41:44.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.952+0000 7fe1e7d1f800 20 remove_watcher() i=2 2024-09-22T08:41:44.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.953+0000 7fe1e7d1f800 20 remove_watcher() i=3 2024-09-22T08:41:44.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.954+0000 7fe1e7d1f800 20 remove_watcher() i=4 2024-09-22T08:41:44.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.955+0000 7fe1e7d1f800 20 remove_watcher() i=5 2024-09-22T08:41:44.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.956+0000 7fe1e7d1f800 20 remove_watcher() i=6 2024-09-22T08:41:44.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:44.957+0000 7fe1e7d1f800 20 remove_watcher() i=7 2024-09-22T08:41:44.968 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:44.968 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:44.968 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:44.968 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:44.969 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T08:41:45.003 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:45.003 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:45.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.039+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 realm 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:45.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 searching for the correct realm 2024-09-22T08:41:45.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.044+0000 7f9a691bd640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9a54075040 msgr2=0x7f9a5406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.249+0000 7f9a63fff640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f9a6403a070 msgr2=0x7f9a6406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zone default found 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Realm: () 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:45.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zonegroup default 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started sync module instance, tier type = 2024-09-22T08:41:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:45.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=0 2024-09-22T08:41:45.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=1 2024-09-22T08:41:45.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=2 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=3 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=4 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=5 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=6 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.468+0000 7f9a6cd32800 20 add_watcher() i=7 2024-09-22T08:41:45.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.468+0000 7f9a6cd32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:45.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f991f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 note: GC not initialized 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f991e7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 Filter name: none 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f99177fe640 20 reqs_thread_entry: start 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:41:45.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : miss 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:45.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94024798744368 notifier 7322 bl.length()=1007 2024-09-22T08:41:45.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:41:45.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:41:45.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:41:45.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:41:45.482 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6cd32800 time 2024-09-22T08:41:45.482248+0000 2024-09-22T08:41:45.482 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9a6e38c748] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:41:45.483 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f9a6cd32800 thread_name:radosgw-admin 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.482+0000 7f9a6cd32800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6cd32800 time 2024-09-22T08:41:45.482248+0000 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9a6e38c748] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:41:45.484 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:41:45.485 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9a6d03e6f0] 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9a6d08b99c] 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9a6e38c7a2] 2024-09-22T08:41:45.499 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.483+0000 7f9a6cd32800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f9a6cd32800 thread_name:radosgw-admin 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9a6d03e6f0] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9a6d08b99c] 2024-09-22T08:41:45.500 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9a6e38c7a2] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:41:45.501 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: shutdown 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 asok(0x5583da8890f0) unregister_commands rotate-key 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.502 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.503 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: starting msgr at 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: starting objecter 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests hook 0x5583daadbb30 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: setting wanted keys 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: calling monclient init 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.504 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key hook 0x5583daaaa4d8 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583da956750 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.505 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583da9ed600 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583da9f38d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.812393s 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583da956750 auth_method 0 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583da9ed600 auth_method 0 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.506 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583da9f38d0 auth_method 0 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-22T08:41:45.507 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:41:45.023+0000 7f9a63fff640 1 monclient: found mon.noname-c 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:41:45.023+0000 7f9955602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: dump: 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.508 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: dump: 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.509 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7313 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:41:45.024+0000 7f9956e05640 4 set_mon_vals no callback set 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 1 librados: init done 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:41:45.026+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9950077570 auth_method 0 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:41:45.026+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583daad2cd0 auth_method 0 2024-09-22T08:41:45.510 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:41:45.027+0000 7f9a689bc640 10 monclient: get_auth_request con 0x5583daaf4a40 auth_method 0 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:41:45.028+0000 7f9a63fff640 10 monclient: get_auth_request con 0x5583daaf8c30 auth_method 0 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:41:45.029+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583daafd010 auth_method 0 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.511 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.512 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests cmddesc objecter_requests hook 0x5583dab04180 EEXIST 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.513 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x5583daaffea0 EEXIST 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab284a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab28880 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab271b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.514 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.819781s 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab28880 auth_method 0 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab284a0 auth_method 0 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.515 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab271b0 auth_method 0 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient(hunting): handle_auth_done global_id 7905 payload 824 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:41:45.031+0000 7f9a691bd640 1 monclient: found mon.noname-a 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: dump: 2024-09-22T08:41:45.516 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:45.517 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: dump: 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7905 2024-09-22T08:41:45.518 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:41:45.031+0000 7f9a699be640 4 set_mon_vals no callback set 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:41:45.033+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9940077480 auth_method 0 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: get_monmap_and_config 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.519 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.520 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.521 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf47aac98 EEXIST 2024-09-22T08:41:45.522 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab4c520 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab76f90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab78340 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.823478s 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab4c520 auth_method 0 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab78340 auth_method 0 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.523 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab76f90 auth_method 0 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.524 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_done global_id 7908 payload 274 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:41:45.034+0000 7f9a63fff640 1 monclient: found mon.noname-a 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: dump: 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.525 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: dump: 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7908 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: get_monmap_and_config success 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 4 set_mon_vals no callback set 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: shutdown 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.527 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.528 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: starting msgr at 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: starting objecter 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests cmddesc objecter_requests hook 0x5583dab79da0 EEXIST 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: setting wanted keys 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: calling monclient init 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.529 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.530 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x5583dab3cea8 EEXIST 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab4c520 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab78340 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab7c150 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.825778s 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab4c520 auth_method 0 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.531 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab7c150 auth_method 0 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab78340 auth_method 0 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.532 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:41:45.037+0000 7f9a689bc640 1 monclient: found mon.noname-c 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: dump: 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.533 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: dump: 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.534 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7322 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:41:45.037+0000 7f993ffff640 4 set_mon_vals no callback set 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 1 librados: init done 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cr dump hook 0x5583dab7b658 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:41:45.039+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.535 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:41:45.039+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9934077570 auth_method 0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:41:45.040+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583dab97630 auth_method 0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 realm 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:41:45.041+0000 7f9a63fff640 10 monclient: get_auth_request con 0x5583dab9b640 auth_method 0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.536 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:41:45.041+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583dab9ef30 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 searching for the correct realm 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:41:45.042+0000 7f9a689bc640 10 monclient: get_auth_request con 0x5583daba3c50 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:41:45.043+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a5c07d070 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:41:45.044+0000 7f9a691bd640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9a54075040 msgr2=0x7f9a5406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:41:45.044+0000 7f9a691bd640 10 monclient: get_auth_request con 0x7f9a54075040 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:41:45.227+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9950077570 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:41:45.246+0000 7f9a691bd640 10 monclient: get_auth_request con 0x7f9a54075040 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:41:45.247+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9a5c065040 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:41:45.249+0000 7f9a63fff640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f9a6403a070 msgr2=0x7f9a6406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:41:45.249+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a6403a070 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:41:45.451+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a6403a070 auth_method 0 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:45.537 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zone default found 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Realm: () 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:45.538 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zonegroup default 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started sync module instance, tier type = 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=0 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=1 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=2 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=3 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=4 2024-09-22T08:41:45.539 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=5 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=6 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:41:45.468+0000 7f9a6cd32800 20 add_watcher() i=7 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:41:45.468+0000 7f9a6cd32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:41:45.470+0000 7f991f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.540 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache list hook 0x5583dab82450 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache inspect hook 0x5583dab82450 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache erase hook 0x5583dab82450 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache zap hook 0x5583dab82450 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 note: GC not initialized 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:41:45.470+0000 7f991e7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace show hook 0x7f9a64004720 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace history hook 0x7f9a64004720 2024-09-22T08:41:45.541 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace active hook 0x7f9a64004720 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace active_short hook 0x7f9a64004720 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 Filter name: none 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:41:45.471+0000 7f99177fe640 20 reqs_thread_entry: start 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : miss 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.542 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94024798744368 notifier 7322 bl.length()=1007 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:41:45.543 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:41:45.482+0000 7f9a6cd32800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6cd32800 time 2024-09-22T08:41:45.482248+0000 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9a6e38c748] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.544 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:41:45.483+0000 7f9a6cd32800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f9a6cd32800 thread_name:radosgw-admin 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9a6d03e6f0] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9a6d08b99c] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9a6e38c7a2] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.545 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:41:45.546 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:41:45.547 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:41:45.548 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:41:45.549 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:41:45.550 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:41:45.551 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f99177fe640 / http_manager 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f991e7e4640 / http_manager 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f991f7e6640 / rgw_dt_lg_renew 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993e7fc640 / ms_dispatch 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993f7fe640 / io_context_pool 2024-09-22T08:41:45.552 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993ffff640 / io_context_pool 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f994e7fc640 / ms_dispatch 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9955602640 / ms_dispatch 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9956e05640 / io_context_pool 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a63fff640 / msgr-worker-2 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a689bc640 / msgr-worker-1 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a691bd640 / msgr-worker-0 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a699be640 / io_context_pool 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a6cd32800 / radosgw-admin 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.136351.log 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:41:45.553 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: shutdown 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 asok(0x5583da8890f0) unregister_commands rotate-key 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.554 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding auth protocol: cephx 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: crc 2024-09-22T08:41:45.555 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaafaf0) adding con mode: secure 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: starting msgr at 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: starting objecter 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests hook 0x5583daadbb30 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: setting wanted keys 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 1 librados: calling monclient init 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding auth protocol: cephx 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.556 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: crc 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:41:45.022+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaaa390) adding con mode: secure 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key hook 0x5583daaaa4d8 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583da956750 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583da9ed600 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.557 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583da9f38d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:41:45.023+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.812393s 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583da956750 auth_method 0 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583da9ed600 auth_method 0 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.558 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:41:45.023+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583da9f38d0 auth_method 0 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:41:45.023+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.559 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:41:45.023+0000 7f9a63fff640 1 monclient: found mon.noname-c 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:41:45.023+0000 7f9a63fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:41:45.023+0000 7f9955602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: dump: 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.560 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:41:45.024+0000 7f9955602640 10 monclient: dump: 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.561 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7313 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:41:45.024+0000 7f9956e05640 4 set_mon_vals no callback set 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:41:45.024+0000 7f9a6cd32800 1 librados: init done 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:41:45.025+0000 7f9955602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:41:45.026+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9950077570 auth_method 0 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:41:45.026+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583daad2cd0 auth_method 0 2024-09-22T08:41:45.562 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:41:45.027+0000 7f9a689bc640 10 monclient: get_auth_request con 0x5583daaf4a40 auth_method 0 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:41:45.028+0000 7f9a63fff640 10 monclient: get_auth_request con 0x5583daaf8c30 auth_method 0 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:41:45.029+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583daafd010 auth_method 0 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.563 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding auth protocol: cephx 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: crc 2024-09-22T08:41:45.564 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:41:45.029+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab00cb0) adding con mode: secure 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests cmddesc objecter_requests hook 0x5583dab04180 EEXIST 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding auth protocol: cephx 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.565 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: crc 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 AuthRegistry(0x5583daaffd58) adding con mode: secure 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x5583daaffea0 EEXIST 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab284a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.566 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab28880 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab271b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:41:45.030+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.819781s 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab28880 auth_method 0 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab284a0 auth_method 0 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.567 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:41:45.030+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:41:45.030+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab271b0 auth_method 0 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:41:45.031+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient(hunting): handle_auth_done global_id 7905 payload 824 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:41:45.031+0000 7f9a691bd640 1 monclient: found mon.noname-a 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:41:45.031+0000 7f9a691bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.568 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: dump: 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.569 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:41:45.031+0000 7f994e7fc640 10 monclient: dump: 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.570 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7905 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:41:45.031+0000 7f9a699be640 4 set_mon_vals no callback set 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:41:45.031+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:41:45.033+0000 7f994e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:41:45.033+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9940077480 auth_method 0 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: get_monmap_and_config 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.571 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding auth protocol: cephx 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.572 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: crc 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab483f0) adding con mode: secure 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding auth protocol: cephx 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.573 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: crc 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:41:45.033+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47aab50) adding con mode: secure 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf47aac98 EEXIST 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:45.574 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab4c520 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab76f90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab78340 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:41:45.034+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.823478s 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab4c520 auth_method 0 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab78340 auth_method 0 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.575 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab76f90 auth_method 0 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:41:45.034+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:41:45.034+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient(hunting): handle_auth_done global_id 7908 payload 274 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.576 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:41:45.034+0000 7f9a63fff640 1 monclient: found mon.noname-a 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:41:45.034+0000 7f9a63fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: dump: 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.577 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:41:45.035+0000 7f993ffff640 10 monclient: dump: 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.578 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7908 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: get_monmap_and_config success 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 4 set_mon_vals no callback set 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: shutdown 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: build_initial_monmap 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 1 build_initial for_mkfs: 0 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 10 monclient: monmap: 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:41:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding auth protocol: cephx 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.580 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: crc 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab6d140) adding con mode: secure 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:41:45.035+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: starting msgr at 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: starting objecter 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command objecter_requests cmddesc objecter_requests hook 0x5583dab79da0 EEXIST 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: setting wanted keys 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 1 librados: calling monclient init 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: init 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding auth protocol: cephx 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.581 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: crc 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 AuthRegistry(0x5583dab3cd60) adding con mode: secure 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command rotate-key cmddesc rotate-key hook 0x5583dab3cea8 EEXIST 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: _reopen_session rank -1 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:41:45.582 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-a con 0x5583dab4c520 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-b con 0x5583dab78340 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): picked mon.noname-c con 0x5583dab7c150 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): start opening mon connection 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): _renew_subs 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:41:45.036+0000 7f9a6cd32800 10 monclient(hunting): authenticate will time out at 2220.825778s 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): get_auth_request con 0x5583dab4c520 auth_method 0 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): get_auth_request con 0x5583dab7c150 auth_method 0 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.583 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:41:45.036+0000 7f9a63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:41:45.036+0000 7f9a689bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): get_auth_request con 0x5583dab78340 auth_method 0 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:41:45.036+0000 7f9a691bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:41:45.037+0000 7f9a691bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:41:45.584 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient: _finish_hunting 0 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:41:45.037+0000 7f9a689bc640 1 monclient: found mon.noname-c 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:41:45.037+0000 7f9a689bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: dump: 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.585 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: _finish_auth 0 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: _check_auth_tickets 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:41:45.037+0000 7f993e7fc640 10 monclient: dump: 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:41:45.586 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 5 monclient: authenticate success, global_id 7322 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:41:45.037+0000 7f993ffff640 4 set_mon_vals no callback set 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _renew_subs 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 1 librados: init done 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:41:45.037+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cr dump hook 0x5583dab7b658 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:41:45.039+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:41:45.039+0000 7f993e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:41:45.587 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:41:45.039+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9934077570 auth_method 0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:41:45.040+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583dab97630 auth_method 0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 realm 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:41:45.040+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:41:45.041+0000 7f9a63fff640 10 monclient: get_auth_request con 0x5583dab9b640 auth_method 0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:41:45.041+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:41:45.041+0000 7f9a691bd640 10 monclient: get_auth_request con 0x5583dab9ef30 auth_method 0 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:45.588 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:41:45.042+0000 7f9a6cd32800 20 searching for the correct realm 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:41:45.042+0000 7f9a689bc640 10 monclient: get_auth_request con 0x5583daba3c50 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:41:45.043+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a5c07d070 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:41:45.044+0000 7f9a691bd640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9a54075040 msgr2=0x7f9a5406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:41:45.044+0000 7f9a691bd640 10 monclient: get_auth_request con 0x7f9a54075040 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:41:45.227+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9950077570 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:41:45.246+0000 7f9a691bd640 10 monclient: get_auth_request con 0x7f9a54075040 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:41:45.247+0000 7f9a689bc640 10 monclient: get_auth_request con 0x7f9a5c065040 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:41:45.249+0000 7f9a63fff640 0 -- 172.21.15.78:0/3671063868 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f9a6403a070 msgr2=0x7f9a6406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:41:45.249+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a6403a070 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:41:45.451+0000 7f9a63fff640 10 monclient: get_auth_request con 0x7f9a6403a070 auth_method 0 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:45.589 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:41:45.456+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zone default found 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Realm: () 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 zonegroup default 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.590 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:41:45.457+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started sync module instance, tier type = 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:41:45.458+0000 7f9a6cd32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=0 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=1 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=2 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=3 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=4 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=5 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:41:45.467+0000 7f9a6cd32800 20 add_watcher() i=6 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:41:45.468+0000 7f9a6cd32800 20 add_watcher() i=7 2024-09-22T08:41:45.591 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:41:45.468+0000 7f9a6cd32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding auth protocol: cephx 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:41:45.470+0000 7f991f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: crc 2024-09-22T08:41:45.592 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 AuthRegistry(0x7ffcf47ab020) adding con mode: secure 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache list hook 0x5583dab82450 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache inspect hook 0x5583dab82450 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache erase hook 0x5583dab82450 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command cache zap hook 0x5583dab82450 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 note: GC not initialized 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:41:45.470+0000 7f991e7e4640 20 reqs_thread_entry: start 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace show hook 0x7f9a64004720 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace history hook 0x7f9a64004720 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace active hook 0x7f9a64004720 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 5 asok(0x5583da8890f0) register_command sync trace active_short hook 0x7f9a64004720 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:45.593 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:41:45.470+0000 7f9a6cd32800 20 Filter name: none 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:41:45.471+0000 7f99177fe640 20 reqs_thread_entry: start 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : miss 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:41:45.471+0000 7f9a6cd32800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.594 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:41:45.472+0000 7f9a6cd32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:41:45.477+0000 7f9a6cd32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94024798744368 notifier 7322 bl.length()=1007 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:41:45.477+0000 7f993f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:41:45.479+0000 7f9a6cd32800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:41:45.482+0000 7f9a6cd32800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6cd32800 time 2024-09-22T08:41:45.482248+0000 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:41:45.595 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9a6e38c748] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:41:45.483+0000 7f9a6cd32800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f9a6cd32800 thread_name:radosgw-admin 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.596 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9a6d03e6f0] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9a6d08b99c] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9a6e38c7a2] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f9a6e38c906] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5583d9d5de01] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x5583da27086c] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5583d9d6dc9d] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9a6d029590] 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.597 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:41:45.598 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:41:45.599 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:41:45.600 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:41:45.601 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:41:45.602 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:41:45.603 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f99177fe640 / http_manager 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f991e7e4640 / http_manager 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f991f7e6640 / rgw_dt_lg_renew 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993e7fc640 / ms_dispatch 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993f7fe640 / io_context_pool 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f993ffff640 / io_context_pool 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f994e7fc640 / ms_dispatch 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9955602640 / ms_dispatch 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9956e05640 / io_context_pool 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a63fff640 / msgr-worker-2 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a689bc640 / msgr-worker-1 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a691bd640 / msgr-worker-0 2024-09-22T08:41:45.604 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a699be640 / io_context_pool 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr: 7f9a6cd32800 / radosgw-admin 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:41:45.483885Z_41ef5609-5ba4-4125-bbc3-4c1eb2a69cec/log 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:41:45.605 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:41:45.606 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:45.606 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:45.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.558+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 realm 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.560+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.561+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.561+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.562+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.562+0000 7f2e90136800 20 searching for the correct realm 2024-09-22T08:41:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.564+0000 7f2e8c6b8640 0 -- 172.21.15.78:0/990932988 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2e7407b3d0 msgr2=0x7f2e74003750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.769+0000 7f2e83fff640 0 -- 172.21.15.78:0/990932988 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2e84014030 msgr2=0x7f2e8406a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.774+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 zone default found 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 4 Realm: () 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 zonegroup default 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.775+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 started sync module instance, tier type = 2024-09-22T08:41:45.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.776+0000 7f2e90136800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=0 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=1 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=2 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=3 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=4 2024-09-22T08:41:45.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=5 2024-09-22T08:41:45.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.785+0000 7f2e90136800 20 add_watcher() i=6 2024-09-22T08:41:45.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.786+0000 7f2e90136800 20 add_watcher() i=7 2024-09-22T08:41:45.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.786+0000 7f2e90136800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:45.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.787+0000 7f2d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:45.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:45.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:45.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 5 note: GC not initialized 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2d40fe1640 20 reqs_thread_entry: start 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 20 Filter name: none 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2cba7fc640 20 reqs_thread_entry: start 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.788+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=471 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.789+0000 7f2e90136800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.790+0000 7f2e90136800 20 rados_obj.operate() r=0 bl.length=471 2024-09-22T08:41:45.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.790+0000 7f2e90136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:41:45.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.791+0000 7f2d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:45.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.794+0000 7f2e90136800 20 remove_watcher() i=0 2024-09-22T08:41:45.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.794+0000 7f2e90136800 2 removed watcher, disabling cache 2024-09-22T08:41:45.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.795+0000 7f2e90136800 20 remove_watcher() i=1 2024-09-22T08:41:45.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.796+0000 7f2e90136800 20 remove_watcher() i=2 2024-09-22T08:41:45.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.796+0000 7f2e90136800 20 remove_watcher() i=3 2024-09-22T08:41:45.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.797+0000 7f2e90136800 20 remove_watcher() i=4 2024-09-22T08:41:45.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.798+0000 7f2e90136800 20 remove_watcher() i=5 2024-09-22T08:41:45.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.799+0000 7f2e90136800 20 remove_watcher() i=6 2024-09-22T08:41:45.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.800+0000 7f2e90136800 20 remove_watcher() i=7 2024-09-22T08:41:45.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.812 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:41:45.812 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:41:45.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:41:45.902 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:41:45.935 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:45.935 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:41:45.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.970+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 realm 2024-09-22T08:41:45.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.972+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.973+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:45.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.973+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:45.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.974+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:41:45.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.974+0000 7faff4746800 20 searching for the correct realm 2024-09-22T08:41:45.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:45.976+0000 7faff2a38640 0 -- 172.21.15.78:0/3443412728 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fafdc07d040 msgr2=0x7fafdc091440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:41:46.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.182+0000 7fafe9a36640 0 -- 172.21.15.78:0/3443412728 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fafec09a6b0 msgr2=0x7fafec06d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:41:46.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:41:46.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:41:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.187+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 zone default found 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 4 Realm: () 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:41:46.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 zonegroup default 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.188+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.189+0000 7faff4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.189+0000 7faff4746800 20 started sync module instance, tier type = 2024-09-22T08:41:46.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.189+0000 7faff4746800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:41:46.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=0 2024-09-22T08:41:46.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=1 2024-09-22T08:41:46.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=2 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=3 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=4 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=5 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.197+0000 7faff4746800 20 add_watcher() i=6 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.198+0000 7faff4746800 20 add_watcher() i=7 2024-09-22T08:41:46.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.198+0000 7faff4746800 2 all 8 watchers are set, enabling cache 2024-09-22T08:41:46.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faea8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faff4746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faff4746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faff4746800 5 note: GC not initialized 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7fae237fe640 20 reqs_thread_entry: start 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faff4746800 20 init_complete bucket index max shards: 11 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.200+0000 7faff4746800 20 Filter name: none 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7fae217fa640 20 reqs_thread_entry: start 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:41:46.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:41:46.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:41:46.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:41:46.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : miss 2024-09-22T08:41:46.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 20 rados->read ofs=0 len=0 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 20 rados_obj.operate() r=0 bl.length=471 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.201+0000 7faff4746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.202+0000 7faff4746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.203+0000 7faff4746800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to be held by another RGW process; skipping for now 2024-09-22T08:41:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.203+0000 7faea8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:41:46.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.205+0000 7faff4746800 20 remove_watcher() i=0 2024-09-22T08:41:46.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.205+0000 7faff4746800 2 removed watcher, disabling cache 2024-09-22T08:41:46.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.206+0000 7faff4746800 20 remove_watcher() i=1 2024-09-22T08:41:46.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.207+0000 7faff4746800 20 remove_watcher() i=2 2024-09-22T08:41:46.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.208+0000 7faff4746800 20 remove_watcher() i=3 2024-09-22T08:41:46.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.209+0000 7faff4746800 20 remove_watcher() i=4 2024-09-22T08:41:46.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.210+0000 7faff4746800 20 remove_watcher() i=5 2024-09-22T08:41:46.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.211+0000 7faff4746800 20 remove_watcher() i=6 2024-09-22T08:41:46.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:41:46.212+0000 7faff4746800 20 remove_watcher() i=7 2024-09-22T08:41:46.223 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:42:16.233 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:42:16.268 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:16.268 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:16.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.308+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 realm 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.310+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.311+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:16.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.311+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.312+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:16.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.312+0000 7f18fdd42800 20 searching for the correct realm 2024-09-22T08:42:16.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.315+0000 7f18fa287640 0 -- 172.21.15.78:0/2502299914 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f18e4026040 msgr2=0x7f18e4076ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:16.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.318+0000 7f18f9285640 0 -- 172.21.15.78:0/2502299914 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f18ec069cd0 msgr2=0x7f18ec068740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:16.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.323+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:16.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 zone default found 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 4 Realm: () 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:16.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 zonegroup default 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.324+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 started sync module instance, tier type = 2024-09-22T08:42:16.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.325+0000 7f18fdd42800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=0 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=1 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=2 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=3 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=4 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=5 2024-09-22T08:42:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.335+0000 7f18fdd42800 20 add_watcher() i=6 2024-09-22T08:42:16.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.336+0000 7f18fdd42800 20 add_watcher() i=7 2024-09-22T08:42:16.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.336+0000 7f18fdd42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:16.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.338+0000 7f17affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:16.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.338+0000 7f18fdd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:16.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.338+0000 7f18fdd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:16.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 5 note: GC not initialized 2024-09-22T08:42:16.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f17aefe5640 20 reqs_thread_entry: start 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 20 Filter name: none 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f17acfe1640 20 reqs_thread_entry: start 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : miss 2024-09-22T08:42:16.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.339+0000 7f18fdd42800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 20 rados_obj.operate() r=0 bl.length=471 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.340+0000 7f18fdd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:42:16.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.341+0000 7f18fdd42800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:42:16.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f18fdd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f18fdd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f18fdd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f18fdd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:42:16.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f17dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94104708009152 notifier 7962 bl.length()=1007 2024-09-22T08:42:16.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f17dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f17dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.348+0000 7f17dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.350+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:42:16.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.350+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:42:16.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.350+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:42:16.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.350+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:42:16.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.0 2024-09-22T08:42:16.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.0 2024-09-22T08:42:16.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.1 2024-09-22T08:42:16.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.1 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.2 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.2 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.3 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.3 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.4 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.4 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.5 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.5 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.6 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.6 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.7 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.7 2024-09-22T08:42:16.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.8 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.8 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.9 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.9 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.10 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.10 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.11 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2.11 2024-09-22T08:42:16.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.355+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.0 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.356+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.1 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.356+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.356+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.3 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.357+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.4 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.357+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.5 2024-09-22T08:42:16.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.358+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.6 2024-09-22T08:42:16.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.358+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.7 2024-09-22T08:42:16.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.359+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.8 2024-09-22T08:42:16.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.360+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.9 2024-09-22T08:42:16.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.360+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.10 2024-09-22T08:42:16.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.363+0000 7f18fdd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:16.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.363+0000 7f18fdd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:42:16.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f18fdd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f18fdd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f18fdd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f18fdd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:42:16.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f17dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94104708009152 notifier 7962 bl.length()=1007 2024-09-22T08:42:16.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f17dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f17dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.364+0000 7f17dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.366+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:42:16.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.366+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:42:16.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.366+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:42:16.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.366+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:42:16.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.368+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.0 2024-09-22T08:42:16.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.368+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.1 2024-09-22T08:42:16.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.369+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.2 2024-09-22T08:42:16.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.369+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.3 2024-09-22T08:42:16.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.369+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.4 2024-09-22T08:42:16.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.370+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.5 2024-09-22T08:42:16.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.370+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.6 2024-09-22T08:42:16.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.370+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.7 2024-09-22T08:42:16.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.371+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.8 2024-09-22T08:42:16.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.371+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.9 2024-09-22T08:42:16.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.371+0000 7f18fdd42800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37.10 2024-09-22T08:42:16.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.372+0000 7f18fdd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:16.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.372+0000 7f18fdd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 2024-09-22T08:42:16.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f18fdd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f18fdd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f18fdd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f18fdd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37, ofs0, ns] 2024-09-22T08:42:16.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f17dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94104708009152 notifier 7962 bl.length()=975 2024-09-22T08:42:16.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f17dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 info.flags=0x17 2024-09-22T08:42:16.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f17dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 to cache LRU end 2024-09-22T08:42:16.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.373+0000 7f17dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:16.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.375+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_sources= new_sources= 2024-09-22T08:42:16.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.375+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential sources added=[] removed=[] 2024-09-22T08:42:16.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.375+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): orig_dests= new_dests= 2024-09-22T08:42:16.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.375+0000 7f18fdd42800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37]): potential dests added=[] removed=[] 2024-09-22T08:42:16.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.377+0000 7f18fdd42800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-22T08:42:16.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.379+0000 7f17affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:16.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.381+0000 7f18fdd42800 20 remove_watcher() i=0 2024-09-22T08:42:16.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.381+0000 7f18fdd42800 2 removed watcher, disabling cache 2024-09-22T08:42:16.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.382+0000 7f18fdd42800 20 remove_watcher() i=1 2024-09-22T08:42:16.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.383+0000 7f18fdd42800 20 remove_watcher() i=2 2024-09-22T08:42:16.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.384+0000 7f18fdd42800 20 remove_watcher() i=3 2024-09-22T08:42:16.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.385+0000 7f18fdd42800 20 remove_watcher() i=4 2024-09-22T08:42:16.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.386+0000 7f18fdd42800 20 remove_watcher() i=5 2024-09-22T08:42:16.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.387+0000 7f18fdd42800 20 remove_watcher() i=6 2024-09-22T08:42:16.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.388+0000 7f18fdd42800 20 remove_watcher() i=7 2024-09-22T08:42:16.401 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T08:42:16.430 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:16.430 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:16.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.668+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 20 realm 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.670+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.671+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.671+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.671+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:16.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.671+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.672+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:16.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.672+0000 7fd7e9942800 20 searching for the correct realm 2024-09-22T08:42:16.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.675+0000 7fd7e5eee640 0 -- 172.21.15.78:0/3298882529 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd7d0026040 msgr2=0x7fd7d0073d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:16.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.880+0000 7fd7dceec640 0 -- 172.21.15.78:0/3298882529 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd7e0040bf0 msgr2=0x7fd7e004e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.885+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:16.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 zone default found 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 4 Realm: () 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 zonegroup default 2024-09-22T08:42:16.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.886+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 started sync module instance, tier type = 2024-09-22T08:42:16.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.887+0000 7fd7e9942800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=0 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=1 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=2 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=3 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=4 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=5 2024-09-22T08:42:16.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.897+0000 7fd7e9942800 20 add_watcher() i=6 2024-09-22T08:42:16.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.898+0000 7fd7e9942800 20 add_watcher() i=7 2024-09-22T08:42:16.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.898+0000 7fd7e9942800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:16.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.900+0000 7fd69b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:16.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:16.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:16.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 5 note: GC not initialized 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd69a7e4640 20 reqs_thread_entry: start 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 20 Filter name: none 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd60bfff640 20 reqs_thread_entry: start 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.901+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.902+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:42:16.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.902+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:42:16.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:16.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=217 2024-09-22T08:42:16.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 rados->read ofs=0 len=0 2024-09-22T08:42:16.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 rados_obj.operate() r=0 bl.length=439 2024-09-22T08:42:16.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.903+0000 7fd7e9942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:16.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.905+0000 7fd69b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:16.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.907+0000 7fd7e9942800 20 remove_watcher() i=0 2024-09-22T08:42:16.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.907+0000 7fd7e9942800 2 removed watcher, disabling cache 2024-09-22T08:42:16.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.908+0000 7fd7e9942800 20 remove_watcher() i=1 2024-09-22T08:42:16.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.909+0000 7fd7e9942800 20 remove_watcher() i=2 2024-09-22T08:42:16.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.910+0000 7fd7e9942800 20 remove_watcher() i=3 2024-09-22T08:42:16.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.911+0000 7fd7e9942800 20 remove_watcher() i=4 2024-09-22T08:42:16.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.913+0000 7fd7e9942800 20 remove_watcher() i=5 2024-09-22T08:42:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.914+0000 7fd7e9942800 20 remove_watcher() i=6 2024-09-22T08:42:16.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:16.915+0000 7fd7e9942800 20 remove_watcher() i=7 2024-09-22T08:42:16.926 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:16.927 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:16.927 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:42:16.927 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:17.285 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-22T08:42:17.286 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:18.111 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:42:18.140 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:18.140 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:18.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.175+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.177+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.177+0000 7fd4e3413800 20 realm 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.177+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.178+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.179+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:18.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.179+0000 7fd4e3413800 20 searching for the correct realm 2024-09-22T08:42:18.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.182+0000 7fd4deb48640 0 -- 172.21.15.78:0/1033689130 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x559acd9be870 msgr2=0x559acd9c0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.185+0000 7fd4deb48640 0 -- 172.21.15.78:0/1033689130 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x559acd9b21d0 msgr2=0x559acd9b4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.188+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 zone default found 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 4 Realm: () 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 zonegroup default 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.189+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.190+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.190+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.190+0000 7fd4e3413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.190+0000 7fd4e3413800 20 started sync module instance, tier type = 2024-09-22T08:42:18.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.190+0000 7fd4e3413800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=0 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=1 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=2 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=3 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=4 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=5 2024-09-22T08:42:18.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.198+0000 7fd4e3413800 20 add_watcher() i=6 2024-09-22T08:42:18.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.199+0000 7fd4e3413800 20 add_watcher() i=7 2024-09-22T08:42:18.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.199+0000 7fd4e3413800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.201+0000 7fd3957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 5 note: GC not initialized 2024-09-22T08:42:18.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd30ffff640 20 reqs_thread_entry: start 2024-09-22T08:42:18.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 20 Filter name: none 2024-09-22T08:42:18.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd30dffb640 20 reqs_thread_entry: start 2024-09-22T08:42:18.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.202+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.203+0000 7fd4e3413800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.204+0000 7fd4e3413800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:18.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.204+0000 7fd4e3413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:18.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.206+0000 7fd3957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.208+0000 7fd4e3413800 20 remove_watcher() i=0 2024-09-22T08:42:18.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.208+0000 7fd4e3413800 2 removed watcher, disabling cache 2024-09-22T08:42:18.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.209+0000 7fd4e3413800 20 remove_watcher() i=1 2024-09-22T08:42:18.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.210+0000 7fd4e3413800 20 remove_watcher() i=2 2024-09-22T08:42:18.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.211+0000 7fd4e3413800 20 remove_watcher() i=3 2024-09-22T08:42:18.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.212+0000 7fd4e3413800 20 remove_watcher() i=4 2024-09-22T08:42:18.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.213+0000 7fd4e3413800 20 remove_watcher() i=5 2024-09-22T08:42:18.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.214+0000 7fd4e3413800 20 remove_watcher() i=6 2024-09-22T08:42:18.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.214+0000 7fd4e3413800 20 remove_watcher() i=7 2024-09-22T08:42:18.226 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:18.226 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:18.226 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:42:18.226 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:18.227 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-22T08:42:18.261 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:18.262 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:18.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.298+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 20 realm 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.299+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.300+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.300+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.300+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.300+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.301+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:18.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.301+0000 7f8963240800 20 searching for the correct realm 2024-09-22T08:42:18.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.303+0000 7f896152b640 0 -- 172.21.15.78:0/3057826648 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f8948099040 msgr2=0x7f8948099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.508+0000 7f8958529640 0 -- 172.21.15.78:0/3057826648 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f895c018040 msgr2=0x7f895c08e170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.513+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 zone default found 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 4 Realm: () 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 zonegroup default 2024-09-22T08:42:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.514+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.515+0000 7f8963240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.515+0000 7f8963240800 20 started sync module instance, tier type = 2024-09-22T08:42:18.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.515+0000 7f8963240800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:18.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=0 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=1 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=2 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=3 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=4 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=5 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.523+0000 7f8963240800 20 add_watcher() i=6 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.524+0000 7f8963240800 20 add_watcher() i=7 2024-09-22T08:42:18.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.524+0000 7f8963240800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.526+0000 7f8816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.526+0000 7f8963240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.526+0000 7f8963240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.526+0000 7f8963240800 5 note: GC not initialized 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8815fe3640 20 reqs_thread_entry: start 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 20 Filter name: none 2024-09-22T08:42:18.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f87877fe640 20 reqs_thread_entry: start 2024-09-22T08:42:18.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:42:18.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:18.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:18.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 : miss 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.527+0000 7f8963240800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:18.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.528+0000 7f8963240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 2024-09-22T08:42:18.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8963240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8963240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8963240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8963240800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38, ofs0, ns] 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562522 cookie 93984445236112 notifier 8013 bl.length()=1015 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8837fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8837fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:18.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.533+0000 7f8837fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:18.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.535+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_sources= new_sources= 2024-09-22T08:42:18.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.535+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential sources added=[] removed=[] 2024-09-22T08:42:18.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.535+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_dests= new_dests= 2024-09-22T08:42:18.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.535+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential dests added=[] removed=[] 2024-09-22T08:42:18.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.0 2024-09-22T08:42:18.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.0 2024-09-22T08:42:18.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.1 2024-09-22T08:42:18.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.1 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.2 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.2 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.3 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.3 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.4 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.4 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.5 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.5 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.6 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.6 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.7 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.7 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.8 2024-09-22T08:42:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.8 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.9 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.9 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.10 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.10 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.11 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.11 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.0 2024-09-22T08:42:18.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.540+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1 2024-09-22T08:42:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.541+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.2 2024-09-22T08:42:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.541+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.3 2024-09-22T08:42:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.542+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.4 2024-09-22T08:42:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.542+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.5 2024-09-22T08:42:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.543+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.6 2024-09-22T08:42:18.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.543+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.7 2024-09-22T08:42:18.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.544+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.8 2024-09-22T08:42:18.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.544+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.9 2024-09-22T08:42:18.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.545+0000 7f8963240800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.10 2024-09-22T08:42:18.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.547+0000 7f8963240800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-22T08:42:18.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.547+0000 7f8963240800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-22T08:42:18.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.558+0000 7f8963240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:18.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.558+0000 7f8963240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.559+0000 7f8963240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.559+0000 7f8963240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.559+0000 7f8963240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.559+0000 7f8963240800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38, ofs0, ns] 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.560+0000 7f8837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562523 cookie 93984445236112 notifier 8013 bl.length()=983 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.560+0000 7f8837fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.560+0000 7f8837fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:18.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.560+0000 7f8837fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:18.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.561+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_sources= new_sources= 2024-09-22T08:42:18.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.561+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential sources added=[] removed=[] 2024-09-22T08:42:18.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.561+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_dests= new_dests= 2024-09-22T08:42:18.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.561+0000 7f8963240800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential dests added=[] removed=[] 2024-09-22T08:42:18.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.561+0000 7f8963240800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-22T08:42:18.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.563+0000 7f8816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.565+0000 7f8963240800 20 remove_watcher() i=0 2024-09-22T08:42:18.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.565+0000 7f8963240800 2 removed watcher, disabling cache 2024-09-22T08:42:18.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.566+0000 7f8963240800 20 remove_watcher() i=1 2024-09-22T08:42:18.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.567+0000 7f8963240800 20 remove_watcher() i=2 2024-09-22T08:42:18.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.568+0000 7f8963240800 20 remove_watcher() i=3 2024-09-22T08:42:18.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.570+0000 7f8963240800 20 remove_watcher() i=4 2024-09-22T08:42:18.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.571+0000 7f8963240800 20 remove_watcher() i=5 2024-09-22T08:42:18.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.572+0000 7f8963240800 20 remove_watcher() i=6 2024-09-22T08:42:18.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.572+0000 7f8963240800 20 remove_watcher() i=7 2024-09-22T08:42:18.585 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:42:18.614 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:18.614 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:18.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.649+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 realm 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.652+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.653+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.653+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.654+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:18.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.654+0000 7fa6d012c800 20 searching for the correct realm 2024-09-22T08:42:18.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.656+0000 7fa6cc53f640 0 -- 172.21.15.78:0/2608158312 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa6b406e6b0 msgr2=0x7fa6b404a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.860+0000 7fa6c3fff640 0 -- 172.21.15.78:0/2608158312 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa6c4018070 msgr2=0x7fa6c4027960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:18.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:18.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:18.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:18.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:18.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:18.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:18.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.865+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 zone default found 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 4 Realm: () 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 zonegroup default 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.866+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.867+0000 7fa6d012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:18.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.867+0000 7fa6d012c800 20 started sync module instance, tier type = 2024-09-22T08:42:18.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.867+0000 7fa6d012c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=0 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=1 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=2 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=3 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=4 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=5 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.875+0000 7fa6d012c800 20 add_watcher() i=6 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.876+0000 7fa6d012c800 20 add_watcher() i=7 2024-09-22T08:42:18.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.876+0000 7fa6d012c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:18.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.878+0000 7fa581fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.878+0000 7fa6d012c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.878+0000 7fa6d012c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 5 note: GC not initialized 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa580fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:18.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 20 Filter name: none 2024-09-22T08:42:18.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa4fa7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:18.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:18.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.879+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.880+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.880+0000 7fa6d012c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.880+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.880+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.880+0000 7fa6d012c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.881+0000 7fa6d012c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:18.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.881+0000 7fa6d012c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:18.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.882+0000 7fa581fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:18.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.884+0000 7fa6d012c800 20 remove_watcher() i=0 2024-09-22T08:42:18.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.884+0000 7fa6d012c800 2 removed watcher, disabling cache 2024-09-22T08:42:18.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.885+0000 7fa6d012c800 20 remove_watcher() i=1 2024-09-22T08:42:18.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.886+0000 7fa6d012c800 20 remove_watcher() i=2 2024-09-22T08:42:18.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.887+0000 7fa6d012c800 20 remove_watcher() i=3 2024-09-22T08:42:18.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.889+0000 7fa6d012c800 20 remove_watcher() i=4 2024-09-22T08:42:18.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.890+0000 7fa6d012c800 20 remove_watcher() i=5 2024-09-22T08:42:18.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.891+0000 7fa6d012c800 20 remove_watcher() i=6 2024-09-22T08:42:18.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:18.892+0000 7fa6d012c800 20 remove_watcher() i=7 2024-09-22T08:42:18.903 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:18.903 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:18.903 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:42:18.903 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:18.993 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:42:19.024 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:19.024 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:19.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.060+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.061+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.061+0000 7fbe80013800 20 realm 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.061+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.062+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.063+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:19.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.063+0000 7fbe80013800 20 searching for the correct realm 2024-09-22T08:42:19.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.065+0000 7fbe72f47640 0 -- 172.21.15.78:0/2895351458 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x555bc4b92430 msgr2=0x555bc4b94860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.068+0000 7fbe72f47640 0 -- 172.21.15.78:0/2895351458 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fbe74090060 msgr2=0x7fbe740d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.274+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 zone default found 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 4 Realm: () 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 zonegroup default 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.275+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.276+0000 7fbe80013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.276+0000 7fbe80013800 20 started sync module instance, tier type = 2024-09-22T08:42:19.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.276+0000 7fbe80013800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=0 2024-09-22T08:42:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=1 2024-09-22T08:42:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=2 2024-09-22T08:42:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=3 2024-09-22T08:42:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=4 2024-09-22T08:42:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=5 2024-09-22T08:42:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.284+0000 7fbe80013800 20 add_watcher() i=6 2024-09-22T08:42:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.285+0000 7fbe80013800 20 add_watcher() i=7 2024-09-22T08:42:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.285+0000 7fbe80013800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.287+0000 7fbd31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.287+0000 7fbe80013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.287+0000 7fbe80013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.287+0000 7fbe80013800 5 note: GC not initialized 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbd30fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 20 Filter name: none 2024-09-22T08:42:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbcaa7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:42:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:19.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:19.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:42:19.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 : miss 2024-09-22T08:42:19.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.288+0000 7fbe80013800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:19.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:19.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.289+0000 7fbe80013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 2024-09-22T08:42:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbe80013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbe80013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbe80013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbe80013800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38, ofs0, ns] 2024-09-22T08:42:19.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562524 cookie 93852630908752 notifier 8055 bl.length()=1015 2024-09-22T08:42:19.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbd5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbd5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.294+0000 7fbd5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.296+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_sources= new_sources= 2024-09-22T08:42:19.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.296+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential sources added=[] removed=[] 2024-09-22T08:42:19.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.296+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_dests= new_dests= 2024-09-22T08:42:19.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.296+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential dests added=[] removed=[] 2024-09-22T08:42:19.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.0 2024-09-22T08:42:19.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.0 2024-09-22T08:42:19.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.1 2024-09-22T08:42:19.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.1 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.2 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.2 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.3 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.3 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.4 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.4 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.5 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.5 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.6 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.6 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.7 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.7 2024-09-22T08:42:19.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.8 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.8 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.9 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.9 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.10 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.10 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.11 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1.11 2024-09-22T08:42:19.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.300+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.0 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.301+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.301+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.2 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.301+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.3 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.302+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.4 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.302+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.5 2024-09-22T08:42:19.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.303+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.6 2024-09-22T08:42:19.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.303+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.7 2024-09-22T08:42:19.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.304+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.8 2024-09-22T08:42:19.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.304+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.9 2024-09-22T08:42:19.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.305+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.10 2024-09-22T08:42:19.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.307+0000 7fbe80013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:19.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.308+0000 7fbe80013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 2024-09-22T08:42:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbe80013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbe80013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbe80013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbe80013800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38, ofs0, ns] 2024-09-22T08:42:19.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562525 cookie 93852630908752 notifier 8055 bl.length()=1015 2024-09-22T08:42:19.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbd5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbd5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.309+0000 7fbd5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.310+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_sources= new_sources= 2024-09-22T08:42:19.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.310+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential sources added=[] removed=[] 2024-09-22T08:42:19.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.310+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_dests= new_dests= 2024-09-22T08:42:19.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.310+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential dests added=[] removed=[] 2024-09-22T08:42:19.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.313+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.0 2024-09-22T08:42:19.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.313+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.1 2024-09-22T08:42:19.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.313+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.2 2024-09-22T08:42:19.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.314+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.3 2024-09-22T08:42:19.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.314+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.4 2024-09-22T08:42:19.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.314+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.5 2024-09-22T08:42:19.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.315+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.6 2024-09-22T08:42:19.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.315+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.7 2024-09-22T08:42:19.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.315+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.8 2024-09-22T08:42:19.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.316+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.9 2024-09-22T08:42:19.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.316+0000 7fbe80013800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38.10 2024-09-22T08:42:19.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.316+0000 7fbe80013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:19.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.316+0000 7fbe80013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 2024-09-22T08:42:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.317+0000 7fbe80013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.317+0000 7fbe80013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.317+0000 7fbe80013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.317+0000 7fbe80013800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38, ofs0, ns] 2024-09-22T08:42:19.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.318+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562526 cookie 93852630908752 notifier 8055 bl.length()=983 2024-09-22T08:42:19.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.318+0000 7fbd5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 info.flags=0x17 2024-09-22T08:42:19.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.318+0000 7fbd5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 to cache LRU end 2024-09-22T08:42:19.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.318+0000 7fbd5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:19.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.319+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_sources= new_sources= 2024-09-22T08:42:19.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.319+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential sources added=[] removed=[] 2024-09-22T08:42:19.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.319+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): orig_dests= new_dests= 2024-09-22T08:42:19.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.319+0000 7fbe80013800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38]): potential dests added=[] removed=[] 2024-09-22T08:42:19.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.321+0000 7fbe80013800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:42:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.323+0000 7fbd31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.325+0000 7fbe80013800 20 remove_watcher() i=0 2024-09-22T08:42:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.325+0000 7fbe80013800 2 removed watcher, disabling cache 2024-09-22T08:42:19.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.326+0000 7fbe80013800 20 remove_watcher() i=1 2024-09-22T08:42:19.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.327+0000 7fbe80013800 20 remove_watcher() i=2 2024-09-22T08:42:19.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.328+0000 7fbe80013800 20 remove_watcher() i=3 2024-09-22T08:42:19.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.329+0000 7fbe80013800 20 remove_watcher() i=4 2024-09-22T08:42:19.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.330+0000 7fbe80013800 20 remove_watcher() i=5 2024-09-22T08:42:19.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.331+0000 7fbe80013800 20 remove_watcher() i=6 2024-09-22T08:42:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.332+0000 7fbe80013800 20 remove_watcher() i=7 2024-09-22T08:42:19.345 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:42:19.374 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:19.374 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:19.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.412+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.413+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.413+0000 7f934612c800 20 realm 2024-09-22T08:42:19.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.413+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.414+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.415+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:19.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.415+0000 7f934612c800 20 searching for the correct realm 2024-09-22T08:42:19.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.417+0000 7f934253f640 0 -- 172.21.15.78:0/198953645 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f932c04e1f0 msgr2=0x7f932c061c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.621+0000 7f933953d640 0 -- 172.21.15.78:0/198953645 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f933c079070 msgr2=0x7f933c07b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:19.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.626+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:19.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 zone default found 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 4 Realm: () 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 zonegroup default 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.627+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.628+0000 7f934612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.628+0000 7f934612c800 20 started sync module instance, tier type = 2024-09-22T08:42:19.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.628+0000 7f934612c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=0 2024-09-22T08:42:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=1 2024-09-22T08:42:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=2 2024-09-22T08:42:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=3 2024-09-22T08:42:19.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=4 2024-09-22T08:42:19.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=5 2024-09-22T08:42:19.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.636+0000 7f934612c800 20 add_watcher() i=6 2024-09-22T08:42:19.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.637+0000 7f934612c800 20 add_watcher() i=7 2024-09-22T08:42:19.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.637+0000 7f934612c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:19.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f91f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f934612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f934612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f934612c800 5 note: GC not initialized 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f91f27fc640 20 reqs_thread_entry: start 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f934612c800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.639+0000 7f934612c800 20 Filter name: none 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.640+0000 7f9163fff640 20 reqs_thread_entry: start 2024-09-22T08:42:19.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.640+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.640+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:19.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.640+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:19.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.641+0000 7f934612c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:19.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.642+0000 7f934612c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:19.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.643+0000 7f91f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:19.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.645+0000 7f934612c800 20 remove_watcher() i=0 2024-09-22T08:42:19.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.645+0000 7f934612c800 2 removed watcher, disabling cache 2024-09-22T08:42:19.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.646+0000 7f934612c800 20 remove_watcher() i=1 2024-09-22T08:42:19.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.647+0000 7f934612c800 20 remove_watcher() i=2 2024-09-22T08:42:19.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.648+0000 7f934612c800 20 remove_watcher() i=3 2024-09-22T08:42:19.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.649+0000 7f934612c800 20 remove_watcher() i=4 2024-09-22T08:42:19.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.650+0000 7f934612c800 20 remove_watcher() i=5 2024-09-22T08:42:19.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.651+0000 7f934612c800 20 remove_watcher() i=6 2024-09-22T08:42:19.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:19.652+0000 7f934612c800 20 remove_watcher() i=7 2024-09-22T08:42:19.663 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:19.663 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:19.663 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:42:19.663 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:20.034 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-22T08:42:20.034 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:20.853 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:42:20.882 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:20.882 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:20.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.918+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.919+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.919+0000 7fc332b25800 20 realm 2024-09-22T08:42:20.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.919+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.920+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.920+0000 7fc332b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:20.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.920+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.920+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:20.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.920+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.921+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:20.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.921+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:20.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.921+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:20.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.921+0000 7fc332b25800 20 searching for the correct realm 2024-09-22T08:42:20.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:20.922+0000 7fc32e8a2640 0 -- 172.21.15.78:0/3339462015 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x56444f47d860 msgr2=0x56444f47fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.125+0000 7fc32e8a2640 0 -- 172.21.15.78:0/3339462015 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fc32006f5b0 msgr2=0x7fc32006b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.334+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 zone default found 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 4 Realm: () 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 zonegroup default 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.335+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.336+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.336+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.336+0000 7fc332b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.336+0000 7fc332b25800 20 started sync module instance, tier type = 2024-09-22T08:42:21.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.336+0000 7fc332b25800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:21.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=0 2024-09-22T08:42:21.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=1 2024-09-22T08:42:21.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=2 2024-09-22T08:42:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=3 2024-09-22T08:42:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=4 2024-09-22T08:42:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=5 2024-09-22T08:42:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.345+0000 7fc332b25800 20 add_watcher() i=6 2024-09-22T08:42:21.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.346+0000 7fc332b25800 20 add_watcher() i=7 2024-09-22T08:42:21.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.346+0000 7fc332b25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.348+0000 7fc1e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:21.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 5 note: GC not initialized 2024-09-22T08:42:21.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc15ffff640 20 reqs_thread_entry: start 2024-09-22T08:42:21.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:21.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 20 Filter name: none 2024-09-22T08:42:21.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc15dffb640 20 reqs_thread_entry: start 2024-09-22T08:42:21.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.349+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.350+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.350+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.350+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.350+0000 7fc332b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.350+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.351+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:21.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.351+0000 7fc332b25800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.351+0000 7fc332b25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:21.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.351+0000 7fc332b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:21.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.353+0000 7fc1e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.355+0000 7fc332b25800 20 remove_watcher() i=0 2024-09-22T08:42:21.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.355+0000 7fc332b25800 2 removed watcher, disabling cache 2024-09-22T08:42:21.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.356+0000 7fc332b25800 20 remove_watcher() i=1 2024-09-22T08:42:21.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.357+0000 7fc332b25800 20 remove_watcher() i=2 2024-09-22T08:42:21.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.358+0000 7fc332b25800 20 remove_watcher() i=3 2024-09-22T08:42:21.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.358+0000 7fc332b25800 20 remove_watcher() i=4 2024-09-22T08:42:21.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.359+0000 7fc332b25800 20 remove_watcher() i=5 2024-09-22T08:42:21.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.360+0000 7fc332b25800 20 remove_watcher() i=6 2024-09-22T08:42:21.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.361+0000 7fc332b25800 20 remove_watcher() i=7 2024-09-22T08:42:21.372 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:21.373 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:21.373 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:42:21.373 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:21.374 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-22T08:42:21.409 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:21.410 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:21.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.445+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 realm 2024-09-22T08:42:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.447+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.448+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.448+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.449+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:21.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.449+0000 7f9abbf19800 20 searching for the correct realm 2024-09-22T08:42:21.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.451+0000 7f9aba20b640 0 -- 172.21.15.78:0/3416917088 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f9ab0027070 msgr2=0x7f9ab0067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.655+0000 7f9ab9209640 0 -- 172.21.15.78:0/3416917088 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f9ab4033060 msgr2=0x7f9ab4067240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.660+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 zone default found 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 4 Realm: () 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 zonegroup default 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 started sync module instance, tier type = 2024-09-22T08:42:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.661+0000 7f9abbf19800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:21.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=0 2024-09-22T08:42:21.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=1 2024-09-22T08:42:21.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=2 2024-09-22T08:42:21.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=3 2024-09-22T08:42:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=4 2024-09-22T08:42:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=5 2024-09-22T08:42:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.670+0000 7f9abbf19800 20 add_watcher() i=6 2024-09-22T08:42:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.671+0000 7f9abbf19800 20 add_watcher() i=7 2024-09-22T08:42:21.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.671+0000 7f9abbf19800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.673+0000 7f996b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.673+0000 7f9abbf19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.673+0000 7f9abbf19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.673+0000 7f9abbf19800 5 note: GC not initialized 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f996a7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:21.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 20 Filter name: none 2024-09-22T08:42:21.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f98dbfff640 20 reqs_thread_entry: start 2024-09-22T08:42:21.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T08:42:21.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 : miss 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.674+0000 7f9abbf19800 20 rados->read ofs=0 len=0 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.675+0000 7f9abbf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f9abbf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f9abbf19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f9abbf19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f9abbf19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39, ofs0, ns] 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f999cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562531 cookie 93924204009568 notifier 7514 bl.length()=1015 2024-09-22T08:42:21.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f999cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f999cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.680+0000 7f999cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.682+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_sources= new_sources= 2024-09-22T08:42:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.682+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential sources added=[] removed=[] 2024-09-22T08:42:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.682+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_dests= new_dests= 2024-09-22T08:42:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.682+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential dests added=[] removed=[] 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.0 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.0 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.1 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.1 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.2 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.2 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.3 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.3 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.4 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.4 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.5 2024-09-22T08:42:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.5 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.6 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.6 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.7 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.7 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.8 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.8 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.9 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.9 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.10 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.10 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.11 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1.11 2024-09-22T08:42:21.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.686+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.0 2024-09-22T08:42:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.687+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1 2024-09-22T08:42:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.687+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.2 2024-09-22T08:42:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.688+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.3 2024-09-22T08:42:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.688+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.4 2024-09-22T08:42:21.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.689+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.5 2024-09-22T08:42:21.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.689+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.6 2024-09-22T08:42:21.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.690+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.7 2024-09-22T08:42:21.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.690+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.8 2024-09-22T08:42:21.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.691+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.9 2024-09-22T08:42:21.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.692+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.10 2024-09-22T08:42:21.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.695+0000 7f9abbf19800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-22T08:42:21.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.695+0000 7f9abbf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:21.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.695+0000 7f9abbf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 2024-09-22T08:42:21.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.696+0000 7f9abbf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.696+0000 7f9abbf19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.696+0000 7f9abbf19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.696+0000 7f9abbf19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39, ofs0, ns] 2024-09-22T08:42:21.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.697+0000 7f999d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562532 cookie 93924204009568 notifier 7514 bl.length()=1015 2024-09-22T08:42:21.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.697+0000 7f999d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.697+0000 7f999d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.697+0000 7f999d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.698+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_sources= new_sources= 2024-09-22T08:42:21.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.698+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential sources added=[] removed=[] 2024-09-22T08:42:21.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.698+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_dests= new_dests= 2024-09-22T08:42:21.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.698+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential dests added=[] removed=[] 2024-09-22T08:42:21.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.700+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.0 2024-09-22T08:42:21.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.700+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.1 2024-09-22T08:42:21.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.701+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.2 2024-09-22T08:42:21.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.701+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.3 2024-09-22T08:42:21.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.701+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.4 2024-09-22T08:42:21.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.702+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.5 2024-09-22T08:42:21.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.702+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.6 2024-09-22T08:42:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.702+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.7 2024-09-22T08:42:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.703+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.8 2024-09-22T08:42:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.703+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.9 2024-09-22T08:42:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.703+0000 7f9abbf19800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39.10 2024-09-22T08:42:21.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.704+0000 7f9abbf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:21.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.704+0000 7f9abbf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 2024-09-22T08:42:21.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.705+0000 7f9abbf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.705+0000 7f9abbf19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.705+0000 7f9abbf19800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.705+0000 7f9abbf19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39, ofs0, ns] 2024-09-22T08:42:21.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.706+0000 7f999cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562533 cookie 93924204009568 notifier 7514 bl.length()=983 2024-09-22T08:42:21.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.706+0000 7f999cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 info.flags=0x17 2024-09-22T08:42:21.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.706+0000 7f999cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 to cache LRU end 2024-09-22T08:42:21.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.706+0000 7f999cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:21.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.707+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_sources= new_sources= 2024-09-22T08:42:21.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.707+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential sources added=[] removed=[] 2024-09-22T08:42:21.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.707+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): orig_dests= new_dests= 2024-09-22T08:42:21.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.707+0000 7f9abbf19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39]): potential dests added=[] removed=[] 2024-09-22T08:42:21.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.709+0000 7f9abbf19800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:42:21.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.711+0000 7f996b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.713+0000 7f9abbf19800 20 remove_watcher() i=0 2024-09-22T08:42:21.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.713+0000 7f9abbf19800 2 removed watcher, disabling cache 2024-09-22T08:42:21.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.714+0000 7f9abbf19800 20 remove_watcher() i=1 2024-09-22T08:42:21.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.715+0000 7f9abbf19800 20 remove_watcher() i=2 2024-09-22T08:42:21.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.716+0000 7f9abbf19800 20 remove_watcher() i=3 2024-09-22T08:42:21.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.716+0000 7f9abbf19800 20 remove_watcher() i=4 2024-09-22T08:42:21.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.717+0000 7f9abbf19800 20 remove_watcher() i=5 2024-09-22T08:42:21.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.718+0000 7f9abbf19800 20 remove_watcher() i=6 2024-09-22T08:42:21.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.720+0000 7f9abbf19800 20 remove_watcher() i=7 2024-09-22T08:42:21.732 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T08:42:21.761 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:21.761 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:21.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.797+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.999+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.999+0000 7ff9d3546800 20 realm 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:21.999+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.000+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.000+0000 7ff9d3546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.000+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.000+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.000+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.001+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.001+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.002+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:22.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.002+0000 7ff9d3546800 20 searching for the correct realm 2024-09-22T08:42:22.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.004+0000 7ff9d0836640 0 -- 172.21.15.78:0/2034860808 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55e46ababcc0 msgr2=0x55e46abae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:22.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.007+0000 7ff9d0836640 0 -- 172.21.15.78:0/2034860808 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7ff9cc082060 msgr2=0x7ff9cc084460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:42:22.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:22.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:22.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:22.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:22.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:22.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:22.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.214+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 zone default found 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 4 Realm: () 2024-09-22T08:42:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 zonegroup default 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.215+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.216+0000 7ff9d3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.216+0000 7ff9d3546800 20 started sync module instance, tier type = 2024-09-22T08:42:22.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.216+0000 7ff9d3546800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:22.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=0 2024-09-22T08:42:22.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=1 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=2 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=3 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=4 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=5 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.224+0000 7ff9d3546800 20 add_watcher() i=6 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.225+0000 7ff9d3546800 20 add_watcher() i=7 2024-09-22T08:42:22.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.225+0000 7ff9d3546800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:22.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.227+0000 7ff8877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.227+0000 7ff9d3546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:22.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.227+0000 7ff9d3546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:22.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.227+0000 7ff9d3546800 5 note: GC not initialized 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.227+0000 7ff8867e4640 20 reqs_thread_entry: start 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff9d3546800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff9d3546800 20 Filter name: none 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff7f7fff640 20 reqs_thread_entry: start 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:22.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.228+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.229+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:22.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.229+0000 7ff9d3546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:22.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.229+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.230+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:22.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.230+0000 7ff9d3546800 20 rados->read ofs=0 len=0 2024-09-22T08:42:22.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.230+0000 7ff9d3546800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:22.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.230+0000 7ff9d3546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:22.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.232+0000 7ff8877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:22.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.234+0000 7ff9d3546800 20 remove_watcher() i=0 2024-09-22T08:42:22.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.234+0000 7ff9d3546800 2 removed watcher, disabling cache 2024-09-22T08:42:22.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.235+0000 7ff9d3546800 20 remove_watcher() i=1 2024-09-22T08:42:22.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.236+0000 7ff9d3546800 20 remove_watcher() i=2 2024-09-22T08:42:22.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.237+0000 7ff9d3546800 20 remove_watcher() i=3 2024-09-22T08:42:22.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.238+0000 7ff9d3546800 20 remove_watcher() i=4 2024-09-22T08:42:22.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.239+0000 7ff9d3546800 20 remove_watcher() i=5 2024-09-22T08:42:22.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.240+0000 7ff9d3546800 20 remove_watcher() i=6 2024-09-22T08:42:22.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:22.241+0000 7ff9d3546800 20 remove_watcher() i=7 2024-09-22T08:42:22.253 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:22.253 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:22.253 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-22T08:42:22.253 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:22.633 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-22T08:42:22.633 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:23.449 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:42:23.478 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:23.478 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:23.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.513+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 realm 2024-09-22T08:42:23.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.515+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.516+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:23.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.516+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.517+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:23.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.517+0000 7f2cd9b46800 20 searching for the correct realm 2024-09-22T08:42:23.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.519+0000 7f2cd7e38640 0 -- 172.21.15.78:0/2101883933 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2cc0017070 msgr2=0x7f2cc001b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:23.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.724+0000 7f2ccffff640 0 -- 172.21.15.78:0/2101883933 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2cd0032040 msgr2=0x7f2cd006d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:23.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:23.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:23.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:23.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:23.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:23.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:23.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.729+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 zone default found 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 4 Realm: () 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:23.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 zonegroup default 2024-09-22T08:42:23.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.730+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.731+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.731+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.731+0000 7f2cd9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.731+0000 7f2cd9b46800 20 started sync module instance, tier type = 2024-09-22T08:42:23.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.731+0000 7f2cd9b46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=0 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=1 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=2 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=3 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=4 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=5 2024-09-22T08:42:23.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.740+0000 7f2cd9b46800 20 add_watcher() i=6 2024-09-22T08:42:23.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.741+0000 7f2cd9b46800 20 add_watcher() i=7 2024-09-22T08:42:23.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.741+0000 7f2cd9b46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:23.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.743+0000 7f2b8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.743+0000 7f2cd9b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.743+0000 7f2cd9b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.743+0000 7f2cd9b46800 5 note: GC not initialized 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.744+0000 7f2b8cfe1640 20 reqs_thread_entry: start 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.744+0000 7f2cd9b46800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.744+0000 7f2cd9b46800 20 Filter name: none 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.744+0000 7f2b067fc640 20 reqs_thread_entry: start 2024-09-22T08:42:23.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.744+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:23.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:23.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:23.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.745+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:23.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.746+0000 7f2cd9b46800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.746+0000 7f2cd9b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:23.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.746+0000 7f2cd9b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:23.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.747+0000 7f2b8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:23.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.750+0000 7f2cd9b46800 20 remove_watcher() i=0 2024-09-22T08:42:23.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.750+0000 7f2cd9b46800 2 removed watcher, disabling cache 2024-09-22T08:42:23.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.751+0000 7f2cd9b46800 20 remove_watcher() i=1 2024-09-22T08:42:23.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.752+0000 7f2cd9b46800 20 remove_watcher() i=2 2024-09-22T08:42:23.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.753+0000 7f2cd9b46800 20 remove_watcher() i=3 2024-09-22T08:42:23.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.753+0000 7f2cd9b46800 20 remove_watcher() i=4 2024-09-22T08:42:23.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.754+0000 7f2cd9b46800 20 remove_watcher() i=5 2024-09-22T08:42:23.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.755+0000 7f2cd9b46800 20 remove_watcher() i=6 2024-09-22T08:42:23.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.756+0000 7f2cd9b46800 20 remove_watcher() i=7 2024-09-22T08:42:23.768 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:23.768 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:23.768 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:42:23.768 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:23.769 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T08:42:23.804 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:23.804 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:23.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.839+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 realm 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:23.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:23.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:23.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:23.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.842+0000 7f5ca281d800 20 searching for the correct realm 2024-09-22T08:42:23.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:23.844+0000 7f5c9e7ec640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5c8806b020 msgr2=0x7f5c880a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.048+0000 7f5c957ea640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5c9800e070 msgr2=0x7f5c980a57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:24.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:24.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:24.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:24.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:24.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:24.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zone default found 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Realm: () 2024-09-22T08:42:24.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zonegroup default 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.055+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started sync module instance, tier type = 2024-09-22T08:42:24.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=0 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=1 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=2 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=3 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=4 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=5 2024-09-22T08:42:24.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=6 2024-09-22T08:42:24.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.064+0000 7f5ca281d800 20 add_watcher() i=7 2024-09-22T08:42:24.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.064+0000 7f5ca281d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:24.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.065+0000 7f5b4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 5 note: GC not initialized 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5b4e7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:24.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 Filter name: none 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ac3fff640 20 reqs_thread_entry: start 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:24.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : miss 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.067+0000 7f5ca281d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.071+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.071+0000 7f5ca281d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.071+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.071+0000 7f5ca281d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94124887242704 notifier 8166 bl.length()=1015 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:24.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:24.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:24.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.0 2024-09-22T08:42:24.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.079+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1 2024-09-22T08:42:24.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2 2024-09-22T08:42:24.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.3 2024-09-22T08:42:24.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.4 2024-09-22T08:42:24.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.5 2024-09-22T08:42:24.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.6 2024-09-22T08:42:24.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.082+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.7 2024-09-22T08:42:24.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.8 2024-09-22T08:42:24.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.9 2024-09-22T08:42:24.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.084+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.10 2024-09-22T08:42:24.088 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ca281d800 time 2024-09-22T08:42:24.088568+0000 2024-09-22T08:42:24.088 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ca398c748] 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.089 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.088+0000 7f5ca281d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ca281d800 time 2024-09-22T08:42:24.088568+0000 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ca398c748] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:24.090 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.091 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:24.091 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:24.091 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.091 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:42:24.091 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5ca281d800 thread_name:radosgw-admin 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5ca263e6f0] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5ca268b99c] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ca398c7a2] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.110 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.089+0000 7f5ca281d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5ca281d800 thread_name:radosgw-admin 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5ca263e6f0] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5ca268b99c] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ca398c7a2] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.111 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.112 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:42:23.823+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:42:23.824+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:42:23.824+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key hook 0x559b2867e6e8 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b2852a7c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b285c46f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b286afee0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.113 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.613254s 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b285c46f0 auth_method 0 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b286afee0 auth_method 0 2024-09-22T08:42:24.114 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2852a7c0 auth_method 0 2024-09-22T08:42:24.115 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:42:23.824+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.116 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: dump: 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.117 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: dump: 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.118 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:42:23.824+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7556 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.119 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:42:23.824+0000 7f5b8be07640 4 set_mon_vals no callback set 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:42:23.824+0000 7f5ca281d800 1 librados: init done 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:42:23.826+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5b84077570 auth_method 0 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:42:23.827+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b286c6ab0 auth_method 0 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:42:23.827+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b286c9c90 auth_method 0 2024-09-22T08:42:24.120 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:42:23.828+0000 7f5c957ea640 10 monclient: get_auth_request con 0x559b286cde80 auth_method 0 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:42:23.829+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b286cd510 auth_method 0 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:42:23.830+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.121 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.122 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:42:23.830+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x559b286d9560 EEXIST 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.123 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:42:23.830+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:42:23.831+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:42:23.831+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x559b286d5060 EEXIST 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b286fd880 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.124 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b286fdc60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b286fc590 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.620331s 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b286fd880 auth_method 0 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b286fc590 auth_method 0 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.125 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b286fdc60 auth_method 0 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7559 payload 824 2024-09-22T08:42:24.126 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:42:23.831+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: dump: 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.127 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: dump: 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.128 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:42:23.831+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7559 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:42:23.831+0000 7f5c9efed640 4 set_mon_vals no callback set 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:42:23.832+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:42:23.832+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.129 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:42:23.833+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5b78077480 auth_method 0 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: get_monmap_and_config 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:42:23.834+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.130 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.131 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.132 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdebdfc548 EEXIST 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b28721660 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b2874c0d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b2874d480 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.623956s 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b28721660 auth_method 0 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.133 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2874d480 auth_method 0 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7562 payload 274 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:42:23.835+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.134 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: dump: 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.135 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:42:23.835+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7562 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:42:23.835+0000 7f5ca281d800 10 monclient: get_monmap_and_config success 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:42:23.835+0000 7f5ca281d800 4 set_mon_vals no callback set 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: dump: 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.136 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:42:23.835+0000 7f5ca281d800 10 monclient: shutdown 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.137 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.138 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:42:23.836+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: starting msgr at 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: starting objecter 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x559b28722a40 EEXIST 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: setting wanted keys 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: calling monclient init 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.139 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.140 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:42:23.836+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:42:23.837+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x559b28712288 EEXIST 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b28721660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b2874d480 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b2873ef30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.626115s 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b2874d480 auth_method 0 2024-09-22T08:42:24.141 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2873ef30 auth_method 0 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.142 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b28721660 auth_method 0 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_done global_id 8166 payload 824 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.143 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 1 monclient: found mon.noname-a 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: dump: 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.144 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: dump: 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.145 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 monclient: authenticate success, global_id 8166 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:42:23.837+0000 7f5b817fa640 4 set_mon_vals no callback set 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.146 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:42:23.837+0000 7f5ca281d800 1 librados: init done 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cr dump hook 0x559b2874a918 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:42:23.839+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:42:23.840+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5b68077570 auth_method 0 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:42:23.840+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b2876c3a0 auth_method 0 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 realm 2024-09-22T08:42:24.147 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:42:23.841+0000 7f5ca281d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:42:23.841+0000 7f5c957ea640 10 monclient: get_auth_request con 0x559b287705b0 auth_method 0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:42:23.842+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b28773e10 auth_method 0 2024-09-22T08:42:24.148 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 searching for the correct realm 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:42:23.843+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b28778b50 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:42:23.843+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5c9002fbd0 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:42:23.844+0000 7f5c9e7ec640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5c8806b020 msgr2=0x7f5c880a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:42:23.844+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5c8806b020 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:42:24.045+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5c8806b020 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:42:24.046+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5c9002eb00 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:42:24.048+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5c9800e070 auth_method 0 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:42:24.048+0000 7f5c957ea640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5c9800e070 msgr2=0x7f5c980a57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 1 client.8166.objecter ms_handle_reset 0x7f5c9800e070 session 0x7f5c98037070 osd.3 2024-09-22T08:42:24.149 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 10 monclient: _renew_subs 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:42:24.049+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5b68087790 auth_method 0 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.150 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zone default found 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Realm: () 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:42:24.054+0000 7f5ca281d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:24.151 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zonegroup default 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started sync module instance, tier type = 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=0 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=1 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=2 2024-09-22T08:42:24.152 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=3 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=4 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=5 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=6 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:42:24.064+0000 7f5ca281d800 20 add_watcher() i=7 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:42:24.064+0000 7f5ca281d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.153 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:42:24.065+0000 7f5b4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:42:24.066+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache list hook 0x559b2873f350 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache inspect hook 0x559b2873f350 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache erase hook 0x559b2873f350 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache zap hook 0x559b2873f350 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 note: GC not initialized 2024-09-22T08:42:24.154 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:42:24.066+0000 7f5b4e7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace show hook 0x7f5c90002d60 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace history hook 0x7f5c90002d60 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace active hook 0x7f5c90002d60 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace active_short hook 0x7f5c90002d60 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 Filter name: none 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:42:24.066+0000 7f5ac3fff640 20 reqs_thread_entry: start 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : miss 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.155 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:42:24.067+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94124887242704 notifier 8166 bl.length()=1015 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.156 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:42:24.074+0000 7f5b6f7fe640 1 client.8166.objecter ms_handle_reset 0x7f5c9002eb00 session 0x7f5c9002e990 osd.5 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:42:24.074+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5c9800e070 auth_method 0 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.157 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.158 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.0 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:42:24.079+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.3 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.4 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.5 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.6 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:42:24.082+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.7 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.8 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.9 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:42:24.084+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.10 2024-09-22T08:42:24.159 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:42:24.088+0000 7f5ca281d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ca281d800 time 2024-09-22T08:42:24.088568+0000 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ca398c748] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:42:24.089+0000 7f5ca281d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:24.160 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5ca281d800 thread_name:radosgw-admin 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5ca263e6f0] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5ca268b99c] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ca398c7a2] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.161 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:42:24.162 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:42:24.163 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:42:24.164 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:42:24.165 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:42:24.166 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:42:24.167 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:42:24.168 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5ac3fff640 / http_manager 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b4e7fc640 / http_manager 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b4f7fe640 / rgw_dt_lg_renew 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b6f7fe640 / ms_dispatch 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b80ff9640 / io_context_pool 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b817fa640 / io_context_pool 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b837fe640 / ms_dispatch 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b8a604640 / ms_dispatch 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b8be07640 / io_context_pool 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c957ea640 / msgr-worker-2 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9dfeb640 / msgr-worker-1 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9e7ec640 / msgr-worker-0 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9efed640 / io_context_pool 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5ca281d800 / radosgw-admin 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:42:24.169 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.144597.log 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: crc 2024-09-22T08:42:24.170 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:42:23.823+0000 7f5ca281d800 5 AuthRegistry(0x559b2867e5a0) adding con mode: secure 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:42:23.823+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:42:23.824+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:42:23.824+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key hook 0x559b2867e6e8 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b2852a7c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b285c46f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b286afee0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.171 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.613254s 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b285c46f0 auth_method 0 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b286afee0 auth_method 0 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.172 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:42:23.824+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2852a7c0 auth_method 0 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:42:23.824+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:42:23.824+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:42:23.824+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.173 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: dump: 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.174 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:42:23.824+0000 7f5b8a604640 10 monclient: dump: 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.175 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:42:23.824+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7556 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:42:23.824+0000 7f5b8be07640 4 set_mon_vals no callback set 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:42:23.824+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:42:23.824+0000 7f5ca281d800 1 librados: init done 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.176 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:42:23.826+0000 7f5b8a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:42:23.826+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5b84077570 auth_method 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:42:23.827+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b286c6ab0 auth_method 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:42:23.827+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b286c9c90 auth_method 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:42:23.828+0000 7f5c957ea640 10 monclient: get_auth_request con 0x559b286cde80 auth_method 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:42:23.829+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b286cd510 auth_method 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:42:23.830+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.177 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.178 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding auth protocol: cephx 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.179 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: crc 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d6110) adding con mode: secure 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:42:23.830+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x559b286d9560 EEXIST 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:42:23.830+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding auth protocol: cephx 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.180 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: crc 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:42:23.830+0000 7f5ca281d800 5 AuthRegistry(0x559b286d4f18) adding con mode: secure 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:42:23.830+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:42:23.831+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:42:23.831+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x559b286d5060 EEXIST 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b286fd880 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b286fdc60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b286fc590 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.181 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.620331s 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b286fd880 auth_method 0 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b286fc590 auth_method 0 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.182 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b286fdc60 auth_method 0 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:42:23.831+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:42:23.831+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.183 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7559 payload 824 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:42:23.831+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:42:23.831+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: dump: 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.184 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:42:23.831+0000 7f5b837fe640 10 monclient: dump: 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.185 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:42:23.831+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7559 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:42:23.831+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:42:23.831+0000 7f5c9efed640 4 set_mon_vals no callback set 2024-09-22T08:42:24.186 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:42:23.832+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:42:23.832+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:42:23.833+0000 7f5b837fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:42:23.833+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5b78077480 auth_method 0 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: get_monmap_and_config 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:42:23.834+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.187 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding auth protocol: cephx 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.188 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: crc 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x559b2871d550) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding auth protocol: cephx 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.189 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: crc 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc400) adding con mode: secure 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:42:23.834+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:42:23.834+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdebdfc548 EEXIST 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b28721660 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b2874c0d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.190 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b2874d480 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:42:23.834+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.623956s 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b28721660 auth_method 0 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2874d480 auth_method 0 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.191 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:42:23.835+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient(hunting): handle_auth_done global_id 7562 payload 274 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:42:23.835+0000 7f5c957ea640 1 monclient: found mon.noname-c 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:42:23.835+0000 7f5c957ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: dump: 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.192 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:42:23.835+0000 7f5ca281d800 5 monclient: authenticate success, global_id 7562 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:42:23.835+0000 7f5ca281d800 10 monclient: get_monmap_and_config success 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:42:23.835+0000 7f5ca281d800 4 set_mon_vals no callback set 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:42:23.835+0000 7f5b817fa640 10 monclient: dump: 2024-09-22T08:42:24.193 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:42:23.835+0000 7f5ca281d800 10 monclient: shutdown 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: build_initial_monmap 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 build_initial for_mkfs: 0 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: monmap: 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:24.194 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding auth protocol: cephx 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.195 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: crc 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28722240) adding con mode: secure 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:42:23.836+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: starting msgr at 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: starting objecter 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command objecter_requests cmddesc objecter_requests hook 0x559b28722a40 EEXIST 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: setting wanted keys 2024-09-22T08:42:24.196 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:42:23.836+0000 7f5ca281d800 1 librados: calling monclient init 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:42:23.836+0000 7f5ca281d800 10 monclient: init 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding auth protocol: cephx 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.197 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: crc 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:42:23.836+0000 7f5ca281d800 5 AuthRegistry(0x559b28712140) adding con mode: secure 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:42:23.836+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:42:23.837+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command rotate-key cmddesc rotate-key hook 0x559b28712288 EEXIST 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-b con 0x559b28721660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-a con 0x559b2874d480 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): picked mon.noname-c con 0x559b2873ef30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.198 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient(hunting): authenticate will time out at 2259.626115s 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request con 0x559b2874d480 auth_method 0 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request con 0x559b2873ef30 auth_method 0 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.199 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): get_auth_request con 0x559b28721660 auth_method 0 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:42:23.837+0000 7f5c9dfeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:42:23.837+0000 7f5c957ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient(hunting): handle_auth_done global_id 8166 payload 824 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient: _finish_hunting 0 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 1 monclient: found mon.noname-a 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:42:23.837+0000 7f5c9e7ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.200 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: dump: 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: _finish_auth 0 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: _check_auth_tickets 2024-09-22T08:42:24.201 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:42:23.837+0000 7f5b6f7fe640 10 monclient: dump: 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.202 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 monclient: authenticate success, global_id 8166 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:42:23.837+0000 7f5b817fa640 4 set_mon_vals no callback set 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _renew_subs 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:42:23.837+0000 7f5ca281d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:42:23.837+0000 7f5ca281d800 1 librados: init done 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:42:23.837+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cr dump hook 0x559b2874a918 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:42:23.839+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:42:23.839+0000 7f5b6f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:42:23.840+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5b68077570 auth_method 0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:42:23.840+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b2876c3a0 auth_method 0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.203 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 realm 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:42:23.841+0000 7f5ca281d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:42:23.841+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:42:23.841+0000 7f5c957ea640 10 monclient: get_auth_request con 0x559b287705b0 auth_method 0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:42:23.842+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x559b28773e10 auth_method 0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:42:23.842+0000 7f5ca281d800 20 searching for the correct realm 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:42:23.843+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x559b28778b50 auth_method 0 2024-09-22T08:42:24.204 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:42:23.843+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5c9002fbd0 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:42:23.844+0000 7f5c9e7ec640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5c8806b020 msgr2=0x7f5c880a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:42:23.844+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5c8806b020 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:42:24.045+0000 7f5c9e7ec640 10 monclient: get_auth_request con 0x7f5c8806b020 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:42:24.046+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5c9002eb00 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:42:24.048+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5c9800e070 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:42:24.048+0000 7f5c957ea640 0 -- 172.21.15.78:0/2632561730 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5c9800e070 msgr2=0x7f5c980a57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 1 client.8166.objecter ms_handle_reset 0x7f5c9800e070 session 0x7f5c98037070 osd.3 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 10 monclient: _renew_subs 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:42:24.048+0000 7f5b6f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:42:24.049+0000 7f5c957ea640 10 monclient: get_auth_request con 0x7f5b68087790 auth_method 0 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:24.205 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:42:24.053+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zone default found 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Realm: () 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:42:24.054+0000 7f5ca281d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:42:24.054+0000 7f5ca281d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 zonegroup default 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.206 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:42:24.054+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started sync module instance, tier type = 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:42:24.055+0000 7f5ca281d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=0 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=1 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=2 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=3 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=4 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=5 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:42:24.063+0000 7f5ca281d800 20 add_watcher() i=6 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:42:24.064+0000 7f5ca281d800 20 add_watcher() i=7 2024-09-22T08:42:24.207 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:42:24.064+0000 7f5ca281d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding auth protocol: cephx 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: crc 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:42:24.065+0000 7f5ca281d800 5 AuthRegistry(0x7ffdebdfc8d0) adding con mode: secure 2024-09-22T08:42:24.208 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:42:24.065+0000 7f5b4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:42:24.066+0000 7f5ca281d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache list hook 0x559b2873f350 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache inspect hook 0x559b2873f350 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache erase hook 0x559b2873f350 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command cache zap hook 0x559b2873f350 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 note: GC not initialized 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:42:24.066+0000 7f5b4e7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace show hook 0x7f5c90002d60 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace history hook 0x7f5c90002d60 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace active hook 0x7f5c90002d60 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:42:24.066+0000 7f5ca281d800 5 asok(0x559b2845c0f0) register_command sync trace active_short hook 0x7f5c90002d60 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:24.209 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 Filter name: none 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:42:24.066+0000 7f5ac3fff640 20 reqs_thread_entry: start 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:42:24.066+0000 7f5ca281d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : miss 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:42:24.066+0000 7f5ca281d800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:42:24.067+0000 7f5ca281d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:42:24.067+0000 7f5ca281d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.210 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:42:24.071+0000 7f5ca281d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94124887242704 notifier 8166 bl.length()=1015 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:42:24.072+0000 7f5b80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:42:24.073+0000 7f5ca281d800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:42:24.074+0000 7f5b6f7fe640 1 client.8166.objecter ms_handle_reset 0x7f5c9002eb00 session 0x7f5c9002e990 osd.5 2024-09-22T08:42:24.211 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:42:24.074+0000 7f5c9dfeb640 10 monclient: get_auth_request con 0x7f5c9800e070 auth_method 0 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.0 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.1 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.2 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.3 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.4 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.5 2024-09-22T08:42:24.212 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.6 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.7 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.8 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.9 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.10 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:42:24.078+0000 7f5ca281d800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1.11 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:42:24.078+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.0 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:42:24.079+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:42:24.080+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.3 2024-09-22T08:42:24.213 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.4 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.5 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:42:24.081+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.6 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:42:24.082+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.7 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.8 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:42:24.083+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.9 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:42:24.084+0000 7f5ca281d800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.10 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:42:24.088+0000 7f5ca281d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5ca281d800 time 2024-09-22T08:42:24.088568+0000 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ca398c748] 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.214 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:42:24.089+0000 7f5ca281d800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5ca281d800 thread_name:radosgw-admin 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5ca263e6f0] 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5ca268b99c] 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:24.215 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ca398c7a2] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f5ca398c906] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b27202e01] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x559b27211e9b] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559b27212d64] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5ca2629590] 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:42:24.216 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:42:24.217 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:42:24.218 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:42:24.219 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:42:24.220 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:42:24.221 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5ac3fff640 / http_manager 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b4e7fc640 / http_manager 2024-09-22T08:42:24.222 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b4f7fe640 / rgw_dt_lg_renew 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b6f7fe640 / ms_dispatch 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b80ff9640 / io_context_pool 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b817fa640 / io_context_pool 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b837fe640 / ms_dispatch 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b8a604640 / ms_dispatch 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5b8be07640 / io_context_pool 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c957ea640 / msgr-worker-2 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9dfeb640 / msgr-worker-1 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9e7ec640 / msgr-worker-0 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c9efed640 / io_context_pool 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5ca281d800 / radosgw-admin 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:42:24.090192Z_5d4ac1e4-b67e-4aeb-a3d8-f74230d90ea4/log 2024-09-22T08:42:24.223 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:42:24.224 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:42:24.224 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:24.224 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.364+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.366+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.366+0000 7ff8ad72c800 20 realm 2024-09-22T08:42:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.366+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.367+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.367+0000 7ff8ad72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:24.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.367+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.367+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.367+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.368+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.368+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.368+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:24.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.368+0000 7ff8ad72c800 20 searching for the correct realm 2024-09-22T08:42:24.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.370+0000 7ff8a0c4e640 0 -- 172.21.15.78:0/1526274855 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7ff89c06f430 msgr2=0x7ff89c06f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.373+0000 7ff8a0c4e640 0 -- 172.21.15.78:0/1526274855 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55aea4349890 msgr2=0x55aea434bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.378+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 zone default found 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 4 Realm: () 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:24.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 zonegroup default 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.379+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.380+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.380+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.380+0000 7ff8ad72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.380+0000 7ff8ad72c800 20 started sync module instance, tier type = 2024-09-22T08:42:24.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.380+0000 7ff8ad72c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:24.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=0 2024-09-22T08:42:24.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=1 2024-09-22T08:42:24.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=2 2024-09-22T08:42:24.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=3 2024-09-22T08:42:24.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=4 2024-09-22T08:42:24.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=5 2024-09-22T08:42:24.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.389+0000 7ff8ad72c800 20 add_watcher() i=6 2024-09-22T08:42:24.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.390+0000 7ff8ad72c800 20 add_watcher() i=7 2024-09-22T08:42:24.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.390+0000 7ff8ad72c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff75f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 5 note: GC not initialized 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff75e7e4640 20 reqs_thread_entry: start 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 20 Filter name: none 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff6cffff640 20 reqs_thread_entry: start 2024-09-22T08:42:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.392+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.393+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.393+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.393+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.393+0000 7ff8ad72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.393+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.394+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.394+0000 7ff8ad72c800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.394+0000 7ff8ad72c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:42:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.394+0000 7ff8ad72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:24.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.396+0000 7ff75f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.398+0000 7ff8ad72c800 20 remove_watcher() i=0 2024-09-22T08:42:24.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.398+0000 7ff8ad72c800 2 removed watcher, disabling cache 2024-09-22T08:42:24.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.399+0000 7ff8ad72c800 20 remove_watcher() i=1 2024-09-22T08:42:24.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.400+0000 7ff8ad72c800 20 remove_watcher() i=2 2024-09-22T08:42:24.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.401+0000 7ff8ad72c800 20 remove_watcher() i=3 2024-09-22T08:42:24.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.402+0000 7ff8ad72c800 20 remove_watcher() i=4 2024-09-22T08:42:24.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.403+0000 7ff8ad72c800 20 remove_watcher() i=5 2024-09-22T08:42:24.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.404+0000 7ff8ad72c800 20 remove_watcher() i=6 2024-09-22T08:42:24.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.405+0000 7ff8ad72c800 20 remove_watcher() i=7 2024-09-22T08:42:24.416 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.416 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:24.417 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-22T08:42:24.417 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:24.507 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:42:24.538 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:24.538 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:24.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.574+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 realm 2024-09-22T08:42:24.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.576+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.577+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.577+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.578+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:24.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.578+0000 7f674a528800 20 searching for the correct realm 2024-09-22T08:42:24.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.580+0000 7f6746a70640 0 -- 172.21.15.78:0/1984641214 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f673008c040 msgr2=0x7f673008c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.786+0000 7f673da6e640 0 -- 172.21.15.78:0/1984641214 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f6740024040 msgr2=0x7f6740068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:24.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:24.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.991+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:24.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 zone default found 2024-09-22T08:42:24.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 4 Realm: () 2024-09-22T08:42:24.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.992+0000 7f674a528800 20 zonegroup default 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.993+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.993+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.993+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.993+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.993+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.994+0000 7f674a528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.994+0000 7f674a528800 20 started sync module instance, tier type = 2024-09-22T08:42:24.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:24.994+0000 7f674a528800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.002+0000 7f674a528800 20 add_watcher() i=0 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.002+0000 7f674a528800 20 add_watcher() i=1 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.002+0000 7f674a528800 20 add_watcher() i=2 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.003+0000 7f674a528800 20 add_watcher() i=3 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.003+0000 7f674a528800 20 add_watcher() i=4 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.003+0000 7f674a528800 20 add_watcher() i=5 2024-09-22T08:42:25.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.003+0000 7f674a528800 20 add_watcher() i=6 2024-09-22T08:42:25.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.004+0000 7f674a528800 20 add_watcher() i=7 2024-09-22T08:42:25.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.004+0000 7f674a528800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:25.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.005+0000 7f65fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:25.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 5 note: GC not initialized 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f65777fe640 20 reqs_thread_entry: start 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 20 Filter name: none 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f65757fa640 20 reqs_thread_entry: start 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:42:25.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.006+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : miss 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:25.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.007+0000 7f674a528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:25.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.008+0000 7f674a528800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to be held by another RGW process; skipping for now 2024-09-22T08:42:25.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.009+0000 7f65fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:25.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.011+0000 7f674a528800 20 remove_watcher() i=0 2024-09-22T08:42:25.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.011+0000 7f674a528800 2 removed watcher, disabling cache 2024-09-22T08:42:25.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.012+0000 7f674a528800 20 remove_watcher() i=1 2024-09-22T08:42:25.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.013+0000 7f674a528800 20 remove_watcher() i=2 2024-09-22T08:42:25.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.014+0000 7f674a528800 20 remove_watcher() i=3 2024-09-22T08:42:25.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.015+0000 7f674a528800 20 remove_watcher() i=4 2024-09-22T08:42:25.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.016+0000 7f674a528800 20 remove_watcher() i=5 2024-09-22T08:42:25.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.017+0000 7f674a528800 20 remove_watcher() i=6 2024-09-22T08:42:25.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:25.018+0000 7f674a528800 20 remove_watcher() i=7 2024-09-22T08:42:25.029 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T08:42:55.037 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-22T08:42:55.071 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:55.071 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:55.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.119+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 realm 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.120+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.121+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:55.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.121+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.122+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:55.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.122+0000 7f6f42a2f800 20 searching for the correct realm 2024-09-22T08:42:55.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.125+0000 7f6f3e5cd640 0 -- 172.21.15.78:0/547291578 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f6f2805fd20 msgr2=0x7f6f28069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:55.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.331+0000 7f6f37fff640 0 -- 172.21.15.78:0/547291578 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f6f38030060 msgr2=0x7f6f38071bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:55.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.336+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:55.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 zone default found 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 4 Realm: () 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 zonegroup default 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.337+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.338+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.338+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.338+0000 7f6f42a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.338+0000 7f6f42a2f800 20 started sync module instance, tier type = 2024-09-22T08:42:55.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.338+0000 7f6f42a2f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=0 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=1 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=2 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=3 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=4 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=5 2024-09-22T08:42:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.348+0000 7f6f42a2f800 20 add_watcher() i=6 2024-09-22T08:42:55.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.349+0000 7f6f42a2f800 20 add_watcher() i=7 2024-09-22T08:42:55.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.349+0000 7f6f42a2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:55.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6f42a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6f42a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6f42a2f800 5 note: GC not initialized 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6dee7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6f42a2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6f42a2f800 20 Filter name: none 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.351+0000 7f6d63fff640 20 reqs_thread_entry: start 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T08:42:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:55.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T08:42:55.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T08:42:55.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : miss 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.352+0000 7f6f42a2f800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 20 rados_obj.operate() r=0 bl.length=475 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.353+0000 7f6f42a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:55.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.354+0000 7f6f42a2f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:42:55.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.361+0000 7f6f42a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.361+0000 7f6f42a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.361+0000 7f6f42a2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.361+0000 7f6f42a2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.362+0000 7f6e217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94038395470560 notifier 8223 bl.length()=1015 2024-09-22T08:42:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.362+0000 7f6e217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.362+0000 7f6e217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.362+0000 7f6e217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.364+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:55.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.364+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:55.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.364+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:55.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.364+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.0 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.0 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.1 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.1 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.2 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.2 2024-09-22T08:42:55.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.3 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.3 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.4 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.4 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.5 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.5 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.6 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.6 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.7 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.369+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.7 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.8 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.8 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.9 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.9 2024-09-22T08:42:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.10 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.10 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.11 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2.11 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.0 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.370+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1 2024-09-22T08:42:55.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.371+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2 2024-09-22T08:42:55.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.371+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.3 2024-09-22T08:42:55.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.372+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.4 2024-09-22T08:42:55.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.372+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.5 2024-09-22T08:42:55.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.373+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.6 2024-09-22T08:42:55.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.373+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.7 2024-09-22T08:42:55.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.374+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.8 2024-09-22T08:42:55.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.374+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.9 2024-09-22T08:42:55.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.375+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.10 2024-09-22T08:42:55.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.378+0000 7f6f42a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:55.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.378+0000 7f6f42a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:55.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6f42a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6f42a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6f42a2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6f42a2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:55.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6e20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94038395470560 notifier 8223 bl.length()=1015 2024-09-22T08:42:55.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6e20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6e20ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.379+0000 7f6e20ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.381+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:55.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.381+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:55.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.381+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:55.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.381+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:55.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.383+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.0 2024-09-22T08:42:55.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.383+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.1 2024-09-22T08:42:55.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.384+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.2 2024-09-22T08:42:55.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.384+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.3 2024-09-22T08:42:55.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.384+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.4 2024-09-22T08:42:55.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.385+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.5 2024-09-22T08:42:55.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.385+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.6 2024-09-22T08:42:55.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.385+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.7 2024-09-22T08:42:55.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.386+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.8 2024-09-22T08:42:55.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.386+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.9 2024-09-22T08:42:55.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.386+0000 7f6f42a2f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40.10 2024-09-22T08:42:55.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.387+0000 7f6f42a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 : hit (requested=0x17, cached=0x17) 2024-09-22T08:42:55.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.387+0000 7f6f42a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 2024-09-22T08:42:55.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6f42a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6f42a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6f42a2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6f42a2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40, ofs0, ns] 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6e217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94038395470560 notifier 8223 bl.length()=983 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6e217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 info.flags=0x17 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6e217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 to cache LRU end 2024-09-22T08:42:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.388+0000 7f6e217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-22T08:42:55.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.390+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_sources= new_sources= 2024-09-22T08:42:55.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.390+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential sources added=[] removed=[] 2024-09-22T08:42:55.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.390+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): orig_dests= new_dests= 2024-09-22T08:42:55.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.390+0000 7f6f42a2f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40]): potential dests added=[] removed=[] 2024-09-22T08:42:55.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.392+0000 7f6f42a2f800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-22T08:42:55.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.394+0000 7f6def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:55.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.396+0000 7f6f42a2f800 20 remove_watcher() i=0 2024-09-22T08:42:55.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.396+0000 7f6f42a2f800 2 removed watcher, disabling cache 2024-09-22T08:42:55.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.398+0000 7f6f42a2f800 20 remove_watcher() i=1 2024-09-22T08:42:55.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.399+0000 7f6f42a2f800 20 remove_watcher() i=2 2024-09-22T08:42:55.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.400+0000 7f6f42a2f800 20 remove_watcher() i=3 2024-09-22T08:42:55.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.401+0000 7f6f42a2f800 20 remove_watcher() i=4 2024-09-22T08:42:55.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.402+0000 7f6f42a2f800 20 remove_watcher() i=5 2024-09-22T08:42:55.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.403+0000 7f6f42a2f800 20 remove_watcher() i=6 2024-09-22T08:42:55.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.404+0000 7f6f42a2f800 20 remove_watcher() i=7 2024-09-22T08:42:55.417 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T08:42:55.445 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:55.445 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:55.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.481+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 realm 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.483+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.484+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:55.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.484+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.485+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:55.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.485+0000 7fecb2121800 20 searching for the correct realm 2024-09-22T08:42:55.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.487+0000 7fecae645640 0 -- 172.21.15.78:0/4249451673 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fec98064410 msgr2=0x7fec98064850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:55.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.693+0000 7feca5643640 0 -- 172.21.15.78:0/4249451673 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7feca8051fc0 msgr2=0x7feca8060560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:55.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:55.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.698+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 zone default found 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 4 Realm: () 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 zonegroup default 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.699+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.700+0000 7fecb2121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:55.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.700+0000 7fecb2121800 20 started sync module instance, tier type = 2024-09-22T08:42:55.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.700+0000 7fecb2121800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=0 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=1 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=2 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=3 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=4 2024-09-22T08:42:55.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=5 2024-09-22T08:42:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.709+0000 7fecb2121800 20 add_watcher() i=6 2024-09-22T08:42:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.710+0000 7fecb2121800 20 add_watcher() i=7 2024-09-22T08:42:55.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.710+0000 7fecb2121800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:55.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.712+0000 7feb5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.712+0000 7fecb2121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.712+0000 7fecb2121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.712+0000 7fecb2121800 5 note: GC not initialized 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7feb5e7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7fecb2121800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7fecb2121800 20 Filter name: none 2024-09-22T08:42:55.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7feacffff640 20 reqs_thread_entry: start 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.713+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.714+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.714+0000 7fecb2121800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:55.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.714+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.714+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=221 2024-09-22T08:42:55.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.714+0000 7fecb2121800 20 rados->read ofs=0 len=0 2024-09-22T08:42:55.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.715+0000 7fecb2121800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T08:42:55.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.715+0000 7fecb2121800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:55.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.716+0000 7feb5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:55.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.718+0000 7fecb2121800 20 remove_watcher() i=0 2024-09-22T08:42:55.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.718+0000 7fecb2121800 2 removed watcher, disabling cache 2024-09-22T08:42:55.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.719+0000 7fecb2121800 20 remove_watcher() i=1 2024-09-22T08:42:55.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.720+0000 7fecb2121800 20 remove_watcher() i=2 2024-09-22T08:42:55.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.722+0000 7fecb2121800 20 remove_watcher() i=3 2024-09-22T08:42:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.723+0000 7fecb2121800 20 remove_watcher() i=4 2024-09-22T08:42:55.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.724+0000 7fecb2121800 20 remove_watcher() i=5 2024-09-22T08:42:55.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.725+0000 7fecb2121800 20 remove_watcher() i=6 2024-09-22T08:42:55.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:55.726+0000 7fecb2121800 20 remove_watcher() i=7 2024-09-22T08:42:55.737 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:55.737 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-22T08:42:55.737 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.108 INFO:tasks.workunit.client.0.smithi078.stderr: test: logrecord could be stopped after reshard failed 2024-09-22T08:42:56.109 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:42:56.137 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:56.137 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:56.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.172+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 realm 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.174+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.175+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.175+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.176+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.176+0000 7f116c539800 20 searching for the correct realm 2024-09-22T08:42:56.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.178+0000 7f11689c8640 0 -- 172.21.15.78:0/3630997159 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f11500930c0 msgr2=0x7f115009aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.181+0000 7f115ffff640 0 -- 172.21.15.78:0/3630997159 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f11600779b0 msgr2=0x7f116004b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.185+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 zone default found 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 4 Realm: () 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 zonegroup default 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.186+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.187+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.187+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.187+0000 7f116c539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.187+0000 7f116c539800 20 started sync module instance, tier type = 2024-09-22T08:42:56.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.187+0000 7f116c539800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=0 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=1 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=2 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=3 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=4 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=5 2024-09-22T08:42:56.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.198+0000 7f116c539800 20 add_watcher() i=6 2024-09-22T08:42:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.199+0000 7f116c539800 20 add_watcher() i=7 2024-09-22T08:42:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.199+0000 7f116c539800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f101efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f116c539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f116c539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f116c539800 5 note: GC not initialized 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f101dfdb640 20 reqs_thread_entry: start 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f116c539800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.201+0000 7f116c539800 20 Filter name: none 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f0f8f7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.202+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.203+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.203+0000 7f116c539800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.203+0000 7f116c539800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.203+0000 7f116c539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.205+0000 7f101efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.207+0000 7f116c539800 20 remove_watcher() i=0 2024-09-22T08:42:56.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.207+0000 7f116c539800 2 removed watcher, disabling cache 2024-09-22T08:42:56.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.208+0000 7f116c539800 20 remove_watcher() i=1 2024-09-22T08:42:56.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.209+0000 7f116c539800 20 remove_watcher() i=2 2024-09-22T08:42:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.211+0000 7f116c539800 20 remove_watcher() i=3 2024-09-22T08:42:56.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.212+0000 7f116c539800 20 remove_watcher() i=4 2024-09-22T08:42:56.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.213+0000 7f116c539800 20 remove_watcher() i=5 2024-09-22T08:42:56.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.214+0000 7f116c539800 20 remove_watcher() i=6 2024-09-22T08:42:56.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.215+0000 7f116c539800 20 remove_watcher() i=7 2024-09-22T08:42:56.227 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.227 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:42:56.227 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-22T08:42:56.227 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.228 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:42:56.257 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:56.257 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:56.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.292+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 realm 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.294+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.295+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.295+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.296+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.296+0000 7f68e872e800 20 searching for the correct realm 2024-09-22T08:42:56.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.298+0000 7f68e4364640 0 -- 172.21.15.78:0/504008108 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55f772d50c40 msgr2=0x55f772d53090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.301+0000 7f68e4b65640 0 -- 172.21.15.78:0/504008108 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x55f772d58640 msgr2=0x55f772d5aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.305+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 zone default found 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 4 Realm: () 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 zonegroup default 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.306+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 started sync module instance, tier type = 2024-09-22T08:42:56.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.307+0000 7f68e872e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=0 2024-09-22T08:42:56.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=1 2024-09-22T08:42:56.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=2 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=3 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=4 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=5 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.315+0000 7f68e872e800 20 add_watcher() i=6 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.316+0000 7f68e872e800 20 add_watcher() i=7 2024-09-22T08:42:56.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.316+0000 7f68e872e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f679afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 5 note: GC not initialized 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f6799fdb640 20 reqs_thread_entry: start 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 20 Filter name: none 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f670b7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:56.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.318+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.319+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.319+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.319+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.319+0000 7f68e872e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.319+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.320+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.320+0000 7f68e872e800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.320+0000 7f68e872e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.320+0000 7f68e872e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.321+0000 7f679afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.323+0000 7f68e872e800 20 remove_watcher() i=0 2024-09-22T08:42:56.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.323+0000 7f68e872e800 2 removed watcher, disabling cache 2024-09-22T08:42:56.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.324+0000 7f68e872e800 20 remove_watcher() i=1 2024-09-22T08:42:56.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.325+0000 7f68e872e800 20 remove_watcher() i=2 2024-09-22T08:42:56.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.326+0000 7f68e872e800 20 remove_watcher() i=3 2024-09-22T08:42:56.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.327+0000 7f68e872e800 20 remove_watcher() i=4 2024-09-22T08:42:56.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.328+0000 7f68e872e800 20 remove_watcher() i=5 2024-09-22T08:42:56.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.329+0000 7f68e872e800 20 remove_watcher() i=6 2024-09-22T08:42:56.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.330+0000 7f68e872e800 20 remove_watcher() i=7 2024-09-22T08:42:56.342 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T08:42:56.375 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:56.375 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:56.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.411+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 realm 2024-09-22T08:42:56.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.415+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.415+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.416+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.416+0000 7f371d840800 20 searching for the correct realm 2024-09-22T08:42:56.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.418+0000 7f371bb2b640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3704028070 msgr2=0x7f3704036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.623+0000 7f3712b29640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f37140c1040 msgr2=0x7f37140b68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.627+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 zone default found 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 4 Realm: () 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 zonegroup default 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 started sync module instance, tier type = 2024-09-22T08:42:56.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.629+0000 7f371d840800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=0 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=1 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=2 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=3 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=4 2024-09-22T08:42:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=5 2024-09-22T08:42:56.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=6 2024-09-22T08:42:56.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.639+0000 7f371d840800 20 add_watcher() i=7 2024-09-22T08:42:56.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.639+0000 7f371d840800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.640+0000 7f35d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 5 note: GC not initialized 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f35d0fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 20 Filter name: none 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f354a7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.641+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.642+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.642+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:42:56.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.642+0000 7f371d840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.642+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.642+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.643+0000 7f371d840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:42:56.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.647+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.647+0000 7f371d840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.647+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.647+0000 7f371d840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562536 cookie 94578943482896 notifier 8301 bl.length()=911 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:42:56.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:42:56.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:42:56.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.656+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.656+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.660+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.660+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.663 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f371d840800 time 2024-09-22T08:42:56.663045+0000 2024-09-22T08:42:56.663 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:56.663 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3720d8c748] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.662+0000 7f371d840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f371d840800 time 2024-09-22T08:42:56.663045+0000 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.664 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3720d8c748] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:42:56.665 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f371d840800 thread_name:radosgw-admin 2024-09-22T08:42:56.679 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.679 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f371fa3e6f0] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f371fa8b99c] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3720d8c7a2] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:56.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.663+0000 7f371d840800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f371d840800 thread_name:radosgw-admin 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f371fa3e6f0] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f371fa8b99c] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3720d8c7a2] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:56.681 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:42:56.396+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:42:56.396+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key hook 0x5604e04438b8 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e02cd1a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0389c40 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0475170 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.682 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.185204s 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e02cd1a0 auth_method 0 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0475170 auth_method 0 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.683 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0389c40 auth_method 0 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:42:56.396+0000 7f371b32a640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: dump: 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.684 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.685 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: dump: 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:42:56.396+0000 7f371d840800 5 monclient: authenticate success, global_id 8292 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.686 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:42:56.396+0000 7f360960a640 4 set_mon_vals no callback set 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:42:56.397+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:42:56.397+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:42:56.397+0000 7f371d840800 1 librados: init done 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:42:56.398+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f3600077570 auth_method 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:42:56.399+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e048bfd0 auth_method 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:42:56.400+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e048f1b0 auth_method 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:42:56.400+0000 7f3712b29640 10 monclient: get_auth_request con 0x5604e04933a0 auth_method 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:42:56.401+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e0492a60 auth_method 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:42:56.402+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.687 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.688 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:42:56.402+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:42:56.402+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5604e049e940 EEXIST 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.689 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:42:56.403+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:42:56.403+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.690 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:42:56.403+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x5604e049a440 EEXIST 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e04c2c60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e04c3040 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e04c1970 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.192463s 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e04c3040 auth_method 0 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.691 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e04c1970 auth_method 0 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e04c2c60 auth_method 0 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_done global_id 8295 payload 824 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:42:56.403+0000 7f371bb2b640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.692 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: dump: 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.693 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: dump: 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:42:56.404+0000 7f371d840800 5 monclient: authenticate success, global_id 8295 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.694 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:42:56.404+0000 7f371c32c640 4 set_mon_vals no callback set 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:42:56.406+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35f4077480 auth_method 0 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: get_monmap_and_config 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:42:56.406+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.695 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.696 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:42:56.406+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.697 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:42:56.407+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:42:56.407+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:42:56.407+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe52306908 EEXIST 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:42:56.698 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0517190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0512690 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e0508ea0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.196327s 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0512690 auth_method 0 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e0508ea0 auth_method 0 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.699 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0517190 auth_method 0 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_done global_id 8298 payload 274 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:42:56.407+0000 7f371b32a640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.700 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: dump: 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.701 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: dump: 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:42:56.407+0000 7f371d840800 5 monclient: authenticate success, global_id 8298 2024-09-22T08:42:56.702 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: get_monmap_and_config success 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:42:56.407+0000 7f371d840800 4 set_mon_vals no callback set 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: shutdown 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:42:56.408+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.703 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.704 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:42:56.408+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: starting msgr at 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: starting objecter 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:42:56.408+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5604e0512670 EEXIST 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: setting wanted keys 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: calling monclient init 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.705 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:42:56.409+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:42:56.409+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:42:56.409+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x5604e04d7668 EEXIST 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0508ea0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e0512690 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.706 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0517190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.198508s 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0512690 auth_method 0 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0508ea0 auth_method 0 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.707 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:42:56.409+0000 7f371bb2b640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: dump: 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: dump: 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.709 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:42:56.410+0000 7f371d840800 5 monclient: authenticate success, global_id 8301 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:42:56.410+0000 7f35feffd640 4 set_mon_vals no callback set 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.710 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:42:56.410+0000 7f371d840800 1 librados: init done 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:42:56.410+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cr dump hook 0x5604e050dc68 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:42:56.411+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:42:56.412+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35e40775a0 auth_method 0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:42:56.413+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e05315a0 auth_method 0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:42:56.414+0000 7f371d840800 20 realm 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:42:56.414+0000 7f371d840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.711 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:42:56.414+0000 7f3712b29640 10 monclient: get_auth_request con 0x5604e05357e0 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:42:56.415+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:42:56.415+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:42:56.415+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e0539060 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:42:56.416+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:42:56.416+0000 7f371d840800 20 searching for the correct realm 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:42:56.416+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e053de00 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:42:56.417+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f370c062290 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:42:56.418+0000 7f371bb2b640 10 monclient: get_auth_request con 0x7f3704028070 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:42:56.418+0000 7f371bb2b640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3704028070 msgr2=0x7f3704036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:42:56.619+0000 7f371bb2b640 10 monclient: get_auth_request con 0x7f3704028070 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:42:56.620+0000 7f371b32a640 10 monclient: get_auth_request con 0x7f370c09ab50 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:42:56.622+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f37140c1040 auth_method 0 2024-09-22T08:42:56.712 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:42:56.623+0000 7f3712b29640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f37140c1040 msgr2=0x7f37140b68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 1 client.8301.objecter ms_handle_reset 0x7f37140c1040 session 0x7f3714068040 osd.3 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 10 monclient: _renew_subs 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:42:56.623+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35e40878c0 auth_method 0 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:42:56.627+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.713 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:42:56.628+0000 7f371d840800 20 zone default found 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:42:56.628+0000 7f371d840800 4 Realm: () 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:42:56.628+0000 7f371d840800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:42:56.628+0000 7f371d840800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:42:56.628+0000 7f371d840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:42:56.628+0000 7f371d840800 20 zonegroup default 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.714 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:42:56.629+0000 7f371d840800 20 started sync module instance, tier type = 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:42:56.629+0000 7f371d840800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=0 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=1 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=2 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=3 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=4 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=5 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=6 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:42:56.639+0000 7f371d840800 20 add_watcher() i=7 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:42:56.639+0000 7f371d840800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.715 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:42:56.640+0000 7f35d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:42:56.641+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.716 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache list hook 0x5604e0506440 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache inspect hook 0x5604e0506440 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache erase hook 0x5604e0506440 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache zap hook 0x5604e0506440 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:42:56.641+0000 7f371d840800 5 note: GC not initialized 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:42:56.641+0000 7f35d0fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace show hook 0x7f3714004e20 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace history hook 0x7f3714004e20 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace active hook 0x7f3714004e20 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace active_short hook 0x7f3714004e20 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:42:56.641+0000 7f371d840800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:42:56.641+0000 7f371d840800 20 Filter name: none 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:42:56.641+0000 7f354a7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:42:56.641+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.717 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:42:56.642+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:42:56.642+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:42:56.642+0000 7f371d840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:42:56.642+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:42:56.642+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:42:56.643+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:42:56.643+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:42:56.643+0000 7f371d840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:42:56.643+0000 7f371d840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:42:56.647+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:42:56.647+0000 7f371d840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:42:56.647+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:42:56.647+0000 7f371d840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562536 cookie 94578943482896 notifier 8301 bl.length()=911 2024-09-22T08:42:56.718 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.719 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.720 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:42:56.656+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:42:56.656+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.721 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:42:56.660+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:42:56.660+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.722 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:42:56.662+0000 7f371d840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f371d840800 time 2024-09-22T08:42:56.663045+0000 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3720d8c748] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:42:56.663+0000 7f371d840800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:56.723 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f371d840800 thread_name:radosgw-admin 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f371fa3e6f0] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f371fa8b99c] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3720d8c7a2] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:56.724 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:42:56.725 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:42:56.726 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:42:56.727 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:42:56.728 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:42:56.729 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:42:56.730 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f354a7fc640 / http_manager 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35d0fe1640 / http_manager 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35d1fe3640 / rgw_dt_lg_renew 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35fd7fa640 / ms_dispatch 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35feffd640 / io_context_pool 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3605602640 / ms_dispatch 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3607e07640 / ms_dispatch 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f360960a640 / io_context_pool 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3712b29640 / msgr-worker-2 2024-09-22T08:42:56.731 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371b32a640 / msgr-worker-1 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371bb2b640 / msgr-worker-0 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371c32c640 / io_context_pool 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371d840800 / radosgw-admin 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.148720.log 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:42:56.396+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:42:56.396+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key hook 0x5604e04438b8 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e02cd1a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.732 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0389c40 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0475170 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.185204s 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e02cd1a0 auth_method 0 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0475170 auth_method 0 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.733 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:42:56.396+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0389c40 auth_method 0 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:42:56.396+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:42:56.396+0000 7f371b32a640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:42:56.396+0000 7f371b32a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.734 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: dump: 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.735 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:42:56.396+0000 7f3607e07640 10 monclient: dump: 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:42:56.396+0000 7f371d840800 5 monclient: authenticate success, global_id 8292 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:42:56.396+0000 7f360960a640 4 set_mon_vals no callback set 2024-09-22T08:42:56.736 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:42:56.396+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:42:56.397+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:42:56.397+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:42:56.397+0000 7f371d840800 1 librados: init done 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:42:56.398+0000 7f3607e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:42:56.398+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f3600077570 auth_method 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:42:56.399+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e048bfd0 auth_method 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:42:56.400+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e048f1b0 auth_method 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:42:56.400+0000 7f3712b29640 10 monclient: get_auth_request con 0x5604e04933a0 auth_method 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:42:56.401+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e0492a60 auth_method 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:42:56.402+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.737 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding auth protocol: cephx 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.738 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: crc 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049b4f0) adding con mode: secure 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:42:56.402+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:42:56.402+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5604e049e940 EEXIST 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:42:56.402+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.739 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding auth protocol: cephx 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: crc 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:42:56.402+0000 7f371d840800 5 AuthRegistry(0x5604e049a2f8) adding con mode: secure 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:42:56.403+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.740 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:42:56.403+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:42:56.403+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x5604e049a440 EEXIST 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e04c2c60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e04c3040 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e04c1970 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:42:56.403+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.192463s 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e04c3040 auth_method 0 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.741 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e04c1970 auth_method 0 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:42:56.403+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e04c2c60 auth_method 0 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.742 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:42:56.403+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient(hunting): handle_auth_done global_id 8295 payload 824 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:42:56.403+0000 7f371bb2b640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:42:56.403+0000 7f371bb2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: dump: 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.743 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:42:56.404+0000 7f3605602640 10 monclient: dump: 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:42:56.404+0000 7f371d840800 5 monclient: authenticate success, global_id 8295 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:42:56.404+0000 7f371c32c640 4 set_mon_vals no callback set 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:42:56.404+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:42:56.406+0000 7f3605602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:42:56.406+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35f4077480 auth_method 0 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: get_monmap_and_config 2024-09-22T08:42:56.745 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:42:56.406+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.746 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding auth protocol: cephx 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: crc 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x5604e04e2be0) adding con mode: secure 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:42:56.406+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:42:56.406+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.747 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding auth protocol: cephx 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: crc 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:42:56.406+0000 7f371d840800 5 AuthRegistry(0x7ffe523067c0) adding con mode: secure 2024-09-22T08:42:56.748 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:42:56.407+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:42:56.407+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:42:56.407+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffe52306908 EEXIST 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0517190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0512690 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e0508ea0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.196327s 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0512690 auth_method 0 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.749 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): get_auth_request con 0x5604e0508ea0 auth_method 0 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:42:56.407+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0517190 auth_method 0 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:42:56.407+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient(hunting): handle_auth_done global_id 8298 payload 274 2024-09-22T08:42:56.750 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:42:56.407+0000 7f371b32a640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:42:56.407+0000 7f371b32a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: dump: 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.751 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:42:56.407+0000 7f35feffd640 10 monclient: dump: 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.752 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:42:56.407+0000 7f371d840800 5 monclient: authenticate success, global_id 8298 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:42:56.407+0000 7f371d840800 10 monclient: get_monmap_and_config success 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:42:56.407+0000 7f371d840800 4 set_mon_vals no callback set 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: shutdown 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: build_initial_monmap 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:42:56.408+0000 7f371d840800 1 build_initial for_mkfs: 0 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: monmap: 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:42:56.753 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding auth protocol: cephx 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: crc 2024-09-22T08:42:56.754 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04e6c90) adding con mode: secure 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:42:56.408+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: starting msgr at 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: starting objecter 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:42:56.408+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5604e0512670 EEXIST 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: setting wanted keys 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:42:56.408+0000 7f371d840800 1 librados: calling monclient init 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:42:56.408+0000 7f371d840800 10 monclient: init 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:42:56.408+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding auth protocol: cephx 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.755 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: crc 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:42:56.409+0000 7f371d840800 5 AuthRegistry(0x5604e04d7520) adding con mode: secure 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:42:56.409+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:42:56.409+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:42:56.409+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command rotate-key cmddesc rotate-key hook 0x5604e04d7668 EEXIST 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient: _reopen_session rank -1 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-c con 0x5604e0508ea0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-a con 0x5604e0512690 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): picked mon.noname-b con 0x5604e0517190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:42:56.756 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): start opening mon connection 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): _renew_subs 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:42:56.409+0000 7f371d840800 10 monclient(hunting): authenticate will time out at 2292.198508s 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): get_auth_request con 0x5604e0512690 auth_method 0 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): get_auth_request con 0x5604e0508ea0 auth_method 0 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.757 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:42:56.409+0000 7f3712b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient: _finish_hunting 0 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:42:56.409+0000 7f371bb2b640 1 monclient: found mon.noname-a 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:42:56.409+0000 7f371bb2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: dump: 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.758 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:42:56.410+0000 7f35fd7fa640 10 monclient: dump: 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:42:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:42:56.410+0000 7f371d840800 5 monclient: authenticate success, global_id 8301 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:42:56.410+0000 7f35feffd640 4 set_mon_vals no callback set 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _renew_subs 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:42:56.410+0000 7f371d840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:42:56.410+0000 7f371d840800 1 librados: init done 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:42:56.410+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cr dump hook 0x5604e050dc68 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:42:56.411+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:42:56.412+0000 7f35fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:42:56.760 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:42:56.412+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35e40775a0 auth_method 0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:42:56.413+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e05315a0 auth_method 0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:42:56.414+0000 7f371d840800 20 realm 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:42:56.414+0000 7f371d840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:42:56.414+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:42:56.414+0000 7f3712b29640 10 monclient: get_auth_request con 0x5604e05357e0 auth_method 0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:42:56.415+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:42:56.415+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:42:56.415+0000 7f371bb2b640 10 monclient: get_auth_request con 0x5604e0539060 auth_method 0 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:42:56.416+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.761 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:42:56.416+0000 7f371d840800 20 searching for the correct realm 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:42:56.416+0000 7f371b32a640 10 monclient: get_auth_request con 0x5604e053de00 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:42:56.417+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f370c062290 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:42:56.418+0000 7f371bb2b640 10 monclient: get_auth_request con 0x7f3704028070 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:42:56.418+0000 7f371bb2b640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3704028070 msgr2=0x7f3704036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:42:56.619+0000 7f371bb2b640 10 monclient: get_auth_request con 0x7f3704028070 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:42:56.620+0000 7f371b32a640 10 monclient: get_auth_request con 0x7f370c09ab50 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:42:56.622+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f37140c1040 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:42:56.623+0000 7f3712b29640 0 -- 172.21.15.78:0/4210334967 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f37140c1040 msgr2=0x7f37140b68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 1 client.8301.objecter ms_handle_reset 0x7f37140c1040 session 0x7f3714068040 osd.3 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 10 monclient: _renew_subs 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:42:56.623+0000 7f35fd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:42:56.623+0000 7f3712b29640 10 monclient: get_auth_request con 0x7f35e40878c0 auth_method 0 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.762 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:42:56.627+0000 7f371d840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:42:56.627+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:42:56.628+0000 7f371d840800 20 zone default found 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:42:56.628+0000 7f371d840800 4 Realm: () 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:42:56.628+0000 7f371d840800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:42:56.628+0000 7f371d840800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:42:56.628+0000 7f371d840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.763 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:42:56.628+0000 7f371d840800 20 zonegroup default 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:42:56.628+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:42:56.629+0000 7f371d840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:42:56.629+0000 7f371d840800 20 started sync module instance, tier type = 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:42:56.629+0000 7f371d840800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=0 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=1 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=2 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=3 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=4 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=5 2024-09-22T08:42:56.764 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:42:56.638+0000 7f371d840800 20 add_watcher() i=6 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:42:56.639+0000 7f371d840800 20 add_watcher() i=7 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:42:56.639+0000 7f371d840800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding auth protocol: cephx 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.765 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: crc 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:42:56.640+0000 7f371d840800 5 AuthRegistry(0x7ffe52306c90) adding con mode: secure 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:42:56.640+0000 7f35d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:42:56.641+0000 7f371d840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache list hook 0x5604e0506440 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache inspect hook 0x5604e0506440 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache erase hook 0x5604e0506440 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command cache zap hook 0x5604e0506440 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:42:56.641+0000 7f371d840800 5 note: GC not initialized 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:42:56.641+0000 7f35d0fe1640 20 reqs_thread_entry: start 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace show hook 0x7f3714004e20 2024-09-22T08:42:56.766 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace history hook 0x7f3714004e20 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace active hook 0x7f3714004e20 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:42:56.641+0000 7f371d840800 5 asok(0x5604e021f0f0) register_command sync trace active_short hook 0x7f3714004e20 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:42:56.641+0000 7f371d840800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:42:56.641+0000 7f371d840800 20 Filter name: none 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:42:56.641+0000 7f354a7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:42:56.641+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:42:56.641+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:42:56.642+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:42:56.642+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:42:56.642+0000 7f371d840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:42:56.642+0000 7f371d840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:42:56.642+0000 7f371d840800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:42:56.643+0000 7f371d840800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:42:56.767 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:42:56.643+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:42:56.643+0000 7f371d840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:42:56.643+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:42:56.643+0000 7f371d840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:42:56.647+0000 7f371d840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:42:56.647+0000 7f371d840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:42:56.647+0000 7f371d840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:42:56.647+0000 7f371d840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562536 cookie 94578943482896 notifier 8301 bl.length()=911 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:42:56.648+0000 7f35feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:42:56.768 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:42:56.649+0000 7f371d840800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.1 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.2 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.3 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.4 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.5 2024-09-22T08:42:56.769 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.6 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.7 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.8 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.9 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.10 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.11 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.12 2024-09-22T08:42:56.770 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.13 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:42:56.654+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:42:56.654+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:42:56.655+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:42:56.655+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:42:56.656+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:42:56.656+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.771 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:42:56.657+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:42:56.657+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:42:56.658+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:42:56.658+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:42:56.659+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:42:56.659+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:42:56.660+0000 7f371d840800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:42:56.660+0000 7f371d840800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:42:56.662+0000 7f371d840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f371d840800 time 2024-09-22T08:42:56.663045+0000 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:42:56.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3720d8c748] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:42:56.663+0000 7f371d840800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f371d840800 thread_name:radosgw-admin 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.773 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f371fa3e6f0] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f371fa8b99c] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3720d8c7a2] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f3720d8c906] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604df806e01] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5604df815e9b] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5604df816d64] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f371fa29590] 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:42:56.774 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:42:56.775 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:42:56.776 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:42:56.777 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:42:56.778 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:42:56.779 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:42:56.780 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f354a7fc640 / http_manager 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35d0fe1640 / http_manager 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35d1fe3640 / rgw_dt_lg_renew 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35fd7fa640 / ms_dispatch 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35feffd640 / io_context_pool 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3605602640 / ms_dispatch 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3607e07640 / ms_dispatch 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f360960a640 / io_context_pool 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3712b29640 / msgr-worker-2 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371b32a640 / msgr-worker-1 2024-09-22T08:42:56.781 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371bb2b640 / msgr-worker-0 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371c32c640 / io_context_pool 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr: 7f371d840800 / radosgw-admin 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:42:56.664641Z_e9f67092-184e-4cb6-b267-4970f88604d5/log 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:42:56.782 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:42:56.783 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:56.783 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:56.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.737+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 20 realm 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.739+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.740+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.740+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.740+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.740+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.741+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.741+0000 7fa5cc6b9800 20 searching for the correct realm 2024-09-22T08:42:56.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.743+0000 7fa5ca9a4640 0 -- 172.21.15.78:0/4050761165 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa5c0027040 msgr2=0x7fa5c0044420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.949+0000 7fa5c99a2640 0 -- 172.21.15.78:0/4050761165 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa5c4081020 msgr2=0x7fa5c40abb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.953+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.954+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.954+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.954+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:56.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.954+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:56.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 zone default found 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 4 Realm: () 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 zonegroup default 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.955+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.956+0000 7fa5cc6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:56.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.956+0000 7fa5cc6b9800 20 started sync module instance, tier type = 2024-09-22T08:42:56.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.956+0000 7fa5cc6b9800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=0 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=1 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=2 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=3 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=4 2024-09-22T08:42:56.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=5 2024-09-22T08:42:56.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.964+0000 7fa5cc6b9800 20 add_watcher() i=6 2024-09-22T08:42:56.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.965+0000 7fa5cc6b9800 20 add_watcher() i=7 2024-09-22T08:42:56.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.965+0000 7fa5cc6b9800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:56.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.966+0000 7fa480fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:56.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:56.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 5 note: GC not initialized 2024-09-22T08:42:56.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa3fb7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:56.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:56.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 20 Filter name: none 2024-09-22T08:42:56.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa3f97fa640 20 reqs_thread_entry: start 2024-09-22T08:42:56.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.967+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.968+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.968+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.968+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.968+0000 7fa5cc6b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.968+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.969+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:56.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.969+0000 7fa5cc6b9800 20 rados->read ofs=0 len=0 2024-09-22T08:42:56.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.969+0000 7fa5cc6b9800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:42:56.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.969+0000 7fa5cc6b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:42:56.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.971+0000 7fa480fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:56.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.973+0000 7fa5cc6b9800 20 remove_watcher() i=0 2024-09-22T08:42:56.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.973+0000 7fa5cc6b9800 2 removed watcher, disabling cache 2024-09-22T08:42:56.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.974+0000 7fa5cc6b9800 20 remove_watcher() i=1 2024-09-22T08:42:56.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.975+0000 7fa5cc6b9800 20 remove_watcher() i=2 2024-09-22T08:42:56.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.976+0000 7fa5cc6b9800 20 remove_watcher() i=3 2024-09-22T08:42:56.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.976+0000 7fa5cc6b9800 20 remove_watcher() i=4 2024-09-22T08:42:56.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.977+0000 7fa5cc6b9800 20 remove_watcher() i=5 2024-09-22T08:42:56.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.978+0000 7fa5cc6b9800 20 remove_watcher() i=6 2024-09-22T08:42:56.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:56.979+0000 7fa5cc6b9800 20 remove_watcher() i=7 2024-09-22T08:42:57.031 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:42:57.060 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:57.060 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:57.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.097+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.098+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.098+0000 7f91cc810800 20 realm 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.098+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.099+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.099+0000 7f91cc810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.099+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.099+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.099+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.100+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:57.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.100+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.100+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:42:57.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.100+0000 7f91cc810800 20 searching for the correct realm 2024-09-22T08:42:57.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.102+0000 7f91c86cc640 0 -- 172.21.15.78:0/2206889431 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f91bc06d5c0 msgr2=0x7f91bc06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:57.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.308+0000 7f91c76ca640 0 -- 172.21.15.78:0/2206889431 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f91c0028030 msgr2=0x7f91c0067030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:57.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.313+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:57.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 zone default found 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 4 Realm: () 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 zonegroup default 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.314+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.315+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.315+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.315+0000 7f91cc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.315+0000 7f91cc810800 20 started sync module instance, tier type = 2024-09-22T08:42:57.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.315+0000 7f91cc810800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=0 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=1 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=2 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=3 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=4 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=5 2024-09-22T08:42:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.323+0000 7f91cc810800 20 add_watcher() i=6 2024-09-22T08:42:57.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.324+0000 7f91cc810800 20 add_watcher() i=7 2024-09-22T08:42:57.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.324+0000 7f91cc810800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:57.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.326+0000 7f907dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:57.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:57.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:57.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 5 note: GC not initialized 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f907cfe1640 20 reqs_thread_entry: start 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 20 init_complete bucket index max shards: 11 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 20 Filter name: none 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f8ff67fc640 20 reqs_thread_entry: start 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.327+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:42:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 20 rados->read ofs=0 len=0 2024-09-22T08:42:57.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.328+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:57.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.329+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:42:57.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:57.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:42:57.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:57.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.330+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.331+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.331+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.331+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.331+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.332+0000 7f91cc810800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:42:57.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.333+0000 7f907dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:57.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.336+0000 7f91cc810800 20 remove_watcher() i=0 2024-09-22T08:42:57.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.336+0000 7f91cc810800 2 removed watcher, disabling cache 2024-09-22T08:42:57.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.336+0000 7f91cc810800 20 remove_watcher() i=1 2024-09-22T08:42:57.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.338+0000 7f91cc810800 20 remove_watcher() i=2 2024-09-22T08:42:57.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.339+0000 7f91cc810800 20 remove_watcher() i=3 2024-09-22T08:42:57.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.340+0000 7f91cc810800 20 remove_watcher() i=4 2024-09-22T08:42:57.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.341+0000 7f91cc810800 20 remove_watcher() i=5 2024-09-22T08:42:57.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.342+0000 7f91cc810800 20 remove_watcher() i=6 2024-09-22T08:42:57.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:42:57.342+0000 7f91cc810800 20 remove_watcher() i=7 2024-09-22T08:43:27.386 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:43:27.419 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:27.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.460+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 realm 2024-09-22T08:43:27.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.462+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.463+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:27.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.463+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.464+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:27.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.464+0000 7f648e40f800 20 searching for the correct realm 2024-09-22T08:43:27.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.466+0000 7f648c6fa640 0 -- 172.21.15.78:0/1295766034 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f6474021030 msgr2=0x7f6474062490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:43:27.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.673+0000 7f6483fff640 0 -- 172.21.15.78:0/1295766034 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f64840d1c20 msgr2=0x7f64840aa5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.679+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.680+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.680+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.680+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.680+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:27.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 zone default found 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 4 Realm: () 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 zonegroup default 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.681+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.682+0000 7f648e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.682+0000 7f648e40f800 20 started sync module instance, tier type = 2024-09-22T08:43:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.682+0000 7f648e40f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=0 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=1 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=2 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=3 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=4 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=5 2024-09-22T08:43:27.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.692+0000 7f648e40f800 20 add_watcher() i=6 2024-09-22T08:43:27.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.693+0000 7f648e40f800 20 add_watcher() i=7 2024-09-22T08:43:27.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.693+0000 7f648e40f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:27.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.695+0000 7f63427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.695+0000 7f648e40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.695+0000 7f648e40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.695+0000 7f648e40f800 5 note: GC not initialized 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f63417e2640 20 reqs_thread_entry: start 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f648e40f800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f648e40f800 20 Filter name: none 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f633a7fc640 20 reqs_thread_entry: start 2024-09-22T08:43:27.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:27.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.696+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.697+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:27.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.697+0000 7f648e40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:27.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.697+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.697+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:27.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.697+0000 7f648e40f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.698+0000 7f648e40f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:27.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.698+0000 7f648e40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:27.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.700+0000 7f63427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:27.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.702+0000 7f648e40f800 20 remove_watcher() i=0 2024-09-22T08:43:27.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.702+0000 7f648e40f800 2 removed watcher, disabling cache 2024-09-22T08:43:27.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.703+0000 7f648e40f800 20 remove_watcher() i=1 2024-09-22T08:43:27.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.704+0000 7f648e40f800 20 remove_watcher() i=2 2024-09-22T08:43:27.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.706+0000 7f648e40f800 20 remove_watcher() i=3 2024-09-22T08:43:27.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.707+0000 7f648e40f800 20 remove_watcher() i=4 2024-09-22T08:43:27.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.708+0000 7f648e40f800 20 remove_watcher() i=5 2024-09-22T08:43:27.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.709+0000 7f648e40f800 20 remove_watcher() i=6 2024-09-22T08:43:27.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.710+0000 7f648e40f800 20 remove_watcher() i=7 2024-09-22T08:43:27.819 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:43:27.848 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:27.848 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:27.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.884+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 realm 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:27.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.885+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.886+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:27.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.886+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:27.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.887+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:27.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.887+0000 7f5e8ef0c800 20 searching for the correct realm 2024-09-22T08:43:27.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:27.890+0000 7f5e8d1f7640 0 -- 172.21.15.78:0/1116641370 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5e74018070 msgr2=0x7f5e7408bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.096+0000 7f5e841f5640 0 -- 172.21.15.78:0/1116641370 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5e88089040 msgr2=0x7f5e8808b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.101+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 zone default found 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 4 Realm: () 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 zonegroup default 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.102+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.103+0000 7f5e8ef0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.103+0000 7f5e8ef0c800 20 started sync module instance, tier type = 2024-09-22T08:43:28.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.103+0000 7f5e8ef0c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=0 2024-09-22T08:43:28.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=1 2024-09-22T08:43:28.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=2 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=3 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=4 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=5 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.112+0000 7f5e8ef0c800 20 add_watcher() i=6 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.113+0000 7f5e8ef0c800 20 add_watcher() i=7 2024-09-22T08:43:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.113+0000 7f5e8ef0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.115+0000 7f5d42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.115+0000 7f5e8ef0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.115+0000 7f5e8ef0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.115+0000 7f5e8ef0c800 5 note: GC not initialized 2024-09-22T08:43:28.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5d41fe3640 20 reqs_thread_entry: start 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 20 Filter name: none 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5cb37fe640 20 reqs_thread_entry: start 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:28.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.116+0000 7f5e8ef0c800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:28.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.117+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.118+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.118+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.118+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:28.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.118+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.119+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.120+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.120+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.120+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.120+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.121+0000 7f5e8ef0c800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:28.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.122+0000 7f5d42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.125+0000 7f5e8ef0c800 20 remove_watcher() i=0 2024-09-22T08:43:28.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.125+0000 7f5e8ef0c800 2 removed watcher, disabling cache 2024-09-22T08:43:28.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.126+0000 7f5e8ef0c800 20 remove_watcher() i=1 2024-09-22T08:43:28.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.127+0000 7f5e8ef0c800 20 remove_watcher() i=2 2024-09-22T08:43:28.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.128+0000 7f5e8ef0c800 20 remove_watcher() i=3 2024-09-22T08:43:28.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.129+0000 7f5e8ef0c800 20 remove_watcher() i=4 2024-09-22T08:43:28.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.130+0000 7f5e8ef0c800 20 remove_watcher() i=5 2024-09-22T08:43:28.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.131+0000 7f5e8ef0c800 20 remove_watcher() i=6 2024-09-22T08:43:28.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.133+0000 7f5e8ef0c800 20 remove_watcher() i=7 2024-09-22T08:43:28.145 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:43:28.174 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:28.174 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:28.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.209+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 realm 2024-09-22T08:43:28.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.213+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.214+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.214+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.215+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.215+0000 7f3017746800 20 searching for the correct realm 2024-09-22T08:43:28.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.217+0000 7f3015a38640 0 -- 172.21.15.78:0/2459160896 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x56298565d690 msgr2=0x56298565faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.220+0000 7f3015a38640 0 -- 172.21.15.78:0/2459160896 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x562985665150 msgr2=0x562985667540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.225+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 zone default found 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 4 Realm: () 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 zonegroup default 2024-09-22T08:43:28.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.226+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.227+0000 7f3017746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.227+0000 7f3017746800 20 started sync module instance, tier type = 2024-09-22T08:43:28.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.227+0000 7f3017746800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=0 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=1 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=2 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=3 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=4 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=5 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.235+0000 7f3017746800 20 add_watcher() i=6 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.236+0000 7f3017746800 20 add_watcher() i=7 2024-09-22T08:43:28.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.236+0000 7f3017746800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.238+0000 7f2ecb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.238+0000 7f3017746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.238+0000 7f3017746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.238+0000 7f3017746800 5 note: GC not initialized 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f2eca7e4640 20 reqs_thread_entry: start 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f3017746800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f3017746800 20 Filter name: none 2024-09-22T08:43:28.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f2e3bfff640 20 reqs_thread_entry: start 2024-09-22T08:43:28.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.239+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.240+0000 7f3017746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.242+0000 7f2ecb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.244+0000 7f3017746800 20 remove_watcher() i=0 2024-09-22T08:43:28.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.244+0000 7f3017746800 2 removed watcher, disabling cache 2024-09-22T08:43:28.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.245+0000 7f3017746800 20 remove_watcher() i=1 2024-09-22T08:43:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.246+0000 7f3017746800 20 remove_watcher() i=2 2024-09-22T08:43:28.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.247+0000 7f3017746800 20 remove_watcher() i=3 2024-09-22T08:43:28.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.248+0000 7f3017746800 20 remove_watcher() i=4 2024-09-22T08:43:28.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.249+0000 7f3017746800 20 remove_watcher() i=5 2024-09-22T08:43:28.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.250+0000 7f3017746800 20 remove_watcher() i=6 2024-09-22T08:43:28.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.251+0000 7f3017746800 20 remove_watcher() i=7 2024-09-22T08:43:28.262 INFO:tasks.workunit.client.0.smithi078.stderr: test: duplicated entries should be purged before reshard 2024-09-22T08:43:28.264 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:43:28.293 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:28.293 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:28.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.328+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 20 realm 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.330+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.331+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.331+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.331+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.331+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.332+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.332+0000 7f29b6926800 20 searching for the correct realm 2024-09-22T08:43:28.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.333+0000 7f29a9dd8640 0 -- 172.21.15.78:0/3350401601 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f29a4038020 msgr2=0x7f29a4068d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:43:28.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.337+0000 7f29b2dda640 0 -- 172.21.15.78:0/3350401601 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5634615f3ca0 msgr2=0x5634615f6090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.342+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 zone default found 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 4 Realm: () 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 zonegroup default 2024-09-22T08:43:28.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.343+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.344+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.344+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.344+0000 7f29b6926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.344+0000 7f29b6926800 20 started sync module instance, tier type = 2024-09-22T08:43:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.344+0000 7f29b6926800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=0 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=1 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=2 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=3 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=4 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=5 2024-09-22T08:43:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.352+0000 7f29b6926800 20 add_watcher() i=6 2024-09-22T08:43:28.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.353+0000 7f29b6926800 20 add_watcher() i=7 2024-09-22T08:43:28.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.353+0000 7f29b6926800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.355+0000 7f2868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 5 note: GC not initialized 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f27e37fe640 20 reqs_thread_entry: start 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 Filter name: none 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f27e17fa640 20 reqs_thread_entry: start 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.356+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.357+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.357+0000 7f29b6926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.357+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.357+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.357+0000 7f29b6926800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.358+0000 7f29b6926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.358+0000 7f29b6926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.359+0000 7f2868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.362+0000 7f29b6926800 20 remove_watcher() i=0 2024-09-22T08:43:28.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.362+0000 7f29b6926800 2 removed watcher, disabling cache 2024-09-22T08:43:28.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.363+0000 7f29b6926800 20 remove_watcher() i=1 2024-09-22T08:43:28.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.364+0000 7f29b6926800 20 remove_watcher() i=2 2024-09-22T08:43:28.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.365+0000 7f29b6926800 20 remove_watcher() i=3 2024-09-22T08:43:28.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.366+0000 7f29b6926800 20 remove_watcher() i=4 2024-09-22T08:43:28.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.367+0000 7f29b6926800 20 remove_watcher() i=5 2024-09-22T08:43:28.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.367+0000 7f29b6926800 20 remove_watcher() i=6 2024-09-22T08:43:28.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.368+0000 7f29b6926800 20 remove_watcher() i=7 2024-09-22T08:43:28.379 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.379 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:43:28.379 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-22T08:43:28.380 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.381 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:43:28.414 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:28.415 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:28.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.450+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 realm 2024-09-22T08:43:28.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.454+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.454+0000 7f17abc0f800 20 searching for the correct realm 2024-09-22T08:43:28.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.455+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x5649f2869c50 msgr2=0x5649f286c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.459+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f17a4018040 msgr2=0x7f17a4025470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.665+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zone default found 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Realm: () 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zonegroup default 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started sync module instance, tier type = 2024-09-22T08:43:28.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=0 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=1 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=2 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=3 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=4 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=5 2024-09-22T08:43:28.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=6 2024-09-22T08:43:28.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.677+0000 7f17abc0f800 20 add_watcher() i=7 2024-09-22T08:43:28.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.677+0000 7f17abc0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f165ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 5 note: GC not initialized 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f165efe5640 20 reqs_thread_entry: start 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 20 Filter name: none 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f165cfe1640 20 reqs_thread_entry: start 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:28.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.680+0000 7f17abc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f17abc0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f17abc0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562538 cookie 94875601568640 notifier 7799 bl.length()=911 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:28.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:28.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:28.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:28.694 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17abc0f800 time 2024-09-22T08:43:28.694183+0000 2024-09-22T08:43:28.694 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f17af18c748] 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:43:28.695 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:43:28.696 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f17abc0f800 thread_name:radosgw-admin 2024-09-22T08:43:28.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.693+0000 7f17abc0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17abc0f800 time 2024-09-22T08:43:28.694183+0000 2024-09-22T08:43:28.696 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f17af18c748] 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:43:28.697 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:43:28.698 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17ade3e6f0] 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f17ade8b99c] 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:28.714 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f17af18c7a2] 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.694+0000 7f17abc0f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f17abc0f800 thread_name:radosgw-admin 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.715 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17ade3e6f0] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f17ade8b99c] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f17af18c7a2] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:43:28.716 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:43:28.433+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8418 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: dump: 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.717 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:43:28.433+0000 7f17abc0f800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:43:28.433+0000 7f17abc0f800 4 set_mon_vals no callback set 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:43:28.433+0000 7f17abc0f800 10 monclient: shutdown 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:43:28.433+0000 7f17abc0f800 5 asok(0x5649f25560f0) unregister_commands rotate-key 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.718 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.719 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: starting msgr at 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: starting objecter 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests hook 0x5649f277eac0 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: setting wanted keys 2024-09-22T08:43:28.720 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: calling monclient init 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.721 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:43:28.435+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key hook 0x5649f27787b8 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f26247c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f26be1b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f277de30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.224078s 2024-09-22T08:43:28.722 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f26247c0 auth_method 0 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f277de30 auth_method 0 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f26be1b0 auth_method 0 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.723 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_done global_id 8421 payload 824 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:43:28.435+0000 7f17a96f9640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: dump: 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.724 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: dump: 2024-09-22T08:43:28.725 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:43:28.435+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8421 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:43:28.435+0000 7f1697606640 4 set_mon_vals no callback set 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.726 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:43:28.435+0000 7f17abc0f800 1 librados: init done 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:43:28.437+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f1690077570 auth_method 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:43:28.438+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f27a1ee0 auth_method 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:43:28.438+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f27c3bd0 auth_method 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:43:28.439+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x5649f27c7f70 auth_method 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:43:28.440+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f27c7480 auth_method 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:43:28.441+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.727 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.728 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:43:28.441+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests cmddesc objecter_requests hook 0x5649f27d35c0 EEXIST 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.729 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:43:28.441+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:43:28.442+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.730 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:43:28.442+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x5649f27cf180 EEXIST 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f27f78e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f27f7cc0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f27f65f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.231215s 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f27f78e0 auth_method 0 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.731 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f27f65f0 auth_method 0 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f27f7cc0 auth_method 0 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 8424 payload 824 2024-09-22T08:43:28.732 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: dump: 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.733 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:43:28.442+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8424 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.734 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: dump: 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:43:28.442+0000 7f17aa6fb640 4 set_mon_vals no callback set 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.735 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:43:28.444+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f1684077480 auth_method 0 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: get_monmap_and_config 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:43:28.445+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.736 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.737 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:43:28.445+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.738 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:43:28.445+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:43:28.446+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:43:28.446+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x7ffde3888858 EEXIST 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f284be30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f281cd80 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f28476d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.739 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.235164s 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f284be30 auth_method 0 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f281cd80 auth_method 0 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.740 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f28476d0 auth_method 0 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 8427 payload 274 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: dump: 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.741 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.742 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: dump: 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:43:28.446+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8427 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:28.743 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:43:28.446+0000 7f17abc0f800 4 set_mon_vals no callback set 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: shutdown 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.744 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.745 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:43:28.447+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: starting msgr at 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: starting objecter 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests cmddesc objecter_requests hook 0x5649f281a2f0 EEXIST 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: setting wanted keys 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: calling monclient init 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.746 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:43:28.447+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.747 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:43:28.448+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:43:28.448+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x5649f280c2e8 EEXIST 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f281cd80 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f28476d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f284be30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.237281s 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f281cd80 auth_method 0 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.748 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f284be30 auth_method 0 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 1 monclient: found mon.noname-c 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.749 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: dump: 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.750 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: dump: 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.751 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:43:28.448+0000 7f168cff9640 4 set_mon_vals no callback set 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:43:28.449+0000 7f17abc0f800 5 monclient: authenticate success, global_id 7799 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:43:28.449+0000 7f17abc0f800 1 librados: init done 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:43:28.449+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cr dump hook 0x5649f283afe8 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:43:28.450+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:43:28.451+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f1674077570 auth_method 0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:43:28.451+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f2865a20 auth_method 0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.752 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 realm 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:43:28.452+0000 7f17abc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:43:28.452+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x5649f2869c50 auth_method 0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:43:28.453+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f286d4b0 auth_method 0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:43:28.454+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:43:28.454+0000 7f17abc0f800 20 searching for the correct realm 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:43:28.454+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f2872230 auth_method 0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:43:28.454+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f179c0b1c20 auth_method 0 2024-09-22T08:43:28.753 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:43:28.455+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x5649f2869c50 msgr2=0x5649f286c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:43:28.455+0000 7f167affd640 1 client.7799.objecter ms_handle_reset 0x5649f2869c50 session 0x5649f28695d0 osd.1 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:43:28.455+0000 7f167affd640 10 monclient: _renew_subs 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:43:28.455+0000 7f167affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:43:28.456+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f17a0081920 auth_method 0 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:43:28.456+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f1674087810 auth_method 0 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:43:28.457+0000 7f17a96f9640 10 monclient: get_auth_request con 0x7f179c074070 auth_method 0 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:43:28.459+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f17a4018040 msgr2=0x7f17a4025470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:43:28.660+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f17a4018040 auth_method 0 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.754 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zone default found 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Realm: () 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:43:28.666+0000 7f17abc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.755 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zonegroup default 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started sync module instance, tier type = 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=0 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=1 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=2 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=3 2024-09-22T08:43:28.756 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=4 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=5 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=6 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:43:28.677+0000 7f17abc0f800 20 add_watcher() i=7 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:43:28.677+0000 7f17abc0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.757 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:43:28.679+0000 7f165ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:43:28.679+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache list hook 0x5649f283d620 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache inspect hook 0x5649f283d620 2024-09-22T08:43:28.758 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache erase hook 0x5649f283d620 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache zap hook 0x5649f283d620 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 note: GC not initialized 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:43:28.679+0000 7f165efe5640 20 reqs_thread_entry: start 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace show hook 0x7f17a0035020 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace history hook 0x7f17a0035020 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace active hook 0x7f17a0035020 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace active_short hook 0x7f17a0035020 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 Filter name: none 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:43:28.679+0000 7f165cfe1640 20 reqs_thread_entry: start 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:43:28.679+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:28.759 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562538 cookie 94875601568640 notifier 7799 bl.length()=911 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.760 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:43:28.693+0000 7f17abc0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17abc0f800 time 2024-09-22T08:43:28.694183+0000 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f17af18c748] 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.761 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:43:28.694+0000 7f17abc0f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f17abc0f800 thread_name:radosgw-admin 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17ade3e6f0] 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f17ade8b99c] 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:28.762 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f17af18c7a2] 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:43:28.763 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:43:28.764 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:43:28.765 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:43:28.766 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:43:28.767 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:43:28.768 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:43:28.769 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165cfe1640 / http_manager 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165efe5640 / http_manager 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165ffe7640 / rgw_dt_lg_renew 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f167affd640 / ms_dispatch 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f168cff9640 / io_context_pool 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f168effd640 / ms_dispatch 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1695e03640 / ms_dispatch 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1697606640 / io_context_pool 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a8ef8640 / msgr-worker-2 2024-09-22T08:43:28.770 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a96f9640 / msgr-worker-1 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a9efa640 / msgr-worker-0 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17aa6fb640 / io_context_pool 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17abc0f800 / radosgw-admin 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.152843.log 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:43:28.433+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8418 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.771 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:43:28.433+0000 7f1697606640 10 monclient: dump: 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.772 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:43:28.433+0000 7f17abc0f800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:43:28.433+0000 7f17abc0f800 4 set_mon_vals no callback set 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:43:28.433+0000 7f17abc0f800 10 monclient: shutdown 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:43:28.433+0000 7f17abc0f800 5 asok(0x5649f25560f0) unregister_commands rotate-key 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.773 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding auth protocol: cephx 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.774 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: crc 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f277f310) adding con mode: secure 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: starting msgr at 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: starting objecter 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests hook 0x5649f277eac0 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: setting wanted keys 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:43:28.434+0000 7f17abc0f800 1 librados: calling monclient init 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:43:28.434+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding auth protocol: cephx 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.775 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: crc 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:43:28.434+0000 7f17abc0f800 5 AuthRegistry(0x5649f2778670) adding con mode: secure 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:43:28.434+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:43:28.435+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key hook 0x5649f27787b8 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.776 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f26247c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f26be1b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f277de30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.224078s 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f26247c0 auth_method 0 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f277de30 auth_method 0 2024-09-22T08:43:28.777 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f26be1b0 auth_method 0 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:43:28.435+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.778 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:43:28.435+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient(hunting): handle_auth_done global_id 8421 payload 824 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:43:28.435+0000 7f17a96f9640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:43:28.435+0000 7f17a96f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: dump: 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.779 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:43:28.435+0000 7f1695e03640 10 monclient: dump: 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.780 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:43:28.435+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8421 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:43:28.435+0000 7f1697606640 4 set_mon_vals no callback set 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:43:28.435+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:43:28.435+0000 7f17abc0f800 1 librados: init done 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.781 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:43:28.437+0000 7f1695e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:43:28.437+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f1690077570 auth_method 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:43:28.438+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f27a1ee0 auth_method 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:43:28.438+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f27c3bd0 auth_method 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:43:28.439+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x5649f27c7f70 auth_method 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:43:28.440+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f27c7480 auth_method 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:43:28.441+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.782 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding auth protocol: cephx 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.783 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: crc 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27d00f0) adding con mode: secure 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:43:28.441+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests cmddesc objecter_requests hook 0x5649f27d35c0 EEXIST 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:43:28.441+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.784 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding auth protocol: cephx 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: crc 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:43:28.441+0000 7f17abc0f800 5 AuthRegistry(0x5649f27cf038) adding con mode: secure 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:43:28.441+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:43:28.442+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.785 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:43:28.442+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x5649f27cf180 EEXIST 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f27f78e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f27f7cc0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f27f65f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.231215s 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f27f78e0 auth_method 0 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.786 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f27f65f0 auth_method 0 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:43:28.442+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f27f7cc0 auth_method 0 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:43:28.442+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 8424 payload 824 2024-09-22T08:43:28.787 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:43:28.442+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: dump: 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.788 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:43:28.442+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8424 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:43:28.442+0000 7f168effd640 10 monclient: dump: 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.789 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:43:28.442+0000 7f17aa6fb640 4 set_mon_vals no callback set 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:43:28.442+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:43:28.444+0000 7f168effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.790 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:43:28.444+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f1684077480 auth_method 0 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: get_monmap_and_config 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:43:28.445+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.791 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding auth protocol: cephx 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.792 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: crc 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x5649f28177a0) adding con mode: secure 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:43:28.445+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:43:28.445+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding auth protocol: cephx 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.793 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: crc 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:43:28.445+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888710) adding con mode: secure 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:43:28.445+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:43:28.446+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:43:28.446+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x7ffde3888858 EEXIST 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f284be30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f281cd80 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.794 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f28476d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.235164s 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f284be30 auth_method 0 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): get_auth_request con 0x5649f281cd80 auth_method 0 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.795 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:43:28.446+0000 7f17a9efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f28476d0 auth_method 0 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:43:28.446+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.796 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 8427 payload 274 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 1 monclient: found mon.noname-a 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:43:28.446+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: dump: 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.797 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:43:28.446+0000 7f168cff9640 10 monclient: dump: 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.798 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:43:28.446+0000 7f17abc0f800 5 monclient: authenticate success, global_id 8427 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:43:28.446+0000 7f17abc0f800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:43:28.446+0000 7f17abc0f800 4 set_mon_vals no callback set 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: shutdown 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: build_initial_monmap 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 build_initial for_mkfs: 0 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: monmap: 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:28.799 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding auth protocol: cephx 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.800 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: crc 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f283e300) adding con mode: secure 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:43:28.447+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: starting msgr at 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: starting objecter 2024-09-22T08:43:28.801 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command objecter_requests cmddesc objecter_requests hook 0x5649f281a2f0 EEXIST 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: setting wanted keys 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:43:28.447+0000 7f17abc0f800 1 librados: calling monclient init 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:43:28.447+0000 7f17abc0f800 10 monclient: init 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding auth protocol: cephx 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.802 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: crc 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:43:28.447+0000 7f17abc0f800 5 AuthRegistry(0x5649f280c1a0) adding con mode: secure 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:43:28.447+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:43:28.448+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:43:28.448+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command rotate-key cmddesc rotate-key hook 0x5649f280c2e8 EEXIST 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-c con 0x5649f281cd80 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-b con 0x5649f28476d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): picked mon.noname-a con 0x5649f284be30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.803 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:43:28.448+0000 7f17abc0f800 10 monclient(hunting): authenticate will time out at 2324.237281s 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request con 0x5649f281cd80 auth_method 0 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): get_auth_request con 0x5649f284be30 auth_method 0 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.804 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:43:28.448+0000 7f17a96f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient: _finish_hunting 0 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 1 monclient: found mon.noname-c 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:43:28.448+0000 7f17a8ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: dump: 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.805 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: _finish_auth 0 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:43:28.448+0000 7f167affd640 10 monclient: dump: 2024-09-22T08:43:28.806 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:43:28.448+0000 7f168cff9640 4 set_mon_vals no callback set 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:43:28.449+0000 7f17abc0f800 5 monclient: authenticate success, global_id 7799 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _renew_subs 2024-09-22T08:43:28.807 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:43:28.449+0000 7f17abc0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:43:28.449+0000 7f17abc0f800 1 librados: init done 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:43:28.449+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cr dump hook 0x5649f283afe8 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:43:28.450+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:43:28.451+0000 7f167affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:43:28.451+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f1674077570 auth_method 0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:43:28.451+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f2865a20 auth_method 0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 realm 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.808 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:43:28.452+0000 7f17abc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:43:28.452+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:43:28.452+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x5649f2869c50 auth_method 0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:43:28.453+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:43:28.453+0000 7f17a9efa640 10 monclient: get_auth_request con 0x5649f286d4b0 auth_method 0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:43:28.454+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:43:28.454+0000 7f17abc0f800 20 searching for the correct realm 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:43:28.454+0000 7f17a96f9640 10 monclient: get_auth_request con 0x5649f2872230 auth_method 0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:43:28.454+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f179c0b1c20 auth_method 0 2024-09-22T08:43:28.809 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:43:28.455+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x5649f2869c50 msgr2=0x5649f286c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:43:28.455+0000 7f167affd640 1 client.7799.objecter ms_handle_reset 0x5649f2869c50 session 0x5649f28695d0 osd.1 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:43:28.455+0000 7f167affd640 10 monclient: _renew_subs 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:43:28.455+0000 7f167affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:43:28.456+0000 7f17a9efa640 10 monclient: get_auth_request con 0x7f17a0081920 auth_method 0 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:43:28.456+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f1674087810 auth_method 0 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:43:28.457+0000 7f17a96f9640 10 monclient: get_auth_request con 0x7f179c074070 auth_method 0 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:43:28.459+0000 7f17a8ef8640 0 -- 172.21.15.78:0/522213676 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f17a4018040 msgr2=0x7f17a4025470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:43:28.660+0000 7f17a8ef8640 10 monclient: get_auth_request con 0x7f17a4018040 auth_method 0 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.810 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:43:28.665+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zone default found 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Realm: () 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:43:28.666+0000 7f17abc0f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:43:28.666+0000 7f17abc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 zonegroup default 2024-09-22T08:43:28.811 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:43:28.666+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started sync module instance, tier type = 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:43:28.667+0000 7f17abc0f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=0 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=1 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=2 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=3 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=4 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=5 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:43:28.676+0000 7f17abc0f800 20 add_watcher() i=6 2024-09-22T08:43:28.812 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:43:28.677+0000 7f17abc0f800 20 add_watcher() i=7 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:43:28.677+0000 7f17abc0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding auth protocol: cephx 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:43:28.679+0000 7f165ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.813 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: crc 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 AuthRegistry(0x7ffde3888be0) adding con mode: secure 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:43:28.679+0000 7f17abc0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache list hook 0x5649f283d620 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache inspect hook 0x5649f283d620 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache erase hook 0x5649f283d620 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command cache zap hook 0x5649f283d620 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 note: GC not initialized 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:43:28.679+0000 7f165efe5640 20 reqs_thread_entry: start 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace show hook 0x7f17a0035020 2024-09-22T08:43:28.814 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace history hook 0x7f17a0035020 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace active hook 0x7f17a0035020 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:43:28.679+0000 7f17abc0f800 5 asok(0x5649f25560f0) register_command sync trace active_short hook 0x7f17a0035020 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 Filter name: none 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:43:28.679+0000 7f165cfe1640 20 reqs_thread_entry: start 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:43:28.679+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:43:28.679+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:43:28.680+0000 7f17abc0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.815 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:43:28.680+0000 7f17abc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:43:28.686+0000 7f17abc0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562538 cookie 94875601568640 notifier 7799 bl.length()=911 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:43:28.686+0000 7f168cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:28.816 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:43:28.688+0000 7f17abc0f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:43:28.693+0000 7f17abc0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f17abc0f800 time 2024-09-22T08:43:28.694183+0000 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f17af18c748] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.817 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:43:28.694+0000 7f17abc0f800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f17abc0f800 thread_name:radosgw-admin 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f17ade3e6f0] 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f17ade8b99c] 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f17af18c7a2] 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f17af18c906] 2024-09-22T08:43:28.818 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5649f09e2e01] 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5649f09f2d0a] 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f17ade29590] 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:43:28.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:43:28.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:43:28.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:43:28.822 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:43:28.823 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:43:28.824 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:43:28.825 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165cfe1640 / http_manager 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165efe5640 / http_manager 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f165ffe7640 / rgw_dt_lg_renew 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f167affd640 / ms_dispatch 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f168cff9640 / io_context_pool 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f168effd640 / ms_dispatch 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1695e03640 / ms_dispatch 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1697606640 / io_context_pool 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a8ef8640 / msgr-worker-2 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a96f9640 / msgr-worker-1 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17a9efa640 / msgr-worker-0 2024-09-22T08:43:28.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17aa6fb640 / io_context_pool 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr: 7f17abc0f800 / radosgw-admin 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:43:28.695557Z_6805f149-f8dd-4bb3-8b8c-19473e1ee45e/log 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:43:28.827 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:43:28.831 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.768+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.769+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.769+0000 7f130f40e800 20 realm 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.769+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.770+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.770+0000 7f130f40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.770+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.770+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.770+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.771+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.771+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.771+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.771+0000 7f130f40e800 20 searching for the correct realm 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.773+0000 7f130b25a640 0 -- 172.21.15.78:0/831715492 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x556044d95a00 msgr2=0x556044d97e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.776+0000 7f130b25a640 0 -- 172.21.15.78:0/831715492 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x556044d9d480 msgr2=0x556044d9f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.782+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 zone default found 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 4 Realm: () 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 zonegroup default 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 started sync module instance, tier type = 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.783+0000 7f130f40e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=0 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=1 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=2 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=3 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=4 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=5 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.792+0000 7f130f40e800 20 add_watcher() i=6 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.793+0000 7f130f40e800 20 add_watcher() i=7 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.793+0000 7f130f40e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.794+0000 7f11c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 5 note: GC not initialized 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f11c0fe1640 20 reqs_thread_entry: start 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 20 Filter name: none 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f11b9ffb640 20 reqs_thread_entry: start 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.795+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.796+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.796+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.796+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.796+0000 7f130f40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.796+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.797+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.797+0000 7f130f40e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.797+0000 7f130f40e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:28.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.797+0000 7f130f40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.799+0000 7f11c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.800+0000 7f130f40e800 20 remove_watcher() i=0 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.800+0000 7f130f40e800 2 removed watcher, disabling cache 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.801+0000 7f130f40e800 20 remove_watcher() i=1 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.802+0000 7f130f40e800 20 remove_watcher() i=2 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.803+0000 7f130f40e800 20 remove_watcher() i=3 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.804+0000 7f130f40e800 20 remove_watcher() i=4 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.805+0000 7f130f40e800 20 remove_watcher() i=5 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.806+0000 7f130f40e800 20 remove_watcher() i=6 2024-09-22T08:43:28.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.807+0000 7f130f40e800 20 remove_watcher() i=7 2024-09-22T08:43:28.857 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:43:28.885 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:28.885 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:28.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.921+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 20 realm 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.923+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.924+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:28.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.924+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.924+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:28.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.924+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:28.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.925+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:28.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.925+0000 7f2089a0e800 20 searching for the correct realm 2024-09-22T08:43:28.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:28.927+0000 7f2085a1b640 0 -- 172.21.15.78:0/3683495023 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f20700bfb20 msgr2=0x7f20700a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:29.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.132+0000 7f207ca19640 0 -- 172.21.15.78:0/3683495023 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2080017020 msgr2=0x7f2080072a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.137+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 zone default found 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 4 Realm: () 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 zonegroup default 2024-09-22T08:43:29.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.138+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.139+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.139+0000 7f2089a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.139+0000 7f2089a0e800 20 started sync module instance, tier type = 2024-09-22T08:43:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.139+0000 7f2089a0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:29.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=0 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=1 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=2 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=3 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=4 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=5 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.147+0000 7f2089a0e800 20 add_watcher() i=6 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.148+0000 7f2089a0e800 20 add_watcher() i=7 2024-09-22T08:43:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.148+0000 7f2089a0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:29.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.150+0000 7f1f3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:29.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.150+0000 7f2089a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.150+0000 7f2089a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.150+0000 7f2089a0e800 5 note: GC not initialized 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f1f3afe5640 20 reqs_thread_entry: start 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 20 Filter name: none 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f1f38fe1640 20 reqs_thread_entry: start 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:29.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:29.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:29.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.151+0000 7f2089a0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:29.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.152+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:29.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.153+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.154+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:29.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.155+0000 7f2089a0e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:29.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.156+0000 7f1f3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:29.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.159+0000 7f2089a0e800 20 remove_watcher() i=0 2024-09-22T08:43:29.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.159+0000 7f2089a0e800 2 removed watcher, disabling cache 2024-09-22T08:43:29.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.160+0000 7f2089a0e800 20 remove_watcher() i=1 2024-09-22T08:43:29.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.161+0000 7f2089a0e800 20 remove_watcher() i=2 2024-09-22T08:43:29.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.162+0000 7f2089a0e800 20 remove_watcher() i=3 2024-09-22T08:43:29.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.162+0000 7f2089a0e800 20 remove_watcher() i=4 2024-09-22T08:43:29.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.163+0000 7f2089a0e800 20 remove_watcher() i=5 2024-09-22T08:43:29.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.165+0000 7f2089a0e800 20 remove_watcher() i=6 2024-09-22T08:43:29.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:29.165+0000 7f2089a0e800 20 remove_watcher() i=7 2024-09-22T08:43:59.200 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T08:43:59.237 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:59.237 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:59.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.277+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 realm 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.280+0000 7fdadfa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:59.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 searching for the correct realm 2024-09-22T08:43:59.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.283+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x560551fffed0 msgr2=0x5605520022c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.287+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x560552007910 msgr2=0x560552009d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zone default found 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Realm: () 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zonegroup default 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started sync module instance, tier type = 2024-09-22T08:43:59.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=0 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=1 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=2 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=3 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=4 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=5 2024-09-22T08:43:59.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=6 2024-09-22T08:43:59.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.305+0000 7fdadfa0e800 20 add_watcher() i=7 2024-09-22T08:43:59.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.305+0000 7fdadfa0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.307+0000 7fd991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 note: GC not initialized 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.307+0000 7fd990fe1640 20 reqs_thread_entry: start 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:59.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 Filter name: none 2024-09-22T08:43:59.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fd90a7fc640 20 reqs_thread_entry: start 2024-09-22T08:43:59.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:59.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:59.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.310+0000 7fdadfa0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:43:59.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562539 cookie 94580850619840 notifier 7853 bl.length()=911 2024-09-22T08:43:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:59.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:59.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:59.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:59.324 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdadfa0e800 time 2024-09-22T08:43:59.324865+0000 2024-09-22T08:43:59.325 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:59.325 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdae0b8c748] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdadfa0e800 thread_name:radosgw-admin 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.324+0000 7fdadfa0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdadfa0e800 time 2024-09-22T08:43:59.324865+0000 2024-09-22T08:43:59.326 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdae0b8c748] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:43:59.327 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdadf83e6f0] 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdadf88b99c] 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdae0b8c7a2] 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.348 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.325+0000 7fdadfa0e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdadfa0e800 thread_name:radosgw-admin 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdadf83e6f0] 2024-09-22T08:43:59.349 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdadf88b99c] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdae0b8c7a2] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:59.350 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 asok(0x560551cf00f0) unregister_commands rotate-key 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.351 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.352 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: starting msgr at 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: starting objecter 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests hook 0x560551f13d70 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: setting wanted keys 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: calling monclient init 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.353 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.354 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key hook 0x560551f12908 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551dbfbc0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551e554f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551e5b860 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.049592s 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551e5b860 auth_method 0 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551e554f0 auth_method 0 2024-09-22T08:43:59.355 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551dbfbc0 auth_method 0 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:43:59.260+0000 7fdad3fff640 1 monclient: found mon.noname-c 2024-09-22T08:43:59.356 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: dump: 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.357 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: dump: 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.358 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 7844 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:43:59.261+0000 7fd9c960a640 4 set_mon_vals no callback set 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 1 librados: init done 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:43:59.263+0000 7fdadb21a640 10 monclient: get_auth_request con 0x7fd9c0077570 auth_method 0 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:43:59.264+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551f3aa30 auth_method 0 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:43:59.264+0000 7fdadb21a640 10 monclient: get_auth_request con 0x560551f5db30 auth_method 0 2024-09-22T08:43:59.359 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:43:59.265+0000 7fdad3fff640 10 monclient: get_auth_request con 0x560551f61fa0 auth_method 0 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:43:59.266+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551f61440 auth_method 0 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.360 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.361 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests cmddesc objecter_requests hook 0x560551f6d6e0 EEXIST 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.362 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x560551f691a0 EEXIST 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551f91a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551f91de0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551f90710 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.057776s 2024-09-22T08:43:59.363 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551f91de0 auth_method 0 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551f90710 auth_method 0 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551f91a00 auth_method 0 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.364 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient(hunting): handle_auth_done global_id 8481 payload 824 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:43:59.269+0000 7fdadba1b640 1 monclient: found mon.noname-a 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: dump: 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.365 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: dump: 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.366 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 8481 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:43:59.269+0000 7fdadc21c640 4 set_mon_vals no callback set 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.367 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:43:59.271+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fd9b4077480 auth_method 0 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: get_monmap_and_config 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.368 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.369 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.370 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x7ffeca587da8 EEXIST 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.371 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551fe5da0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551fd66f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551fe11d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.061843s 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551fe5da0 auth_method 0 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551fd66f0 auth_method 0 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.372 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551fe11d0 auth_method 0 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_done global_id 8484 payload 274 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.373 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:43:59.273+0000 7fdadba1b640 1 monclient: found mon.noname-a 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: dump: 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.374 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: dump: 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.375 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 8484 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 4 set_mon_vals no callback set 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: shutdown 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.376 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.377 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: starting msgr at 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: starting objecter 2024-09-22T08:43:59.378 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests cmddesc objecter_requests hook 0x560551f8fe40 EEXIST 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: setting wanted keys 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: calling monclient init 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.379 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x560551fa6408 EEXIST 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551fd66f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551fe11d0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551fe5da0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.380 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.064235s 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551fe11d0 auth_method 0 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551fe5da0 auth_method 0 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.381 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551fd66f0 auth_method 0 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_done global_id 7853 payload 824 2024-09-22T08:43:59.382 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:43:59.275+0000 7fdadb21a640 1 monclient: found mon.noname-c 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: dump: 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: dump: 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 7853 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:43:59.275+0000 7fd9beffd640 4 set_mon_vals no callback set 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 1 librados: init done 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cr dump hook 0x560551fdfed8 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:43:59.277+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.385 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:43:59.278+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fd9a4077570 auth_method 0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:43:59.279+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551fffed0 auth_method 0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 realm 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:43:59.280+0000 7fdad3fff640 10 monclient: get_auth_request con 0x5605520040b0 auth_method 0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.386 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:43:59.281+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560552007910 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 searching for the correct realm 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:43:59.282+0000 7fdadb21a640 10 monclient: get_auth_request con 0x56055200c640 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:43:59.283+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fdacc041060 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:43:59.283+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x560551fffed0 msgr2=0x5605520022c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 1 client.7853.objecter ms_handle_reset 0x560551fffed0 session 0x560551fff850 osd.6 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 10 monclient: _renew_subs 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:43:59.284+0000 7fdadba1b640 10 monclient: get_auth_request con 0x7fd9a4087890 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:43:59.284+0000 7fdadba1b640 10 monclient: get_auth_request con 0x7fdac4094040 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:43:59.285+0000 7fdadb21a640 10 monclient: get_auth_request con 0x7fdacc06ab60 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:43:59.287+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x560552007910 msgr2=0x560552009d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:43:59.287+0000 7fd9bd7fa640 1 client.7853.objecter ms_handle_reset 0x560552007910 session 0x560552003400 osd.7 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:43:59.287+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fdad4061040 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:43:59.287+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551fffed0 auth_method 0 2024-09-22T08:43:59.387 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:59.388 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zone default found 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Realm: () 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zonegroup default 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started sync module instance, tier type = 2024-09-22T08:43:59.389 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=0 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=1 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=2 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=3 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=4 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=5 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=6 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:43:59.305+0000 7fdadfa0e800 20 add_watcher() i=7 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:43:59.305+0000 7fdadfa0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.390 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:43:59.307+0000 7fd991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache list hook 0x560551fde280 2024-09-22T08:43:59.391 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache inspect hook 0x560551fde280 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache erase hook 0x560551fde280 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache zap hook 0x560551fde280 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 note: GC not initialized 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:43:59.307+0000 7fd990fe1640 20 reqs_thread_entry: start 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace show hook 0x7fdac4010050 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace history hook 0x7fdac4010050 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace active hook 0x7fdac4010050 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace active_short hook 0x7fdac4010050 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 Filter name: none 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:43:59.308+0000 7fd90a7fc640 20 reqs_thread_entry: start 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:59.392 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:43:59.310+0000 7fdadfa0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562539 cookie 94580850619840 notifier 7853 bl.length()=911 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.393 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:43:59.324+0000 7fdadfa0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdadfa0e800 time 2024-09-22T08:43:59.324865+0000 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdae0b8c748] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.394 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:43:59.325+0000 7fdadfa0e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdadfa0e800 thread_name:radosgw-admin 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdadf83e6f0] 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdadf88b99c] 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdae0b8c7a2] 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.395 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:43:59.396 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:43:59.397 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:43:59.398 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:43:59.399 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:43:59.400 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:43:59.401 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd90a7fc640 / http_manager 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd990fe1640 / http_manager 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd991fe3640 / rgw_dt_lg_renew 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9bd7fa640 / ms_dispatch 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9beffd640 / io_context_pool 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c5602640 / ms_dispatch 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c7e07640 / ms_dispatch 2024-09-22T08:43:59.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c960a640 / io_context_pool 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdad3fff640 / msgr-worker-2 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadb21a640 / msgr-worker-1 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadba1b640 / msgr-worker-0 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadc21c640 / io_context_pool 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadfa0e800 / radosgw-admin 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.154610.log 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 asok(0x560551cf00f0) unregister_commands rotate-key 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.403 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding auth protocol: cephx 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.404 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: crc 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f17ee0) adding con mode: secure 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: starting msgr at 2024-09-22T08:43:59.405 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: starting objecter 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests hook 0x560551f13d70 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: setting wanted keys 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 1 librados: calling monclient init 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding auth protocol: cephx 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.406 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: crc 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:43:59.259+0000 7fdadfa0e800 5 AuthRegistry(0x560551f127c0) adding con mode: secure 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key hook 0x560551f12908 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551dbfbc0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551e554f0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551e5b860 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.407 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:43:59.260+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.049592s 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551e5b860 auth_method 0 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551e554f0 auth_method 0 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.408 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:43:59.260+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551dbfbc0 auth_method 0 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:43:59.260+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.409 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:43:59.260+0000 7fdad3fff640 1 monclient: found mon.noname-c 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:43:59.260+0000 7fdad3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: dump: 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.410 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:43:59.261+0000 7fd9c7e07640 10 monclient: dump: 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.411 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 7844 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:43:59.261+0000 7fd9c960a640 4 set_mon_vals no callback set 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:43:59.261+0000 7fdadfa0e800 1 librados: init done 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:43:59.263+0000 7fd9c7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:43:59.263+0000 7fdadb21a640 10 monclient: get_auth_request con 0x7fd9c0077570 auth_method 0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:43:59.264+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551f3aa30 auth_method 0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:43:59.264+0000 7fdadb21a640 10 monclient: get_auth_request con 0x560551f5db30 auth_method 0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:43:59.265+0000 7fdad3fff640 10 monclient: get_auth_request con 0x560551f61fa0 auth_method 0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:43:59.266+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551f61440 auth_method 0 2024-09-22T08:43:59.412 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding auth protocol: cephx 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.413 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: crc 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 5 AuthRegistry(0x560551f6a250) adding con mode: secure 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:43:59.267+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests cmddesc objecter_requests hook 0x560551f6d6e0 EEXIST 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.414 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding auth protocol: cephx 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.415 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: crc 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 AuthRegistry(0x560551f69058) adding con mode: secure 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x560551f691a0 EEXIST 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551f91a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551f91de0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551f90710 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.416 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:43:59.268+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.057776s 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551f91de0 auth_method 0 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551f90710 auth_method 0 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:43:59.268+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:43:59.268+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551f91a00 auth_method 0 2024-09-22T08:43:59.417 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:43:59.268+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:43:59.269+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:43:59.269+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient(hunting): handle_auth_done global_id 8481 payload 824 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:43:59.269+0000 7fdadba1b640 1 monclient: found mon.noname-a 2024-09-22T08:43:59.418 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:43:59.269+0000 7fdadba1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: dump: 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.419 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:43:59.269+0000 7fd9c5602640 10 monclient: dump: 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.420 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 8481 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:43:59.269+0000 7fdadc21c640 4 set_mon_vals no callback set 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:43:59.269+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:43:59.271+0000 7fd9c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:43:59.271+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fd9b4077480 auth_method 0 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: get_monmap_and_config 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding auth protocol: cephx 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.422 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: crc 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:43:59.271+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb17a0) adding con mode: secure 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding auth protocol: cephx 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.423 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: crc 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca587c60) adding con mode: secure 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x7ffeca587da8 EEXIST 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.424 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551fe5da0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551fd66f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551fe11d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:43:59.272+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.061843s 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551fe5da0 auth_method 0 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:43:59.272+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551fd66f0 auth_method 0 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.425 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:43:59.272+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:43:59.273+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551fe11d0 auth_method 0 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:43:59.273+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient(hunting): handle_auth_done global_id 8484 payload 274 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:43:59.273+0000 7fdadba1b640 1 monclient: found mon.noname-a 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:43:59.273+0000 7fdadba1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.426 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: dump: 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.427 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:43:59.273+0000 7fd9beffd640 10 monclient: dump: 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 8484 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 10 monclient: get_monmap_and_config success 2024-09-22T08:43:59.428 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:43:59.273+0000 7fdadfa0e800 4 set_mon_vals no callback set 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: shutdown 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: build_initial_monmap 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 build_initial for_mkfs: 0 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: monmap: 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:43:59.429 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding auth protocol: cephx 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.430 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: crc 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fb5300) adding con mode: secure 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: starting msgr at 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: starting objecter 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command objecter_requests cmddesc objecter_requests hook 0x560551f8fe40 EEXIST 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: setting wanted keys 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 1 librados: calling monclient init 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 10 monclient: init 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding auth protocol: cephx 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.431 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: crc 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 5 AuthRegistry(0x560551fa62c0) adding con mode: secure 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:43:59.274+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command rotate-key cmddesc rotate-key hook 0x560551fa6408 EEXIST 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _reopen_session rank -1 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-b con 0x560551fd66f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-a con 0x560551fe11d0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): picked mon.noname-c con 0x560551fe5da0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.432 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): start opening mon connection 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): _renew_subs 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient(hunting): authenticate will time out at 2355.064235s 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): get_auth_request con 0x560551fe11d0 auth_method 0 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): get_auth_request con 0x560551fe5da0 auth_method 0 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): get_auth_request con 0x560551fd66f0 auth_method 0 2024-09-22T08:43:59.433 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:43:59.275+0000 7fdadba1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:43:59.275+0000 7fdad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient(hunting): handle_auth_done global_id 7853 payload 824 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient: _finish_hunting 0 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:43:59.275+0000 7fdadb21a640 1 monclient: found mon.noname-c 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:43:59.275+0000 7fdadb21a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.434 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: dump: 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: _finish_auth 0 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: _check_auth_tickets 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:43:59.435 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:43:59.275+0000 7fd9bd7fa640 10 monclient: dump: 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 5 monclient: authenticate success, global_id 7853 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:43:59.275+0000 7fd9beffd640 4 set_mon_vals no callback set 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:43:59.275+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.436 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 10 monclient: _renew_subs 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 1 librados: init done 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:43:59.276+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cr dump hook 0x560551fdfed8 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:43:59.277+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:43:59.278+0000 7fd9bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:43:59.278+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fd9a4077570 auth_method 0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:43:59.279+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551fffed0 auth_method 0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 realm 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:43:59.279+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.437 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:43:59.280+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:43:59.280+0000 7fdad3fff640 10 monclient: get_auth_request con 0x5605520040b0 auth_method 0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:43:59.281+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560552007910 auth_method 0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:43:59.281+0000 7fdadfa0e800 20 searching for the correct realm 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:43:59.282+0000 7fdadb21a640 10 monclient: get_auth_request con 0x56055200c640 auth_method 0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:43:59.283+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fdacc041060 auth_method 0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:43:59.283+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x560551fffed0 msgr2=0x5605520022c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 1 client.7853.objecter ms_handle_reset 0x560551fffed0 session 0x560551fff850 osd.6 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 10 monclient: _renew_subs 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:43:59.283+0000 7fd9bd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:43:59.438 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:43:59.284+0000 7fdadba1b640 10 monclient: get_auth_request con 0x7fd9a4087890 auth_method 0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:43:59.284+0000 7fdadba1b640 10 monclient: get_auth_request con 0x7fdac4094040 auth_method 0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:43:59.285+0000 7fdadb21a640 10 monclient: get_auth_request con 0x7fdacc06ab60 auth_method 0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:43:59.287+0000 7fdadba1b640 0 -- 172.21.15.78:0/817195714 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x560552007910 msgr2=0x560552009d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:43:59.287+0000 7fd9bd7fa640 1 client.7853.objecter ms_handle_reset 0x560552007910 session 0x560552003400 osd.7 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:43:59.287+0000 7fdad3fff640 10 monclient: get_auth_request con 0x7fdad4061040 auth_method 0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:43:59.287+0000 7fdadba1b640 10 monclient: get_auth_request con 0x560551fffed0 auth_method 0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:43:59.292+0000 7fdadfa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.439 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zone default found 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Realm: () 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 zonegroup default 2024-09-22T08:43:59.440 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:43:59.293+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started sync module instance, tier type = 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:43:59.294+0000 7fdadfa0e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=0 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=1 2024-09-22T08:43:59.441 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=2 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=3 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=4 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=5 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:43:59.304+0000 7fdadfa0e800 20 add_watcher() i=6 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:43:59.305+0000 7fdadfa0e800 20 add_watcher() i=7 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:43:59.305+0000 7fdadfa0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding auth protocol: cephx 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.442 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:43:59.307+0000 7fd991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: crc 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 AuthRegistry(0x7ffeca588130) adding con mode: secure 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache list hook 0x560551fde280 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache inspect hook 0x560551fde280 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache erase hook 0x560551fde280 2024-09-22T08:43:59.443 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command cache zap hook 0x560551fde280 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:43:59.307+0000 7fdadfa0e800 5 note: GC not initialized 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:43:59.307+0000 7fd990fe1640 20 reqs_thread_entry: start 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace show hook 0x7fdac4010050 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace history hook 0x7fdac4010050 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace active hook 0x7fdac4010050 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 5 asok(0x560551cf00f0) register_command sync trace active_short hook 0x7fdac4010050 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 Filter name: none 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:43:59.308+0000 7fd90a7fc640 20 reqs_thread_entry: start 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:43:59.308+0000 7fdadfa0e800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.444 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:43:59.309+0000 7fdadfa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:43:59.310+0000 7fdadfa0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:43:59.318+0000 7fdadfa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562539 cookie 94580850619840 notifier 7853 bl.length()=911 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.445 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:43:59.318+0000 7fd9beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:43:59.320+0000 7fdadfa0e800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:43:59.324+0000 7fdadfa0e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdadfa0e800 time 2024-09-22T08:43:59.324865+0000 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdae0b8c748] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.446 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:43:59.325+0000 7fdadfa0e800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fdadfa0e800 thread_name:radosgw-admin 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdadf83e6f0] 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdadf88b99c] 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:43:59.447 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdae0b8c7a2] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fdae0b8c906] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605510fce01] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0xd8186c) [0x56055160f86c] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56055110cc9d] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fdadf829590] 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:43:59.448 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:43:59.449 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:43:59.450 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:43:59.451 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:43:59.452 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:43:59.453 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:43:59.454 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd90a7fc640 / http_manager 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd990fe1640 / http_manager 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd991fe3640 / rgw_dt_lg_renew 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9bd7fa640 / ms_dispatch 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9beffd640 / io_context_pool 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c5602640 / ms_dispatch 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c7e07640 / ms_dispatch 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fd9c960a640 / io_context_pool 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdad3fff640 / msgr-worker-2 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadb21a640 / msgr-worker-1 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadba1b640 / msgr-worker-0 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadc21c640 / io_context_pool 2024-09-22T08:43:59.455 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdadfa0e800 / radosgw-admin 2024-09-22T08:43:59.456 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:43:59.456 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:43:59.456 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:43:59.326527Z_e07432f1-9256-4e25-a9a1-56334644bdc7/log 2024-09-22T08:43:59.456 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:43:59.456 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:43:59.457 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:43:59.457 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:43:59.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.401+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 realm 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.403+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.404+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.404+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.405+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.405+0000 7f565a063800 20 searching for the correct realm 2024-09-22T08:43:59.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.407+0000 7f5658355640 0 -- 172.21.15.78:0/3003315134 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f5640078040 msgr2=0x7f56400d41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:43:59.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.613+0000 7f564f353640 0 -- 172.21.15.78:0/3003315134 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f565002ab60 msgr2=0x7f565001f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.618+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 zone default found 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 4 Realm: () 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 zonegroup default 2024-09-22T08:43:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.619+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 started sync module instance, tier type = 2024-09-22T08:43:59.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.620+0000 7f565a063800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=0 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=1 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=2 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=3 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=4 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=5 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.629+0000 7f565a063800 20 add_watcher() i=6 2024-09-22T08:43:59.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.630+0000 7f565a063800 20 add_watcher() i=7 2024-09-22T08:43:59.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.630+0000 7f565a063800 2 all 8 watchers are set, enabling cache 2024-09-22T08:43:59.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f550dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:59.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f565a063800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:43:59.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f565a063800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:43:59.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f565a063800 5 note: GC not initialized 2024-09-22T08:43:59.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f550cfe1640 20 reqs_thread_entry: start 2024-09-22T08:43:59.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f565a063800 20 init_complete bucket index max shards: 11 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f565a063800 20 Filter name: none 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.633+0000 7f54867fc640 20 reqs_thread_entry: start 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:43:59.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.634+0000 7f565a063800 20 rados->read ofs=0 len=0 2024-09-22T08:43:59.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:43:59.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:43:59.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:43:59.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.635+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:59.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:43:59.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.636+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.637+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.637+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.637+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.637+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:43:59.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:59.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.638+0000 7f565a063800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:43:59.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.639+0000 7f550dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:43:59.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.643+0000 7f565a063800 20 remove_watcher() i=0 2024-09-22T08:43:59.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.643+0000 7f565a063800 2 removed watcher, disabling cache 2024-09-22T08:43:59.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.644+0000 7f565a063800 20 remove_watcher() i=1 2024-09-22T08:43:59.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.645+0000 7f565a063800 20 remove_watcher() i=2 2024-09-22T08:43:59.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.646+0000 7f565a063800 20 remove_watcher() i=3 2024-09-22T08:43:59.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.647+0000 7f565a063800 20 remove_watcher() i=4 2024-09-22T08:43:59.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.648+0000 7f565a063800 20 remove_watcher() i=5 2024-09-22T08:43:59.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.649+0000 7f565a063800 20 remove_watcher() i=6 2024-09-22T08:43:59.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:43:59.651+0000 7f565a063800 20 remove_watcher() i=7 2024-09-22T08:43:59.662 INFO:tasks.workunit.client.0.smithi078.stderr: test: duplicated entries can be purged manually 2024-09-22T08:44:29.686 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:44:29.718 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:29.718 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:29.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.758+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.760+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.760+0000 7fa08c240800 20 realm 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.760+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.761+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.761+0000 7fa08c240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.761+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.761+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.761+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.762+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.762+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.763+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:29.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.763+0000 7fa08c240800 20 searching for the correct realm 2024-09-22T08:44:29.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.764+0000 7fa089d2a640 0 -- 172.21.15.78:0/3493319154 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55bb0af0dac0 msgr2=0x55bb0af0feb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:29.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.769+0000 7fa081529640 0 -- 172.21.15.78:0/3493319154 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x55bb0af11bc0 msgr2=0x55bb0af13fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:29.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:29.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:29.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:29.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:29.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:29.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.774+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 zone default found 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 4 Realm: () 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:29.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 zonegroup default 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.775+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 started sync module instance, tier type = 2024-09-22T08:44:29.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.776+0000 7fa08c240800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=0 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=1 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=2 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=3 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=4 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=5 2024-09-22T08:44:29.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.786+0000 7fa08c240800 20 add_watcher() i=6 2024-09-22T08:44:29.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.787+0000 7fa08c240800 20 add_watcher() i=7 2024-09-22T08:44:29.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.787+0000 7fa08c240800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:29.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.788+0000 7f9f3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:29.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 5 note: GC not initialized 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7f9f3efe5640 20 reqs_thread_entry: start 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 20 Filter name: none 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7f9f3cfe1640 20 reqs_thread_entry: start 2024-09-22T08:44:29.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.789+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.790+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.790+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.790+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.790+0000 7fa08c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.790+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.791+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:29.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.791+0000 7fa08c240800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.791+0000 7fa08c240800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:29.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.791+0000 7fa08c240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:29.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.793+0000 7f9f3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.795+0000 7fa08c240800 20 remove_watcher() i=0 2024-09-22T08:44:29.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.795+0000 7fa08c240800 2 removed watcher, disabling cache 2024-09-22T08:44:29.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.796+0000 7fa08c240800 20 remove_watcher() i=1 2024-09-22T08:44:29.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.797+0000 7fa08c240800 20 remove_watcher() i=2 2024-09-22T08:44:29.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.798+0000 7fa08c240800 20 remove_watcher() i=3 2024-09-22T08:44:29.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.799+0000 7fa08c240800 20 remove_watcher() i=4 2024-09-22T08:44:29.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.800+0000 7fa08c240800 20 remove_watcher() i=5 2024-09-22T08:44:29.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.801+0000 7fa08c240800 20 remove_watcher() i=6 2024-09-22T08:44:29.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.802+0000 7fa08c240800 20 remove_watcher() i=7 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T08:44:29.849 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:29.849 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:29.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.885+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 realm 2024-09-22T08:44:29.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:29.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 searching for the correct realm 2024-09-22T08:44:29.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.891+0000 7fe0de899640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5621cd3f3fe0 msgr2=0x5621cd3f63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.894+0000 7fe0df09a640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x5621cd3fba50 msgr2=0x5621cd3fde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zone default found 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Realm: () 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zonegroup default 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started sync module instance, tier type = 2024-09-22T08:44:29.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=0 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=1 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=2 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=3 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=4 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=5 2024-09-22T08:44:29.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=6 2024-09-22T08:44:29.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.910+0000 7fe0e0daf800 20 add_watcher() i=7 2024-09-22T08:44:29.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.910+0000 7fe0e0daf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:29.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.911+0000 7fdf957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:29.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:29.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 note: GC not initialized 2024-09-22T08:44:29.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fdf0ffff640 20 reqs_thread_entry: start 2024-09-22T08:44:29.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:29.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 Filter name: none 2024-09-22T08:44:29.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fdf0dffb640 20 reqs_thread_entry: start 2024-09-22T08:44:29.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:44:29.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:29.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:44:29.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.914+0000 7fe0e0daf800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562540 cookie 94703177451104 notifier 7907 bl.length()=911 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:44:29.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:44:29.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:44:29.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:44:29.930 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0e0daf800 time 2024-09-22T08:44:29.930498+0000 2024-09-22T08:44:29.930 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe0e438c748] 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:44:29.931 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.930+0000 7fe0e0daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0e0daf800 time 2024-09-22T08:44:29.930498+0000 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe0e438c748] 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:44:29.932 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:44:29.933 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.933 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-22T08:44:29.933 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe0e0daf800 thread_name:radosgw-admin 2024-09-22T08:44:29.952 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.952 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe0e303e6f0] 2024-09-22T08:44:29.952 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe0e308b99c] 2024-09-22T08:44:29.952 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe0e438c7a2] 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:29.931+0000 7fe0e0daf800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe0e0daf800 thread_name:radosgw-admin 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.953 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe0e303e6f0] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe0e308b99c] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe0e438c7a2] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:44:29.954 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) unregister_commands rotate-key 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:29.955 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:29.956 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: starting msgr at 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: starting objecter 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests hook 0x5621cd336940 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: setting wanted keys 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: calling monclient init 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.957 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key hook 0x5621cd305ca8 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd1bb2d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:29.958 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd1bb6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd2538c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.658855s 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd1bb2d0 auth_method 0 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd1bb6b0 auth_method 0 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.959 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd2538c0 auth_method 0 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_done global_id 7898 payload 824 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient: _finish_hunting 0 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:44:29.870+0000 7fe0de899640 1 monclient: found mon.noname-c 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.960 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: dump: 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: _finish_auth 0 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: _check_auth_tickets 2024-09-22T08:44:29.961 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: dump: 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.962 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7898 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:44:29.870+0000 7fdfcce09640 4 set_mon_vals no callback set 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 1 librados: init done 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:44:29.872+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfc4077570 auth_method 0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:44:29.873+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd32c330 auth_method 0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:44:29.873+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd350d60 auth_method 0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:44:29.874+0000 7fe0d6098640 10 monclient: get_auth_request con 0x5621cd3555c0 auth_method 0 2024-09-22T08:44:29.963 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:44:29.875+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd359490 auth_method 0 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.964 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:29.965 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests cmddesc objecter_requests hook 0x5621cd360b70 EEXIST 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.966 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x5621cd35c630 EEXIST 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd384e90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd385270 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd383ba0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.967 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.666324s 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd383ba0 auth_method 0 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd385270 auth_method 0 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.968 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd384e90 auth_method 0 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_done global_id 7901 payload 824 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient: _finish_hunting 0 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:44:29.877+0000 7fe0de899640 1 monclient: found mon.noname-c 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.969 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: dump: 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: _finish_auth 0 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: _check_auth_tickets 2024-09-22T08:44:29.970 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: dump: 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7901 2024-09-22T08:44:29.971 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:44:29.877+0000 7fe0df89b640 4 set_mon_vals no callback set 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:44:29.878+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:44:29.878+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:44:29.879+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfb8077480 auth_method 0 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: get_monmap_and_config 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:29.972 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.973 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:29.974 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.975 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd947bedd8 EEXIST 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd3d93b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd3a91c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd3d4770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.669996s 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd3d93b0 auth_method 0 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.976 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd3a91c0 auth_method 0 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd3d4770 auth_method 0 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.977 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_done global_id 8544 payload 274 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient: _finish_hunting 0 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:44:29.881+0000 7fe0d6098640 1 monclient: found mon.noname-a 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: dump: 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.978 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: _finish_auth 0 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: dump: 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.979 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 8544 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 10 monclient: get_monmap_and_config success 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 4 set_mon_vals no callback set 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: shutdown 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:29.980 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.981 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: starting msgr at 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: starting objecter 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests cmddesc objecter_requests hook 0x5621cd3d3e60 EEXIST 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: setting wanted keys 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: calling monclient init 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:29.982 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.983 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x5621cd399898 EEXIST 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd3a91c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd3d4770 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd3d93b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.672250s 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd3d4770 auth_method 0 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.984 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd3d93b0 auth_method 0 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd3a91c0 auth_method 0 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:29.985 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_done global_id 7907 payload 824 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient: _finish_hunting 0 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:44:29.883+0000 7fe0df09a640 1 monclient: found mon.noname-c 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: dump: 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.986 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: _finish_auth 0 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: dump: 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:29.987 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7907 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:44:29.883+0000 7fdfc27fc640 4 set_mon_vals no callback set 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.988 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 1 librados: init done 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cr dump hook 0x7fe0c8001758 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:44:29.885+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:44:29.886+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfa80775a0 auth_method 0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:44:29.886+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd3f3fe0 auth_method 0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 realm 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.989 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:44:29.887+0000 7fe0d6098640 10 monclient: get_auth_request con 0x5621cd3f81f0 auth_method 0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:44:29.888+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd3fba50 auth_method 0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 searching for the correct realm 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:44:29.889+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd400810 auth_method 0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:44:29.890+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fe0d0045100 auth_method 0 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:44:29.891+0000 7fe0de899640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5621cd3f3fe0 msgr2=0x5621cd3f63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 1 client.7907.objecter ms_handle_reset 0x5621cd3f3fe0 session 0x5621cd3f3960 osd.6 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 10 monclient: _renew_subs 2024-09-22T08:44:29.990 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:44:29.891+0000 7fe0de899640 10 monclient: get_auth_request con 0x7fdfa80878c0 auth_method 0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:44:29.891+0000 7fe0df09a640 10 monclient: get_auth_request con 0x7fe0c8054040 auth_method 0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:44:29.892+0000 7fe0de899640 10 monclient: get_auth_request con 0x7fe0d0098a70 auth_method 0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:44:29.894+0000 7fe0df09a640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x5621cd3fba50 msgr2=0x5621cd3fde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:44:29.894+0000 7fdfc0ff9640 1 client.7907.objecter ms_handle_reset 0x5621cd3fba50 session 0x5621cd3f7580 osd.7 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:44:29.894+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fe0d8081020 auth_method 0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:44:29.894+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd3f3fe0 auth_method 0 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:29.991 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zone default found 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Realm: () 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zonegroup default 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.992 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started sync module instance, tier type = 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=0 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=1 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=2 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=3 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=4 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=5 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=6 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:44:29.910+0000 7fe0e0daf800 20 add_watcher() i=7 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:44:29.910+0000 7fe0e0daf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:29.993 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:44:29.911+0000 7fdf957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:29.994 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache list hook 0x5621cd3e3c00 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache inspect hook 0x5621cd3e3c00 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache erase hook 0x5621cd3e3c00 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache zap hook 0x5621cd3e3c00 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 note: GC not initialized 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:44:29.912+0000 7fdf0ffff640 20 reqs_thread_entry: start 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace show hook 0x7fe0c800ee10 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace history hook 0x7fe0c800ee10 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace active hook 0x7fe0c800ee10 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace active_short hook 0x7fe0c800ee10 2024-09-22T08:44:29.995 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 Filter name: none 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:44:29.912+0000 7fdf0dffb640 20 reqs_thread_entry: start 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.996 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:44:29.914+0000 7fe0e0daf800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562540 cookie 94703177451104 notifier 7907 bl.length()=911 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:44:29.930+0000 7fe0e0daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0e0daf800 time 2024-09-22T08:44:29.930498+0000 2024-09-22T08:44:29.997 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe0e438c748] 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:44:29.931+0000 7fe0e0daf800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe0e0daf800 thread_name:radosgw-admin 2024-09-22T08:44:29.998 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe0e303e6f0] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe0e308b99c] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe0e438c7a2] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:44:29.999 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:44:30.000 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:44:30.001 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:44:30.002 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:44:30.003 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:44:30.004 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:44:30.005 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf0dffb640 / http_manager 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf0ffff640 / http_manager 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf957e2640 / rgw_dt_lg_renew 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc0ff9640 / ms_dispatch 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc27fc640 / io_context_pool 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc8e01640 / ms_dispatch 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfcb606640 / ms_dispatch 2024-09-22T08:44:30.006 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfcce09640 / io_context_pool 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0d6098640 / msgr-worker-2 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0de899640 / msgr-worker-1 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0df09a640 / msgr-worker-0 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0df89b640 / io_context_pool 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0e0daf800 / radosgw-admin 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.156377.log 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) unregister_commands rotate-key 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:30.007 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding auth protocol: cephx 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.008 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: crc 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-22T08:44:29.868+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd30b180) adding con mode: secure 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: starting msgr at 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: starting objecter 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests hook 0x5621cd336940 2024-09-22T08:44:30.009 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: setting wanted keys 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 1 librados: calling monclient init 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding auth protocol: cephx 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.010 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: crc 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd305b60) adding con mode: secure 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key hook 0x5621cd305ca8 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd1bb2d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd1bb6b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd2538c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.011 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-22T08:44:29.869+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.658855s 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd1bb2d0 auth_method 0 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-22T08:44:29.869+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd1bb6b0 auth_method 0 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-22T08:44:29.869+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.012 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.013 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-22T08:44:29.870+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.013 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd2538c0 auth_method 0 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-22T08:44:29.870+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient(hunting): handle_auth_done global_id 7898 payload 824 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient: _finish_hunting 0 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-22T08:44:29.870+0000 7fe0de899640 1 monclient: found mon.noname-c 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-22T08:44:29.870+0000 7fe0de899640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.019 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: dump: 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: _finish_auth 0 2024-09-22T08:44:30.020 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: _check_auth_tickets 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-22T08:44:29.870+0000 7fdfcb606640 10 monclient: dump: 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.021 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7898 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-22T08:44:29.870+0000 7fdfcce09640 4 set_mon_vals no callback set 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-22T08:44:29.870+0000 7fe0e0daf800 1 librados: init done 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-22T08:44:29.872+0000 7fdfcb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-22T08:44:29.872+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfc4077570 auth_method 0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-22T08:44:29.873+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd32c330 auth_method 0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-22T08:44:29.873+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd350d60 auth_method 0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-22T08:44:29.874+0000 7fe0d6098640 10 monclient: get_auth_request con 0x5621cd3555c0 auth_method 0 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-22T08:44:29.875+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd359490 auth_method 0 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:30.023 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding auth protocol: cephx 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: crc 2024-09-22T08:44:30.024 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35d6e0) adding con mode: secure 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests cmddesc objecter_requests hook 0x5621cd360b70 EEXIST 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding auth protocol: cephx 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.025 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: crc 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-22T08:44:29.876+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd35c4e8) adding con mode: secure 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x5621cd35c630 EEXIST 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd384e90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd385270 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd383ba0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:30.026 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.666324s 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd383ba0 auth_method 0 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd385270 auth_method 0 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.027 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd384e90 auth_method 0 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-22T08:44:29.877+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-22T08:44:29.877+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient(hunting): handle_auth_done global_id 7901 payload 824 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient: _finish_hunting 0 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-22T08:44:29.877+0000 7fe0de899640 1 monclient: found mon.noname-c 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-22T08:44:29.877+0000 7fe0de899640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: dump: 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.029 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: _finish_auth 0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: _check_auth_tickets 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-22T08:44:29.877+0000 7fdfc8e01640 10 monclient: dump: 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7901 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-22T08:44:29.877+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-22T08:44:29.877+0000 7fe0df89b640 4 set_mon_vals no callback set 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-22T08:44:29.878+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-22T08:44:29.878+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-22T08:44:29.879+0000 7fdfc8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-22T08:44:29.879+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfb8077480 auth_method 0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: get_monmap_and_config 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding auth protocol: cephx 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.032 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: crc 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3a4cd0) adding con mode: secure 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:30.033 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding auth protocol: cephx 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: crc 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bec90) adding con mode: secure 2024-09-22T08:44:30.034 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd947bedd8 EEXIST 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd3d93b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd3a91c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd3d4770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-22T08:44:29.880+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.669996s 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd3d93b0 auth_method 0 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.035 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd3a91c0 auth_method 0 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-22T08:44:29.881+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd3d4770 auth_method 0 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.036 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-22T08:44:29.881+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient(hunting): handle_auth_done global_id 8544 payload 274 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient: _finish_hunting 0 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-22T08:44:29.881+0000 7fe0d6098640 1 monclient: found mon.noname-a 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-22T08:44:29.881+0000 7fe0d6098640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: dump: 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.037 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: _finish_auth 0 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: _check_auth_tickets 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-22T08:44:29.881+0000 7fdfc27fc640 10 monclient: dump: 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.038 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 8544 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 10 monclient: get_monmap_and_config success 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-22T08:44:29.881+0000 7fe0e0daf800 4 set_mon_vals no callback set 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: shutdown 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: build_initial_monmap 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 build_initial for_mkfs: 0 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: monmap: 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-22T08:44:30.039 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding auth protocol: cephx 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.040 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: crc 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd3aa000) adding con mode: secure 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: starting msgr at 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: starting objecter 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command objecter_requests cmddesc objecter_requests hook 0x5621cd3d3e60 EEXIST 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: setting wanted keys 2024-09-22T08:44:30.041 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 1 librados: calling monclient init 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 10 monclient: init 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding auth protocol: cephx 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.042 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: crc 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 5 AuthRegistry(0x5621cd399750) adding con mode: secure 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-22T08:44:29.882+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command rotate-key cmddesc rotate-key hook 0x5621cd399898 EEXIST 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _reopen_session rank -1 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-b con 0x5621cd3a91c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-c con 0x5621cd3d4770 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): picked mon.noname-a con 0x5621cd3d93b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.043 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): start opening mon connection 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): _renew_subs 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient(hunting): authenticate will time out at 2385.672250s 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): get_auth_request con 0x5621cd3d4770 auth_method 0 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): get_auth_request con 0x5621cd3d93b0 auth_method 0 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.044 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-22T08:44:29.883+0000 7fe0de899640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): get_auth_request con 0x5621cd3a91c0 auth_method 0 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): _init_auth method 2 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-22T08:44:29.883+0000 7fe0d6098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient(hunting): handle_auth_done global_id 7907 payload 824 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient: _finish_hunting 0 2024-09-22T08:44:30.045 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-22T08:44:29.883+0000 7fe0df09a640 1 monclient: found mon.noname-c 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-22T08:44:29.883+0000 7fe0df09a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: dump: 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.046 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: _finish_auth 0 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: _check_auth_tickets 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-22T08:44:29.883+0000 7fdfc0ff9640 10 monclient: dump: 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:fsid fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-22T08:16:23.724808+0000 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-22T08:44:30.047 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 5 monclient: authenticate success, global_id 7907 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-22T08:44:29.883+0000 7fdfc27fc640 4 set_mon_vals no callback set 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-22T08:44:29.883+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 10 monclient: _renew_subs 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 1 librados: init done 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-22T08:44:29.884+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cr dump hook 0x7fe0c8001758 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-22T08:44:29.885+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-22T08:44:29.886+0000 7fdfc0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6800/1312258676,v1:172.21.15.78:6801/1312258676] 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-22T08:44:29.886+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fdfa80775a0 auth_method 0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-22T08:44:29.886+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd3f3fe0 auth_method 0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 realm 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-22T08:44:29.887+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-22T08:44:29.887+0000 7fe0d6098640 10 monclient: get_auth_request con 0x5621cd3f81f0 auth_method 0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-22T08:44:29.888+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-22T08:44:29.888+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd3fba50 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-22T08:44:29.889+0000 7fe0e0daf800 20 searching for the correct realm 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-22T08:44:29.889+0000 7fe0de899640 10 monclient: get_auth_request con 0x5621cd400810 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-22T08:44:29.890+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fe0d0045100 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-22T08:44:29.891+0000 7fe0de899640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5621cd3f3fe0 msgr2=0x5621cd3f63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 1 client.7907.objecter ms_handle_reset 0x5621cd3f3fe0 session 0x5621cd3f3960 osd.6 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 10 monclient: _renew_subs 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-22T08:44:29.891+0000 7fdfc0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-22T08:44:29.891+0000 7fe0de899640 10 monclient: get_auth_request con 0x7fdfa80878c0 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-22T08:44:29.891+0000 7fe0df09a640 10 monclient: get_auth_request con 0x7fe0c8054040 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-22T08:44:29.892+0000 7fe0de899640 10 monclient: get_auth_request con 0x7fe0d0098a70 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-22T08:44:29.894+0000 7fe0df09a640 0 -- 172.21.15.78:0/1618770063 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x5621cd3fba50 msgr2=0x5621cd3fde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-22T08:44:29.894+0000 7fdfc0ff9640 1 client.7907.objecter ms_handle_reset 0x5621cd3fba50 session 0x5621cd3f7580 osd.7 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-22T08:44:29.894+0000 7fe0d6098640 10 monclient: get_auth_request con 0x7fe0d8081020 auth_method 0 2024-09-22T08:44:30.050 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-22T08:44:29.894+0000 7fe0df09a640 10 monclient: get_auth_request con 0x5621cd3f3fe0 auth_method 0 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-22T08:44:29.899+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zone default found 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Realm: () 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 zonegroup default 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started sync module instance, tier type = 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-22T08:44:29.900+0000 7fe0e0daf800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=0 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=1 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=2 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=3 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=4 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=5 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-22T08:44:29.909+0000 7fe0e0daf800 20 add_watcher() i=6 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-22T08:44:29.910+0000 7fe0e0daf800 20 add_watcher() i=7 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-22T08:44:29.910+0000 7fe0e0daf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding auth protocol: cephx 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-22T08:44:29.911+0000 7fdf957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: crc 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-22T08:44:29.911+0000 7fe0e0daf800 5 AuthRegistry(0x7ffd947bf160) adding con mode: secure 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache list hook 0x5621cd3e3c00 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache inspect hook 0x5621cd3e3c00 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache erase hook 0x5621cd3e3c00 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command cache zap hook 0x5621cd3e3c00 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 note: GC not initialized 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-22T08:44:29.912+0000 7fdf0ffff640 20 reqs_thread_entry: start 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace show hook 0x7fe0c800ee10 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace history hook 0x7fe0c800ee10 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace active hook 0x7fe0c800ee10 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 5 asok(0x5621cd0e10f0) register_command sync trace active_short hook 0x7fe0c800ee10 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 Filter name: none 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-22T08:44:29.912+0000 7fdf0dffb640 20 reqs_thread_entry: start 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-22T08:44:29.912+0000 7fe0e0daf800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-22T08:44:29.913+0000 7fe0e0daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-22T08:44:29.914+0000 7fe0e0daf800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-22T08:44:29.922+0000 7fe0e0daf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562540 cookie 94703177451104 notifier 7907 bl.length()=911 2024-09-22T08:44:30.056 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-22T08:44:29.923+0000 7fdfc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-22T08:44:29.924+0000 7fe0e0daf800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-22T08:44:29.930+0000 7fe0e0daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0e0daf800 time 2024-09-22T08:44:29.930498+0000 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe0e438c748] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-22T08:44:29.931+0000 7fe0e0daf800 -1 *** Caught signal (Aborted) ** 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fe0e0daf800 thread_name:radosgw-admin 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe0e303e6f0] 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe0e308b99c] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe0e438c7a2] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe0e438c906] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621cc314e01] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5621cc324d0a] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe0e3029590] 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-22T08:44:30.065 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf0dffb640 / http_manager 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf0ffff640 / http_manager 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdf957e2640 / rgw_dt_lg_renew 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc0ff9640 / ms_dispatch 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc27fc640 / io_context_pool 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfc8e01640 / ms_dispatch 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfcb606640 / ms_dispatch 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fdfcce09640 / io_context_pool 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0d6098640 / msgr-worker-2 2024-09-22T08:44:30.066 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0de899640 / msgr-worker-1 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0df09a640 / msgr-worker-0 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0df89b640 / io_context_pool 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: 7fe0e0daf800 / radosgw-admin 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-22T08:44:29.931884Z_76562812-543c-43f2-bdcf-aeea65cc7d21/log 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-22T08:44:30.067 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:44:30.068 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:30.068 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:30.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.206+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 realm 2024-09-22T08:44:30.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.208+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.209+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.209+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.210+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:30.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.210+0000 7f8fe1e0d800 20 searching for the correct realm 2024-09-22T08:44:30.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.212+0000 7f8fe00f8640 0 -- 172.21.15.78:0/3184129088 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f8fd40b9e30 msgr2=0x7f8fd40b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.416+0000 7f8fdf0f6640 0 -- 172.21.15.78:0/3184129088 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f8fd8051040 msgr2=0x7f8fd80437a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.421+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 zone default found 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 4 Realm: () 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 zonegroup default 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.422+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.423+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.423+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.423+0000 7f8fe1e0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.423+0000 7f8fe1e0d800 20 started sync module instance, tier type = 2024-09-22T08:44:30.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.423+0000 7f8fe1e0d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=0 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=1 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=2 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=3 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=4 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=5 2024-09-22T08:44:30.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.431+0000 7f8fe1e0d800 20 add_watcher() i=6 2024-09-22T08:44:30.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.433+0000 7f8fe1e0d800 20 add_watcher() i=7 2024-09-22T08:44:30.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.433+0000 7f8fe1e0d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:30.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.434+0000 7f8e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.434+0000 7f8fe1e0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:30.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:30.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 5 note: GC not initialized 2024-09-22T08:44:30.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8e94fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:30.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:30.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 Filter name: none 2024-09-22T08:44:30.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8e0e7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:30.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.435+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.436+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.436+0000 7f8fe1e0d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.436+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.436+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:30.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.436+0000 7f8fe1e0d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.437+0000 7f8fe1e0d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:30.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.437+0000 7f8fe1e0d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:30.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.439+0000 7f8e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.441+0000 7f8fe1e0d800 20 remove_watcher() i=0 2024-09-22T08:44:30.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.441+0000 7f8fe1e0d800 2 removed watcher, disabling cache 2024-09-22T08:44:30.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.442+0000 7f8fe1e0d800 20 remove_watcher() i=1 2024-09-22T08:44:30.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.443+0000 7f8fe1e0d800 20 remove_watcher() i=2 2024-09-22T08:44:30.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.444+0000 7f8fe1e0d800 20 remove_watcher() i=3 2024-09-22T08:44:30.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.445+0000 7f8fe1e0d800 20 remove_watcher() i=4 2024-09-22T08:44:30.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.446+0000 7f8fe1e0d800 20 remove_watcher() i=5 2024-09-22T08:44:30.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.446+0000 7f8fe1e0d800 20 remove_watcher() i=6 2024-09-22T08:44:30.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.447+0000 7f8fe1e0d800 20 remove_watcher() i=7 2024-09-22T08:44:30.498 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:44:30.526 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:30.526 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:30.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.562+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.564+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.564+0000 7f7a40ebb800 20 realm 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.564+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.565+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.566+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:30.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.566+0000 7f7a40ebb800 20 searching for the correct realm 2024-09-22T08:44:30.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.568+0000 7f7a3e1a4640 0 -- 172.21.15.78:0/1096207396 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f7a3006f430 msgr2=0x7f7a3006f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.571+0000 7f7a3e1a4640 0 -- 172.21.15.78:0/1096207396 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x560130d5d970 msgr2=0x560130d5fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:30.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.576+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 zone default found 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 4 Realm: () 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 zonegroup default 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.577+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.578+0000 7f7a40ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.578+0000 7f7a40ebb800 20 started sync module instance, tier type = 2024-09-22T08:44:30.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.578+0000 7f7a40ebb800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:44:30.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=0 2024-09-22T08:44:30.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=1 2024-09-22T08:44:30.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=2 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=3 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=4 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=5 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.586+0000 7f7a40ebb800 20 add_watcher() i=6 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.587+0000 7f7a40ebb800 20 add_watcher() i=7 2024-09-22T08:44:30.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.587+0000 7f7a40ebb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:30.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f78f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f7a40ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f7a40ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f7a40ebb800 5 note: GC not initialized 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f786ffff640 20 reqs_thread_entry: start 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.589+0000 7f7a40ebb800 20 init_complete bucket index max shards: 11 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 Filter name: none 2024-09-22T08:44:30.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f786dffb640 20 reqs_thread_entry: start 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:44:30.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:44:30.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.590+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.591+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:44:30.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.592+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.593+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.593+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.593+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.593+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:44:30.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:44:30.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.594+0000 7f7a40ebb800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:44:30.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.596+0000 7f78f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.598+0000 7f7a40ebb800 20 remove_watcher() i=0 2024-09-22T08:44:30.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.598+0000 7f7a40ebb800 2 removed watcher, disabling cache 2024-09-22T08:44:30.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.599+0000 7f7a40ebb800 20 remove_watcher() i=1 2024-09-22T08:44:30.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.600+0000 7f7a40ebb800 20 remove_watcher() i=2 2024-09-22T08:44:30.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.601+0000 7f7a40ebb800 20 remove_watcher() i=3 2024-09-22T08:44:30.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.602+0000 7f7a40ebb800 20 remove_watcher() i=4 2024-09-22T08:44:30.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.603+0000 7f7a40ebb800 20 remove_watcher() i=5 2024-09-22T08:44:30.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.604+0000 7f7a40ebb800 20 remove_watcher() i=6 2024-09-22T08:44:30.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:44:30.605+0000 7f7a40ebb800 20 remove_watcher() i=7 2024-09-22T08:45:00.626 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-22T08:45:00.659 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:00.659 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:00.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.701+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 realm 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.703+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.704+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:00.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.704+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.705+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:00.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.705+0000 7fd89fd26800 20 searching for the correct realm 2024-09-22T08:45:00.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.705+0000 7fd89b909640 0 -- 172.21.15.78:0/2130971264 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x564d33c96d30 msgr2=0x564d33c991f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:00.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.912+0000 7fd89b909640 0 -- 172.21.15.78:0/2130971264 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7fd88c06cbd0 msgr2=0x7fd88c0b21a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.921+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 zone default found 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 4 Realm: () 2024-09-22T08:45:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 zonegroup default 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.922+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.923+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.923+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.923+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.923+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.924+0000 7fd89fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.924+0000 7fd89fd26800 20 started sync module instance, tier type = 2024-09-22T08:45:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.924+0000 7fd89fd26800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=0 2024-09-22T08:45:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=1 2024-09-22T08:45:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=2 2024-09-22T08:45:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=3 2024-09-22T08:45:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=4 2024-09-22T08:45:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=5 2024-09-22T08:45:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.935+0000 7fd89fd26800 20 add_watcher() i=6 2024-09-22T08:45:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.936+0000 7fd89fd26800 20 add_watcher() i=7 2024-09-22T08:45:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.936+0000 7fd89fd26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:00.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.938+0000 7fd751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:00.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.938+0000 7fd89fd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:00.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.938+0000 7fd89fd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:00.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.938+0000 7fd89fd26800 5 note: GC not initialized 2024-09-22T08:45:00.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.938+0000 7fd750fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:00.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:00.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 20 Filter name: none 2024-09-22T08:45:00.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd6ca7fc640 20 reqs_thread_entry: start 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.939+0000 7fd89fd26800 20 rados->read ofs=0 len=0 2024-09-22T08:45:00.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:45:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.940+0000 7fd89fd26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:45:00.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.945+0000 7fd751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:00.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.948+0000 7fd89fd26800 20 remove_watcher() i=0 2024-09-22T08:45:00.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.948+0000 7fd89fd26800 2 removed watcher, disabling cache 2024-09-22T08:45:00.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.949+0000 7fd89fd26800 20 remove_watcher() i=1 2024-09-22T08:45:00.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.950+0000 7fd89fd26800 20 remove_watcher() i=2 2024-09-22T08:45:00.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.952+0000 7fd89fd26800 20 remove_watcher() i=3 2024-09-22T08:45:00.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.953+0000 7fd89fd26800 20 remove_watcher() i=4 2024-09-22T08:45:00.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.954+0000 7fd89fd26800 20 remove_watcher() i=5 2024-09-22T08:45:00.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.956+0000 7fd89fd26800 20 remove_watcher() i=6 2024-09-22T08:45:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:00.957+0000 7fd89fd26800 20 remove_watcher() i=7 2024-09-22T08:45:00.972 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T08:45:01.003 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:01.003 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:01.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.041+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 20 realm 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.042+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.043+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.043+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.043+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.043+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.044+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:01.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.044+0000 7fb35b40f800 20 searching for the correct realm 2024-09-22T08:45:01.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.047+0000 7fb357323640 0 -- 172.21.15.78:0/2854912784 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fb34006d040 msgr2=0x7fb34006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:01.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.253+0000 7fb34e321640 0 -- 172.21.15.78:0/2854912784 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fb35005ff50 msgr2=0x7fb350059a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:01.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:01.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:01.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.259+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 zone default found 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 4 Realm: () 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 zonegroup default 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.260+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.261+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.261+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.261+0000 7fb35b40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.261+0000 7fb35b40f800 20 started sync module instance, tier type = 2024-09-22T08:45:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.261+0000 7fb35b40f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:01.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=0 2024-09-22T08:45:01.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=1 2024-09-22T08:45:01.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=2 2024-09-22T08:45:01.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=3 2024-09-22T08:45:01.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=4 2024-09-22T08:45:01.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=5 2024-09-22T08:45:01.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.271+0000 7fb35b40f800 20 add_watcher() i=6 2024-09-22T08:45:01.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.273+0000 7fb35b40f800 20 add_watcher() i=7 2024-09-22T08:45:01.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.273+0000 7fb35b40f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:01.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.274+0000 7fb20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:01.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 5 note: GC not initialized 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb187fff640 20 reqs_thread_entry: start 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 20 Filter name: none 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb185ffb640 20 reqs_thread_entry: start 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:45:01.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.275+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.276+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.276+0000 7fb35b40f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:45:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.276+0000 7fb35b40f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:45:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.276+0000 7fb35b40f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:45:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.276+0000 7fb35b40f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:01.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.277+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.278+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.279+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.279+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:01.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.280+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.281+0000 7fb35b40f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.282+0000 7fb20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.285+0000 7fb35b40f800 20 remove_watcher() i=0 2024-09-22T08:45:01.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.285+0000 7fb35b40f800 2 removed watcher, disabling cache 2024-09-22T08:45:01.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.286+0000 7fb35b40f800 20 remove_watcher() i=1 2024-09-22T08:45:01.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.288+0000 7fb35b40f800 20 remove_watcher() i=2 2024-09-22T08:45:01.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.289+0000 7fb35b40f800 20 remove_watcher() i=3 2024-09-22T08:45:01.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.290+0000 7fb35b40f800 20 remove_watcher() i=4 2024-09-22T08:45:01.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.291+0000 7fb35b40f800 20 remove_watcher() i=5 2024-09-22T08:45:01.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.292+0000 7fb35b40f800 20 remove_watcher() i=6 2024-09-22T08:45:01.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.294+0000 7fb35b40f800 20 remove_watcher() i=7 2024-09-22T08:45:01.306 INFO:tasks.workunit.client.0.smithi078.stderr:check reshard logrecord successfully 2024-09-22T08:45:01.306 INFO:tasks.workunit.client.0.smithi078.stderr: test: reshard versioned bucket 2024-09-22T08:45:01.307 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:45:01.336 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:01.336 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:01.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.372+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.373+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.373+0000 7fb288613800 20 realm 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.373+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.374+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.374+0000 7fb288613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.374+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.374+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.374+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.375+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.375+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.375+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:01.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.375+0000 7fb288613800 20 searching for the correct realm 2024-09-22T08:45:01.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.376+0000 7fb27b547640 0 -- 172.21.15.78:0/116989968 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7fb274094070 msgr2=0x7fb2740015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:01.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.582+0000 7fb284549640 0 -- 172.21.15.78:0/116989968 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5637f38e5fb0 msgr2=0x5637f38e83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.588+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 zone default found 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 4 Realm: () 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 zonegroup default 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.589+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 started sync module instance, tier type = 2024-09-22T08:45:01.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.590+0000 7fb288613800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=0 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=1 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=2 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=3 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=4 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=5 2024-09-22T08:45:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.600+0000 7fb288613800 20 add_watcher() i=6 2024-09-22T08:45:01.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.601+0000 7fb288613800 20 add_watcher() i=7 2024-09-22T08:45:01.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.601+0000 7fb288613800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:01.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.602+0000 7fb139fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 5 note: GC not initialized 2024-09-22T08:45:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb138fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:01.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 20 Filter name: none 2024-09-22T08:45:01.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb0b27fc640 20 reqs_thread_entry: start 2024-09-22T08:45:01.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.603+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.604+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.604+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.604+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.604+0000 7fb288613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.604+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.605+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:01.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.605+0000 7fb288613800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.605+0000 7fb288613800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:01.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.605+0000 7fb288613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:01.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.607+0000 7fb139fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.609+0000 7fb288613800 20 remove_watcher() i=0 2024-09-22T08:45:01.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.609+0000 7fb288613800 2 removed watcher, disabling cache 2024-09-22T08:45:01.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.610+0000 7fb288613800 20 remove_watcher() i=1 2024-09-22T08:45:01.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.611+0000 7fb288613800 20 remove_watcher() i=2 2024-09-22T08:45:01.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.612+0000 7fb288613800 20 remove_watcher() i=3 2024-09-22T08:45:01.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.613+0000 7fb288613800 20 remove_watcher() i=4 2024-09-22T08:45:01.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.615+0000 7fb288613800 20 remove_watcher() i=5 2024-09-22T08:45:01.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.615+0000 7fb288613800 20 remove_watcher() i=6 2024-09-22T08:45:01.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.617+0000 7fb288613800 20 remove_watcher() i=7 2024-09-22T08:45:01.628 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:01.628 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:45:01.628 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-22T08:45:01.628 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-22T08:45:01.660 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:01.660 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:01.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.696+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 realm 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.698+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.699+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.699+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.700+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.700+0000 7f27dc3af800 20 searching for the correct realm 2024-09-22T08:45:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.701+0000 7f27d9698640 0 -- 172.21.15.78:0/345612539 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f27cc075070 msgr2=0x7f27cc0a5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:01.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.704+0000 7f27d9e99640 0 -- 172.21.15.78:0/345612539 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x563e01ebbf60 msgr2=0x563e01ebe3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.709+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:01.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 zone default found 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 4 Realm: () 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:01.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 zonegroup default 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.710+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.711+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.711+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.711+0000 7f27dc3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.711+0000 7f27dc3af800 20 started sync module instance, tier type = 2024-09-22T08:45:01.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.711+0000 7f27dc3af800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:01.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=0 2024-09-22T08:45:01.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=1 2024-09-22T08:45:01.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=2 2024-09-22T08:45:01.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=3 2024-09-22T08:45:01.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=4 2024-09-22T08:45:01.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=5 2024-09-22T08:45:01.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.720+0000 7f27dc3af800 20 add_watcher() i=6 2024-09-22T08:45:01.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.721+0000 7f27dc3af800 20 add_watcher() i=7 2024-09-22T08:45:01.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.721+0000 7f27dc3af800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:01.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.722+0000 7f268b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.722+0000 7f27dc3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:01.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.722+0000 7f27dc3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:01.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.722+0000 7f27dc3af800 5 note: GC not initialized 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f268a7fc640 20 reqs_thread_entry: start 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f27dc3af800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f27dc3af800 20 Filter name: none 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f25fbfff640 20 reqs_thread_entry: start 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f27dc3af800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.723+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : miss 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 20 rados->read ofs=0 len=0 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:01.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 adding default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.724+0000 7f27dc3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:01.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f27dc3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f27dc3af800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f27dc3af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f27dc3af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:01.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f26bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562492 cookie 94824320263680 notifier 8003 bl.length()=905 2024-09-22T08:45:01.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f26bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f26bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.729+0000 7f26bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.731+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.731+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.731+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.731+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:01.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:01.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:01.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:01.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:01.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:01.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:01.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:01.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.735+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.0 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.736+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1 2024-09-22T08:45:01.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.736+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.737+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.737+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.4 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.737+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.5 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.738+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.6 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.738+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.7 2024-09-22T08:45:01.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.739+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.8 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.739+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.9 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.740+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.10 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.740+0000 7f27dc3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.740+0000 7f27dc3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f27dc3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f27dc3af800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f27dc3af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f27dc3af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f26bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562493 cookie 94824320263680 notifier 8003 bl.length()=905 2024-09-22T08:45:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f26bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f26bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.742+0000 7f26bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.744+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:01.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.744+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:01.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.744+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:01.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.744+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:01.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.747+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.0 2024-09-22T08:45:01.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.747+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1 2024-09-22T08:45:01.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.747+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2 2024-09-22T08:45:01.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.748+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3 2024-09-22T08:45:01.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.748+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.4 2024-09-22T08:45:01.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.748+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.5 2024-09-22T08:45:01.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.749+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.6 2024-09-22T08:45:01.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.749+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.7 2024-09-22T08:45:01.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.749+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.8 2024-09-22T08:45:01.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.749+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.9 2024-09-22T08:45:01.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.750+0000 7f27dc3af800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.10 2024-09-22T08:45:01.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.750+0000 7f27dc3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:01.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.750+0000 7f27dc3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:01.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.751+0000 7f27dc3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.751+0000 7f27dc3af800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.751+0000 7f27dc3af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.751+0000 7f27dc3af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:01.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.752+0000 7f26bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562494 cookie 94824320263680 notifier 8003 bl.length()=873 2024-09-22T08:45:01.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.752+0000 7f26bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:01.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.752+0000 7f26bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:01.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.752+0000 7f26bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:01.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.753+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:01.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.753+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:01.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.753+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:01.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.753+0000 7f27dc3af800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:01.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.756+0000 7f27dc3af800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-22T08:45:01.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.758+0000 7f268b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:01.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.760+0000 7f27dc3af800 20 remove_watcher() i=0 2024-09-22T08:45:01.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.760+0000 7f27dc3af800 2 removed watcher, disabling cache 2024-09-22T08:45:01.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.761+0000 7f27dc3af800 20 remove_watcher() i=1 2024-09-22T08:45:01.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.762+0000 7f27dc3af800 20 remove_watcher() i=2 2024-09-22T08:45:01.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.763+0000 7f27dc3af800 20 remove_watcher() i=3 2024-09-22T08:45:01.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.764+0000 7f27dc3af800 20 remove_watcher() i=4 2024-09-22T08:45:01.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.765+0000 7f27dc3af800 20 remove_watcher() i=5 2024-09-22T08:45:01.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.766+0000 7f27dc3af800 20 remove_watcher() i=6 2024-09-22T08:45:01.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:01.767+0000 7f27dc3af800 20 remove_watcher() i=7 2024-09-22T08:45:01.779 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:45:01.808 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:01.808 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:02.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.041+0000 7efe7d460640 0 --2- 172.21.15.78:0/3156824790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d28ef275a0 0x55d28ef28410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:45:02.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.046+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 realm 2024-09-22T08:45:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.048+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.049+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.049+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.050+0000 7efe7d460640 0 -- 172.21.15.78:0/2222385451 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x55d28ef4ed40 msgr2=0x55d28ef51130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:02.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.252+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:02.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.252+0000 7efe7f175800 20 searching for the correct realm 2024-09-22T08:45:02.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.255+0000 7efe7d460640 0 -- 172.21.15.78:0/2222385451 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7efe70074070 msgr2=0x7efe70060ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.262+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:02.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 zone default found 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 4 Realm: () 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 zonegroup default 2024-09-22T08:45:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.263+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.264+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.264+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.264+0000 7efe7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.264+0000 7efe7f175800 20 started sync module instance, tier type = 2024-09-22T08:45:02.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.264+0000 7efe7f175800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=0 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=1 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=2 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=3 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=4 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=5 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.272+0000 7efe7f175800 20 add_watcher() i=6 2024-09-22T08:45:02.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.274+0000 7efe7f175800 20 add_watcher() i=7 2024-09-22T08:45:02.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.274+0000 7efe7f175800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:02.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.275+0000 7efd337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 5 note: GC not initialized 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efd327e4640 20 reqs_thread_entry: start 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 Filter name: none 2024-09-22T08:45:02.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efd2b7fe640 20 reqs_thread_entry: start 2024-09-22T08:45:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.276+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.277+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.277+0000 7efe7f175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:02.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.277+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.277+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:02.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.277+0000 7efe7f175800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.278+0000 7efe7f175800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:02.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.278+0000 7efe7f175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:02.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.279+0000 7efd337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.282+0000 7efe7f175800 20 remove_watcher() i=0 2024-09-22T08:45:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.282+0000 7efe7f175800 2 removed watcher, disabling cache 2024-09-22T08:45:02.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.283+0000 7efe7f175800 20 remove_watcher() i=1 2024-09-22T08:45:02.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.284+0000 7efe7f175800 20 remove_watcher() i=2 2024-09-22T08:45:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.285+0000 7efe7f175800 20 remove_watcher() i=3 2024-09-22T08:45:02.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.286+0000 7efe7f175800 20 remove_watcher() i=4 2024-09-22T08:45:02.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.287+0000 7efe7f175800 20 remove_watcher() i=5 2024-09-22T08:45:02.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.288+0000 7efe7f175800 20 remove_watcher() i=6 2024-09-22T08:45:02.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.289+0000 7efe7f175800 20 remove_watcher() i=7 2024-09-22T08:45:02.300 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:02.300 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:45:02.301 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:45:02.301 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:02.376 INFO:tasks.workunit.client.0.smithi078.stderr: test: reshard removes olh entries with empty name 2024-09-22T08:45:02.695 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T08:45:02.723 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:02.723 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:02.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.758+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.760+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.760+0000 7fd444015800 20 realm 2024-09-22T08:45:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.760+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.761+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.761+0000 7fd444015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:02.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.761+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.761+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.761+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.762+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:02.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.762+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.762+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:02.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.762+0000 7fd444015800 20 searching for the correct realm 2024-09-22T08:45:02.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.764+0000 7fd43ff93640 0 -- 172.21.15.78:0/2697784366 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fd434033060 msgr2=0x7fd434067450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:02.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.768+0000 7fd43ef91640 0 -- 172.21.15.78:0/2697784366 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fd43803d030 msgr2=0x7fd43806b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:02.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:02.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:02.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:02.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:02.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:02.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:02.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 zone default found 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 4 Realm: () 2024-09-22T08:45:02.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 zonegroup default 2024-09-22T08:45:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.773+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 started sync module instance, tier type = 2024-09-22T08:45:02.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.774+0000 7fd444015800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=0 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=1 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=2 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=3 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=4 2024-09-22T08:45:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=5 2024-09-22T08:45:02.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.782+0000 7fd444015800 20 add_watcher() i=6 2024-09-22T08:45:02.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.783+0000 7fd444015800 20 add_watcher() i=7 2024-09-22T08:45:02.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.783+0000 7fd444015800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.785+0000 7fd2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 5 note: GC not initialized 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd2f4fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:02.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 Filter name: none 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd26e7fc640 20 reqs_thread_entry: start 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.786+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.787+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.787+0000 7fd444015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.787+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.787+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.787+0000 7fd444015800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.788+0000 7fd444015800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:02.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.788+0000 7fd444015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:02.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.790+0000 7fd2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.792+0000 7fd444015800 20 remove_watcher() i=0 2024-09-22T08:45:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.792+0000 7fd444015800 2 removed watcher, disabling cache 2024-09-22T08:45:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.792+0000 7fd444015800 20 remove_watcher() i=1 2024-09-22T08:45:02.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.793+0000 7fd444015800 20 remove_watcher() i=2 2024-09-22T08:45:02.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.794+0000 7fd444015800 20 remove_watcher() i=3 2024-09-22T08:45:02.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.795+0000 7fd444015800 20 remove_watcher() i=4 2024-09-22T08:45:02.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.796+0000 7fd444015800 20 remove_watcher() i=5 2024-09-22T08:45:02.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.797+0000 7fd444015800 20 remove_watcher() i=6 2024-09-22T08:45:02.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.798+0000 7fd444015800 20 remove_watcher() i=7 2024-09-22T08:45:02.809 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:02.809 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:45:02.809 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-22T08:45:02.810 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:02.811 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-22T08:45:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:02.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.878+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 realm 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:02.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:02.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.880+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.881+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:02.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.881+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.882+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.882+0000 7fbff5375800 20 searching for the correct realm 2024-09-22T08:45:02.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:02.884+0000 7fbff3667640 0 -- 172.21.15.78:0/1824654706 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fbfe8091070 msgr2=0x7fbfe807ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.089+0000 7fbff2665640 0 -- 172.21.15.78:0/1824654706 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fbfec0676b0 msgr2=0x7fbfec07ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.093+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 zone default found 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 4 Realm: () 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 zonegroup default 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.094+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.095+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.095+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.095+0000 7fbff5375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.095+0000 7fbff5375800 20 started sync module instance, tier type = 2024-09-22T08:45:03.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.095+0000 7fbff5375800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:03.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=0 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=1 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=2 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=3 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=4 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=5 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.103+0000 7fbff5375800 20 add_watcher() i=6 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.104+0000 7fbff5375800 20 add_watcher() i=7 2024-09-22T08:45:03.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.104+0000 7fbff5375800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:03.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbff5375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:03.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbff5375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:03.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbff5375800 5 note: GC not initialized 2024-09-22T08:45:03.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbe23fff640 20 reqs_thread_entry: start 2024-09-22T08:45:03.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbff5375800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:03.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.106+0000 7fbff5375800 20 Filter name: none 2024-09-22T08:45:03.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.107+0000 7fbe21ffb640 20 reqs_thread_entry: start 2024-09-22T08:45:03.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.107+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.107+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:03.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.107+0000 7fbff5375800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.108+0000 7fbff5375800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:03.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.108+0000 7fbff5375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:03.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.108+0000 7fbea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.110+0000 7fbff5375800 20 remove_watcher() i=0 2024-09-22T08:45:03.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.110+0000 7fbff5375800 2 removed watcher, disabling cache 2024-09-22T08:45:03.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.111+0000 7fbff5375800 20 remove_watcher() i=1 2024-09-22T08:45:03.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.113+0000 7fbff5375800 20 remove_watcher() i=2 2024-09-22T08:45:03.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.113+0000 7fbff5375800 20 remove_watcher() i=3 2024-09-22T08:45:03.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.114+0000 7fbff5375800 20 remove_watcher() i=4 2024-09-22T08:45:03.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.115+0000 7fbff5375800 20 remove_watcher() i=5 2024-09-22T08:45:03.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.116+0000 7fbff5375800 20 remove_watcher() i=6 2024-09-22T08:45:03.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.117+0000 7fbff5375800 20 remove_watcher() i=7 2024-09-22T08:45:03.130 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.index setomapval .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-22T08:45:03.157 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:03.157 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:03.173 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T08:45:03.201 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:03.201 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:03.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.237+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 realm 2024-09-22T08:45:03.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.239+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.240+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.240+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.241+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:03.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.241+0000 7f11dc60e800 20 searching for the correct realm 2024-09-22T08:45:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.243+0000 7f11d856c640 0 -- 172.21.15.78:0/3630081364 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f11c006a7d0 msgr2=0x7f11c006a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.247+0000 7f11cf56a640 0 -- 172.21.15.78:0/3630081364 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f11d0080060 msgr2=0x7f11d00aa9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:03.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.251+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 zone default found 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 4 Realm: () 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 zonegroup default 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.252+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.253+0000 7f11dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.253+0000 7f11dc60e800 20 started sync module instance, tier type = 2024-09-22T08:45:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.253+0000 7f11dc60e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=0 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=1 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=2 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=3 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=4 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=5 2024-09-22T08:45:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.261+0000 7f11dc60e800 20 add_watcher() i=6 2024-09-22T08:45:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.262+0000 7f11dc60e800 20 add_watcher() i=7 2024-09-22T08:45:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.262+0000 7f11dc60e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.263+0000 7f108dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:03.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:03.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 5 note: GC not initialized 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f108cfe1640 20 reqs_thread_entry: start 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 Filter name: none 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f10067fc640 20 reqs_thread_entry: start 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.264+0000 7f11dc60e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 20 INFO: main: starting shard=0 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.265+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 INFO: main: starting shard=1 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 INFO: main: starting shard=2 2024-09-22T08:45:03.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.266+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: starting shard=3 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: starting shard=4 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 INFO: main: starting shard=5 2024-09-22T08:45:03.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.267+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 INFO: main: starting shard=6 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 INFO: main: starting shard=7 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.268+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 INFO: main: starting shard=8 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 INFO: main: starting shard=9 2024-09-22T08:45:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.269+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: starting shard=10 2024-09-22T08:45:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: starting shard=11 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 INFO: main: starting shard=12 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.270+0000 7f11dc60e800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.271+0000 7f11dc60e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.271+0000 7f11dc60e800 20 INFO: main: done 2024-09-22T08:45:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.271+0000 7f108dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.274+0000 7f11dc60e800 20 remove_watcher() i=0 2024-09-22T08:45:03.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.274+0000 7f11dc60e800 2 removed watcher, disabling cache 2024-09-22T08:45:03.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.275+0000 7f11dc60e800 20 remove_watcher() i=1 2024-09-22T08:45:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.276+0000 7f11dc60e800 20 remove_watcher() i=2 2024-09-22T08:45:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.277+0000 7f11dc60e800 20 remove_watcher() i=3 2024-09-22T08:45:03.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.277+0000 7f11dc60e800 20 remove_watcher() i=4 2024-09-22T08:45:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.278+0000 7f11dc60e800 20 remove_watcher() i=5 2024-09-22T08:45:03.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.279+0000 7f11dc60e800 20 remove_watcher() i=6 2024-09-22T08:45:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.280+0000 7f11dc60e800 20 remove_watcher() i=7 2024-09-22T08:45:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-22T08:45:03.324 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:03.324 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:03.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.360+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 realm 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.362+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.363+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.363+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.364+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.364+0000 7f3c1d62f800 20 searching for the correct realm 2024-09-22T08:45:03.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.366+0000 7f3c1b91a640 0 -- 172.21.15.78:0/269951859 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3c040820f0 msgr2=0x7f3c0406e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.572+0000 7f3c12918640 0 -- 172.21.15.78:0/269951859 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f3c1407f070 msgr2=0x7f3c14060c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:03.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:03.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.577+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 zone default found 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 4 Realm: () 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:03.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 zonegroup default 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 started sync module instance, tier type = 2024-09-22T08:45:03.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.578+0000 7f3c1d62f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=0 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=1 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=2 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=3 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=4 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=5 2024-09-22T08:45:03.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.587+0000 7f3c1d62f800 20 add_watcher() i=6 2024-09-22T08:45:03.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.588+0000 7f3c1d62f800 20 add_watcher() i=7 2024-09-22T08:45:03.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.588+0000 7f3c1d62f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:03.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 5 note: GC not initialized 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3ad0fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 20 Filter name: none 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3a4a7fc640 20 reqs_thread_entry: start 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.590+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : miss 2024-09-22T08:45:03.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.591+0000 7f3c1d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3c1d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3c1d62f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3c1d62f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3c1d62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3afe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562542 cookie 94671385260752 notifier 8760 bl.length()=911 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3afe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3afe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.595+0000 7f3afe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.597+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.597+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.597+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:45:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.597+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:45:03.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.602+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:45:03.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.602+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:45:03.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.602+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.602+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.603+0000 7f3c1d62f800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-22T08:45:03.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.603+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.603+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.603+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.603+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.604+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.605+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.605+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.605+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.605+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.606+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.607+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.607+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.607+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.607+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.608+0000 7f3c1d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.608+0000 7f3c1d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:45:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3c1d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3c1d62f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3c1d62f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3c1d62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:45:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3afe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562543 cookie 94671385260752 notifier 8760 bl.length()=911 2024-09-22T08:45:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3afe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3afe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.609+0000 7f3afe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.611+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:45:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.611+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:45:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.611+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:45:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.611+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.0 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.1 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.2 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.614+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.3 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.4 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.5 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.615+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.6 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.7 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.8 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.616+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.9 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.10 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.11 2024-09-22T08:45:03.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.2.12 2024-09-22T08:45:03.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:03.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.617+0000 7f3c1d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3c1d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3c1d62f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3c1d62f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3c1d62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18, ofs0, ns] 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3afeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562544 cookie 94671385260752 notifier 8760 bl.length()=879 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3afeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 info.flags=0x17 2024-09-22T08:45:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3afeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18 to cache LRU end 2024-09-22T08:45:03.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.619+0000 7f3afeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:03.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.620+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_sources= new_sources= 2024-09-22T08:45:03.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.620+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential sources added=[] removed=[] 2024-09-22T08:45:03.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.620+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): orig_dests= new_dests= 2024-09-22T08:45:03.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.620+0000 7f3c1d62f800 20 handle_bi_update(): bucket=:a-bucket[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18]): potential dests added=[] removed=[] 2024-09-22T08:45:03.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.623+0000 7f3c1d62f800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-22T08:45:03.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.625+0000 7f3ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.627+0000 7f3c1d62f800 20 remove_watcher() i=0 2024-09-22T08:45:03.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.627+0000 7f3c1d62f800 2 removed watcher, disabling cache 2024-09-22T08:45:03.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.628+0000 7f3c1d62f800 20 remove_watcher() i=1 2024-09-22T08:45:03.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.629+0000 7f3c1d62f800 20 remove_watcher() i=2 2024-09-22T08:45:03.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.630+0000 7f3c1d62f800 20 remove_watcher() i=3 2024-09-22T08:45:03.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.631+0000 7f3c1d62f800 20 remove_watcher() i=4 2024-09-22T08:45:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.632+0000 7f3c1d62f800 20 remove_watcher() i=5 2024-09-22T08:45:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.632+0000 7f3c1d62f800 20 remove_watcher() i=6 2024-09-22T08:45:03.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.633+0000 7f3c1d62f800 20 remove_watcher() i=7 2024-09-22T08:45:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T08:45:03.675 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:03.675 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.710+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 realm 2024-09-22T08:45:03.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.712+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.713+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.713+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.714+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.714+0000 7f639e212800 20 searching for the correct realm 2024-09-22T08:45:03.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.716+0000 7f639a1e1640 0 -- 172.21.15.78:0/1564825860 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f6384086030 msgr2=0x7f638407a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.921+0000 7f63911df640 0 -- 172.21.15.78:0/1564825860 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f63940697a0 msgr2=0x7f6394068210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.926+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:03.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 zone default found 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 4 Realm: () 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:03.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 zonegroup default 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.927+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 started sync module instance, tier type = 2024-09-22T08:45:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.928+0000 7f639e212800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=0 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=1 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=2 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=3 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=4 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=5 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.937+0000 7f639e212800 20 add_watcher() i=6 2024-09-22T08:45:03.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.938+0000 7f639e212800 20 add_watcher() i=7 2024-09-22T08:45:03.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.938+0000 7f639e212800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:03.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.939+0000 7f62237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:03.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:03.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 5 note: GC not initialized 2024-09-22T08:45:03.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f62227fc640 20 reqs_thread_entry: start 2024-09-22T08:45:03.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:03.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 20 Filter name: none 2024-09-22T08:45:03.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f61bbfff640 20 reqs_thread_entry: start 2024-09-22T08:45:03.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.940+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=200 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 rados->read ofs=0 len=0 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 rados_obj.operate() r=0 bl.length=422 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 INFO: main: starting shard=0 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.941+0000 7f639e212800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18.3.0 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.942+0000 7f639e212800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:03.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.942+0000 7f639e212800 20 INFO: main: done 2024-09-22T08:45:03.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.942+0000 7f62237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:03.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.945+0000 7f639e212800 20 remove_watcher() i=0 2024-09-22T08:45:03.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.945+0000 7f639e212800 2 removed watcher, disabling cache 2024-09-22T08:45:03.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.946+0000 7f639e212800 20 remove_watcher() i=1 2024-09-22T08:45:03.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.947+0000 7f639e212800 20 remove_watcher() i=2 2024-09-22T08:45:03.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.948+0000 7f639e212800 20 remove_watcher() i=3 2024-09-22T08:45:03.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.949+0000 7f639e212800 20 remove_watcher() i=4 2024-09-22T08:45:03.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.950+0000 7f639e212800 20 remove_watcher() i=5 2024-09-22T08:45:03.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.951+0000 7f639e212800 20 remove_watcher() i=6 2024-09-22T08:45:03.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:03.951+0000 7f639e212800 20 remove_watcher() i=7 2024-09-22T08:45:03.962 INFO:tasks.workunit.client.0.smithi078.stderr: test: PUT succeeds during reshard 2024-09-22T08:45:03.964 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:45:03.993 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:03.993 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:04.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.028+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.030+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.030+0000 7eff54726800 20 realm 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.030+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.031+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.031+0000 7eff54726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.031+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.031+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.031+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.032+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.032+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.032+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:04.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.032+0000 7eff54726800 20 searching for the correct realm 2024-09-22T08:45:04.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.034+0000 7eff50bda640 0 -- 172.21.15.78:0/1393209475 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7eff3806da80 msgr2=0x7eff3806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:04.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.240+0000 7eff47fff640 0 -- 172.21.15.78:0/1393209475 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7eff48059ca0 msgr2=0x7eff4804f520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.245+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:04.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:04.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 zone default found 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 4 Realm: () 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 zonegroup default 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.246+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.247+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.247+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.247+0000 7eff54726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.247+0000 7eff54726800 20 started sync module instance, tier type = 2024-09-22T08:45:04.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.247+0000 7eff54726800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=0 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=1 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=2 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=3 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=4 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=5 2024-09-22T08:45:04.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.256+0000 7eff54726800 20 add_watcher() i=6 2024-09-22T08:45:04.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.257+0000 7eff54726800 20 add_watcher() i=7 2024-09-22T08:45:04.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.257+0000 7eff54726800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:04.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7efe06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:04.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:04.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 5 note: GC not initialized 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7efe05fdb640 20 reqs_thread_entry: start 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 20 Filter name: none 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7efd777fe640 20 reqs_thread_entry: start 2024-09-22T08:45:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.259+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.260+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.260+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.260+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.260+0000 7eff54726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.260+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.261+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:04.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.261+0000 7eff54726800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.261+0000 7eff54726800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:04.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.261+0000 7eff54726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:04.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.263+0000 7efe06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:04.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.265+0000 7eff54726800 20 remove_watcher() i=0 2024-09-22T08:45:04.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.265+0000 7eff54726800 2 removed watcher, disabling cache 2024-09-22T08:45:04.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.266+0000 7eff54726800 20 remove_watcher() i=1 2024-09-22T08:45:04.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.267+0000 7eff54726800 20 remove_watcher() i=2 2024-09-22T08:45:04.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.268+0000 7eff54726800 20 remove_watcher() i=3 2024-09-22T08:45:04.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.269+0000 7eff54726800 20 remove_watcher() i=4 2024-09-22T08:45:04.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.270+0000 7eff54726800 20 remove_watcher() i=5 2024-09-22T08:45:04.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.271+0000 7eff54726800 20 remove_watcher() i=6 2024-09-22T08:45:04.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.271+0000 7eff54726800 20 remove_watcher() i=7 2024-09-22T08:45:04.282 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:04.283 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-22T08:45:04.283 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-22T08:45:04.283 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:04.284 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-22T08:45:04.317 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:04.317 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:04.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.353+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 20 realm 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.354+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.355+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.355+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.355+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:04.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.355+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.356+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:04.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.356+0000 7f772b739800 20 searching for the correct realm 2024-09-22T08:45:04.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.358+0000 7f7727bc8640 0 -- 172.21.15.78:0/2037439680 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f771003daa0 msgr2=0x7f7710093a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:04.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.563+0000 7f7726bc6640 0 -- 172.21.15.78:0/2037439680 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f7718068620 msgr2=0x7f7718068090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.568+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:04.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 zone default found 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 4 Realm: () 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 zonegroup default 2024-09-22T08:45:04.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.569+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 started sync module instance, tier type = 2024-09-22T08:45:04.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.570+0000 7f772b739800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=0 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=1 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=2 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=3 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=4 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=5 2024-09-22T08:45:04.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.579+0000 7f772b739800 20 add_watcher() i=6 2024-09-22T08:45:04.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.580+0000 7f772b739800 20 add_watcher() i=7 2024-09-22T08:45:04.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.580+0000 7f772b739800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:04.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.581+0000 7f75ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:04.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:04.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:04.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 5 note: GC not initialized 2024-09-22T08:45:04.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f75dcfe1640 20 reqs_thread_entry: start 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 20 Filter name: none 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f75567fc640 20 reqs_thread_entry: start 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.582+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : miss 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 20 rados->read ofs=0 len=0 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 adding default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.583+0000 7f772b739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f772b739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f772b739800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f772b739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f772b739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f760affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562495 cookie 94063740976544 notifier 8817 bl.length()=905 2024-09-22T08:45:04.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f760affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:04.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f760affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:04.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.588+0000 7f760affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.590+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.590+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.590+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.590+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:04.595+0000 7f772b739800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-22T08:45:05.348 INFO:tasks.workunit.client.0.smithi078.stderr:put object successful 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:09.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:09.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.595+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.597+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.597+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.597+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.597+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.598+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.598+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.599+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.599+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:09.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.599+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:09.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.599+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:09.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.600+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:09.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.600+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:09.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.601+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:09.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.601+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:09.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.602+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:09.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.602+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:09.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.602+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:09.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.602+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:09.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.603+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:09.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.603+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:09.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.603+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:09.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.603+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:09.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.606+0000 7f772b739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:09.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.606+0000 7f772b739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.607+0000 7f772b739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.607+0000 7f772b739800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.607+0000 7f772b739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.607+0000 7f772b739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.608+0000 7f760a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562496 cookie 94063740976544 notifier 8817 bl.length()=905 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.608+0000 7f760a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.608+0000 7f760a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:09.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.608+0000 7f760a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:09.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.610+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:09.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.610+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:09.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.610+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:09.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.610+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:09.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.613+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:09.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.613+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.0 2024-09-22T08:45:09.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.614+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:09.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.614+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.1 2024-09-22T08:45:09.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.614+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:09.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.614+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.2 2024-09-22T08:45:09.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.615+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:09.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.615+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.3 2024-09-22T08:45:09.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.615+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:09.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.615+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.4 2024-09-22T08:45:09.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.616+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:09.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.616+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.5 2024-09-22T08:45:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.616+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.616+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.6 2024-09-22T08:45:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.617+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.617+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.7 2024-09-22T08:45:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.617+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:09.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.617+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.8 2024-09-22T08:45:09.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:09.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.9 2024-09-22T08:45:09.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:09.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.10 2024-09-22T08:45:09.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:09.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.618+0000 7f772b739800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.1.11 2024-09-22T08:45:09.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.620+0000 7f772b739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:09.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.620+0000 7f772b739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:09.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f772b739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:09.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f772b739800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:09.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f772b739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:09.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f772b739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:09.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f760affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562497 cookie 94063740976544 notifier 8817 bl.length()=873 2024-09-22T08:45:09.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f760affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:09.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f760affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:09.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.622+0000 7f760affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:09.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.624+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:09.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.624+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:09.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.624+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:09.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.624+0000 7f772b739800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:09.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.628+0000 7f772b739800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-22T08:45:09.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.630+0000 7f75ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:09.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.633+0000 7f772b739800 20 remove_watcher() i=0 2024-09-22T08:45:09.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.633+0000 7f772b739800 2 removed watcher, disabling cache 2024-09-22T08:45:09.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.634+0000 7f772b739800 20 remove_watcher() i=1 2024-09-22T08:45:09.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.635+0000 7f772b739800 20 remove_watcher() i=2 2024-09-22T08:45:09.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.637+0000 7f772b739800 20 remove_watcher() i=3 2024-09-22T08:45:09.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.638+0000 7f772b739800 20 remove_watcher() i=4 2024-09-22T08:45:09.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.639+0000 7f772b739800 20 remove_watcher() i=5 2024-09-22T08:45:09.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.640+0000 7f772b739800 20 remove_watcher() i=6 2024-09-22T08:45:09.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:09.642+0000 7f772b739800 20 remove_watcher() i=7 2024-09-22T08:45:10.354 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-22T08:45:10.354 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T08:45:10.680 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:45:11.080 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:45:12.565 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:45:12.566 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-22T08:45:12.596 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:12.597 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:12.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.632+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.634+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.634+0000 7f68e2919800 20 realm 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.634+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.635+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.635+0000 7f68e2919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.635+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.635+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.635+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.636+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:12.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.636+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.636+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:12.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.636+0000 7f68e2919800 20 searching for the correct realm 2024-09-22T08:45:12.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.639+0000 7f68e0c04640 0 -- 172.21.15.78:0/2225418537 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f68c80b8070 msgr2=0x7f68c80cebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:12.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.643+0000 7f68d7c02640 0 -- 172.21.15.78:0/2225418537 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f68d8017040 msgr2=0x7f68d8075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:12.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:12.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.647+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 zone default found 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 4 Realm: () 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 zonegroup default 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.648+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 started sync module instance, tier type = 2024-09-22T08:45:12.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.649+0000 7f68e2919800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=0 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=1 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=2 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=3 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=4 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=5 2024-09-22T08:45:12.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.659+0000 7f68e2919800 20 add_watcher() i=6 2024-09-22T08:45:12.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.660+0000 7f68e2919800 20 add_watcher() i=7 2024-09-22T08:45:12.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.660+0000 7f68e2919800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:12.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.662+0000 7f6796fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.662+0000 7f68e2919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.662+0000 7f68e2919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.662+0000 7f68e2919800 5 note: GC not initialized 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.662+0000 7f6795fdb640 20 reqs_thread_entry: start 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f68e2919800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f68e2919800 20 Filter name: none 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f67077fe640 20 reqs_thread_entry: start 2024-09-22T08:45:12.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:12.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.663+0000 7f68e2919800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 INFO: main: starting shard=0 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 INFO: main: starting shard=1 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:12.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.664+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 INFO: main: starting shard=2 2024-09-22T08:45:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:12.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 INFO: main: starting shard=3 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.665+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.666+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.666+0000 7f68e2919800 20 INFO: main: starting shard=4 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.666+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.666+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 INFO: main: starting shard=5 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 INFO: main: starting shard=6 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.667+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 INFO: main: starting shard=7 2024-09-22T08:45:12.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 INFO: main: starting shard=8 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.668+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:12.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 20 INFO: main: starting shard=9 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.669+0000 7f68e2919800 20 INFO: main: starting shard=10 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:12.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 INFO: main: starting shard=11 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 INFO: main: starting shard=12 2024-09-22T08:45:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.670+0000 7f68e2919800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.671+0000 7f68e2919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.671+0000 7f68e2919800 20 INFO: main: done 2024-09-22T08:45:12.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.672+0000 7f6796fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:12.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.674+0000 7f68e2919800 20 remove_watcher() i=0 2024-09-22T08:45:12.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.674+0000 7f68e2919800 2 removed watcher, disabling cache 2024-09-22T08:45:12.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.675+0000 7f68e2919800 20 remove_watcher() i=1 2024-09-22T08:45:12.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.676+0000 7f68e2919800 20 remove_watcher() i=2 2024-09-22T08:45:12.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.677+0000 7f68e2919800 20 remove_watcher() i=3 2024-09-22T08:45:12.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.678+0000 7f68e2919800 20 remove_watcher() i=4 2024-09-22T08:45:12.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.679+0000 7f68e2919800 20 remove_watcher() i=5 2024-09-22T08:45:12.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.680+0000 7f68e2919800 20 remove_watcher() i=6 2024-09-22T08:45:12.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.681+0000 7f68e2919800 20 remove_watcher() i=7 2024-09-22T08:45:12.801 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:45:12.803 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-22T08:45:12.833 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:12.833 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:12.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.869+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 realm 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.871+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.872+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:12.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.872+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:12.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.873+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:12.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.873+0000 7ffb1632f800 20 searching for the correct realm 2024-09-22T08:45:12.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:12.875+0000 7ffb12877640 0 -- 172.21.15.78:0/1544154729 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7ffafc01f060 msgr2=0x7ffafc06a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:13.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.081+0000 7ffb09875640 0 -- 172.21.15.78:0/1544154729 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7ffb0c08c040 msgr2=0x7ffb0c08c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:13.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.086+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 zone default found 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 4 Realm: () 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 zonegroup default 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.087+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.088+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.088+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.088+0000 7ffb1632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.088+0000 7ffb1632f800 20 started sync module instance, tier type = 2024-09-22T08:45:13.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.088+0000 7ffb1632f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:13.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=0 2024-09-22T08:45:13.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=1 2024-09-22T08:45:13.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=2 2024-09-22T08:45:13.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=3 2024-09-22T08:45:13.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=4 2024-09-22T08:45:13.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=5 2024-09-22T08:45:13.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.098+0000 7ffb1632f800 20 add_watcher() i=6 2024-09-22T08:45:13.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.099+0000 7ffb1632f800 20 add_watcher() i=7 2024-09-22T08:45:13.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.099+0000 7ffb1632f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:13.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.101+0000 7ff9c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.101+0000 7ffb1632f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.101+0000 7ffb1632f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.101+0000 7ffb1632f800 5 note: GC not initialized 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.102+0000 7ff9437fe640 20 reqs_thread_entry: start 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.102+0000 7ffb1632f800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.102+0000 7ffb1632f800 20 Filter name: none 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.102+0000 7ff9417fa640 20 reqs_thread_entry: start 2024-09-22T08:45:13.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.102+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:13.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 INFO: main: starting shard=0 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.103+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 INFO: main: starting shard=1 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:13.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 INFO: main: starting shard=2 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.104+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 INFO: main: starting shard=3 2024-09-22T08:45:13.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 INFO: main: starting shard=4 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.105+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 INFO: main: starting shard=5 2024-09-22T08:45:13.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 INFO: main: starting shard=6 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.106+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 INFO: main: starting shard=7 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 INFO: main: starting shard=8 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.107+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:13.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.108+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.108+0000 7ffb1632f800 20 INFO: main: starting shard=9 2024-09-22T08:45:13.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.108+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:13.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.108+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: starting shard=10 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: starting shard=11 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:13.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 INFO: main: starting shard=12 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.109+0000 7ffb1632f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.110+0000 7ffb1632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.110+0000 7ffb1632f800 20 INFO: main: done 2024-09-22T08:45:13.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.111+0000 7ff9c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:13.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.113+0000 7ffb1632f800 20 remove_watcher() i=0 2024-09-22T08:45:13.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.113+0000 7ffb1632f800 2 removed watcher, disabling cache 2024-09-22T08:45:13.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.114+0000 7ffb1632f800 20 remove_watcher() i=1 2024-09-22T08:45:13.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.115+0000 7ffb1632f800 20 remove_watcher() i=2 2024-09-22T08:45:13.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.116+0000 7ffb1632f800 20 remove_watcher() i=3 2024-09-22T08:45:13.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.117+0000 7ffb1632f800 20 remove_watcher() i=4 2024-09-22T08:45:13.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.118+0000 7ffb1632f800 20 remove_watcher() i=5 2024-09-22T08:45:13.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.119+0000 7ffb1632f800 20 remove_watcher() i=6 2024-09-22T08:45:13.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.120+0000 7ffb1632f800 20 remove_watcher() i=7 2024-09-22T08:45:13.241 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:45:13.243 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-22T08:45:13.275 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:13.275 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:13.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.310+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.312+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.312+0000 7f283e528800 20 realm 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.312+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:13.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.313+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.315+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:13.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.315+0000 7f283e528800 20 searching for the correct realm 2024-09-22T08:45:13.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.316+0000 7f283995c640 0 -- 172.21.15.78:0/830773382 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f282c039420 msgr2=0x7f282c039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:13.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.319+0000 7f283995c640 0 -- 172.21.15.78:0/830773382 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x558ed0f51180 msgr2=0x558ed0f53570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.324+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 zone default found 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 4 Realm: () 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 zonegroup default 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.325+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.326+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.326+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.326+0000 7f283e528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:13.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.326+0000 7f283e528800 20 started sync module instance, tier type = 2024-09-22T08:45:13.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.326+0000 7f283e528800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=0 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=1 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=2 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=3 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=4 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=5 2024-09-22T08:45:13.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.335+0000 7f283e528800 20 add_watcher() i=6 2024-09-22T08:45:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.336+0000 7f283e528800 20 add_watcher() i=7 2024-09-22T08:45:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.336+0000 7f283e528800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:13.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.337+0000 7f26f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.337+0000 7f283e528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.337+0000 7f283e528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.337+0000 7f283e528800 5 note: GC not initialized 2024-09-22T08:45:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f266b7fe640 20 reqs_thread_entry: start 2024-09-22T08:45:13.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f283e528800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:13.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f283e528800 20 Filter name: none 2024-09-22T08:45:13.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f26697fa640 20 reqs_thread_entry: start 2024-09-22T08:45:13.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:13.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.338+0000 7f283e528800 20 rados->read ofs=0 len=0 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 INFO: main: starting shard=0 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 INFO: main: starting shard=1 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.339+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:13.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.340+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.340+0000 7f283e528800 20 INFO: main: starting shard=2 2024-09-22T08:45:13.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.340+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:13.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.340+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:13.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 INFO: main: starting shard=3 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 INFO: main: starting shard=4 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:13.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.341+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 INFO: main: starting shard=5 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 INFO: main: starting shard=6 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.342+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 INFO: main: starting shard=7 2024-09-22T08:45:13.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:13.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:13.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 INFO: main: starting shard=8 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.343+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 INFO: main: starting shard=9 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 INFO: main: starting shard=10 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:13.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.344+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: starting shard=11 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: starting shard=12 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:13.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:45:13.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.345+0000 7f283e528800 20 INFO: main: done 2024-09-22T08:45:13.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.346+0000 7f26f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:13.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.348+0000 7f283e528800 20 remove_watcher() i=0 2024-09-22T08:45:13.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.348+0000 7f283e528800 2 removed watcher, disabling cache 2024-09-22T08:45:13.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.349+0000 7f283e528800 20 remove_watcher() i=1 2024-09-22T08:45:13.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.351+0000 7f283e528800 20 remove_watcher() i=2 2024-09-22T08:45:13.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.352+0000 7f283e528800 20 remove_watcher() i=3 2024-09-22T08:45:13.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.353+0000 7f283e528800 20 remove_watcher() i=4 2024-09-22T08:45:13.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.354+0000 7f283e528800 20 remove_watcher() i=5 2024-09-22T08:45:13.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.355+0000 7f283e528800 20 remove_watcher() i=6 2024-09-22T08:45:13.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:13.356+0000 7f283e528800 20 remove_watcher() i=7 2024-09-22T08:45:13.393 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:45:13.788 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:45:14.177 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-22T08:45:14.208 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:14.208 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:14.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.245+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.247+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.247+0000 7f92bf82f800 20 realm 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.247+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.248+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.248+0000 7f92bf82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.248+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.248+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.248+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.249+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:14.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.249+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.249+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:14.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.249+0000 7f92bf82f800 20 searching for the correct realm 2024-09-22T08:45:14.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.252+0000 7f92b4b18640 0 -- 172.21.15.78:0/119288610 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x560505116fc0 msgr2=0x5605051193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:14.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.255+0000 7f92b4b18640 0 -- 172.21.15.78:0/119288610 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f92b802fb40 msgr2=0x7f92b8019940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:14.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:14.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:14.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.461+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.462+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.462+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.462+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.462+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 zone default found 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 4 Realm: () 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:14.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 zonegroup default 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.463+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.464+0000 7f92bf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.464+0000 7f92bf82f800 20 started sync module instance, tier type = 2024-09-22T08:45:14.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.464+0000 7f92bf82f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:14.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=0 2024-09-22T08:45:14.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=1 2024-09-22T08:45:14.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=2 2024-09-22T08:45:14.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=3 2024-09-22T08:45:14.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=4 2024-09-22T08:45:14.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.474+0000 7f92bf82f800 20 add_watcher() i=5 2024-09-22T08:45:14.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.475+0000 7f92bf82f800 20 add_watcher() i=6 2024-09-22T08:45:14.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.476+0000 7f92bf82f800 20 add_watcher() i=7 2024-09-22T08:45:14.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.476+0000 7f92bf82f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:14.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f91737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f92bf82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f92bf82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f92bf82f800 5 note: GC not initialized 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f91727e4640 20 reqs_thread_entry: start 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.478+0000 7f92bf82f800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 20 Filter name: none 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f90e3fff640 20 reqs_thread_entry: start 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:45:14.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:45:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:45:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : miss 2024-09-22T08:45:14.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.479+0000 7f92bf82f800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 10 adding default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.480+0000 7f92bf82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:14.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f92bf82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f92bf82f800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f92bf82f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f92bf82f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:14.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f91a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562498 cookie 94579559914368 notifier 8219 bl.length()=905 2024-09-22T08:45:14.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f91a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f91a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.485+0000 7f91a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.487+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:14.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.487+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:14.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.487+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:14.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.487+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.0 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.0 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.1 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.1 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.2 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.2 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.3 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.3 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.4 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.4 2024-09-22T08:45:14.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.5 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.5 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.6 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.6 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.7 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.7 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.8 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.8 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.10 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.10 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.11 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.11 2024-09-22T08:45:14.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.12 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.12 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.13 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.13 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.14 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.14 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.15 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.15 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.16 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.16 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.493+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.494+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:14.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.494+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.494+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.494+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.495+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.495+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.495+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:14.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.495+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.496+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.496+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.497+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.497+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.497+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.497+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:14.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.498+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.498+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.498+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.498+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.499+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.499+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.499+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:14.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.499+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:14.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.500+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:14.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.500+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:14.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.502+0000 7f92bf82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:14.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.502+0000 7f92bf82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:14.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f92bf82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f92bf82f800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f92bf82f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f92bf82f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:14.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f918ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562499 cookie 94579559914368 notifier 8219 bl.length()=905 2024-09-22T08:45:14.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f918ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f918ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.503+0000 7f918ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.505+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:14.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.505+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:14.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.505+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:14.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.505+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.0 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.1 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:14.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.508+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.2 2024-09-22T08:45:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.3 2024-09-22T08:45:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:14.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.4 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.509+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.5 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.510+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.510+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.6 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.510+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:14.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.510+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.7 2024-09-22T08:45:14.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:14.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.8 2024-09-22T08:45:14.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:14.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.9 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.10 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.511+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.11 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.512+0000 7f92bf82f800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:14.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.512+0000 7f92bf82f800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.2.12 2024-09-22T08:45:14.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.512+0000 7f92bf82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : hit (requested=0x17, cached=0x17) 2024-09-22T08:45:14.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.512+0000 7f92bf82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.513+0000 7f92bf82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.513+0000 7f92bf82f800 10 moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.513+0000 7f92bf82f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.513+0000 7f92bf82f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19, ofs0, ns] 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.514+0000 7f91a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562500 cookie 94579559914368 notifier 8219 bl.length()=873 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.514+0000 7f91a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.514+0000 7f91a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.514+0000 7f91a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.515+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_sources= new_sources= 2024-09-22T08:45:14.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.515+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential sources added=[] removed=[] 2024-09-22T08:45:14.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.515+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): orig_dests= new_dests= 2024-09-22T08:45:14.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.515+0000 7f92bf82f800 20 handle_bi_update(): bucket=:myver[bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19]): potential dests added=[] removed=[] 2024-09-22T08:45:14.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.518+0000 7f92bf82f800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-22T08:45:14.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.519+0000 7f91737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:14.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.521+0000 7f92bf82f800 20 remove_watcher() i=0 2024-09-22T08:45:14.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.521+0000 7f92bf82f800 2 removed watcher, disabling cache 2024-09-22T08:45:14.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.523+0000 7f92bf82f800 20 remove_watcher() i=1 2024-09-22T08:45:14.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.524+0000 7f92bf82f800 20 remove_watcher() i=2 2024-09-22T08:45:14.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.525+0000 7f92bf82f800 20 remove_watcher() i=3 2024-09-22T08:45:14.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.526+0000 7f92bf82f800 20 remove_watcher() i=4 2024-09-22T08:45:14.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.528+0000 7f92bf82f800 20 remove_watcher() i=5 2024-09-22T08:45:14.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.529+0000 7f92bf82f800 20 remove_watcher() i=6 2024-09-22T08:45:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.530+0000 7f92bf82f800 20 remove_watcher() i=7 2024-09-22T08:45:14.542 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:45:14.577 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:14.577 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:14.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.613+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.614+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.614+0000 7f1fb7d40800 20 realm 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.614+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.615+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.615+0000 7f1fb7d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.615+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.615+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.615+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.616+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:14.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.616+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.616+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:14.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.616+0000 7f1fb7d40800 20 searching for the correct realm 2024-09-22T08:45:14.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.618+0000 7f1fb42c1640 0 -- 172.21.15.78:0/4093362406 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f1f9c056b70 msgr2=0x7f1f9c08d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:14.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.823+0000 7f1fab2bf640 0 -- 172.21.15.78:0/4093362406 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f1fac076090 msgr2=0x7f1fac020030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:14.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:14.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:14.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.828+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 zone default found 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 4 Realm: () 2024-09-22T08:45:14.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 zonegroup default 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.829+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.830+0000 7f1fb7d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.830+0000 7f1fb7d40800 20 started sync module instance, tier type = 2024-09-22T08:45:14.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.830+0000 7f1fb7d40800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=0 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=1 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=2 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=3 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=4 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=5 2024-09-22T08:45:14.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.840+0000 7f1fb7d40800 20 add_watcher() i=6 2024-09-22T08:45:14.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.842+0000 7f1fb7d40800 20 add_watcher() i=7 2024-09-22T08:45:14.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.842+0000 7f1fb7d40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:14.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.843+0000 7f1e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:14.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:14.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 5 note: GC not initialized 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1e68fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 20 Filter name: none 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1de27fc640 20 reqs_thread_entry: start 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T08:45:14.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.844+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:14.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T08:45:14.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T08:45:14.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 : miss 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 20 rados->read ofs=0 len=0 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 info.flags=0x17 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 adding default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 to cache LRU end 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.845+0000 7f1fb7d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.846+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.0 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.846+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.0 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.846+0000 7f1fb7d40800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.846+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.1 2024-09-22T08:45:14.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.846+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.1 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.2 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.2 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.3 2024-09-22T08:45:14.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.847+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.3 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.848+0000 7f1fb7d40800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.848+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.4 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.848+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.4 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.5 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.5 2024-09-22T08:45:14.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-22T08:45:14.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.6 2024-09-22T08:45:14.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.6 2024-09-22T08:45:14.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T08:45:14.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.7 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.849+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.7 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.850+0000 7f1fb7d40800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.850+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.8 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.850+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.8 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.851+0000 7f1fb7d40800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.851+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.851+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.851+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.10 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.851+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.10 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.11 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.11 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-22T08:45:14.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.12 2024-09-22T08:45:14.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.852+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.12 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.13 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.13 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.14 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.14 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.15 2024-09-22T08:45:14.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.853+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.15 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.854+0000 7f1fb7d40800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.854+0000 7f1fb7d40800 10 bucket_obj is .dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.16 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.854+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.16 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:x state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to orl8mkm022icfwj77zn8mi7fwnjsim2n 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 20 get_obj_state_impl: setting s->olh_tag to izcabvgrd7jqjp76ovsty8wbcj39awp0 2024-09-22T08:45:14.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.855+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=izcabvgrd7jqjp76ovsty8wbcj39awp0 2024-09-22T08:45:14.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.857+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.858+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-22T08:45:14.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=3 key=x[Hf-cVMb40E3MSy9KPDKEB.leZWAIMk1] 2024-09-22T08:45:14.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:Hf-cVMb40E3MSy9KPDKEB.leZWAIMk1_x state=0x55a642b27238 s->prefetch_data=0 2024-09-22T08:45:14.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 10 manifest: total_size = 22 2024-09-22T08:45:14.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13032716138699867195 2024-09-22T08:45:14.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:Hf-cVMb40E3MSy9KPDKEB.leZWAIMk1_x state=0x55a642b27238 s->prefetch_data=0 2024-09-22T08:45:14.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 prepare_atomic_modification: state is not atomic. state=0x55a642b27238 2024-09-22T08:45:14.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.859+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.862+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:45:14.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.862+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-22T08:45:14.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.862+0000 7f1fb7d40800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:45:14.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.862+0000 7f1fb7d40800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:Hf-cVMb40E3MSy9KPDKEB.leZWAIMk1_.rPnPWxLqx7S_HYYx9Y9b4ZJ5XBh9MLv_0 2024-09-22T08:45:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.863+0000 7f1e92ffd640 20 handle_completion(): completion ok for obj=x[Hf-cVMb40E3MSy9KPDKEB.leZWAIMk1] 2024-09-22T08:45:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.863+0000 7f1fb7d40800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:45:14.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.864+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:x state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.864+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=izcabvgrd7jqjp76ovsty8wbcj39awp0 2024-09-22T08:45:14.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.867+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.869+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.869+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.869+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:y state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.870+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to 1552ipj855epz292lth3ndmebtbxeb8p 2024-09-22T08:45:14.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.870+0000 7f1fb7d40800 20 get_obj_state_impl: setting s->olh_tag to kt8scboypxf7jp9io7kxarg4zi3dxdrf 2024-09-22T08:45:14.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.870+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kt8scboypxf7jp9io7kxarg4zi3dxdrf 2024-09-22T08:45:14.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.871+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.872+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=3 key=y[uq3FQeW.t9B006xN6aQG7H6viTT2ATQ] 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:uq3FQeW.t9B006xN6aQG7H6viTT2ATQ_y state=0x55a642b277a8 s->prefetch_data=0 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 10 manifest: total_size = 9 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12680560097973484241 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:uq3FQeW.t9B006xN6aQG7H6viTT2ATQ_y state=0x55a642b277a8 s->prefetch_data=0 2024-09-22T08:45:14.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 prepare_atomic_modification: state is not atomic. state=0x55a642b277a8 2024-09-22T08:45:14.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.873+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.875+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:45:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.875+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-22T08:45:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.875+0000 7f1fb7d40800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:45:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.875+0000 7f1fb7d40800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:uq3FQeW.t9B006xN6aQG7H6viTT2ATQ_.ItwZpEnV6FSuh7JpEarLfGSIWwbXFii_0 2024-09-22T08:45:14.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.877+0000 7f1fb7d40800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:45:14.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.877+0000 7f1e927fc640 20 handle_completion(): completion ok for obj=y[uq3FQeW.t9B006xN6aQG7H6viTT2ATQ] 2024-09-22T08:45:14.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.878+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:y state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.878+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kt8scboypxf7jp9io7kxarg4zi3dxdrf 2024-09-22T08:45:14.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.881+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.882+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.882+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.883+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:z state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.883+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to otei4f7tq4gb90i6gjtffrrx9zx853j1 2024-09-22T08:45:14.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.883+0000 7f1fb7d40800 20 get_obj_state_impl: setting s->olh_tag to jhc5tikgs0rxflrjh101ewf8z3abaikg 2024-09-22T08:45:14.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.883+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jhc5tikgs0rxflrjh101ewf8z3abaikg 2024-09-22T08:45:14.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.884+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.885+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-22T08:45:14.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 olh_log_entry: epoch=2 op=3 key=z[J5W7o2KpZkU-ajGEynmfHLTAULTB6vH] 2024-09-22T08:45:14.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:J5W7o2KpZkU-ajGEynmfHLTAULTB6vH_z state=0x55a642b277a8 s->prefetch_data=0 2024-09-22T08:45:14.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 10 manifest: total_size = 9 2024-09-22T08:45:14.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 get_obj_state: setting s->obj_tag to bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9433399206829026573 2024-09-22T08:45:14.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:_:J5W7o2KpZkU-ajGEynmfHLTAULTB6vH_z state=0x55a642b277a8 s->prefetch_data=0 2024-09-22T08:45:14.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 prepare_atomic_modification: state is not atomic. state=0x55a642b277a8 2024-09-22T08:45:14.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.886+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.889+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T08:45:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.889+0000 7f1fb7d40800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-22T08:45:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.889+0000 7f1fb7d40800 0 deleting objects inline since gc isn't initialized 2024-09-22T08:45:14.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.889+0000 7f1fb7d40800 5 delete_objs_inline: removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:J5W7o2KpZkU-ajGEynmfHLTAULTB6vH_.W_pMz6LRHC441T55R7Ei6zdZUcTppaT_0 2024-09-22T08:45:14.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.890+0000 7f1e92ffd640 20 handle_completion(): completion ok for obj=z[J5W7o2KpZkU-ajGEynmfHLTAULTB6vH] 2024-09-22T08:45:14.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.890+0000 7f1fb7d40800 5 delete_objs_inline: refcount put returned error -2 2024-09-22T08:45:14.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.891+0000 7f1fb7d40800 20 get_obj_state: octx=0x55a64281c0f0 obj=myver:z state=0x55a642aebbe8 s->prefetch_data=0 2024-09-22T08:45:14.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.891+0000 7f1fb7d40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jhc5tikgs0rxflrjh101ewf8z3abaikg 2024-09-22T08:45:14.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.894+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.895+0000 7f1fb7d40800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19.3.9 2024-09-22T08:45:14.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.895+0000 7f1fb7d40800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-22T08:45:14.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.895+0000 7f1fb7d40800 1 NOTICE: finished all shards (3 entries removed) 2024-09-22T08:45:14.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.896+0000 7f1e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:14.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.898+0000 7f1fb7d40800 20 remove_watcher() i=0 2024-09-22T08:45:14.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.898+0000 7f1fb7d40800 2 removed watcher, disabling cache 2024-09-22T08:45:14.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.899+0000 7f1fb7d40800 20 remove_watcher() i=1 2024-09-22T08:45:14.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.901+0000 7f1fb7d40800 20 remove_watcher() i=2 2024-09-22T08:45:14.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.902+0000 7f1fb7d40800 20 remove_watcher() i=3 2024-09-22T08:45:14.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.903+0000 7f1fb7d40800 20 remove_watcher() i=4 2024-09-22T08:45:14.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.904+0000 7f1fb7d40800 20 remove_watcher() i=5 2024-09-22T08:45:14.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.905+0000 7f1fb7d40800 20 remove_watcher() i=6 2024-09-22T08:45:14.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:14.906+0000 7f1fb7d40800 20 remove_watcher() i=7 2024-09-22T08:45:15.055 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T08:45:15.083 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:15.083 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:15.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.119+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 realm 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.121+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.122+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:15.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.122+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.123+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:15.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.123+0000 7f271d319800 20 searching for the correct realm 2024-09-22T08:45:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.125+0000 7f271b60b640 0 -- 172.21.15.78:0/1547487889 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f2710045040 msgr2=0x7f271009d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:15.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.330+0000 7f271a609640 0 -- 172.21.15.78:0/1547487889 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f2714034040 msgr2=0x7f2714034420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:15.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.335+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:15.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 zone default found 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 4 Realm: () 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 zonegroup default 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.336+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.337+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.337+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.337+0000 7f271d319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.337+0000 7f271d319800 20 started sync module instance, tier type = 2024-09-22T08:45:15.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.337+0000 7f271d319800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=0 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=1 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=2 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=3 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=4 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=5 2024-09-22T08:45:15.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.346+0000 7f271d319800 20 add_watcher() i=6 2024-09-22T08:45:15.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.347+0000 7f271d319800 20 add_watcher() i=7 2024-09-22T08:45:15.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.347+0000 7f271d319800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:15.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.348+0000 7f25d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:15.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:15.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:15.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 5 note: GC not initialized 2024-09-22T08:45:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f254bfff640 20 reqs_thread_entry: start 2024-09-22T08:45:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 20 Filter name: none 2024-09-22T08:45:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f2549ffb640 20 reqs_thread_entry: start 2024-09-22T08:45:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.349+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.350+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.350+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.350+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T08:45:15.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 rados->read ofs=0 len=0 2024-09-22T08:45:15.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:45:15.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.351+0000 7f271d319800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:45:15.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.353+0000 7f25d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:15.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.356+0000 7f271d319800 20 remove_watcher() i=0 2024-09-22T08:45:15.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.356+0000 7f271d319800 2 removed watcher, disabling cache 2024-09-22T08:45:15.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.357+0000 7f271d319800 20 remove_watcher() i=1 2024-09-22T08:45:15.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.358+0000 7f271d319800 20 remove_watcher() i=2 2024-09-22T08:45:15.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.360+0000 7f271d319800 20 remove_watcher() i=3 2024-09-22T08:45:15.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.361+0000 7f271d319800 20 remove_watcher() i=4 2024-09-22T08:45:15.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.362+0000 7f271d319800 20 remove_watcher() i=5 2024-09-22T08:45:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.363+0000 7f271d319800 20 remove_watcher() i=6 2024-09-22T08:45:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T08:45:15.364+0000 7f271d319800 20 remove_watcher() i=7 2024-09-22T08:45:15.376 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T08:45:15.376 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket a-bucket 2024-09-22T08:45:15.454 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket myver 2024-09-22T08:45:15.688 INFO:tasks.workunit.client.0.smithi078.stderr:Completed resharding tests 2024-09-22T08:45:15.689 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:45:15.767 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-22T08:45:15.768 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-22T08:45:15.768 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-22T08:45:15.769 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:45:15.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:45:15.847 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-22T08:45:15.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:45:16.243 DEBUG:teuthology.parallel:result is None 2024-09-22T08:45:16.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:45:16.281 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:45:16.282 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:45:16.351 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:45:16.351 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-22T08:45:16.365 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-22T08:45:16.365 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-22T08:45:16.365 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-22T08:45:16.365 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-22T08:45:16.420 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-22T08:45:20.601 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-22T08:45:20.601 DEBUG:teuthology.orchestra.run.smithi078:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-22T08:45:22.487 INFO:teuthology.orchestra.run.smithi078.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-22T08:45:23.068 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:30:59 ago on Sun 22 Sep 2024 08:14:24 AM UTC. 2024-09-22T08:45:23.208 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-22T08:45:23.209 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout:Install 5 Packages 2024-09-22T08:45:23.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:23.211 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 46 M 2024-09-22T08:45:23.211 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 166 M 2024-09-22T08:45:23.211 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-22T08:45:23.752 INFO:teuthology.orchestra.run.smithi078.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.6 MB/s | 426 kB 00:00 2024-09-22T08:45:24.519 INFO:teuthology.orchestra.run.smithi078.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 3.4 MB/s | 3.5 MB 00:01 2024-09-22T08:45:24.569 INFO:teuthology.orchestra.run.smithi078.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 517 kB/s | 26 kB 00:00 2024-09-22T08:45:25.387 INFO:teuthology.orchestra.run.smithi078.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 4.9 MB/s | 9.3 MB 00:01 2024-09-22T08:45:28.370 INFO:teuthology.orchestra.run.smithi078.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 7.0 MB/s | 32 MB 00:04 2024-09-22T08:45:28.371 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:45:28.371 INFO:teuthology.orchestra.run.smithi078.stdout:Total 8.8 MB/s | 46 MB 00:05 2024-09-22T08:45:28.797 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-22T08:45:28.817 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-22T08:45:28.818 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-22T08:45:29.298 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-22T08:45:29.299 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-22T08:45:29.831 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-22T08:45:29.976 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-22T08:45:30.188 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-22T08:45:30.805 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-22T08:45:30.858 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T08:45:31.093 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T08:45:31.125 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T08:45:31.354 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T08:45:31.396 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:45:31.404 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:45:31.413 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-22T08:45:31.448 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-22T08:45:34.405 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T08:45:34.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-22T08:45:34.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-22T08:45:34.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-22T08:45:34.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-22T08:45:34.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:34.812 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-22T08:45:35.249 INFO:teuthology.orchestra.run.smithi078.stdout: Gradle will be installed under /opt/gradle 2024-09-22T08:45:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-22 08:45:35-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-22T08:45:35.728 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-22T08:45:35.736 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-22T08:45:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-22T08:45:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-22T08:45:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-22 08:45:35-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-22T08:45:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving github.com (github.com)... 140.82.114.3 2024-09-22T08:45:35.814 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to github.com (github.com)|140.82.114.3|:443... connected. 2024-09-22T08:45:35.952 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-22T08:45:35.952 INFO:teuthology.orchestra.run.smithi078.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T084535Z&X-Amz-Expires=300&X-Amz-Signature=5b65b01658fcaf16ff2e435532ed858be54e2b7866dd97c6b5ca58f1731415c5&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-22T08:45:35.952 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-22 08:45:35-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T084535Z&X-Amz-Expires=300&X-Amz-Signature=5b65b01658fcaf16ff2e435532ed858be54e2b7866dd97c6b5ca58f1731415c5&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-22T08:45:35.952 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.111.133, ... 2024-09-22T08:45:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-22T08:45:36.038 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-22T08:45:36.038 INFO:teuthology.orchestra.run.smithi078.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-22T08:45:36.038 INFO:teuthology.orchestra.run.smithi078.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-22T08:45:36.038 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T08:45:36.061 INFO:teuthology.orchestra.run.smithi078.stderr: 0K .......... .......... .......... .......... .......... 0% 2.11M 43s 2024-09-22T08:45:36.064 INFO:teuthology.orchestra.run.smithi078.stderr: 50K .......... .......... .......... .......... .......... 0% 15.4M 24s 2024-09-22T08:45:36.073 INFO:teuthology.orchestra.run.smithi078.stderr: 100K .......... .......... .......... .......... .......... 0% 5.42M 22s 2024-09-22T08:45:36.076 INFO:teuthology.orchestra.run.smithi078.stderr: 150K .......... .......... .......... .......... .......... 0% 17.6M 18s 2024-09-22T08:45:36.077 INFO:teuthology.orchestra.run.smithi078.stderr: 200K .......... .......... .......... .......... .......... 0% 37.4M 15s 2024-09-22T08:45:36.079 INFO:teuthology.orchestra.run.smithi078.stderr: 250K .......... .......... .......... .......... .......... 0% 24.5M 13s 2024-09-22T08:45:36.085 INFO:teuthology.orchestra.run.smithi078.stderr: 300K .......... .......... .......... .......... .......... 0% 8.34M 12s 2024-09-22T08:45:36.087 INFO:teuthology.orchestra.run.smithi078.stderr: 350K .......... .......... .......... .......... .......... 0% 28.1M 11s 2024-09-22T08:45:36.089 INFO:teuthology.orchestra.run.smithi078.stderr: 400K .......... .......... .......... .......... .......... 0% 32.4M 10s 2024-09-22T08:45:36.089 INFO:teuthology.orchestra.run.smithi078.stderr: 450K .......... .......... .......... .......... .......... 0% 92.6M 9s 2024-09-22T08:45:36.092 INFO:teuthology.orchestra.run.smithi078.stderr: 500K .......... .......... .......... .......... .......... 0% 47.6M 9s 2024-09-22T08:45:36.092 INFO:teuthology.orchestra.run.smithi078.stderr: 550K .......... .......... .......... .......... .......... 0% 55.6M 8s 2024-09-22T08:45:36.096 INFO:teuthology.orchestra.run.smithi078.stderr: 600K .......... .......... .......... .......... .......... 0% 10.1M 8s 2024-09-22T08:45:36.097 INFO:teuthology.orchestra.run.smithi078.stderr: 650K .......... .......... .......... .......... .......... 0% 46.9M 8s 2024-09-22T08:45:36.106 INFO:teuthology.orchestra.run.smithi078.stderr: 700K .......... .......... .......... .......... .......... 0% 45.2M 7s 2024-09-22T08:45:36.106 INFO:teuthology.orchestra.run.smithi078.stderr: 750K .......... .......... .......... .......... .......... 0% 51.0M 7s 2024-09-22T08:45:36.106 INFO:teuthology.orchestra.run.smithi078.stderr: 800K .......... .......... .......... .......... .......... 0% 349M 7s 2024-09-22T08:45:36.106 INFO:teuthology.orchestra.run.smithi078.stderr: 850K .......... .......... .......... .......... .......... 0% 49.7M 6s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 900K .......... .......... .......... .......... .......... 1% 115M 6s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 950K .......... .......... .......... .......... .......... 1% 220M 6s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 1000K .......... .......... .......... .......... .......... 1% 59.3M 6s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 1050K .......... .......... .......... .......... .......... 1% 132M 5s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 1100K .......... .......... .......... .......... .......... 1% 66.5M 5s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 1150K .......... .......... .......... .......... .......... 1% 113M 5s 2024-09-22T08:45:36.107 INFO:teuthology.orchestra.run.smithi078.stderr: 1200K .......... .......... .......... .......... .......... 1% 317M 5s 2024-09-22T08:45:37.461 INFO:teuthology.orchestra.run.smithi078.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.5M 5s 2024-09-22T08:45:37.461 INFO:teuthology.orchestra.run.smithi078.stderr: 1300K .......... .......... .......... .......... .......... 1% 45.9M 5s 2024-09-22T08:45:37.461 INFO:teuthology.orchestra.run.smithi078.stderr: 1350K .......... .......... .......... .......... .......... 1% 75.4M 5s 2024-09-22T08:45:37.461 INFO:teuthology.orchestra.run.smithi078.stderr: 1400K .......... .......... .......... .......... .......... 1% 234M 4s 2024-09-22T08:45:37.461 INFO:teuthology.orchestra.run.smithi078.stderr: 1450K .......... .......... .......... .......... .......... 1% 268M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1500K .......... .......... .......... .......... .......... 1% 74.6M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1550K .......... .......... .......... .......... .......... 1% 248M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1600K .......... .......... .......... .......... .......... 1% 141M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1650K .......... .......... .......... .......... .......... 1% 365M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1700K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1750K .......... .......... .......... .......... .......... 1% 138M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1800K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1850K .......... .......... .......... .......... .......... 2% 386M 4s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1900K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 1950K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 2000K .......... .......... .......... .......... .......... 2% 141M 3s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 2050K .......... .......... .......... .......... .......... 2% 175M 3s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 2100K .......... .......... .......... .......... .......... 2% 389M 3s 2024-09-22T08:45:37.462 INFO:teuthology.orchestra.run.smithi078.stderr: 2150K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2200K .......... .......... .......... .......... .......... 2% 228M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2250K .......... .......... .......... .......... .......... 2% 175M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2300K .......... .......... .......... .......... .......... 2% 284M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2350K .......... .......... .......... .......... .......... 2% 221M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2400K .......... .......... .......... .......... .......... 2% 180M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2450K .......... .......... .......... .......... .......... 2% 213M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2500K .......... .......... .......... .......... .......... 2% 14.4M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2550K .......... .......... .......... .......... .......... 2% 232M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2600K .......... .......... .......... .......... .......... 2% 361M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2650K .......... .......... .......... .......... .......... 2% 57.9M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2700K .......... .......... .......... .......... .......... 2% 323M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2750K .......... .......... .......... .......... .......... 3% 65.8M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2800K .......... .......... .......... .......... .......... 3% 282M 3s 2024-09-22T08:45:37.463 INFO:teuthology.orchestra.run.smithi078.stderr: 2850K .......... .......... .......... .......... .......... 3% 349M 3s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 2900K .......... .......... .......... .......... .......... 3% 272M 3s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 2950K .......... .......... .......... .......... .......... 3% 231M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3000K .......... .......... .......... .......... .......... 3% 376M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3050K .......... .......... .......... .......... .......... 3% 325M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3100K .......... .......... .......... .......... .......... 3% 228M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3150K .......... .......... .......... .......... .......... 3% 200M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3200K .......... .......... .......... .......... .......... 3% 350M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3250K .......... .......... .......... .......... .......... 3% 331M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3300K .......... .......... .......... .......... .......... 3% 357M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3350K .......... .......... .......... .......... .......... 3% 256M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3400K .......... .......... .......... .......... .......... 3% 381M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3450K .......... .......... .......... .......... .......... 3% 351M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3500K .......... .......... .......... .......... .......... 3% 211M 2s 2024-09-22T08:45:37.464 INFO:teuthology.orchestra.run.smithi078.stderr: 3550K .......... .......... .......... .......... .......... 3% 294M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3600K .......... .......... .......... .......... .......... 3% 307M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3650K .......... .......... .......... .......... .......... 3% 293M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3700K .......... .......... .......... .......... .......... 4% 392M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3750K .......... .......... .......... .......... .......... 4% 319M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3800K .......... .......... .......... .......... .......... 4% 279M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3850K .......... .......... .......... .......... .......... 4% 330M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3900K .......... .......... .......... .......... .......... 4% 299M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 3950K .......... .......... .......... .......... .......... 4% 291M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4000K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4050K .......... .......... .......... .......... .......... 4% 370M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4100K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4150K .......... .......... .......... .......... .......... 4% 331M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4200K .......... .......... .......... .......... .......... 4% 322M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4250K .......... .......... .......... .......... .......... 4% 331M 2s 2024-09-22T08:45:37.465 INFO:teuthology.orchestra.run.smithi078.stderr: 4300K .......... .......... .......... .......... .......... 4% 326M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4350K .......... .......... .......... .......... .......... 4% 266M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4400K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4450K .......... .......... .......... .......... .......... 4% 330M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4500K .......... .......... .......... .......... .......... 4% 361M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4550K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4600K .......... .......... .......... .......... .......... 5% 370M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4650K .......... .......... .......... .......... .......... 5% 396M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4700K .......... .......... .......... .......... .......... 5% 386M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4750K .......... .......... .......... .......... .......... 5% 244M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4800K .......... .......... .......... .......... .......... 5% 326M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4850K .......... .......... .......... .......... .......... 5% 334M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4900K .......... .......... .......... .......... .......... 5% 401M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 4950K .......... .......... .......... .......... .......... 5% 357M 2s 2024-09-22T08:45:37.466 INFO:teuthology.orchestra.run.smithi078.stderr: 5000K .......... .......... .......... .......... .......... 5% 410M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5050K .......... .......... .......... .......... .......... 5% 19.8M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5100K .......... .......... .......... .......... .......... 5% 264M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5150K .......... .......... .......... .......... .......... 5% 303M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5200K .......... .......... .......... .......... .......... 5% 354M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5250K .......... .......... .......... .......... .......... 5% 425M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5300K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5350K .......... .......... .......... .......... .......... 5% 345M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5400K .......... .......... .......... .......... .......... 5% 161M 2s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5450K .......... .......... .......... .......... .......... 5% 312M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5500K .......... .......... .......... .......... .......... 5% 402M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5550K .......... .......... .......... .......... .......... 6% 172M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5600K .......... .......... .......... .......... .......... 6% 379M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5650K .......... .......... .......... .......... .......... 6% 162M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5700K .......... .......... .......... .......... .......... 6% 355M 1s 2024-09-22T08:45:37.467 INFO:teuthology.orchestra.run.smithi078.stderr: 5750K .......... .......... .......... .......... .......... 6% 366M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 5800K .......... .......... .......... .......... .......... 6% 421M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 5850K .......... .......... .......... .......... .......... 6% 326M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 5900K .......... .......... .......... .......... .......... 6% 410M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 5950K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6000K .......... .......... .......... .......... .......... 6% 369M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6050K .......... .......... .......... .......... .......... 6% 386M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6100K .......... .......... .......... .......... .......... 6% 315M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6150K .......... .......... .......... .......... .......... 6% 350M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6200K .......... .......... .......... .......... .......... 6% 317M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6250K .......... .......... .......... .......... .......... 6% 365M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6300K .......... .......... .......... .......... .......... 6% 335M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6350K .......... .......... .......... .......... .......... 6% 278M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6400K .......... .......... .......... .......... .......... 6% 386M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6450K .......... .......... .......... .......... .......... 6% 370M 1s 2024-09-22T08:45:37.468 INFO:teuthology.orchestra.run.smithi078.stderr: 6500K .......... .......... .......... .......... .......... 7% 367M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6550K .......... .......... .......... .......... .......... 7% 309M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6600K .......... .......... .......... .......... .......... 7% 368M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6650K .......... .......... .......... .......... .......... 7% 313M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6700K .......... .......... .......... .......... .......... 7% 403M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6750K .......... .......... .......... .......... .......... 7% 335M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6800K .......... .......... .......... .......... .......... 7% 414M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6850K .......... .......... .......... .......... .......... 7% 256M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6900K .......... .......... .......... .......... .......... 7% 236M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 6950K .......... .......... .......... .......... .......... 7% 246M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 7000K .......... .......... .......... .......... .......... 7% 293M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 7050K .......... .......... .......... .......... .......... 7% 289M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 7100K .......... .......... .......... .......... .......... 7% 283M 1s 2024-09-22T08:45:37.469 INFO:teuthology.orchestra.run.smithi078.stderr: 7150K .......... .......... .......... .......... .......... 7% 208M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7200K .......... .......... .......... .......... .......... 7% 284M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7250K .......... .......... .......... .......... .......... 7% 256M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7300K .......... .......... .......... .......... .......... 7% 295M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7350K .......... .......... .......... .......... .......... 7% 269M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7400K .......... .......... .......... .......... .......... 8% 283M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7450K .......... .......... .......... .......... .......... 8% 253M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7500K .......... .......... .......... .......... .......... 8% 268M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7550K .......... .......... .......... .......... .......... 8% 205M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7600K .......... .......... .......... .......... .......... 8% 260M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7650K .......... .......... .......... .......... .......... 8% 246M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7700K .......... .......... .......... .......... .......... 8% 260M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7750K .......... .......... .......... .......... .......... 8% 247M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7800K .......... .......... .......... .......... .......... 8% 317M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7850K .......... .......... .......... .......... .......... 8% 308M 1s 2024-09-22T08:45:37.470 INFO:teuthology.orchestra.run.smithi078.stderr: 7900K .......... .......... .......... .......... .......... 8% 270M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 7950K .......... .......... .......... .......... .......... 8% 225M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8000K .......... .......... .......... .......... .......... 8% 28.5M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8050K .......... .......... .......... .......... .......... 8% 265M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8100K .......... .......... .......... .......... .......... 8% 196M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8150K .......... .......... .......... .......... .......... 8% 244M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8200K .......... .......... .......... .......... .......... 8% 300M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8250K .......... .......... .......... .......... .......... 8% 252M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8300K .......... .......... .......... .......... .......... 8% 297M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8350K .......... .......... .......... .......... .......... 9% 230M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8400K .......... .......... .......... .......... .......... 9% 273M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8450K .......... .......... .......... .......... .......... 9% 299M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8500K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8550K .......... .......... .......... .......... .......... 9% 283M 1s 2024-09-22T08:45:37.471 INFO:teuthology.orchestra.run.smithi078.stderr: 8600K .......... .......... .......... .......... .......... 9% 313M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8650K .......... .......... .......... .......... .......... 9% 254M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8700K .......... .......... .......... .......... .......... 9% 297M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8750K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8800K .......... .......... .......... .......... .......... 9% 264M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8850K .......... .......... .......... .......... .......... 9% 306M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8900K .......... .......... .......... .......... .......... 9% 254M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 8950K .......... .......... .......... .......... .......... 9% 237M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9000K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9050K .......... .......... .......... .......... .......... 9% 293M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9100K .......... .......... .......... .......... .......... 9% 299M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9150K .......... .......... .......... .......... .......... 9% 221M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9200K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9250K .......... .......... .......... .......... .......... 10% 263M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9300K .......... .......... .......... .......... .......... 10% 297M 1s 2024-09-22T08:45:37.472 INFO:teuthology.orchestra.run.smithi078.stderr: 9350K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9400K .......... .......... .......... .......... .......... 10% 288M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9450K .......... .......... .......... .......... .......... 10% 257M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9500K .......... .......... .......... .......... .......... 10% 287M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9550K .......... .......... .......... .......... .......... 10% 235M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9600K .......... .......... .......... .......... .......... 10% 282M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9650K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9700K .......... .......... .......... .......... .......... 10% 309M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9750K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9800K .......... .......... .......... .......... .......... 10% 278M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9850K .......... .......... .......... .......... .......... 10% 251M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9900K .......... .......... .......... .......... .......... 10% 310M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 9950K .......... .......... .......... .......... .......... 10% 305M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 10000K .......... .......... .......... .......... .......... 10% 262M 1s 2024-09-22T08:45:37.473 INFO:teuthology.orchestra.run.smithi078.stderr: 10050K .......... .......... .......... .......... .......... 10% 268M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10100K .......... .......... .......... .......... .......... 10% 278M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10150K .......... .......... .......... .......... .......... 10% 294M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10200K .......... .......... .......... .......... .......... 11% 268M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10250K .......... .......... .......... .......... .......... 11% 341M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10300K .......... .......... .......... .......... .......... 11% 224M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10350K .......... .......... .......... .......... .......... 11% 270M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10400K .......... .......... .......... .......... .......... 11% 281M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10450K .......... .......... .......... .......... .......... 11% 300M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10500K .......... .......... .......... .......... .......... 11% 273M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10550K .......... .......... .......... .......... .......... 11% 312M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10600K .......... .......... .......... .......... .......... 11% 270M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10650K .......... .......... .......... .......... .......... 11% 272M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10700K .......... .......... .......... .......... .......... 11% 245M 1s 2024-09-22T08:45:37.474 INFO:teuthology.orchestra.run.smithi078.stderr: 10750K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 10800K .......... .......... .......... .......... .......... 11% 310M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 10850K .......... .......... .......... .......... .......... 11% 264M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 10900K .......... .......... .......... .......... .......... 11% 268M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 10950K .......... .......... .......... .......... .......... 11% 281M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11000K .......... .......... .......... .......... .......... 11% 53.2M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11050K .......... .......... .......... .......... .......... 11% 285M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11100K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11150K .......... .......... .......... .......... .......... 12% 264M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11200K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11250K .......... .......... .......... .......... .......... 12% 288M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11300K .......... .......... .......... .......... .......... 12% 244M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11350K .......... .......... .......... .......... .......... 12% 293M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11400K .......... .......... .......... .......... .......... 12% 288M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11450K .......... .......... .......... .......... .......... 12% 296M 1s 2024-09-22T08:45:37.475 INFO:teuthology.orchestra.run.smithi078.stderr: 11500K .......... .......... .......... .......... .......... 12% 206M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11550K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11600K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11650K .......... .......... .......... .......... .......... 12% 298M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11700K .......... .......... .......... .......... .......... 12% 279M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11750K .......... .......... .......... .......... .......... 12% 128M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11800K .......... .......... .......... .......... .......... 12% 273M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11850K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11900K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 11950K .......... .......... .......... .......... .......... 12% 294M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12000K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12050K .......... .......... .......... .......... .......... 13% 252M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12100K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12150K .......... .......... .......... .......... .......... 13% 185M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12200K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-22T08:45:37.476 INFO:teuthology.orchestra.run.smithi078.stderr: 12250K .......... .......... .......... .......... .......... 13% 284M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12300K .......... .......... .......... .......... .......... 13% 200M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12350K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12400K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12450K .......... .......... .......... .......... .......... 13% 245M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12500K .......... .......... .......... .......... .......... 13% 216M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12550K .......... .......... .......... .......... .......... 13% 286M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12600K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12650K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12700K .......... .......... .......... .......... .......... 13% 191M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12750K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12800K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12850K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12900K .......... .......... .......... .......... .......... 13% 265M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 12950K .......... .......... .......... .......... .......... 13% 306M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 13000K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-22T08:45:37.477 INFO:teuthology.orchestra.run.smithi078.stderr: 13050K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13100K .......... .......... .......... .......... .......... 14% 246M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13150K .......... .......... .......... .......... .......... 14% 314M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13200K .......... .......... .......... .......... .......... 14% 304M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13250K .......... .......... .......... .......... .......... 14% 253M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13300K .......... .......... .......... .......... .......... 14% 266M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13350K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13400K .......... .......... .......... .......... .......... 14% 307M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13450K .......... .......... .......... .......... .......... 14% 317M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13500K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13550K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13600K .......... .......... .......... .......... .......... 14% 263M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13650K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13700K .......... .......... .......... .......... .......... 14% 261M 1s 2024-09-22T08:45:37.478 INFO:teuthology.orchestra.run.smithi078.stderr: 13750K .......... .......... .......... .......... .......... 14% 294M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 13800K .......... .......... .......... .......... .......... 14% 323M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 13850K .......... .......... .......... .......... .......... 14% 65.7M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 13900K .......... .......... .......... .......... .......... 15% 233M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 13950K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14000K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14050K .......... .......... .......... .......... .......... 15% 261M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14100K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14150K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14200K .......... .......... .......... .......... .......... 15% 248M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14250K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14300K .......... .......... .......... .......... .......... 15% 234M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14350K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14400K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-22T08:45:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 14450K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14500K .......... .......... .......... .......... .......... 15% 203M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14550K .......... .......... .......... .......... .......... 15% 246M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14600K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14650K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14700K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14750K .......... .......... .......... .......... .......... 15% 202M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14800K .......... .......... .......... .......... .......... 15% 245M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14850K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14900K .......... .......... .......... .......... .......... 16% 272M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 14950K .......... .......... .......... .......... .......... 16% 241M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 15000K .......... .......... .......... .......... .......... 16% 352M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 15050K .......... .......... .......... .......... .......... 16% 426M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 15100K .......... .......... .......... .......... .......... 16% 341M 1s 2024-09-22T08:45:37.480 INFO:teuthology.orchestra.run.smithi078.stderr: 15150K .......... .......... .......... .......... .......... 16% 440M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15200K .......... .......... .......... .......... .......... 16% 408M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15250K .......... .......... .......... .......... .......... 16% 309M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15300K .......... .......... .......... .......... .......... 16% 390M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15350K .......... .......... .......... .......... .......... 16% 375M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15400K .......... .......... .......... .......... .......... 16% 338M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15450K .......... .......... .......... .......... .......... 16% 379M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15500K .......... .......... .......... .......... .......... 16% 353M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15550K .......... .......... .......... .......... .......... 16% 317M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15600K .......... .......... .......... .......... .......... 16% 349M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15650K .......... .......... .......... .......... .......... 16% 456M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15700K .......... .......... .......... .......... .......... 16% 230M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15750K .......... .......... .......... .......... .......... 17% 101M 1s 2024-09-22T08:45:37.481 INFO:teuthology.orchestra.run.smithi078.stderr: 15800K .......... .......... .......... .......... .......... 17% 245M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 15850K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 15900K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 15950K .......... .......... .......... .......... .......... 17% 368M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16000K .......... .......... .......... .......... .......... 17% 363M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16050K .......... .......... .......... .......... .......... 17% 407M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16100K .......... .......... .......... .......... .......... 17% 381M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16150K .......... .......... .......... .......... .......... 17% 351M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16200K .......... .......... .......... .......... .......... 17% 170M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16250K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16300K .......... .......... .......... .......... .......... 17% 224M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16350K .......... .......... .......... .......... .......... 17% 424M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16400K .......... .......... .......... .......... .......... 17% 41.3M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16450K .......... .......... .......... .......... .......... 17% 396M 1s 2024-09-22T08:45:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: 16500K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16550K .......... .......... .......... .......... .......... 17% 426M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16600K .......... .......... .......... .......... .......... 17% 463M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16650K .......... .......... .......... .......... .......... 17% 456M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16700K .......... .......... .......... .......... .......... 18% 59.8M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16750K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16800K .......... .......... .......... .......... .......... 18% 342M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16850K .......... .......... .......... .......... .......... 18% 387M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16900K .......... .......... .......... .......... .......... 18% 336M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 16950K .......... .......... .......... .......... .......... 18% 353M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 17000K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 17050K .......... .......... .......... .......... .......... 18% 448M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 17100K .......... .......... .......... .......... .......... 18% 339M 1s 2024-09-22T08:45:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: 17150K .......... .......... .......... .......... .......... 18% 388M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17200K .......... .......... .......... .......... .......... 18% 377M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17250K .......... .......... .......... .......... .......... 18% 444M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17300K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17350K .......... .......... .......... .......... .......... 18% 420M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17400K .......... .......... .......... .......... .......... 18% 379M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17450K .......... .......... .......... .......... .......... 18% 375M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17500K .......... .......... .......... .......... .......... 18% 300M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17550K .......... .......... .......... .......... .......... 18% 390M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17600K .......... .......... .......... .......... .......... 18% 110M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17650K .......... .......... .......... .......... .......... 19% 229M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17700K .......... .......... .......... .......... .......... 19% 268M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17750K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17800K .......... .......... .......... .......... .......... 19% 209M 1s 2024-09-22T08:45:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: 17850K .......... .......... .......... .......... .......... 19% 353M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 17900K .......... .......... .......... .......... .......... 19% 225M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 17950K .......... .......... .......... .......... .......... 19% 136M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18000K .......... .......... .......... .......... .......... 19% 355M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18050K .......... .......... .......... .......... .......... 19% 402M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18100K .......... .......... .......... .......... .......... 19% 322M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18150K .......... .......... .......... .......... .......... 19% 159M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18200K .......... .......... .......... .......... .......... 19% 370M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18250K .......... .......... .......... .......... .......... 19% 186M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18300K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18350K .......... .......... .......... .......... .......... 19% 357M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18400K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18450K .......... .......... .......... .......... .......... 19% 327M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18500K .......... .......... .......... .......... .......... 19% 377M 1s 2024-09-22T08:45:37.485 INFO:teuthology.orchestra.run.smithi078.stderr: 18550K .......... .......... .......... .......... .......... 20% 452M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18600K .......... .......... .......... .......... .......... 20% 398M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18650K .......... .......... .......... .......... .......... 20% 360M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18700K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18750K .......... .......... .......... .......... .......... 20% 461M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18800K .......... .......... .......... .......... .......... 20% 169M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18850K .......... .......... .......... .......... .......... 20% 402M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18900K .......... .......... .......... .......... .......... 20% 327M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 18950K .......... .......... .......... .......... .......... 20% 82.2M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 19000K .......... .......... .......... .......... .......... 20% 351M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 19050K .......... .......... .......... .......... .......... 20% 384M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 19100K .......... .......... .......... .......... .......... 20% 324M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 19150K .......... .......... .......... .......... .......... 20% 419M 1s 2024-09-22T08:45:37.486 INFO:teuthology.orchestra.run.smithi078.stderr: 19200K .......... .......... .......... .......... .......... 20% 419M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19250K .......... .......... .......... .......... .......... 20% 413M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19300K .......... .......... .......... .......... .......... 20% 359M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19350K .......... .......... .......... .......... .......... 20% 385M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19400K .......... .......... .......... .......... .......... 20% 461M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19450K .......... .......... .......... .......... .......... 20% 45.1M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19500K .......... .......... .......... .......... .......... 21% 112M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19550K .......... .......... .......... .......... .......... 21% 361M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19600K .......... .......... .......... .......... .......... 21% 454M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19650K .......... .......... .......... .......... .......... 21% 62.2M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19700K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19750K .......... .......... .......... .......... .......... 21% 434M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19800K .......... .......... .......... .......... .......... 21% 424M 1s 2024-09-22T08:45:37.487 INFO:teuthology.orchestra.run.smithi078.stderr: 19850K .......... .......... .......... .......... .......... 21% 288M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 19900K .......... .......... .......... .......... .......... 21% 343M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 19950K .......... .......... .......... .......... .......... 21% 383M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20000K .......... .......... .......... .......... .......... 21% 412M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20050K .......... .......... .......... .......... .......... 21% 404M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20100K .......... .......... .......... .......... .......... 21% 376M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20150K .......... .......... .......... .......... .......... 21% 399M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20200K .......... .......... .......... .......... .......... 21% 391M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20250K .......... .......... .......... .......... .......... 21% 384M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20300K .......... .......... .......... .......... .......... 21% 353M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20350K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20400K .......... .......... .......... .......... .......... 22% 380M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20450K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20500K .......... .......... .......... .......... .......... 22% 405M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20550K .......... .......... .......... .......... .......... 22% 394M 1s 2024-09-22T08:45:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: 20600K .......... .......... .......... .......... .......... 22% 474M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20650K .......... .......... .......... .......... .......... 22% 282M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20700K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20750K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20800K .......... .......... .......... .......... .......... 22% 401M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20850K .......... .......... .......... .......... .......... 22% 146M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20900K .......... .......... .......... .......... .......... 22% 236M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 20950K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21000K .......... .......... .......... .......... .......... 22% 413M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21050K .......... .......... .......... .......... .......... 22% 159M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21100K .......... .......... .......... .......... .......... 22% 122M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21150K .......... .......... .......... .......... .......... 22% 253M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21200K .......... .......... .......... .......... .......... 22% 344M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21250K .......... .......... .......... .......... .......... 22% 275M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21300K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-22T08:45:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: 21350K .......... .......... .......... .......... .......... 23% 377M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21400K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21450K .......... .......... .......... .......... .......... 23% 431M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21500K .......... .......... .......... .......... .......... 23% 146M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21550K .......... .......... .......... .......... .......... 23% 311M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21600K .......... .......... .......... .......... .......... 23% 379M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21650K .......... .......... .......... .......... .......... 23% 412M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21700K .......... .......... .......... .......... .......... 23% 422M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21750K .......... .......... .......... .......... .......... 23% 408M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21800K .......... .......... .......... .......... .......... 23% 384M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21850K .......... .......... .......... .......... .......... 23% 389M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21900K .......... .......... .......... .......... .......... 23% 456M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 21950K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 22000K .......... .......... .......... .......... .......... 23% 97.0M 1s 2024-09-22T08:45:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: 22050K .......... .......... .......... .......... .......... 23% 167M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22100K .......... .......... .......... .......... .......... 23% 398M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22150K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22200K .......... .......... .......... .......... .......... 23% 358M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22250K .......... .......... .......... .......... .......... 24% 383M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22300K .......... .......... .......... .......... .......... 24% 401M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22350K .......... .......... .......... .......... .......... 24% 360M 0s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22400K .......... .......... .......... .......... .......... 24% 45.6M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22450K .......... .......... .......... .......... .......... 24% 303M 1s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22500K .......... .......... .......... .......... .......... 24% 458M 0s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22550K .......... .......... .......... .......... .......... 24% 179M 0s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22600K .......... .......... .......... .......... .......... 24% 316M 0s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22650K .......... .......... .......... .......... .......... 24% 377M 0s 2024-09-22T08:45:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: 22700K .......... .......... .......... .......... .......... 24% 45.9M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 22750K .......... .......... .......... .......... .......... 24% 299M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 22800K .......... .......... .......... .......... .......... 24% 366M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 22850K .......... .......... .......... .......... .......... 24% 363M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 22900K .......... .......... .......... .......... .......... 24% 408M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 22950K .......... .......... .......... .......... .......... 24% 342M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23000K .......... .......... .......... .......... .......... 24% 419M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23050K .......... .......... .......... .......... .......... 24% 396M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23100K .......... .......... .......... .......... .......... 24% 398M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23150K .......... .......... .......... .......... .......... 24% 360M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23200K .......... .......... .......... .......... .......... 25% 433M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23250K .......... .......... .......... .......... .......... 25% 381M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23300K .......... .......... .......... .......... .......... 25% 350M 0s 2024-09-22T08:45:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: 23350K .......... .......... .......... .......... .......... 25% 316M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23400K .......... .......... .......... .......... .......... 25% 350M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23450K .......... .......... .......... .......... .......... 25% 384M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23500K .......... .......... .......... .......... .......... 25% 398M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23550K .......... .......... .......... .......... .......... 25% 272M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23600K .......... .......... .......... .......... .......... 25% 412M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23650K .......... .......... .......... .......... .......... 25% 357M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23700K .......... .......... .......... .......... .......... 25% 446M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23750K .......... .......... .......... .......... .......... 25% 399M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23800K .......... .......... .......... .......... .......... 25% 394M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23850K .......... .......... .......... .......... .......... 25% 402M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23900K .......... .......... .......... .......... .......... 25% 448M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 23950K .......... .......... .......... .......... .......... 25% 123M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 24000K .......... .......... .......... .......... .......... 25% 287M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 24050K .......... .......... .......... .......... .......... 25% 424M 0s 2024-09-22T08:45:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: 24100K .......... .......... .......... .......... .......... 25% 237M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24150K .......... .......... .......... .......... .......... 26% 110M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24200K .......... .......... .......... .......... .......... 26% 142M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24250K .......... .......... .......... .......... .......... 26% 371M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24300K .......... .......... .......... .......... .......... 26% 371M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24350K .......... .......... .......... .......... .......... 26% 238M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24400K .......... .......... .......... .......... .......... 26% 394M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24450K .......... .......... .......... .......... .......... 26% 391M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24500K .......... .......... .......... .......... .......... 26% 466M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24550K .......... .......... .......... .......... .......... 26% 120M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24600K .......... .......... .......... .......... .......... 26% 417M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24650K .......... .......... .......... .......... .......... 26% 307M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24700K .......... .......... .......... .......... .......... 26% 234M 0s 2024-09-22T08:45:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: 24750K .......... .......... .......... .......... .......... 26% 307M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 24800K .......... .......... .......... .......... .......... 26% 413M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 24850K .......... .......... .......... .......... .......... 26% 381M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 24900K .......... .......... .......... .......... .......... 26% 407M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 24950K .......... .......... .......... .......... .......... 26% 417M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25000K .......... .......... .......... .......... .......... 26% 471M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25050K .......... .......... .......... .......... .......... 27% 132M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25100K .......... .......... .......... .......... .......... 27% 373M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25150K .......... .......... .......... .......... .......... 27% 182M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25200K .......... .......... .......... .......... .......... 27% 417M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25250K .......... .......... .......... .......... .......... 27% 395M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25300K .......... .......... .......... .......... .......... 27% 355M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25350K .......... .......... .......... .......... .......... 27% 291M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25400K .......... .......... .......... .......... .......... 27% 265M 0s 2024-09-22T08:45:37.495 INFO:teuthology.orchestra.run.smithi078.stderr: 25450K .......... .......... .......... .......... .......... 27% 463M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25500K .......... .......... .......... .......... .......... 27% 57.5M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25550K .......... .......... .......... .......... .......... 27% 130M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25600K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25650K .......... .......... .......... .......... .......... 27% 335M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25700K .......... .......... .......... .......... .......... 27% 303M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25750K .......... .......... .......... .......... .......... 27% 51.7M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25800K .......... .......... .......... .......... .......... 27% 269M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25850K .......... .......... .......... .......... .......... 27% 232M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25900K .......... .......... .......... .......... .......... 27% 426M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 25950K .......... .......... .......... .......... .......... 27% 258M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 26000K .......... .......... .......... .......... .......... 28% 339M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 26050K .......... .......... .......... .......... .......... 28% 377M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 26100K .......... .......... .......... .......... .......... 28% 355M 0s 2024-09-22T08:45:37.496 INFO:teuthology.orchestra.run.smithi078.stderr: 26150K .......... .......... .......... .......... .......... 28% 352M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26200K .......... .......... .......... .......... .......... 28% 360M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26250K .......... .......... .......... .......... .......... 28% 364M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26300K .......... .......... .......... .......... .......... 28% 459M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26350K .......... .......... .......... .......... .......... 28% 204M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26400K .......... .......... .......... .......... .......... 28% 399M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26450K .......... .......... .......... .......... .......... 28% 389M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26500K .......... .......... .......... .......... .......... 28% 376M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26550K .......... .......... .......... .......... .......... 28% 381M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26600K .......... .......... .......... .......... .......... 28% 393M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26650K .......... .......... .......... .......... .......... 28% 399M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26700K .......... .......... .......... .......... .......... 28% 433M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26750K .......... .......... .......... .......... .......... 28% 283M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26800K .......... .......... .......... .......... .......... 28% 377M 0s 2024-09-22T08:45:37.497 INFO:teuthology.orchestra.run.smithi078.stderr: 26850K .......... .......... .......... .......... .......... 28% 413M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 26900K .......... .......... .......... .......... .......... 29% 472M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 26950K .......... .......... .......... .......... .......... 29% 190M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27000K .......... .......... .......... .......... .......... 29% 384M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27050K .......... .......... .......... .......... .......... 29% 451M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27100K .......... .......... .......... .......... .......... 29% 293M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27150K .......... .......... .......... .......... .......... 29% 312M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27200K .......... .......... .......... .......... .......... 29% 133M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27250K .......... .......... .......... .......... .......... 29% 128M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27300K .......... .......... .......... .......... .......... 29% 395M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27350K .......... .......... .......... .......... .......... 29% 145M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27400K .......... .......... .......... .......... .......... 29% 139M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27450K .......... .......... .......... .......... .......... 29% 324M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27500K .......... .......... .......... .......... .......... 29% 436M 0s 2024-09-22T08:45:37.498 INFO:teuthology.orchestra.run.smithi078.stderr: 27550K .......... .......... .......... .......... .......... 29% 271M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27600K .......... .......... .......... .......... .......... 29% 385M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27650K .......... .......... .......... .......... .......... 29% 268M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27700K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27750K .......... .......... .......... .......... .......... 29% 367M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27800K .......... .......... .......... .......... .......... 29% 416M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27850K .......... .......... .......... .......... .......... 30% 439M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27900K .......... .......... .......... .......... .......... 30% 385M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 27950K .......... .......... .......... .......... .......... 30% 99.0M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28000K .......... .......... .......... .......... .......... 30% 416M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28050K .......... .......... .......... .......... .......... 30% 371M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28100K .......... .......... .......... .......... .......... 30% 375M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28150K .......... .......... .......... .......... .......... 30% 365M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28200K .......... .......... .......... .......... .......... 30% 449M 0s 2024-09-22T08:45:37.499 INFO:teuthology.orchestra.run.smithi078.stderr: 28250K .......... .......... .......... .......... .......... 30% 388M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28300K .......... .......... .......... .......... .......... 30% 428M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28350K .......... .......... .......... .......... .......... 30% 355M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28400K .......... .......... .......... .......... .......... 30% 175M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28450K .......... .......... .......... .......... .......... 30% 66.0M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28500K .......... .......... .......... .......... .......... 30% 334M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28550K .......... .......... .......... .......... .......... 30% 365M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28600K .......... .......... .......... .......... .......... 30% 286M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28650K .......... .......... .......... .......... .......... 30% 196M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28700K .......... .......... .......... .......... .......... 30% 260M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28750K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28800K .......... .......... .......... .......... .......... 31% 53.2M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28850K .......... .......... .......... .......... .......... 31% 343M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28900K .......... .......... .......... .......... .......... 31% 157M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 28950K .......... .......... .......... .......... .......... 31% 257M 0s 2024-09-22T08:45:37.500 INFO:teuthology.orchestra.run.smithi078.stderr: 29000K .......... .......... .......... .......... .......... 31% 402M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29050K .......... .......... .......... .......... .......... 31% 381M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29100K .......... .......... .......... .......... .......... 31% 244M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29150K .......... .......... .......... .......... .......... 31% 282M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29200K .......... .......... .......... .......... .......... 31% 396M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29250K .......... .......... .......... .......... .......... 31% 399M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29300K .......... .......... .......... .......... .......... 31% 393M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29350K .......... .......... .......... .......... .......... 31% 191M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29400K .......... .......... .......... .......... .......... 31% 335M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29450K .......... .......... .......... .......... .......... 31% 405M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29500K .......... .......... .......... .......... .......... 31% 207M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29550K .......... .......... .......... .......... .......... 31% 311M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29600K .......... .......... .......... .......... .......... 31% 395M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29650K .......... .......... .......... .......... .......... 31% 375M 0s 2024-09-22T08:45:37.501 INFO:teuthology.orchestra.run.smithi078.stderr: 29700K .......... .......... .......... .......... .......... 32% 430M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 29750K .......... .......... .......... .......... .......... 32% 415M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 29800K .......... .......... .......... .......... .......... 32% 328M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 29850K .......... .......... .......... .......... .......... 32% 386M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 29900K .......... .......... .......... .......... .......... 32% 425M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 29950K .......... .......... .......... .......... .......... 32% 334M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30000K .......... .......... .......... .......... .......... 32% 368M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30050K .......... .......... .......... .......... .......... 32% 416M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30100K .......... .......... .......... .......... .......... 32% 382M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30150K .......... .......... .......... .......... .......... 32% 364M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30200K .......... .......... .......... .......... .......... 32% 446M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30250K .......... .......... .......... .......... .......... 32% 216M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30300K .......... .......... .......... .......... .......... 32% 437M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30350K .......... .......... .......... .......... .......... 32% 126M 0s 2024-09-22T08:45:37.502 INFO:teuthology.orchestra.run.smithi078.stderr: 30400K .......... .......... .......... .......... .......... 32% 167M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30450K .......... .......... .......... .......... .......... 32% 109M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30500K .......... .......... .......... .......... .......... 32% 292M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30550K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30600K .......... .......... .......... .......... .......... 32% 375M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30650K .......... .......... .......... .......... .......... 33% 406M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30700K .......... .......... .......... .......... .......... 33% 332M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30750K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30800K .......... .......... .......... .......... .......... 33% 285M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30850K .......... .......... .......... .......... .......... 33% 383M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30900K .......... .......... .......... .......... .......... 33% 354M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 30950K .......... .......... .......... .......... .......... 33% 390M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 31000K .......... .......... .......... .......... .......... 33% 108M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 31050K .......... .......... .......... .......... .......... 33% 251M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 31100K .......... .......... .......... .......... .......... 33% 349M 0s 2024-09-22T08:45:37.503 INFO:teuthology.orchestra.run.smithi078.stderr: 31150K .......... .......... .......... .......... .......... 33% 191M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31200K .......... .......... .......... .......... .......... 33% 403M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31250K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31300K .......... .......... .......... .......... .......... 33% 356M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31350K .......... .......... .......... .......... .......... 33% 422M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31400K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31450K .......... .......... .......... .......... .......... 33% 379M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31500K .......... .......... .......... .......... .......... 33% 82.4M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31550K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31600K .......... .......... .......... .......... .......... 34% 396M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31650K .......... .......... .......... .......... .......... 34% 400M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31700K .......... .......... .......... .......... .......... 34% 190M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31750K .......... .......... .......... .......... .......... 34% 330M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31800K .......... .......... .......... .......... .......... 34% 49.6M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31850K .......... .......... .......... .......... .......... 34% 390M 0s 2024-09-22T08:45:37.504 INFO:teuthology.orchestra.run.smithi078.stderr: 31900K .......... .......... .......... .......... .......... 34% 305M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 31950K .......... .......... .......... .......... .......... 34% 146M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32000K .......... .......... .......... .......... .......... 34% 411M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32050K .......... .......... .......... .......... .......... 34% 229M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32100K .......... .......... .......... .......... .......... 34% 364M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32150K .......... .......... .......... .......... .......... 34% 109M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32200K .......... .......... .......... .......... .......... 34% 384M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32250K .......... .......... .......... .......... .......... 34% 405M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32300K .......... .......... .......... .......... .......... 34% 337M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32350K .......... .......... .......... .......... .......... 34% 357M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32400K .......... .......... .......... .......... .......... 34% 365M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32450K .......... .......... .......... .......... .......... 34% 380M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32500K .......... .......... .......... .......... .......... 35% 420M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32550K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32600K .......... .......... .......... .......... .......... 35% 180M 0s 2024-09-22T08:45:37.505 INFO:teuthology.orchestra.run.smithi078.stderr: 32650K .......... .......... .......... .......... .......... 35% 347M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32700K .......... .......... .......... .......... .......... 35% 294M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32750K .......... .......... .......... .......... .......... 35% 349M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32800K .......... .......... .......... .......... .......... 35% 423M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32850K .......... .......... .......... .......... .......... 35% 364M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32900K .......... .......... .......... .......... .......... 35% 361M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 32950K .......... .......... .......... .......... .......... 35% 363M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33000K .......... .......... .......... .......... .......... 35% 396M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33050K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33100K .......... .......... .......... .......... .......... 35% 292M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33150K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33200K .......... .......... .......... .......... .......... 35% 381M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33250K .......... .......... .......... .......... .......... 35% 382M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33300K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-22T08:45:37.506 INFO:teuthology.orchestra.run.smithi078.stderr: 33350K .......... .......... .......... .......... .......... 35% 448M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33400K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33450K .......... .......... .......... .......... .......... 36% 106M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33500K .......... .......... .......... .......... .......... 36% 235M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33550K .......... .......... .......... .......... .......... 36% 80.1M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33600K .......... .......... .......... .......... .......... 36% 361M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33650K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33700K .......... .......... .......... .......... .......... 36% 337M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33750K .......... .......... .......... .......... .......... 36% 442M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33800K .......... .......... .......... .......... .......... 36% 461M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33850K .......... .......... .......... .......... .......... 36% 460M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33900K .......... .......... .......... .......... .......... 36% 246M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 33950K .......... .......... .......... .......... .......... 36% 350M 0s 2024-09-22T08:45:37.507 INFO:teuthology.orchestra.run.smithi078.stderr: 34000K .......... .......... .......... .......... .......... 36% 437M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34050K .......... .......... .......... .......... .......... 36% 288M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34100K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34150K .......... .......... .......... .......... .......... 36% 104M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34200K .......... .......... .......... .......... .......... 36% 391M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34250K .......... .......... .......... .......... .......... 36% 386M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34300K .......... .......... .......... .......... .......... 36% 348M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34350K .......... .......... .......... .......... .......... 37% 411M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34400K .......... .......... .......... .......... .......... 37% 112M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34450K .......... .......... .......... .......... .......... 37% 357M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34500K .......... .......... .......... .......... .......... 37% 130M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34550K .......... .......... .......... .......... .......... 37% 386M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34600K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34650K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-22T08:45:37.508 INFO:teuthology.orchestra.run.smithi078.stderr: 34700K .......... .......... .......... .......... .......... 37% 312M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 34750K .......... .......... .......... .......... .......... 37% 419M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 34800K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 34850K .......... .......... .......... .......... .......... 37% 49.8M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 34900K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 34950K .......... .......... .......... .......... .......... 37% 232M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35000K .......... .......... .......... .......... .......... 37% 408M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35050K .......... .......... .......... .......... .......... 37% 357M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35100K .......... .......... .......... .......... .......... 37% 177M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35150K .......... .......... .......... .......... .......... 37% 306M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35200K .......... .......... .......... .......... .......... 37% 101M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35250K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35300K .......... .......... .......... .......... .......... 38% 266M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35350K .......... .......... .......... .......... .......... 38% 395M 0s 2024-09-22T08:45:37.509 INFO:teuthology.orchestra.run.smithi078.stderr: 35400K .......... .......... .......... .......... .......... 38% 409M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35450K .......... .......... .......... .......... .......... 38% 441M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35500K .......... .......... .......... .......... .......... 38% 229M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35550K .......... .......... .......... .......... .......... 38% 318M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35600K .......... .......... .......... .......... .......... 38% 409M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35650K .......... .......... .......... .......... .......... 38% 419M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35700K .......... .......... .......... .......... .......... 38% 388M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35750K .......... .......... .......... .......... .......... 38% 182M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35800K .......... .......... .......... .......... .......... 38% 414M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35850K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35900K .......... .......... .......... .......... .......... 38% 152M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 35950K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 36000K .......... .......... .......... .......... .......... 38% 404M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 36050K .......... .......... .......... .......... .......... 38% 387M 0s 2024-09-22T08:45:37.510 INFO:teuthology.orchestra.run.smithi078.stderr: 36100K .......... .......... .......... .......... .......... 38% 369M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36150K .......... .......... .......... .......... .......... 38% 360M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36200K .......... .......... .......... .......... .......... 39% 387M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36250K .......... .......... .......... .......... .......... 39% 442M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36300K .......... .......... .......... .......... .......... 39% 329M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36350K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36400K .......... .......... .......... .......... .......... 39% 442M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36450K .......... .......... .......... .......... .......... 39% 400M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36500K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36550K .......... .......... .......... .......... .......... 39% 312M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36600K .......... .......... .......... .......... .......... 39% 67.6M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36650K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36700K .......... .......... .......... .......... .......... 39% 269M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36750K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-22T08:45:37.511 INFO:teuthology.orchestra.run.smithi078.stderr: 36800K .......... .......... .......... .......... .......... 39% 174M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 36850K .......... .......... .......... .......... .......... 39% 369M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 36900K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 36950K .......... .......... .......... .......... .......... 39% 410M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37000K .......... .......... .......... .......... .......... 39% 383M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37050K .......... .......... .......... .......... .......... 39% 422M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37100K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37150K .......... .......... .......... .......... .......... 40% 468M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37200K .......... .......... .......... .......... .......... 40% 180M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37250K .......... .......... .......... .......... .......... 40% 266M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37300K .......... .......... .......... .......... .......... 40% 342M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37350K .......... .......... .......... .......... .......... 40% 439M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37400K .......... .......... .......... .......... .......... 40% 106M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37450K .......... .......... .......... .......... .......... 40% 216M 0s 2024-09-22T08:45:37.512 INFO:teuthology.orchestra.run.smithi078.stderr: 37500K .......... .......... .......... .......... .......... 40% 185M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37550K .......... .......... .......... .......... .......... 40% 420M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37600K .......... .......... .......... .......... .......... 40% 402M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37650K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37700K .......... .......... .......... .......... .......... 40% 276M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37750K .......... .......... .......... .......... .......... 40% 370M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37800K .......... .......... .......... .......... .......... 40% 400M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37850K .......... .......... .......... .......... .......... 40% 362M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37900K .......... .......... .......... .......... .......... 40% 49.2M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 37950K .......... .......... .......... .......... .......... 40% 202M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 38000K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 38050K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 38100K .......... .......... .......... .......... .......... 41% 340M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 38150K .......... .......... .......... .......... .......... 41% 361M 0s 2024-09-22T08:45:37.513 INFO:teuthology.orchestra.run.smithi078.stderr: 38200K .......... .......... .......... .......... .......... 41% 391M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38250K .......... .......... .......... .......... .......... 41% 365M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38300K .......... .......... .......... .......... .......... 41% 88.4M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38350K .......... .......... .......... .......... .......... 41% 257M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38400K .......... .......... .......... .......... .......... 41% 136M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38450K .......... .......... .......... .......... .......... 41% 416M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38500K .......... .......... .......... .......... .......... 41% 399M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38550K .......... .......... .......... .......... .......... 41% 268M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38600K .......... .......... .......... .......... .......... 41% 321M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38650K .......... .......... .......... .......... .......... 41% 401M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38700K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38750K .......... .......... .......... .......... .......... 41% 399M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38800K .......... .......... .......... .......... .......... 41% 417M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38850K .......... .......... .......... .......... .......... 41% 279M 0s 2024-09-22T08:45:37.514 INFO:teuthology.orchestra.run.smithi078.stderr: 38900K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 38950K .......... .......... .......... .......... .......... 41% 201M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39000K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39050K .......... .......... .......... .......... .......... 42% 218M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39100K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39150K .......... .......... .......... .......... .......... 42% 414M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39200K .......... .......... .......... .......... .......... 42% 395M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39250K .......... .......... .......... .......... .......... 42% 391M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39300K .......... .......... .......... .......... .......... 42% 369M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39350K .......... .......... .......... .......... .......... 42% 352M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39400K .......... .......... .......... .......... .......... 42% 380M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39450K .......... .......... .......... .......... .......... 42% 361M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39500K .......... .......... .......... .......... .......... 42% 351M 0s 2024-09-22T08:45:37.515 INFO:teuthology.orchestra.run.smithi078.stderr: 39550K .......... .......... .......... .......... .......... 42% 387M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39600K .......... .......... .......... .......... .......... 42% 372M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39650K .......... .......... .......... .......... .......... 42% 81.8M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39700K .......... .......... .......... .......... .......... 42% 229M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39750K .......... .......... .......... .......... .......... 42% 404M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39800K .......... .......... .......... .......... .......... 42% 314M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39850K .......... .......... .......... .......... .......... 42% 149M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39900K .......... .......... .......... .......... .......... 43% 157M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 39950K .......... .......... .......... .......... .......... 43% 410M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40000K .......... .......... .......... .......... .......... 43% 425M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40050K .......... .......... .......... .......... .......... 43% 414M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40100K .......... .......... .......... .......... .......... 43% 371M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40150K .......... .......... .......... .......... .......... 43% 418M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40200K .......... .......... .......... .......... .......... 43% 286M 0s 2024-09-22T08:45:37.516 INFO:teuthology.orchestra.run.smithi078.stderr: 40250K .......... .......... .......... .......... .......... 43% 407M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40300K .......... .......... .......... .......... .......... 43% 259M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40350K .......... .......... .......... .......... .......... 43% 370M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40400K .......... .......... .......... .......... .......... 43% 399M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40450K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40500K .......... .......... .......... .......... .......... 43% 100M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40550K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40600K .......... .......... .......... .......... .......... 43% 409M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40650K .......... .......... .......... .......... .......... 43% 330M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40700K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40750K .......... .......... .......... .......... .......... 43% 387M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40800K .......... .......... .......... .......... .......... 43% 109M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40850K .......... .......... .......... .......... .......... 44% 300M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40900K .......... .......... .......... .......... .......... 44% 370M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 40950K .......... .......... .......... .......... .......... 44% 58.6M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 41000K .......... .......... .......... .......... .......... 44% 277M 0s 2024-09-22T08:45:37.517 INFO:teuthology.orchestra.run.smithi078.stderr: 41050K .......... .......... .......... .......... .......... 44% 429M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41100K .......... .......... .......... .......... .......... 44% 146M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41150K .......... .......... .......... .......... .......... 44% 321M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41200K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41250K .......... .......... .......... .......... .......... 44% 450M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41300K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41350K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41400K .......... .......... .......... .......... .......... 44% 205M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41450K .......... .......... .......... .......... .......... 44% 194M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41500K .......... .......... .......... .......... .......... 44% 155M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41550K .......... .......... .......... .......... .......... 44% 241M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41600K .......... .......... .......... .......... .......... 44% 396M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41650K .......... .......... .......... .......... .......... 44% 213M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41700K .......... .......... .......... .......... .......... 44% 278M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41750K .......... .......... .......... .......... .......... 44% 313M 0s 2024-09-22T08:45:37.518 INFO:teuthology.orchestra.run.smithi078.stderr: 41800K .......... .......... .......... .......... .......... 45% 371M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 41850K .......... .......... .......... .......... .......... 45% 434M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 41900K .......... .......... .......... .......... .......... 45% 221M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 41950K .......... .......... .......... .......... .......... 45% 277M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42000K .......... .......... .......... .......... .......... 45% 280M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42050K .......... .......... .......... .......... .......... 45% 397M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42100K .......... .......... .......... .......... .......... 45% 116M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42150K .......... .......... .......... .......... .......... 45% 278M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42200K .......... .......... .......... .......... .......... 45% 375M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42250K .......... .......... .......... .......... .......... 45% 403M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42300K .......... .......... .......... .......... .......... 45% 386M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42350K .......... .......... .......... .......... .......... 45% 357M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42400K .......... .......... .......... .......... .......... 45% 409M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42450K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-22T08:45:37.519 INFO:teuthology.orchestra.run.smithi078.stderr: 42500K .......... .......... .......... .......... .......... 45% 391M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42550K .......... .......... .......... .......... .......... 45% 364M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42600K .......... .......... .......... .......... .......... 45% 418M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42650K .......... .......... .......... .......... .......... 45% 439M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42700K .......... .......... .......... .......... .......... 46% 465M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42750K .......... .......... .......... .......... .......... 46% 173M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42800K .......... .......... .......... .......... .......... 46% 179M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42850K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42900K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 42950K .......... .......... .......... .......... .......... 46% 221M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43000K .......... .......... .......... .......... .......... 46% 133M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43050K .......... .......... .......... .......... .......... 46% 367M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43100K .......... .......... .......... .......... .......... 46% 155M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43150K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43200K .......... .......... .......... .......... .......... 46% 440M 0s 2024-09-22T08:45:37.520 INFO:teuthology.orchestra.run.smithi078.stderr: 43250K .......... .......... .......... .......... .......... 46% 422M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43300K .......... .......... .......... .......... .......... 46% 408M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43350K .......... .......... .......... .......... .......... 46% 386M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43400K .......... .......... .......... .......... .......... 46% 459M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43450K .......... .......... .......... .......... .......... 46% 126M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43500K .......... .......... .......... .......... .......... 46% 424M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43550K .......... .......... .......... .......... .......... 46% 216M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43600K .......... .......... .......... .......... .......... 46% 386M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43650K .......... .......... .......... .......... .......... 47% 435M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43700K .......... .......... .......... .......... .......... 47% 395M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43750K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43800K .......... .......... .......... .......... .......... 47% 406M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43850K .......... .......... .......... .......... .......... 47% 457M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43900K .......... .......... .......... .......... .......... 47% 106M 0s 2024-09-22T08:45:37.521 INFO:teuthology.orchestra.run.smithi078.stderr: 43950K .......... .......... .......... .......... .......... 47% 322M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44000K .......... .......... .......... .......... .......... 47% 67.2M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44050K .......... .......... .......... .......... .......... 47% 259M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44100K .......... .......... .......... .......... .......... 47% 170M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44150K .......... .......... .......... .......... .......... 47% 324M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44200K .......... .......... .......... .......... .......... 47% 98.4M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44250K .......... .......... .......... .......... .......... 47% 395M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44300K .......... .......... .......... .......... .......... 47% 405M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44350K .......... .......... .......... .......... .......... 47% 196M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44400K .......... .......... .......... .......... .......... 47% 416M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44450K .......... .......... .......... .......... .......... 47% 383M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44500K .......... .......... .......... .......... .......... 47% 378M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44550K .......... .......... .......... .......... .......... 48% 149M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44600K .......... .......... .......... .......... .......... 48% 395M 0s 2024-09-22T08:45:37.522 INFO:teuthology.orchestra.run.smithi078.stderr: 44650K .......... .......... .......... .......... .......... 48% 273M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44700K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44750K .......... .......... .......... .......... .......... 48% 198M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44800K .......... .......... .......... .......... .......... 48% 170M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44850K .......... .......... .......... .......... .......... 48% 399M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44900K .......... .......... .......... .......... .......... 48% 192M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 44950K .......... .......... .......... .......... .......... 48% 204M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45000K .......... .......... .......... .......... .......... 48% 405M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45050K .......... .......... .......... .......... .......... 48% 395M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45100K .......... .......... .......... .......... .......... 48% 459M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45150K .......... .......... .......... .......... .......... 48% 110M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45200K .......... .......... .......... .......... .......... 48% 152M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45250K .......... .......... .......... .......... .......... 48% 394M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45300K .......... .......... .......... .......... .......... 48% 200M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45350K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-22T08:45:37.523 INFO:teuthology.orchestra.run.smithi078.stderr: 45400K .......... .......... .......... .......... .......... 48% 387M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45450K .......... .......... .......... .......... .......... 48% 390M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45500K .......... .......... .......... .......... .......... 49% 358M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45550K .......... .......... .......... .......... .......... 49% 262M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45600K .......... .......... .......... .......... .......... 49% 412M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45650K .......... .......... .......... .......... .......... 49% 386M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45700K .......... .......... .......... .......... .......... 49% 456M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45750K .......... .......... .......... .......... .......... 49% 419M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45800K .......... .......... .......... .......... .......... 49% 462M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45850K .......... .......... .......... .......... .......... 49% 181M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45900K .......... .......... .......... .......... .......... 49% 383M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 45950K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 46000K .......... .......... .......... .......... .......... 49% 462M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 46050K .......... .......... .......... .......... .......... 49% 277M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 46100K .......... .......... .......... .......... .......... 49% 175M 0s 2024-09-22T08:45:37.524 INFO:teuthology.orchestra.run.smithi078.stderr: 46150K .......... .......... .......... .......... .......... 49% 294M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46200K .......... .......... .......... .......... .......... 49% 457M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46250K .......... .......... .......... .......... .......... 49% 187M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46300K .......... .......... .......... .......... .......... 49% 337M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46350K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46400K .......... .......... .......... .......... .......... 49% 167M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46450K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46500K .......... .......... .......... .......... .......... 50% 440M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46550K .......... .......... .......... .......... .......... 50% 314M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46600K .......... .......... .......... .......... .......... 50% 367M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46650K .......... .......... .......... .......... .......... 50% 441M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46700K .......... .......... .......... .......... .......... 50% 342M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46750K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46800K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46850K .......... .......... .......... .......... .......... 50% 116M 0s 2024-09-22T08:45:37.525 INFO:teuthology.orchestra.run.smithi078.stderr: 46900K .......... .......... .......... .......... .......... 50% 159M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 46950K .......... .......... .......... .......... .......... 50% 332M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47000K .......... .......... .......... .......... .......... 50% 81.7M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47050K .......... .......... .......... .......... .......... 50% 367M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47100K .......... .......... .......... .......... .......... 50% 365M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47150K .......... .......... .......... .......... .......... 50% 124M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47200K .......... .......... .......... .......... .......... 50% 347M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47250K .......... .......... .......... .......... .......... 50% 124M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47300K .......... .......... .......... .......... .......... 50% 340M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47350K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47400K .......... .......... .......... .......... .......... 51% 330M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47450K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47500K .......... .......... .......... .......... .......... 51% 252M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47550K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47600K .......... .......... .......... .......... .......... 51% 335M 0s 2024-09-22T08:45:37.526 INFO:teuthology.orchestra.run.smithi078.stderr: 47650K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47700K .......... .......... .......... .......... .......... 51% 204M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47750K .......... .......... .......... .......... .......... 51% 220M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47800K .......... .......... .......... .......... .......... 51% 231M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47850K .......... .......... .......... .......... .......... 51% 423M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47900K .......... .......... .......... .......... .......... 51% 171M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 47950K .......... .......... .......... .......... .......... 51% 237M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48000K .......... .......... .......... .......... .......... 51% 109M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48050K .......... .......... .......... .......... .......... 51% 409M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48100K .......... .......... .......... .......... .......... 51% 435M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48150K .......... .......... .......... .......... .......... 51% 161M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48200K .......... .......... .......... .......... .......... 51% 432M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48250K .......... .......... .......... .......... .......... 51% 87.2M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48300K .......... .......... .......... .......... .......... 52% 133M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48350K .......... .......... .......... .......... .......... 52% 330M 0s 2024-09-22T08:45:37.527 INFO:teuthology.orchestra.run.smithi078.stderr: 48400K .......... .......... .......... .......... .......... 52% 414M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48450K .......... .......... .......... .......... .......... 52% 413M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48500K .......... .......... .......... .......... .......... 52% 449M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48550K .......... .......... .......... .......... .......... 52% 406M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48600K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48650K .......... .......... .......... .......... .......... 52% 441M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48700K .......... .......... .......... .......... .......... 52% 456M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48750K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48800K .......... .......... .......... .......... .......... 52% 348M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48850K .......... .......... .......... .......... .......... 52% 407M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48900K .......... .......... .......... .......... .......... 52% 356M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 48950K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 49000K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 49050K .......... .......... .......... .......... .......... 52% 414M 0s 2024-09-22T08:45:37.528 INFO:teuthology.orchestra.run.smithi078.stderr: 49100K .......... .......... .......... .......... .......... 52% 407M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49150K .......... .......... .......... .......... .......... 52% 281M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49200K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49250K .......... .......... .......... .......... .......... 53% 370M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49300K .......... .......... .......... .......... .......... 53% 378M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49350K .......... .......... .......... .......... .......... 53% 159M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49400K .......... .......... .......... .......... .......... 53% 165M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49450K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49500K .......... .......... .......... .......... .......... 53% 415M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49550K .......... .......... .......... .......... .......... 53% 328M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49600K .......... .......... .......... .......... .......... 53% 389M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49650K .......... .......... .......... .......... .......... 53% 348M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49700K .......... .......... .......... .......... .......... 53% 266M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49750K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49800K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-22T08:45:37.529 INFO:teuthology.orchestra.run.smithi078.stderr: 49850K .......... .......... .......... .......... .......... 53% 407M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 49900K .......... .......... .......... .......... .......... 53% 443M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 49950K .......... .......... .......... .......... .......... 53% 128M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50000K .......... .......... .......... .......... .......... 53% 251M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50050K .......... .......... .......... .......... .......... 53% 98.0M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50100K .......... .......... .......... .......... .......... 53% 166M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50150K .......... .......... .......... .......... .......... 54% 346M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50200K .......... .......... .......... .......... .......... 54% 321M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50250K .......... .......... .......... .......... .......... 54% 185M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50300K .......... .......... .......... .......... .......... 54% 145M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50350K .......... .......... .......... .......... .......... 54% 296M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50400K .......... .......... .......... .......... .......... 54% 291M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50450K .......... .......... .......... .......... .......... 54% 410M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50500K .......... .......... .......... .......... .......... 54% 163M 0s 2024-09-22T08:45:37.530 INFO:teuthology.orchestra.run.smithi078.stderr: 50550K .......... .......... .......... .......... .......... 54% 226M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50600K .......... .......... .......... .......... .......... 54% 398M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50650K .......... .......... .......... .......... .......... 54% 403M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50700K .......... .......... .......... .......... .......... 54% 448M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50750K .......... .......... .......... .......... .......... 54% 230M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50800K .......... .......... .......... .......... .......... 54% 402M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50850K .......... .......... .......... .......... .......... 54% 157M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50900K .......... .......... .......... .......... .......... 54% 434M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 50950K .......... .......... .......... .......... .......... 54% 185M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51000K .......... .......... .......... .......... .......... 54% 271M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51050K .......... .......... .......... .......... .......... 55% 75.4M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51100K .......... .......... .......... .......... .......... 55% 282M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51150K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51200K .......... .......... .......... .......... .......... 55% 419M 0s 2024-09-22T08:45:37.531 INFO:teuthology.orchestra.run.smithi078.stderr: 51250K .......... .......... .......... .......... .......... 55% 83.3M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51300K .......... .......... .......... .......... .......... 55% 342M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51350K .......... .......... .......... .......... .......... 55% 434M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51400K .......... .......... .......... .......... .......... 55% 106M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51450K .......... .......... .......... .......... .......... 55% 380M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51500K .......... .......... .......... .......... .......... 55% 329M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51550K .......... .......... .......... .......... .......... 55% 420M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51600K .......... .......... .......... .......... .......... 55% 342M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51650K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51700K .......... .......... .......... .......... .......... 55% 341M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51750K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51800K .......... .......... .......... .......... .......... 55% 447M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51850K .......... .......... .......... .......... .......... 55% 149M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51900K .......... .......... .......... .......... .......... 55% 337M 0s 2024-09-22T08:45:37.532 INFO:teuthology.orchestra.run.smithi078.stderr: 51950K .......... .......... .......... .......... .......... 55% 383M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52000K .......... .......... .......... .......... .......... 56% 382M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52050K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52100K .......... .......... .......... .......... .......... 56% 365M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52150K .......... .......... .......... .......... .......... 56% 356M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52200K .......... .......... .......... .......... .......... 56% 389M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52250K .......... .......... .......... .......... .......... 56% 376M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52300K .......... .......... .......... .......... .......... 56% 314M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52350K .......... .......... .......... .......... .......... 56% 431M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52400K .......... .......... .......... .......... .......... 56% 225M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52450K .......... .......... .......... .......... .......... 56% 405M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52500K .......... .......... .......... .......... .......... 56% 373M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52550K .......... .......... .......... .......... .......... 56% 413M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52600K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-22T08:45:37.533 INFO:teuthology.orchestra.run.smithi078.stderr: 52650K .......... .......... .......... .......... .......... 56% 156M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52700K .......... .......... .......... .......... .......... 56% 280M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52750K .......... .......... .......... .......... .......... 56% 414M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52800K .......... .......... .......... .......... .......... 56% 404M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52850K .......... .......... .......... .......... .......... 56% 426M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52900K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 52950K .......... .......... .......... .......... .......... 57% 399M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53000K .......... .......... .......... .......... .......... 57% 432M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53050K .......... .......... .......... .......... .......... 57% 413M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53100K .......... .......... .......... .......... .......... 57% 83.1M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53150K .......... .......... .......... .......... .......... 57% 177M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53200K .......... .......... .......... .......... .......... 57% 167M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53250K .......... .......... .......... .......... .......... 57% 381M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53300K .......... .......... .......... .......... .......... 57% 244M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53350K .......... .......... .......... .......... .......... 57% 204M 0s 2024-09-22T08:45:37.534 INFO:teuthology.orchestra.run.smithi078.stderr: 53400K .......... .......... .......... .......... .......... 57% 227M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53450K .......... .......... .......... .......... .......... 57% 404M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53500K .......... .......... .......... .......... .......... 57% 142M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53550K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53600K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53650K .......... .......... .......... .......... .......... 57% 336M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53700K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53750K .......... .......... .......... .......... .......... 57% 226M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53800K .......... .......... .......... .......... .......... 57% 378M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53850K .......... .......... .......... .......... .......... 58% 388M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53900K .......... .......... .......... .......... .......... 58% 339M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 53950K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 54000K .......... .......... .......... .......... .......... 58% 202M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 54050K .......... .......... .......... .......... .......... 58% 164M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 54100K .......... .......... .......... .......... .......... 58% 78.8M 0s 2024-09-22T08:45:37.535 INFO:teuthology.orchestra.run.smithi078.stderr: 54150K .......... .......... .......... .......... .......... 58% 240M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54200K .......... .......... .......... .......... .......... 58% 396M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54250K .......... .......... .......... .......... .......... 58% 82.1M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54300K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54350K .......... .......... .......... .......... .......... 58% 110M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54400K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54450K .......... .......... .......... .......... .......... 58% 368M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54500K .......... .......... .......... .......... .......... 58% 307M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54550K .......... .......... .......... .......... .......... 58% 307M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54600K .......... .......... .......... .......... .......... 58% 404M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54650K .......... .......... .......... .......... .......... 58% 422M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54700K .......... .......... .......... .......... .......... 58% 261M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54750K .......... .......... .......... .......... .......... 58% 382M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54800K .......... .......... .......... .......... .......... 59% 168M 0s 2024-09-22T08:45:37.536 INFO:teuthology.orchestra.run.smithi078.stderr: 54850K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 54900K .......... .......... .......... .......... .......... 59% 361M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 54950K .......... .......... .......... .......... .......... 59% 403M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55000K .......... .......... .......... .......... .......... 59% 234M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55050K .......... .......... .......... .......... .......... 59% 417M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55100K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55150K .......... .......... .......... .......... .......... 59% 447M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55200K .......... .......... .......... .......... .......... 59% 381M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55250K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55300K .......... .......... .......... .......... .......... 59% 263M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55350K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55400K .......... .......... .......... .......... .......... 59% 398M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55450K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55500K .......... .......... .......... .......... .......... 59% 367M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55550K .......... .......... .......... .......... .......... 59% 316M 0s 2024-09-22T08:45:37.537 INFO:teuthology.orchestra.run.smithi078.stderr: 55600K .......... .......... .......... .......... .......... 59% 361M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55650K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55700K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55750K .......... .......... .......... .......... .......... 60% 305M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55800K .......... .......... .......... .......... .......... 60% 393M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55850K .......... .......... .......... .......... .......... 60% 109M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55900K .......... .......... .......... .......... .......... 60% 266M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 55950K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56000K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56050K .......... .......... .......... .......... .......... 60% 398M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56100K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56150K .......... .......... .......... .......... .......... 60% 401M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56200K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56250K .......... .......... .......... .......... .......... 60% 419M 0s 2024-09-22T08:45:37.538 INFO:teuthology.orchestra.run.smithi078.stderr: 56300K .......... .......... .......... .......... .......... 60% 50.1M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56350K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56400K .......... .......... .......... .......... .......... 60% 382M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56450K .......... .......... .......... .......... .......... 60% 399M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56500K .......... .......... .......... .......... .......... 60% 360M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56550K .......... .......... .......... .......... .......... 60% 433M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56600K .......... .......... .......... .......... .......... 60% 63.4M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56650K .......... .......... .......... .......... .......... 61% 268M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56700K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56750K .......... .......... .......... .......... .......... 61% 371M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56800K .......... .......... .......... .......... .......... 61% 375M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56850K .......... .......... .......... .......... .......... 61% 399M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56900K .......... .......... .......... .......... .......... 61% 366M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 56950K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 57000K .......... .......... .......... .......... .......... 61% 449M 0s 2024-09-22T08:45:37.539 INFO:teuthology.orchestra.run.smithi078.stderr: 57050K .......... .......... .......... .......... .......... 61% 405M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57100K .......... .......... .......... .......... .......... 61% 349M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57150K .......... .......... .......... .......... .......... 61% 234M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57200K .......... .......... .......... .......... .......... 61% 369M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57250K .......... .......... .......... .......... .......... 61% 58.6M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57300K .......... .......... .......... .......... .......... 61% 228M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57350K .......... .......... .......... .......... .......... 61% 113M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57400K .......... .......... .......... .......... .......... 61% 320M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57450K .......... .......... .......... .......... .......... 61% 437M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57500K .......... .......... .......... .......... .......... 61% 105M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57550K .......... .......... .......... .......... .......... 62% 341M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57600K .......... .......... .......... .......... .......... 62% 405M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57650K .......... .......... .......... .......... .......... 62% 372M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57700K .......... .......... .......... .......... .......... 62% 369M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57750K .......... .......... .......... .......... .......... 62% 378M 0s 2024-09-22T08:45:37.540 INFO:teuthology.orchestra.run.smithi078.stderr: 57800K .......... .......... .......... .......... .......... 62% 408M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 57850K .......... .......... .......... .......... .......... 62% 411M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 57900K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 57950K .......... .......... .......... .......... .......... 62% 223M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58000K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58050K .......... .......... .......... .......... .......... 62% 383M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58100K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58150K .......... .......... .......... .......... .......... 62% 442M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58200K .......... .......... .......... .......... .......... 62% 378M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58250K .......... .......... .......... .......... .......... 62% 412M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58300K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58350K .......... .......... .......... .......... .......... 62% 228M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58400K .......... .......... .......... .......... .......... 62% 355M 0s 2024-09-22T08:45:37.541 INFO:teuthology.orchestra.run.smithi078.stderr: 58450K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58500K .......... .......... .......... .......... .......... 63% 331M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58550K .......... .......... .......... .......... .......... 63% 384M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58600K .......... .......... .......... .......... .......... 63% 384M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58650K .......... .......... .......... .......... .......... 63% 367M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58700K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58750K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58800K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58850K .......... .......... .......... .......... .......... 63% 448M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58900K .......... .......... .......... .......... .......... 63% 119M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 58950K .......... .......... .......... .......... .......... 63% 277M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 59000K .......... .......... .......... .......... .......... 63% 328M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 59050K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 59100K .......... .......... .......... .......... .......... 63% 372M 0s 2024-09-22T08:45:37.542 INFO:teuthology.orchestra.run.smithi078.stderr: 59150K .......... .......... .......... .......... .......... 63% 380M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59200K .......... .......... .......... .......... .......... 63% 394M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59250K .......... .......... .......... .......... .......... 63% 401M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59300K .......... .......... .......... .......... .......... 63% 413M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59350K .......... .......... .......... .......... .......... 63% 56.0M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59400K .......... .......... .......... .......... .......... 63% 126M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59450K .......... .......... .......... .......... .......... 64% 289M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59500K .......... .......... .......... .......... .......... 64% 392M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59550K .......... .......... .......... .......... .......... 64% 455M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59600K .......... .......... .......... .......... .......... 64% 84.3M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59650K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59700K .......... .......... .......... .......... .......... 64% 112M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59750K .......... .......... .......... .......... .......... 64% 330M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59800K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-22T08:45:37.543 INFO:teuthology.orchestra.run.smithi078.stderr: 59850K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 59900K .......... .......... .......... .......... .......... 64% 338M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 59950K .......... .......... .......... .......... .......... 64% 452M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60000K .......... .......... .......... .......... .......... 64% 453M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60050K .......... .......... .......... .......... .......... 64% 127M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60100K .......... .......... .......... .......... .......... 64% 256M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60150K .......... .......... .......... .......... .......... 64% 363M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60200K .......... .......... .......... .......... .......... 64% 439M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60250K .......... .......... .......... .......... .......... 64% 455M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60300K .......... .......... .......... .......... .......... 64% 210M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60350K .......... .......... .......... .......... .......... 65% 162M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60400K .......... .......... .......... .......... .......... 65% 98.9M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60450K .......... .......... .......... .......... .......... 65% 384M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60500K .......... .......... .......... .......... .......... 65% 277M 0s 2024-09-22T08:45:37.544 INFO:teuthology.orchestra.run.smithi078.stderr: 60550K .......... .......... .......... .......... .......... 65% 121M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60600K .......... .......... .......... .......... .......... 65% 280M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60650K .......... .......... .......... .......... .......... 65% 189M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60700K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60750K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60800K .......... .......... .......... .......... .......... 65% 385M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60850K .......... .......... .......... .......... .......... 65% 383M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60900K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 60950K .......... .......... .......... .......... .......... 65% 384M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61000K .......... .......... .......... .......... .......... 65% 378M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61050K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61100K .......... .......... .......... .......... .......... 65% 316M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61150K .......... .......... .......... .......... .......... 65% 437M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61200K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61250K .......... .......... .......... .......... .......... 65% 370M 0s 2024-09-22T08:45:37.545 INFO:teuthology.orchestra.run.smithi078.stderr: 61300K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61350K .......... .......... .......... .......... .......... 66% 250M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61400K .......... .......... .......... .......... .......... 66% 277M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61450K .......... .......... .......... .......... .......... 66% 391M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61500K .......... .......... .......... .......... .......... 66% 449M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61550K .......... .......... .......... .......... .......... 66% 416M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61600K .......... .......... .......... .......... .......... 66% 272M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61650K .......... .......... .......... .......... .......... 66% 436M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61700K .......... .......... .......... .......... .......... 66% 414M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61750K .......... .......... .......... .......... .......... 66% 428M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61800K .......... .......... .......... .......... .......... 66% 393M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61850K .......... .......... .......... .......... .......... 66% 433M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61900K .......... .......... .......... .......... .......... 66% 388M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 61950K .......... .......... .......... .......... .......... 66% 272M 0s 2024-09-22T08:45:37.546 INFO:teuthology.orchestra.run.smithi078.stderr: 62000K .......... .......... .......... .......... .......... 66% 98.4M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62050K .......... .......... .......... .......... .......... 66% 379M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62100K .......... .......... .......... .......... .......... 66% 413M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62150K .......... .......... .......... .......... .......... 66% 433M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62200K .......... .......... .......... .......... .......... 67% 408M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62250K .......... .......... .......... .......... .......... 67% 423M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62300K .......... .......... .......... .......... .......... 67% 433M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62350K .......... .......... .......... .......... .......... 67% 500M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62400K .......... .......... .......... .......... .......... 67% 62.1M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62450K .......... .......... .......... .......... .......... 67% 146M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62500K .......... .......... .......... .......... .......... 67% 264M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62550K .......... .......... .......... .......... .......... 67% 371M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62600K .......... .......... .......... .......... .......... 67% 69.6M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62650K .......... .......... .......... .......... .......... 67% 258M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62700K .......... .......... .......... .......... .......... 67% 382M 0s 2024-09-22T08:45:37.547 INFO:teuthology.orchestra.run.smithi078.stderr: 62750K .......... .......... .......... .......... .......... 67% 154M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 62800K .......... .......... .......... .......... .......... 67% 99.7M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 62850K .......... .......... .......... .......... .......... 67% 220M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 62900K .......... .......... .......... .......... .......... 67% 436M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 62950K .......... .......... .......... .......... .......... 67% 519M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63000K .......... .......... .......... .......... .......... 67% 386M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63050K .......... .......... .......... .......... .......... 67% 411M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63100K .......... .......... .......... .......... .......... 67% 499M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63150K .......... .......... .......... .......... .......... 68% 167M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63200K .......... .......... .......... .......... .......... 68% 338M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63250K .......... .......... .......... .......... .......... 68% 220M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63300K .......... .......... .......... .......... .......... 68% 406M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63350K .......... .......... .......... .......... .......... 68% 495M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63400K .......... .......... .......... .......... .......... 68% 381M 0s 2024-09-22T08:45:37.548 INFO:teuthology.orchestra.run.smithi078.stderr: 63450K .......... .......... .......... .......... .......... 68% 112M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63500K .......... .......... .......... .......... .......... 68% 435M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63550K .......... .......... .......... .......... .......... 68% 214M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63600K .......... .......... .......... .......... .......... 68% 196M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63650K .......... .......... .......... .......... .......... 68% 129M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63700K .......... .......... .......... .......... .......... 68% 250M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63750K .......... .......... .......... .......... .......... 68% 359M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63800K .......... .......... .......... .......... .......... 68% 162M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63850K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63900K .......... .......... .......... .......... .......... 68% 389M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 63950K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 64000K .......... .......... .......... .......... .......... 68% 347M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 64050K .......... .......... .......... .......... .......... 68% 500M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 64100K .......... .......... .......... .......... .......... 69% 195M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 64150K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-22T08:45:37.549 INFO:teuthology.orchestra.run.smithi078.stderr: 64200K .......... .......... .......... .......... .......... 69% 392M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64250K .......... .......... .......... .......... .......... 69% 398M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64300K .......... .......... .......... .......... .......... 69% 484M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64350K .......... .......... .......... .......... .......... 69% 322M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64400K .......... .......... .......... .......... .......... 69% 284M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64450K .......... .......... .......... .......... .......... 69% 441M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64500K .......... .......... .......... .......... .......... 69% 334M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64550K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64600K .......... .......... .......... .......... .......... 69% 319M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64650K .......... .......... .......... .......... .......... 69% 355M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64700K .......... .......... .......... .......... .......... 69% 444M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64750K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64800K .......... .......... .......... .......... .......... 69% 336M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64850K .......... .......... .......... .......... .......... 69% 367M 0s 2024-09-22T08:45:37.550 INFO:teuthology.orchestra.run.smithi078.stderr: 64900K .......... .......... .......... .......... .......... 69% 355M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 64950K .......... .......... .......... .......... .......... 69% 401M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65000K .......... .......... .......... .......... .......... 70% 412M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65050K .......... .......... .......... .......... .......... 70% 83.8M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65100K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65150K .......... .......... .......... .......... .......... 70% 284M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65200K .......... .......... .......... .......... .......... 70% 420M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65250K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65300K .......... .......... .......... .......... .......... 70% 382M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65350K .......... .......... .......... .......... .......... 70% 469M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65400K .......... .......... .......... .......... .......... 70% 135M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65450K .......... .......... .......... .......... .......... 70% 164M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65500K .......... .......... .......... .......... .......... 70% 148M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65550K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65600K .......... .......... .......... .......... .......... 70% 409M 0s 2024-09-22T08:45:37.551 INFO:teuthology.orchestra.run.smithi078.stderr: 65650K .......... .......... .......... .......... .......... 70% 65.3M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65700K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65750K .......... .......... .......... .......... .......... 70% 363M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65800K .......... .......... .......... .......... .......... 70% 195M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65850K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65900K .......... .......... .......... .......... .......... 70% 98.1M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 65950K .......... .......... .......... .......... .......... 71% 220M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66000K .......... .......... .......... .......... .......... 71% 363M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66050K .......... .......... .......... .......... .......... 71% 383M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66100K .......... .......... .......... .......... .......... 71% 361M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66150K .......... .......... .......... .......... .......... 71% 192M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66200K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66250K .......... .......... .......... .......... .......... 71% 411M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66300K .......... .......... .......... .......... .......... 71% 279M 0s 2024-09-22T08:45:37.552 INFO:teuthology.orchestra.run.smithi078.stderr: 66350K .......... .......... .......... .......... .......... 71% 356M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66400K .......... .......... .......... .......... .......... 71% 385M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66450K .......... .......... .......... .......... .......... 71% 399M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66500K .......... .......... .......... .......... .......... 71% 113M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66550K .......... .......... .......... .......... .......... 71% 396M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66600K .......... .......... .......... .......... .......... 71% 179M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66650K .......... .......... .......... .......... .......... 71% 342M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66700K .......... .......... .......... .......... .......... 71% 214M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66750K .......... .......... .......... .......... .......... 71% 131M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66800K .......... .......... .......... .......... .......... 71% 382M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66850K .......... .......... .......... .......... .......... 72% 233M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66900K .......... .......... .......... .......... .......... 72% 71.2M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 66950K .......... .......... .......... .......... .......... 72% 328M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 67000K .......... .......... .......... .......... .......... 72% 369M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 67050K .......... .......... .......... .......... .......... 72% 369M 0s 2024-09-22T08:45:37.553 INFO:teuthology.orchestra.run.smithi078.stderr: 67100K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67150K .......... .......... .......... .......... .......... 72% 400M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67200K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67250K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67300K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67350K .......... .......... .......... .......... .......... 72% 359M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67400K .......... .......... .......... .......... .......... 72% 390M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67450K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67500K .......... .......... .......... .......... .......... 72% 363M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67550K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67600K .......... .......... .......... .......... .......... 72% 405M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67650K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67700K .......... .......... .......... .......... .......... 72% 356M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67750K .......... .......... .......... .......... .......... 72% 453M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67800K .......... .......... .......... .......... .......... 73% 409M 0s 2024-09-22T08:45:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 67850K .......... .......... .......... .......... .......... 73% 362M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 67900K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 67950K .......... .......... .......... .......... .......... 73% 450M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68000K .......... .......... .......... .......... .......... 73% 425M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68050K .......... .......... .......... .......... .......... 73% 92.1M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68100K .......... .......... .......... .......... .......... 73% 235M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68150K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68200K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68250K .......... .......... .......... .......... .......... 73% 418M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68300K .......... .......... .......... .......... .......... 73% 379M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68350K .......... .......... .......... .......... .......... 73% 264M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68400K .......... .......... .......... .......... .......... 73% 367M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68450K .......... .......... .......... .......... .......... 73% 394M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68500K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68550K .......... .......... .......... .......... .......... 73% 132M 0s 2024-09-22T08:45:37.555 INFO:teuthology.orchestra.run.smithi078.stderr: 68600K .......... .......... .......... .......... .......... 73% 263M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68650K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68700K .......... .......... .......... .......... .......... 74% 82.8M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68750K .......... .......... .......... .......... .......... 74% 208M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68800K .......... .......... .......... .......... .......... 74% 368M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68850K .......... .......... .......... .......... .......... 74% 134M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68900K .......... .......... .......... .......... .......... 74% 353M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 68950K .......... .......... .......... .......... .......... 74% 204M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69000K .......... .......... .......... .......... .......... 74% 131M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69050K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69100K .......... .......... .......... .......... .......... 74% 204M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69150K .......... .......... .......... .......... .......... 74% 421M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69200K .......... .......... .......... .......... .......... 74% 200M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69250K .......... .......... .......... .......... .......... 74% 249M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69300K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-22T08:45:37.556 INFO:teuthology.orchestra.run.smithi078.stderr: 69350K .......... .......... .......... .......... .......... 74% 378M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69400K .......... .......... .......... .......... .......... 74% 413M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69450K .......... .......... .......... .......... .......... 74% 251M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69500K .......... .......... .......... .......... .......... 74% 183M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69550K .......... .......... .......... .......... .......... 74% 390M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69600K .......... .......... .......... .......... .......... 74% 405M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69650K .......... .......... .......... .......... .......... 75% 189M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69700K .......... .......... .......... .......... .......... 75% 265M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69750K .......... .......... .......... .......... .......... 75% 226M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69800K .......... .......... .......... .......... .......... 75% 428M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69850K .......... .......... .......... .......... .......... 75% 153M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69900K .......... .......... .......... .......... .......... 75% 290M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 69950K .......... .......... .......... .......... .......... 75% 63.1M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 70000K .......... .......... .......... .......... .......... 75% 117M 0s 2024-09-22T08:45:37.557 INFO:teuthology.orchestra.run.smithi078.stderr: 70050K .......... .......... .......... .......... .......... 75% 393M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70100K .......... .......... .......... .......... .......... 75% 224M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70150K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70200K .......... .......... .......... .......... .......... 75% 397M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70250K .......... .......... .......... .......... .......... 75% 398M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70300K .......... .......... .......... .......... .......... 75% 341M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70350K .......... .......... .......... .......... .......... 75% 406M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70400K .......... .......... .......... .......... .......... 75% 365M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70450K .......... .......... .......... .......... .......... 75% 364M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70500K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70550K .......... .......... .......... .......... .......... 75% 402M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70600K .......... .......... .......... .......... .......... 76% 357M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70650K .......... .......... .......... .......... .......... 76% 413M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70700K .......... .......... .......... .......... .......... 76% 365M 0s 2024-09-22T08:45:37.558 INFO:teuthology.orchestra.run.smithi078.stderr: 70750K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 70800K .......... .......... .......... .......... .......... 76% 392M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 70850K .......... .......... .......... .......... .......... 76% 378M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 70900K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 70950K .......... .......... .......... .......... .......... 76% 446M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71000K .......... .......... .......... .......... .......... 76% 452M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71050K .......... .......... .......... .......... .......... 76% 165M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71100K .......... .......... .......... .......... .......... 76% 265M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71150K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71200K .......... .......... .......... .......... .......... 76% 287M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71250K .......... .......... .......... .......... .......... 76% 346M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71300K .......... .......... .......... .......... .......... 76% 369M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71350K .......... .......... .......... .......... .......... 76% 213M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71400K .......... .......... .......... .......... .......... 76% 386M 0s 2024-09-22T08:45:37.559 INFO:teuthology.orchestra.run.smithi078.stderr: 71450K .......... .......... .......... .......... .......... 76% 387M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71500K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71550K .......... .......... .......... .......... .......... 77% 192M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71600K .......... .......... .......... .......... .......... 77% 396M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71650K .......... .......... .......... .......... .......... 77% 222M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71700K .......... .......... .......... .......... .......... 77% 304M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71750K .......... .......... .......... .......... .......... 77% 87.4M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71800K .......... .......... .......... .......... .......... 77% 360M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71850K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71900K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 71950K .......... .......... .......... .......... .......... 77% 180M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 72000K .......... .......... .......... .......... .......... 77% 112M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 72050K .......... .......... .......... .......... .......... 77% 165M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 72100K .......... .......... .......... .......... .......... 77% 308M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 72150K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-22T08:45:37.560 INFO:teuthology.orchestra.run.smithi078.stderr: 72200K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72250K .......... .......... .......... .......... .......... 77% 371M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72300K .......... .......... .......... .......... .......... 77% 183M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72350K .......... .......... .......... .......... .......... 77% 142M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72400K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72450K .......... .......... .......... .......... .......... 78% 237M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72500K .......... .......... .......... .......... .......... 78% 390M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72550K .......... .......... .......... .......... .......... 78% 265M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72600K .......... .......... .......... .......... .......... 78% 374M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72650K .......... .......... .......... .......... .......... 78% 300M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72700K .......... .......... .......... .......... .......... 78% 382M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72750K .......... .......... .......... .......... .......... 78% 280M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72800K .......... .......... .......... .......... .......... 78% 259M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72850K .......... .......... .......... .......... .......... 78% 323M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72900K .......... .......... .......... .......... .......... 78% 94.2M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 72950K .......... .......... .......... .......... .......... 78% 318M 0s 2024-09-22T08:45:37.561 INFO:teuthology.orchestra.run.smithi078.stderr: 73000K .......... .......... .......... .......... .......... 78% 89.1M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73050K .......... .......... .......... .......... .......... 78% 314M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73100K .......... .......... .......... .......... .......... 78% 93.7M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73150K .......... .......... .......... .......... .......... 78% 318M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73200K .......... .......... .......... .......... .......... 78% 157M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73250K .......... .......... .......... .......... .......... 78% 379M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73300K .......... .......... .......... .......... .......... 78% 348M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73350K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73400K .......... .......... .......... .......... .......... 79% 234M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73450K .......... .......... .......... .......... .......... 79% 362M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73500K .......... .......... .......... .......... .......... 79% 376M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73550K .......... .......... .......... .......... .......... 79% 257M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73600K .......... .......... .......... .......... .......... 79% 379M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73650K .......... .......... .......... .......... .......... 79% 339M 0s 2024-09-22T08:45:37.562 INFO:teuthology.orchestra.run.smithi078.stderr: 73700K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 73750K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 73800K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 73850K .......... .......... .......... .......... .......... 79% 371M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 73900K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 73950K .......... .......... .......... .......... .......... 79% 311M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74000K .......... .......... .......... .......... .......... 79% 370M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74050K .......... .......... .......... .......... .......... 79% 412M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74100K .......... .......... .......... .......... .......... 79% 375M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74150K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74200K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74250K .......... .......... .......... .......... .......... 79% 342M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74300K .......... .......... .......... .......... .......... 80% 368M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74350K .......... .......... .......... .......... .......... 80% 267M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74400K .......... .......... .......... .......... .......... 80% 354M 0s 2024-09-22T08:45:37.563 INFO:teuthology.orchestra.run.smithi078.stderr: 74450K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74500K .......... .......... .......... .......... .......... 80% 372M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74550K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74600K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74650K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74700K .......... .......... .......... .......... .......... 80% 336M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74750K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74800K .......... .......... .......... .......... .......... 80% 127M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74850K .......... .......... .......... .......... .......... 80% 192M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74900K .......... .......... .......... .......... .......... 80% 329M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 74950K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 75000K .......... .......... .......... .......... .......... 80% 372M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 75050K .......... .......... .......... .......... .......... 80% 81.3M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 75100K .......... .......... .......... .......... .......... 80% 168M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 75150K .......... .......... .......... .......... .......... 80% 178M 0s 2024-09-22T08:45:37.564 INFO:teuthology.orchestra.run.smithi078.stderr: 75200K .......... .......... .......... .......... .......... 81% 382M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75250K .......... .......... .......... .......... .......... 81% 270M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75300K .......... .......... .......... .......... .......... 81% 400M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75350K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75400K .......... .......... .......... .......... .......... 81% 398M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75450K .......... .......... .......... .......... .......... 81% 103M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75500K .......... .......... .......... .......... .......... 81% 213M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75550K .......... .......... .......... .......... .......... 81% 221M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75600K .......... .......... .......... .......... .......... 81% 398M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75650K .......... .......... .......... .......... .......... 81% 387M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75700K .......... .......... .......... .......... .......... 81% 384M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75750K .......... .......... .......... .......... .......... 81% 266M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75800K .......... .......... .......... .......... .......... 81% 385M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75850K .......... .......... .......... .......... .......... 81% 310M 0s 2024-09-22T08:45:37.565 INFO:teuthology.orchestra.run.smithi078.stderr: 75900K .......... .......... .......... .......... .......... 81% 188M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 75950K .......... .......... .......... .......... .......... 81% 127M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76000K .......... .......... .......... .......... .......... 81% 275M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76050K .......... .......... .......... .......... .......... 81% 144M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76100K .......... .......... .......... .......... .......... 81% 376M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76150K .......... .......... .......... .......... .......... 82% 60.3M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76200K .......... .......... .......... .......... .......... 82% 364M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76250K .......... .......... .......... .......... .......... 82% 370M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76300K .......... .......... .......... .......... .......... 82% 229M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76350K .......... .......... .......... .......... .......... 82% 269M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76400K .......... .......... .......... .......... .......... 82% 406M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76450K .......... .......... .......... .......... .......... 82% 303M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76500K .......... .......... .......... .......... .......... 82% 335M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76550K .......... .......... .......... .......... .......... 82% 307M 0s 2024-09-22T08:45:37.566 INFO:teuthology.orchestra.run.smithi078.stderr: 76600K .......... .......... .......... .......... .......... 82% 371M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76650K .......... .......... .......... .......... .......... 82% 404M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76700K .......... .......... .......... .......... .......... 82% 174M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76750K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76800K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76850K .......... .......... .......... .......... .......... 82% 348M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76900K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 76950K .......... .......... .......... .......... .......... 82% 290M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77000K .......... .......... .......... .......... .......... 82% 295M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77050K .......... .......... .......... .......... .......... 82% 305M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77100K .......... .......... .......... .......... .......... 83% 384M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77150K .......... .......... .......... .......... .......... 83% 285M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77200K .......... .......... .......... .......... .......... 83% 392M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77250K .......... .......... .......... .......... .......... 83% 351M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77300K .......... .......... .......... .......... .......... 83% 327M 0s 2024-09-22T08:45:37.567 INFO:teuthology.orchestra.run.smithi078.stderr: 77350K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77400K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77450K .......... .......... .......... .......... .......... 83% 364M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77500K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77550K .......... .......... .......... .......... .......... 83% 250M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77600K .......... .......... .......... .......... .......... 83% 351M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77650K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77700K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77750K .......... .......... .......... .......... .......... 83% 316M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77800K .......... .......... .......... .......... .......... 83% 408M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77850K .......... .......... .......... .......... .......... 83% 385M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77900K .......... .......... .......... .......... .......... 83% 234M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 77950K .......... .......... .......... .......... .......... 83% 182M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 78000K .......... .......... .......... .......... .......... 84% 385M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 78050K .......... .......... .......... .......... .......... 84% 333M 0s 2024-09-22T08:45:37.568 INFO:teuthology.orchestra.run.smithi078.stderr: 78100K .......... .......... .......... .......... .......... 84% 107M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78150K .......... .......... .......... .......... .......... 84% 158M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78200K .......... .......... .......... .......... .......... 84% 399M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78250K .......... .......... .......... .......... .......... 84% 230M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78300K .......... .......... .......... .......... .......... 84% 263M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78350K .......... .......... .......... .......... .......... 84% 297M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78400K .......... .......... .......... .......... .......... 84% 202M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78450K .......... .......... .......... .......... .......... 84% 409M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78500K .......... .......... .......... .......... .......... 84% 139M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78550K .......... .......... .......... .......... .......... 84% 254M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78600K .......... .......... .......... .......... .......... 84% 153M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78650K .......... .......... .......... .......... .......... 84% 382M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78700K .......... .......... .......... .......... .......... 84% 301M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78750K .......... .......... .......... .......... .......... 84% 159M 0s 2024-09-22T08:45:37.569 INFO:teuthology.orchestra.run.smithi078.stderr: 78800K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 78850K .......... .......... .......... .......... .......... 84% 378M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 78900K .......... .......... .......... .......... .......... 84% 298M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 78950K .......... .......... .......... .......... .......... 85% 352M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79000K .......... .......... .......... .......... .......... 85% 163M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79050K .......... .......... .......... .......... .......... 85% 246M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79100K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79150K .......... .......... .......... .......... .......... 85% 47.7M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79200K .......... .......... .......... .......... .......... 85% 262M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79250K .......... .......... .......... .......... .......... 85% 379M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79300K .......... .......... .......... .......... .......... 85% 286M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79350K .......... .......... .......... .......... .......... 85% 336M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79400K .......... .......... .......... .......... .......... 85% 387M 0s 2024-09-22T08:45:37.570 INFO:teuthology.orchestra.run.smithi078.stderr: 79450K .......... .......... .......... .......... .......... 85% 352M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79500K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79550K .......... .......... .......... .......... .......... 85% 274M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79600K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79650K .......... .......... .......... .......... .......... 85% 299M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79700K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79750K .......... .......... .......... .......... .......... 85% 248M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79800K .......... .......... .......... .......... .......... 85% 144M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79850K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79900K .......... .......... .......... .......... .......... 86% 375M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 79950K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 80000K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 80050K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 80100K .......... .......... .......... .......... .......... 86% 278M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 80150K .......... .......... .......... .......... .......... 86% 287M 0s 2024-09-22T08:45:37.571 INFO:teuthology.orchestra.run.smithi078.stderr: 80200K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80250K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80300K .......... .......... .......... .......... .......... 86% 393M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80350K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80400K .......... .......... .......... .......... .......... 86% 393M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80450K .......... .......... .......... .......... .......... 86% 370M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80500K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80550K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80600K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80650K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80700K .......... .......... .......... .......... .......... 86% 367M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80750K .......... .......... .......... .......... .......... 86% 269M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80800K .......... .......... .......... .......... .......... 87% 382M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80850K .......... .......... .......... .......... .......... 87% 215M 0s 2024-09-22T08:45:37.572 INFO:teuthology.orchestra.run.smithi078.stderr: 80900K .......... .......... .......... .......... .......... 87% 327M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 80950K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81000K .......... .......... .......... .......... .......... 87% 402M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81050K .......... .......... .......... .......... .......... 87% 195M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81100K .......... .......... .......... .......... .......... 87% 197M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81150K .......... .......... .......... .......... .......... 87% 243M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81200K .......... .......... .......... .......... .......... 87% 158M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81250K .......... .......... .......... .......... .......... 87% 386M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81300K .......... .......... .......... .......... .......... 87% 141M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81350K .......... .......... .......... .......... .......... 87% 351M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81400K .......... .......... .......... .......... .......... 87% 147M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81450K .......... .......... .......... .......... .......... 87% 411M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81500K .......... .......... .......... .......... .......... 87% 279M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81550K .......... .......... .......... .......... .......... 87% 233M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81600K .......... .......... .......... .......... .......... 87% 215M 0s 2024-09-22T08:45:37.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81650K .......... .......... .......... .......... .......... 87% 174M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81700K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81750K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81800K .......... .......... .......... .......... .......... 88% 188M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81850K .......... .......... .......... .......... .......... 88% 207M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81900K .......... .......... .......... .......... .......... 88% 163M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 81950K .......... .......... .......... .......... .......... 88% 280M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82000K .......... .......... .......... .......... .......... 88% 240M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82050K .......... .......... .......... .......... .......... 88% 347M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82100K .......... .......... .......... .......... .......... 88% 249M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82150K .......... .......... .......... .......... .......... 88% 351M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82200K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82250K .......... .......... .......... .......... .......... 88% 57.7M 0s 2024-09-22T08:45:37.574 INFO:teuthology.orchestra.run.smithi078.stderr: 82300K .......... .......... .......... .......... .......... 88% 146M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82350K .......... .......... .......... .......... .......... 88% 171M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82400K .......... .......... .......... .......... .......... 88% 338M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82450K .......... .......... .......... .......... .......... 88% 357M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82500K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82550K .......... .......... .......... .......... .......... 88% 318M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82600K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82650K .......... .......... .......... .......... .......... 89% 353M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82700K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82750K .......... .......... .......... .......... .......... 89% 245M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82800K .......... .......... .......... .......... .......... 89% 363M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82850K .......... .......... .......... .......... .......... 89% 84.2M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82900K .......... .......... .......... .......... .......... 89% 290M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 82950K .......... .......... .......... .......... .......... 89% 310M 0s 2024-09-22T08:45:37.575 INFO:teuthology.orchestra.run.smithi078.stderr: 83000K .......... .......... .......... .......... .......... 89% 402M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83050K .......... .......... .......... .......... .......... 89% 331M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83100K .......... .......... .......... .......... .......... 89% 391M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83150K .......... .......... .......... .......... .......... 89% 267M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83200K .......... .......... .......... .......... .......... 89% 316M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83250K .......... .......... .......... .......... .......... 89% 342M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83300K .......... .......... .......... .......... .......... 89% 160M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83350K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83400K .......... .......... .......... .......... .......... 89% 401M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83450K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83500K .......... .......... .......... .......... .......... 89% 317M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83550K .......... .......... .......... .......... .......... 89% 310M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83600K .......... .......... .......... .......... .......... 90% 425M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83650K .......... .......... .......... .......... .......... 90% 371M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83700K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-22T08:45:37.576 INFO:teuthology.orchestra.run.smithi078.stderr: 83750K .......... .......... .......... .......... .......... 90% 320M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 83800K .......... .......... .......... .......... .......... 90% 340M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 83850K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 83900K .......... .......... .......... .......... .......... 90% 368M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 83950K .......... .......... .......... .......... .......... 90% 305M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84000K .......... .......... .......... .......... .......... 90% 389M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84050K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84100K .......... .......... .......... .......... .......... 90% 369M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84150K .......... .......... .......... .......... .......... 90% 254M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84200K .......... .......... .......... .......... .......... 90% 375M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84250K .......... .......... .......... .......... .......... 90% 359M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84300K .......... .......... .......... .......... .......... 90% 317M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84350K .......... .......... .......... .......... .......... 90% 147M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84400K .......... .......... .......... .......... .......... 90% 197M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84450K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-22T08:45:37.577 INFO:teuthology.orchestra.run.smithi078.stderr: 84500K .......... .......... .......... .......... .......... 91% 103M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84550K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84600K .......... .......... .......... .......... .......... 91% 382M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84650K .......... .......... .......... .......... .......... 91% 323M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84700K .......... .......... .......... .......... .......... 91% 245M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84750K .......... .......... .......... .......... .......... 91% 126M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84800K .......... .......... .......... .......... .......... 91% 237M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84850K .......... .......... .......... .......... .......... 91% 273M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84900K .......... .......... .......... .......... .......... 91% 327M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 84950K .......... .......... .......... .......... .......... 91% 159M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 85000K .......... .......... .......... .......... .......... 91% 241M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 85050K .......... .......... .......... .......... .......... 91% 310M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 85100K .......... .......... .......... .......... .......... 91% 349M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 85150K .......... .......... .......... .......... .......... 91% 272M 0s 2024-09-22T08:45:37.578 INFO:teuthology.orchestra.run.smithi078.stderr: 85200K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85250K .......... .......... .......... .......... .......... 91% 394M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85300K .......... .......... .......... .......... .......... 91% 64.7M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85350K .......... .......... .......... .......... .......... 91% 141M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85400K .......... .......... .......... .......... .......... 91% 125M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85450K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85500K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85550K .......... .......... .......... .......... .......... 92% 325M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85600K .......... .......... .......... .......... .......... 92% 165M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85650K .......... .......... .......... .......... .......... 92% 282M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85700K .......... .......... .......... .......... .......... 92% 343M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85750K .......... .......... .......... .......... .......... 92% 279M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85800K .......... .......... .......... .......... .......... 92% 363M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85850K .......... .......... .......... .......... .......... 92% 110M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85900K .......... .......... .......... .......... .......... 92% 379M 0s 2024-09-22T08:45:37.579 INFO:teuthology.orchestra.run.smithi078.stderr: 85950K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86000K .......... .......... .......... .......... .......... 92% 340M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86050K .......... .......... .......... .......... .......... 92% 313M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86100K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86150K .......... .......... .......... .......... .......... 92% 288M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86200K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86250K .......... .......... .......... .......... .......... 92% 368M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86300K .......... .......... .......... .......... .......... 92% 194M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86350K .......... .......... .......... .......... .......... 93% 296M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86400K .......... .......... .......... .......... .......... 93% 408M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86450K .......... .......... .......... .......... .......... 93% 131M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86500K .......... .......... .......... .......... .......... 93% 369M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86550K .......... .......... .......... .......... .......... 93% 272M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86600K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-22T08:45:37.580 INFO:teuthology.orchestra.run.smithi078.stderr: 86650K .......... .......... .......... .......... .......... 93% 331M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86700K .......... .......... .......... .......... .......... 93% 362M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86750K .......... .......... .......... .......... .......... 93% 310M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86800K .......... .......... .......... .......... .......... 93% 374M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86850K .......... .......... .......... .......... .......... 93% 341M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86900K .......... .......... .......... .......... .......... 93% 271M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 86950K .......... .......... .......... .......... .......... 93% 266M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87000K .......... .......... .......... .......... .......... 93% 329M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87050K .......... .......... .......... .......... .......... 93% 353M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87100K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87150K .......... .......... .......... .......... .......... 93% 284M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87200K .......... .......... .......... .......... .......... 93% 281M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87250K .......... .......... .......... .......... .......... 93% 407M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87300K .......... .......... .......... .......... .......... 94% 307M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87350K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-22T08:45:37.581 INFO:teuthology.orchestra.run.smithi078.stderr: 87400K .......... .......... .......... .......... .......... 94% 378M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87450K .......... .......... .......... .......... .......... 94% 418M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87500K .......... .......... .......... .......... .......... 94% 427M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87550K .......... .......... .......... .......... .......... 94% 238M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87600K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87650K .......... .......... .......... .......... .......... 94% 197M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87700K .......... .......... .......... .......... .......... 94% 311M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87750K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87800K .......... .......... .......... .......... .......... 94% 408M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87850K .......... .......... .......... .......... .......... 94% 171M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87900K .......... .......... .......... .......... .......... 94% 175M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 87950K .......... .......... .......... .......... .......... 94% 159M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 88000K .......... .......... .......... .......... .......... 94% 257M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 88050K .......... .......... .......... .......... .......... 94% 271M 0s 2024-09-22T08:45:37.582 INFO:teuthology.orchestra.run.smithi078.stderr: 88100K .......... .......... .......... .......... .......... 94% 161M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88150K .......... .......... .......... .......... .......... 94% 260M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88200K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88250K .......... .......... .......... .......... .......... 95% 313M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88300K .......... .......... .......... .......... .......... 95% 77.7M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88350K .......... .......... .......... .......... .......... 95% 246M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88400K .......... .......... .......... .......... .......... 95% 269M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88450K .......... .......... .......... .......... .......... 95% 110M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88500K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88550K .......... .......... .......... .......... .......... 95% 243M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88600K .......... .......... .......... .......... .......... 95% 116M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88650K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88700K .......... .......... .......... .......... .......... 95% 295M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88750K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-22T08:45:37.583 INFO:teuthology.orchestra.run.smithi078.stderr: 88800K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 88850K .......... .......... .......... .......... .......... 95% 157M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 88900K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 88950K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89000K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89050K .......... .......... .......... .......... .......... 95% 293M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89100K .......... .......... .......... .......... .......... 95% 178M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89150K .......... .......... .......... .......... .......... 96% 240M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89200K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89250K .......... .......... .......... .......... .......... 96% 295M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89300K .......... .......... .......... .......... .......... 96% 297M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89350K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89400K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89450K .......... .......... .......... .......... .......... 96% 267M 0s 2024-09-22T08:45:37.584 INFO:teuthology.orchestra.run.smithi078.stderr: 89500K .......... .......... .......... .......... .......... 96% 280M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89550K .......... .......... .......... .......... .......... 96% 120M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89600K .......... .......... .......... .......... .......... 96% 263M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89650K .......... .......... .......... .......... .......... 96% 287M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89700K .......... .......... .......... .......... .......... 96% 276M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89750K .......... .......... .......... .......... .......... 96% 272M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89800K .......... .......... .......... .......... .......... 96% 296M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89850K .......... .......... .......... .......... .......... 96% 307M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89900K .......... .......... .......... .......... .......... 96% 258M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 89950K .......... .......... .......... .......... .......... 96% 226M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 90000K .......... .......... .......... .......... .......... 96% 273M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 90050K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 90100K .......... .......... .......... .......... .......... 97% 294M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 90150K .......... .......... .......... .......... .......... 97% 239M 0s 2024-09-22T08:45:37.585 INFO:teuthology.orchestra.run.smithi078.stderr: 90200K .......... .......... .......... .......... .......... 97% 297M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90250K .......... .......... .......... .......... .......... 97% 253M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90300K .......... .......... .......... .......... .......... 97% 268M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90350K .......... .......... .......... .......... .......... 97% 245M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90400K .......... .......... .......... .......... .......... 97% 307M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90450K .......... .......... .......... .......... .......... 97% 264M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90500K .......... .......... .......... .......... .......... 97% 266M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90550K .......... .......... .......... .......... .......... 97% 275M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90600K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90650K .......... .......... .......... .......... .......... 97% 296M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90700K .......... .......... .......... .......... .......... 97% 268M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90750K .......... .......... .......... .......... .......... 97% 216M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90800K .......... .......... .......... .......... .......... 97% 264M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90850K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-22T08:45:37.586 INFO:teuthology.orchestra.run.smithi078.stderr: 90900K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 90950K .......... .......... .......... .......... .......... 97% 262M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91000K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91050K .......... .......... .......... .......... .......... 98% 267M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91100K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91150K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91200K .......... .......... .......... .......... .......... 98% 305M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91250K .......... .......... .......... .......... .......... 98% 283M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91300K .......... .......... .......... .......... .......... 98% 260M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91350K .......... .......... .......... .......... .......... 98% 239M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91400K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91450K .......... .......... .......... .......... .......... 98% 307M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91500K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91550K .......... .......... .......... .......... .......... 98% 178M 0s 2024-09-22T08:45:37.587 INFO:teuthology.orchestra.run.smithi078.stderr: 91600K .......... .......... .......... .......... .......... 98% 254M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91650K .......... .......... .......... .......... .......... 98% 184M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91700K .......... .......... .......... .......... .......... 98% 261M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91750K .......... .......... .......... .......... .......... 98% 215M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91800K .......... .......... .......... .......... .......... 98% 262M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91850K .......... .......... .......... .......... .......... 98% 147M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91900K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 91950K .......... .......... .......... .......... .......... 99% 159M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92000K .......... .......... .......... .......... .......... 99% 250M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92050K .......... .......... .......... .......... .......... 99% 275M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92100K .......... .......... .......... .......... .......... 99% 225M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92150K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92200K .......... .......... .......... .......... .......... 99% 315M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92250K .......... .......... .......... .......... .......... 99% 255M 0s 2024-09-22T08:45:37.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92300K .......... .......... .......... .......... .......... 99% 270M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92350K .......... .......... .......... .......... .......... 99% 248M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92400K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92450K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92500K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92550K .......... .......... .......... .......... .......... 99% 110M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92600K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92650K .......... .......... .......... .......... .......... 99% 289M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92700K .......... .......... .......... .......... .......... 99% 273M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92750K .......... .......... .......... .......... .......... 99% 237M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92800K .......... .......... .......... .......... .......... 99% 246M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92850K .......... .......... .......... .......... .......... 99% 300M 0s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 92900K 100% 134G=0.4s 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22 08:45:36 (211 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-22T08:45:37.589 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-22T08:45:37.622 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-22T08:45:37.623 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-22T08:45:37.624 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-22T08:45:37.625 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-22T08:45:37.626 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-22T08:45:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-22T08:45:37.628 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-22T08:45:37.629 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-22T08:45:37.630 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-22T08:45:37.631 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-22T08:45:37.632 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-22T08:45:37.633 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-22T08:45:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-22T08:45:37.635 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-22T08:45:37.636 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-22T08:45:37.637 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout:Welcome to Gradle 6.0.1! 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout:Here are the highlights of this release: 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Substantial improvements in dependency management, including 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Advanced control of transitive versions 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for optional features and dependencies 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Rules to tweak published metadata 2024-09-22T08:45:37.638 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for Java 13 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: - Faster incremental Java and Groovy compilation 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: - New Zinc compiler for Scala 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: - VS2019 support 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:------------------------------------------------------------ 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:Gradle 6.0.1 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:------------------------------------------------------------ 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-22T08:45:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout:Kotlin: 1.3.50 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout:Groovy: 2.5.8 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout:OS: Linux 5.14.0-508.el9.x86_64 amd64 2024-09-22T08:45:37.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:37.640 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-22T08:45:37.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T08:45:37.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T08:45:37.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T08:45:37.641 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T08:45:37.641 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-22T08:45:37.845 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-22T08:45:37.845 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-22T08:45:37.845 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'WFXYLZUDNXPCPGZCEGEB', 'access_secret': 'gowp8G+uhNfZJKWcWuPx3wUAiHMkblI07bLCkDG9zOJ/7Oww9FxAwA==', 'region': 'mexico', 'endpoint': 'smithi078.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi078.front.sepia.ceph.com'} 2024-09-22T08:45:37.845 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-22T08:45:37.846 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'WFXYLZUDNXPCPGZCEGEB', '--secret', 'gowp8G+uhNfZJKWcWuPx3wUAiHMkblI07bLCkDG9zOJ/7Oww9FxAwA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-22T08:45:37.846 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key WFXYLZUDNXPCPGZCEGEB --secret gowp8G+uhNfZJKWcWuPx3wUAiHMkblI07bLCkDG9zOJ/7Oww9FxAwA== --email tester.client.0_test@test.test --cluster ceph 2024-09-22T08:45:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:37.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.943+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 20 realm 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.945+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.946+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.946+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.946+0000 7f362732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:37.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.946+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.947+0000 7f362732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:37.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.947+0000 7f362732c800 20 searching for the correct realm 2024-09-22T08:45:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:37.950+0000 7f36238db640 0 -- 172.21.15.78:0/2454821565 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f36180c8b80 msgr2=0x7f36180a5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:38.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.155+0000 7f36228d9640 0 -- 172.21.15.78:0/2454821565 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f361c031060 msgr2=0x7f361c066530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.160+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:38.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:38.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 zone default found 2024-09-22T08:45:38.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 4 Realm: () 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 zonegroup default 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.161+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.162+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.162+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.162+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.162+0000 7f362732c800 20 started sync module instance, tier type = 2024-09-22T08:45:38.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.162+0000 7f362732c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=0 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=1 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=2 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=3 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=4 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=5 2024-09-22T08:45:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.172+0000 7f362732c800 20 add_watcher() i=6 2024-09-22T08:45:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.173+0000 7f362732c800 20 add_watcher() i=7 2024-09-22T08:45:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.173+0000 7f362732c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f34d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 5 note: GC not initialized 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f34d8fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 20 Filter name: none 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f34527fc640 20 reqs_thread_entry: start 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.175+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-22T08:45:38.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:45:38.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-22T08:45:38.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache get: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB : miss 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB info.flags=0x0 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 adding default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB to cache LRU end 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache get: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB : hit (negative entry) 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.176+0000 7f362732c800 10 cache get: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB : hit (negative entry) 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.177+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.177+0000 7f362732c800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:45:38.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.177+0000 7f362732c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T08:45:38.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.178+0000 7f3506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562502 cookie 94405161742640 notifier 8976 bl.length()=670 2024-09-22T08:45:38.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.178+0000 7f3506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T08:45:38.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.178+0000 7f3506ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f362732c800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f362732c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f3506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 94405161734816 notifier 8976 bl.length()=200 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f3506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T08:45:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.181+0000 7f3506ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T08:45:38.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.184+0000 7f362732c800 10 cache put: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB info.flags=0x7 2024-09-22T08:45:38.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.184+0000 7f362732c800 10 moving default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB to cache LRU end 2024-09-22T08:45:38.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.184+0000 7f362732c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:WFXYLZUDNXPCPGZCEGEB, ofs0, ns] 2024-09-22T08:45:38.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.185+0000 7f3506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562547 cookie 94405161737520 notifier 8976 bl.length()=189 2024-09-22T08:45:38.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.185+0000 7f3506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB info.flags=0x7 2024-09-22T08:45:38.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.185+0000 7f3506ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WFXYLZUDNXPCPGZCEGEB to cache LRU end 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "tester.client.0", 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Ms. tester.client.0", 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "tester.client.0_test@test.test", 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:45:38.187 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "tester.client.0", 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "WFXYLZUDNXPCPGZCEGEB", 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "gowp8G+uhNfZJKWcWuPx3wUAiHMkblI07bLCkDG9zOJ/7Oww9FxAwA==", 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:45:38.177653Z" 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:45:38.188 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:45:38.189 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:45:38.177639Z", 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:45:38.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:45:38.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.187+0000 7f34d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:38.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.189+0000 7f362732c800 20 remove_watcher() i=0 2024-09-22T08:45:38.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.189+0000 7f362732c800 2 removed watcher, disabling cache 2024-09-22T08:45:38.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.190+0000 7f362732c800 20 remove_watcher() i=1 2024-09-22T08:45:38.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.192+0000 7f362732c800 20 remove_watcher() i=2 2024-09-22T08:45:38.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.193+0000 7f362732c800 20 remove_watcher() i=3 2024-09-22T08:45:38.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.194+0000 7f362732c800 20 remove_watcher() i=4 2024-09-22T08:45:38.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.195+0000 7f362732c800 20 remove_watcher() i=5 2024-09-22T08:45:38.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.196+0000 7f362732c800 20 remove_watcher() i=6 2024-09-22T08:45:38.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.197+0000 7f362732c800 20 remove_watcher() i=7 2024-09-22T08:45:38.210 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:45:38.210 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-22T08:45:38.240 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-22T08:45:38.240 DEBUG:teuthology.orchestra.run.smithi078:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-22T08:45:38.307 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:45:38.399 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:38.399 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.435+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 20 realm 2024-09-22T08:45:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.437+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.438+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.438+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.438+0000 7f306432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.438+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.439+0000 7f306432e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.439+0000 7f306432e800 20 searching for the correct realm 2024-09-22T08:45:38.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.442+0000 7f3060765640 0 -- 172.21.15.78:0/6289238 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3048065040 msgr2=0x7f3048095920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:45:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.445+0000 7f3057fff640 0 -- 172.21.15.78:0/6289238 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f3058045c60 msgr2=0x7f30580446d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.450+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 zone default found 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 4 Realm: () 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 zonegroup default 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.451+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 rados->read ofs=0 len=0 2024-09-22T08:45:38.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:38.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 started sync module instance, tier type = 2024-09-22T08:45:38.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.452+0000 7f306432e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:38.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=0 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=1 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=2 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=3 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=4 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=5 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.461+0000 7f306432e800 20 add_watcher() i=6 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.462+0000 7f306432e800 20 add_watcher() i=7 2024-09-22T08:45:38.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.462+0000 7f306432e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:38.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.464+0000 7f2f167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:38.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.464+0000 7f306432e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:38.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.464+0000 7f306432e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:38.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.501+0000 7f2f157e2640 20 reqs_thread_entry: start 2024-09-22T08:45:38.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.501+0000 7f306432e800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:38.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.501+0000 7f306432e800 20 Filter name: none 2024-09-22T08:45:38.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.501+0000 7f2f0e7fc640 20 reqs_thread_entry: start 2024-09-22T08:45:38.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.501+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:45:38.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.502+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.503+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18433953105740866593', time=2024-09-22T10:36:40.412802+0000, chain.objs.size()=4 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.1 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.2 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.3 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11__multipart_foo.2~dlFaF0LBDUofkIvL8eiqSTDXwkk0036.4 2024-09-22T08:45:38.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1771364297055243308', time=2024-09-22T10:38:00.670510+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.Nbidrsi5wLppnnUHZwXL6XJgyb7rrj7_0 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10944585665633150040', time=2024-09-22T10:38:38.686921+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.aJ5iYb1owES-quVmWv86Qt1WLyQmmU__0 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3745250507700951725', time=2024-09-22T10:39:12.017647+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.YIIFy12JsrjUb8nCayDgF9GbuGoS3tT_0 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7369454893190670449', time=2024-09-22T10:39:14.949883+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.gsWTmgFu6UQla11dBnbXeiEsxhIn9-I_0 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17931516074234564075', time=2024-09-22T10:39:18.694833+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.b3V17z1d_jDY41Fjt3MoG60u2aqL6OC_0 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8559458570716399595', time=2024-09-22T10:39:52.669068+0000, chain.objs.size()=1 2024-09-22T08:45:38.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.8S8HAR99EcpttIrkaayGsDziAYyRIal_0 2024-09-22T08:45:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7412241243391269508', time=2024-09-22T10:40:28.740625+0000, chain.objs.size()=1 2024-09-22T08:45:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.HOc0V5tQFBSUIVRVjpU9W-lgeENdbX9_0 2024-09-22T08:45:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8687998988468954887', time=2024-09-22T10:41:40.306586+0000, chain.objs.size()=1 2024-09-22T08:45:38.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.504+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.iJsAFvu7RAcdI-IlHA5i5tCgQiHMTmu_0 2024-09-22T08:45:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.508+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9102003413763114366', time=2024-09-22T10:41:43.688252+0000, chain.objs.size()=1 2024-09-22T08:45:38.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.508+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.YttFxh9mHSDDwdpUvRLt9w4e164_cFx_0 2024-09-22T08:45:38.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.510+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16270770281440283041', time=2024-09-22T10:42:17.104499+0000, chain.objs.size()=1 2024-09-22T08:45:38.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.510+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.T6rgiedtmywbP2A7dBs11ro1PrvkSDh_0 2024-09-22T08:45:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.512+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.514+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:45:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.515+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6797888531450290566', time=2024-09-22T10:36:40.732336+0000, chain.objs.size()=1 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.wjumyeMRsWIR1wQiNXbv95XGkOqV05Y_0 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7740181179942957992', time=2024-09-22T10:39:11.949501+0000, chain.objs.size()=1 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.IFKqvrP4dzcs0dQ97MZdLa53NNj3Keo_0 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17962278766968118346', time=2024-09-22T10:39:49.805432+0000, chain.objs.size()=1 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.JrE4YpZVBMLCAP-IuVfH52C_m0uSaRF_0 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1084896797602741082', time=2024-09-22T10:40:28.775140+0000, chain.objs.size()=1 2024-09-22T08:45:38.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.BfNWUEjYa4DxACGLr_PnEtwM6283Hno_0 2024-09-22T08:45:38.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14922792124041293573', time=2024-09-22T10:41:06.613648+0000, chain.objs.size()=1 2024-09-22T08:45:38.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.eAsL31-ELLyNv42FewvqFokx3El3RmO_0 2024-09-22T08:45:38.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12965334343402037581', time=2024-09-22T10:42:22.486619+0000, chain.objs.size()=1 2024-09-22T08:45:38.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.516+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.AWwl65x-uyq7wmbGiYnyAE0dK8D6z15_0 2024-09-22T08:45:38.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.519+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.522+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:45:38.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.523+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-22T08:45:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13683291479523971361', time=2024-09-22T10:38:00.749026+0000, chain.objs.size()=1 2024-09-22T08:45:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.mw1KTNTnoTB12odwIISC71PPz8qHgKN_0 2024-09-22T08:45:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1092074525807268930', time=2024-09-22T10:38:00.749814+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.akvsUzN5SAydsVGyNmI8MeejQ3oro3M_0 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.922262063503647459', time=2024-09-22T10:38:36.730503+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.ur_7fFbCEjiL9dfL3n0Rk4ZQdOBHcGn_0 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11145287366429553325', time=2024-09-22T10:38:38.664400+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.7-h5pivTR1doxHwIXhoFN_plO2a3A6s_0 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.513925211882858597', time=2024-09-22T10:39:12.005794+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.p8RJi8Jr2n-VLLLcJsuR5fSrw7CPM58_0 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16395362517462262096', time=2024-09-22T10:39:14.912886+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.GsNyLWIetHOHzI_JHH0314U1OCAmTTW_0 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13699265882837150074', time=2024-09-22T10:39:52.687825+0000, chain.objs.size()=1 2024-09-22T08:45:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.nfwS3fzi-urKcMbYyaGkneY78UDswGb_0 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16961875046126269203', time=2024-09-22T10:39:52.726930+0000, chain.objs.size()=1 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.xBkv2gWHCFsyxZJSmHO0xPfqVUkyqzJ_0 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6219142957582569812', time=2024-09-22T10:40:28.789689+0000, chain.objs.size()=1 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.LzD90-6F9Lz7xgyFWUYFgs3qMi21FfA_0 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16573233666343827370', time=2024-09-22T10:41:03.139128+0000, chain.objs.size()=1 2024-09-22T08:45:38.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.RgHUDMylLUp3xyHvk8AG2vP_23NLghV_0 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13040225282059338333', time=2024-09-22T10:42:17.087718+0000, chain.objs.size()=1 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.emyquRNGhbObtPJTTlxXQxQb2Cl9q6A_0 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1535140546448547407', time=2024-09-22T10:42:19.806823+0000, chain.objs.size()=1 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.524+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.d21eqI7Rk9FLL6wLvKHTdHSEArDK7d6_0 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.527+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5672900589058152964', time=2024-09-22T10:42:19.807924+0000, chain.objs.size()=1 2024-09-22T08:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.527+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.nvO-ER-69NszVZ4PsE3OTSNKq2lb6dA_0 2024-09-22T08:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.529+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15534959715616202413', time=2024-09-22T10:42:55.922310+0000, chain.objs.size()=1 2024-09-22T08:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.529+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.M1V4fds_GnKMODM4S3clUL4MOUqLMtQ_0 2024-09-22T08:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.530+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3096939635237155558', time=2024-09-22T10:45:15.028015+0000, chain.objs.size()=1 2024-09-22T08:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.530+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:R0m7ebyBOZFz.PQYPk.VyMdaxfaAhPi_.HhQ3AdU1WtIpSYwvS-kIh3sTB3CEptn_0 2024-09-22T08:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.532+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.534+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:45:38.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.535+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18436295146112537858', time=2024-09-22T10:36:40.321200+0000, chain.objs.size()=1 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.kyK0A6Vd_xx8nIJwBvsLhVObRRyRCdG_0 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7081425992712869022', time=2024-09-22T10:38:34.153502+0000, chain.objs.size()=1 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.8Hoo79x9evYwFNLTwk1taanmVNRgtg0_0 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10782319558576832485', time=2024-09-22T10:38:34.156092+0000, chain.objs.size()=1 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.inChv5nP4q2eq35gQXRO5Gyz7l0ItxG_0 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7735912228217200792', time=2024-09-22T10:39:14.942679+0000, chain.objs.size()=1 2024-09-22T08:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.M43hNUvmRjl2cwWHvdhVRqCTgM7Xu9Y_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8013854864531737653', time=2024-09-22T10:39:51.797371+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.AUuvcVnm93XWItdzicg9WXzA3GnlnEV_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12090956190579602749', time=2024-09-22T10:40:25.626562+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.GhTIndp11IgJNjcf17ePZq7Qg5JVp6w_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14968063407146222870', time=2024-09-22T10:40:30.803074+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.RRGstQ0Oa-9FdOLkgzdMdiY34XGezFx_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9898188736459052978', time=2024-09-22T10:40:30.853112+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.tIbIvBqmcBb2zfojTX61w2bk9snK0Yu_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8669774208693457567', time=2024-09-22T10:41:06.609486+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.BE6SZfwD4vS_dPvnZLPgOS8YzyIQo2e_0 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6104549337640332969', time=2024-09-22T10:41:06.610027+0000, chain.objs.size()=1 2024-09-22T08:45:38.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.HFBMbN19rArA6anSIgUC1_tkvDdZK08_0 2024-09-22T08:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13072960267126551335', time=2024-09-22T10:42:19.826998+0000, chain.objs.size()=1 2024-09-22T08:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.536+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.TazKaJpAjXmBNJw3QptS4bInjm6Kyag_0 2024-09-22T08:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.537+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11204971366895617110', time=2024-09-22T10:42:22.422046+0000, chain.objs.size()=1 2024-09-22T08:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.537+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.HNKjJQuBtWFuZhIP4AHZLx9tA6o7XgV_0 2024-09-22T08:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.543+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.545+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:45:38.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.546+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-22T08:45:38.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684714860470176784', time=2024-09-22T10:36:40.495501+0000, chain.objs.size()=1 2024-09-22T08:45:38.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.tIWUKAl9-Myu4RT1bP3xOoXaZ7IoqDX_0 2024-09-22T08:45:38.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1354458018823790459', time=2024-09-22T10:36:40.570810+0000, chain.objs.size()=3 2024-09-22T08:45:38.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.1 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.2 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.3 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6791541784988602845', time=2024-09-22T10:38:36.715045+0000, chain.objs.size()=1 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.I92Gogpb3GdtAgVxfwKSbzwYtLGrcRd_0 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6644841499956726258', time=2024-09-22T10:38:38.714793+0000, chain.objs.size()=1 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.aRFXydLfehFplPJEJ8O2wTQiPMLLtX__0 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4765113445266294750', time=2024-09-22T10:39:49.759803+0000, chain.objs.size()=1 2024-09-22T08:45:38.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.547+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.RcrW588XXZxpY0bRSoJkAe2ANX2DQJi_0 2024-09-22T08:45:38.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7824708298881030887', time=2024-09-22T10:39:49.806698+0000, chain.objs.size()=1 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.fC6Y-rJvXfineTauwVKhMcPW5GuikMW_0 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6874780186757245957', time=2024-09-22T10:39:52.701968+0000, chain.objs.size()=1 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.GbOHtSR7z2IuIzYt9fuu3XJZiUcDPA4_0 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10001314377561495113', time=2024-09-22T10:39:52.703641+0000, chain.objs.size()=1 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.548+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.r66OrgCBpYkSvqwg5IZJmRYESbH3f6E_0 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.549+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13769943513652914503', time=2024-09-22T10:40:25.624045+0000, chain.objs.size()=1 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.549+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.Sp8IN7pgEYLBl7_GTr9cbOWcgdlql9R_0 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.549+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6089162327241111046', time=2024-09-22T10:40:25.626818+0000, chain.objs.size()=1 2024-09-22T08:45:38.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.549+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.z9CAnhsoTPMqxdoUAr25I6fSoosdqaR_0 2024-09-22T08:45:38.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4776158864736919942', time=2024-09-22T10:40:28.804207+0000, chain.objs.size()=1 2024-09-22T08:45:38.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.GYfg9uXZvqyPsxUMIMbMONRJe_mkMgG_0 2024-09-22T08:45:38.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5037469470822039547', time=2024-09-22T10:40:30.778174+0000, chain.objs.size()=1 2024-09-22T08:45:38.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.sGBmisv2NX4Na-t6WXgB1at_6X6F4PA_0 2024-09-22T08:45:38.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.98868882884257069', time=2024-09-22T10:41:43.648724+0000, chain.objs.size()=1 2024-09-22T08:45:38.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.551+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.pRCighRYR8w0vL59A996ZLdcjbzBbZx_0 2024-09-22T08:45:38.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.554+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.557+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:45:38.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.558+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.558+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.511848886037254734', time=2024-09-22T10:36:40.579089+0000, chain.objs.size()=3 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.1 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.2 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.3 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14726001015127537213', time=2024-09-22T10:36:40.694277+0000, chain.objs.size()=1 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.BB7rdfaLz4kQ-QpQDmB8wVmoDVlSkWz_0 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12391922537884756771', time=2024-09-22T10:37:58.965838+0000, chain.objs.size()=1 2024-09-22T08:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.HqxwmkeCpuEICPTdbKrKLsotvcGu6WG_0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17665670286497494342', time=2024-09-22T10:38:34.221153+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.92W5Q4pe4z7Z9jesTUucIYzuBBAHrc5_0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13184311086222040651', time=2024-09-22T10:38:38.678587+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.BAR07ruNOWVkb-yyZxvByXhTizRHCBt_0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.764268017753743048', time=2024-09-22T10:38:38.723836+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.-2mim0vdS5TtDCRUL1s1m6e9lvHdKi__0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1719528190965107787', time=2024-09-22T10:39:49.784932+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.IZqDg3pG263J88vGwXqf_je1F6VxHUf_0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11062094107267932726', time=2024-09-22T10:40:30.802787+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.MQPyqkUAKlAhkS1PIbx57pS9hyljsI6_0 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1465230339952199311', time=2024-09-22T10:40:30.803573+0000, chain.objs.size()=1 2024-09-22T08:45:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.jrL9r-WLVLImJo4yskz6EU-7hv_LuQZ_0 2024-09-22T08:45:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2038589452250864860', time=2024-09-22T10:41:03.882297+0000, chain.objs.size()=1 2024-09-22T08:45:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.559+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.iuDJVBx2m-U5KLhPvyZKy7iqaNLxixG_0 2024-09-22T08:45:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.561+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.509648754643018162', time=2024-09-22T10:41:06.644323+0000, chain.objs.size()=1 2024-09-22T08:45:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.561+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.yD00xcP3vBmZNr0qPx6xu0uRxp2ZRAC_0 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.562+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7461926851117638193', time=2024-09-22T10:41:43.683880+0000, chain.objs.size()=1 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.562+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.N3vrj_TrA_QCtHBNYo5QBtjRQJrpoRX_0 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.562+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10487242668986887558', time=2024-09-22T10:42:19.847729+0000, chain.objs.size()=1 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.562+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.4936SUg2gyUJ3VUyvJ1SBfbLJNzT1lZ_0 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.563+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4832193594060477366', time=2024-09-22T10:45:02.666338+0000, chain.objs.size()=1 2024-09-22T08:45:38.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.563+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.NorD3wsVY8g4nJtQydsBuH0E3a4ftCF_0 2024-09-22T08:45:38.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.565+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.568+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:45:38.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.570+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.570+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_MlZuvsQgF2Qc-hvcyrzPmCisWgmt43m', time=2024-09-22T10:36:40.487578+0000, chain.objs.size()=1 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.flbcKCcqeYL7Kv5LVEazUXqwp_QJH5B_0 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1020289856360415324', time=2024-09-22T10:37:58.872000+0000, chain.objs.size()=1 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.wtYNlRe1jHZJRmECLosOkKNCLIQFd9M_0 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2393454025776261671', time=2024-09-22T10:38:34.148009+0000, chain.objs.size()=1 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.y5poXq-LEBrJHkIhRqoLeLnH9glL1Ss_0 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7641060081720497885', time=2024-09-22T10:39:11.929292+0000, chain.objs.size()=1 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.erT-FUvEon0AJcSevpTW1d9kkKXjO2k_0 2024-09-22T08:45:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16074437708970802112', time=2024-09-22T10:39:11.932501+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.D98VDdEaaS5_etPO2F10zoUCvpDfif-_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3172759492395455502', time=2024-09-22T10:39:12.002360+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.k1bKr19slZoKJCTFFblNrNpIcIrnVCl_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15917576946455022991', time=2024-09-22T10:39:14.882439+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.4Fo_3PQYR3w2XzgKnKYVOlhjv6LVmYp_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8338370364648363870', time=2024-09-22T10:39:49.775535+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.spTwPJCImC1TGXOLxLbzTRrtkt0nJqj_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14175840794021441847', time=2024-09-22T10:40:25.585449+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.J_bt3U9JCcpp_Z-AcM4Apcn7tSawrmz_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14605005466551989167', time=2024-09-22T10:40:30.779596+0000, chain.objs.size()=1 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.vTu485Qh1kJCjYNpjeLJHIOUABOFSef_0 2024-09-22T08:45:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13562989947259854749', time=2024-09-22T10:40:30.838562+0000, chain.objs.size()=1 2024-09-22T08:45:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.Ma_XHPgXPmB_VRR0P6D5dhusFujwvHH_0 2024-09-22T08:45:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1981665930472272549', time=2024-09-22T10:41:06.576097+0000, chain.objs.size()=1 2024-09-22T08:45:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.571+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.raHZK23aC4CF01aVe7BsJdmjrsBDX0a_0 2024-09-22T08:45:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.575+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9148216311391737797', time=2024-09-22T10:41:06.664969+0000, chain.objs.size()=1 2024-09-22T08:45:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.575+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.Gjw20yvQ7Z3TNPYCCUpHujTh0nbUpU__0 2024-09-22T08:45:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17061527786003408961', time=2024-09-22T10:41:40.308568+0000, chain.objs.size()=1 2024-09-22T08:45:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.RP-XQeDXsPnZ3yRXMEz43W6F-DIAA1x_0 2024-09-22T08:45:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5593318558068513831', time=2024-09-22T10:42:22.481686+0000, chain.objs.size()=1 2024-09-22T08:45:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.Rm7HE7mIKwAC6hxlXF-1ugYWnwYvRmq_0 2024-09-22T08:45:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16638638182811946387', time=2024-09-22T10:42:55.933986+0000, chain.objs.size()=1 2024-09-22T08:45:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.576+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.sOKVxbb-7wWPIcyeCrIcwdkpTjQeNG5_0 2024-09-22T08:45:38.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.579+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.581+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:45:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.582+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-22T08:45:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.958283340596782144', time=2024-09-22T10:36:40.698372+0000, chain.objs.size()=1 2024-09-22T08:45:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.x6Da4uaoejJA3_-miFraxKKNi9AMEu__0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18439069729583001442', time=2024-09-22T10:36:40.736355+0000, chain.objs.size()=1 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.PQMdfHyr-CRcq8Av_7EAJfKWEcvOp-c_0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16786853641083522060', time=2024-09-22T10:38:36.729684+0000, chain.objs.size()=1 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.js0somUyEstFnBPaPWAhXfT-VfiPS5X_0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10581102165611630786', time=2024-09-22T10:39:11.973142+0000, chain.objs.size()=1 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.Hp62_rTqGhS7FD6cD2EJX2xakxvxcia_0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15011577865227944738', time=2024-09-22T10:39:52.758598+0000, chain.objs.size()=1 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.YmSxZjk_KIOuA7umHnqm8AbFSnxA3tM_0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7341749687047256170', time=2024-09-22T10:40:30.807394+0000, chain.objs.size()=1 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.qzyA4D-3Kucd_vHjl-GaIT_PtfUDFFm_0 2024-09-22T08:45:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.863224263103911804', time=2024-09-22T10:41:03.837297+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.xcAqNnUwZinInWTxmkbxJrBnhZNStjF_0 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3050129352375001140', time=2024-09-22T10:41:06.643176+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.7tetpb7k_3ilr_9X-LoCthcUUAIAkPK_0 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14287146032419816238', time=2024-09-22T10:41:09.036642+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.J1hrOSx4Nclik3jz1OrDjyNwP7r7Wr-_0 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1478383127387493287', time=2024-09-22T10:41:43.636102+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.LO1Vk0AcJr75RSSSjKdJn_hR8VrxRw4_0 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14787345941836579259', time=2024-09-22T10:42:22.495754+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.Ak-jR2toK1IUGUPdrmY-xfFkegZgLQm_0 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13917899699899798581', time=2024-09-22T10:42:55.893158+0000, chain.objs.size()=1 2024-09-22T08:45:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.583+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.SuHccJD7zhrEZkd_jp7ZkGNnVQ3Qyqr_0 2024-09-22T08:45:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.586+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2102308217370785742', time=2024-09-22T10:45:02.667428+0000, chain.objs.size()=1 2024-09-22T08:45:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.586+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.Dv3Bh_nR5EZmOfUM93kodEFUJhkoCZx_0 2024-09-22T08:45:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.589+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.591+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:45:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2973385253971671832', time=2024-09-22T10:36:40.384599+0000, chain.objs.size()=4 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.1 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.2 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.3 2024-09-22T08:45:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13__multipart_foo.2~zDtOHbrjOG0aR-QZ_RirnnU3IYGJ2a7.4 2024-09-22T08:45:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.593+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607473174258539364', time=2024-09-22T10:36:40.499641+0000, chain.objs.size()=1 2024-09-22T08:45:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.bfMHiZi_Gi_bk2Cl-CELtzGnat26zNb_0 2024-09-22T08:45:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3551323198016478381', time=2024-09-22T10:36:40.507978+0000, chain.objs.size()=1 2024-09-22T08:45:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.TA74ryNAFpwDaaxFPfqjM4kUk-D1upQ_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10826181746374439084', time=2024-09-22T10:37:58.896675+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.JGh6Oy6toLS6JUaFfO6-jf3l_YlgBWo_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4238540916014784310', time=2024-09-22T10:38:36.681293+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.o4SJet7JLNNDCqJzhRoLHpILqQ8wrcj_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14268469775034049304', time=2024-09-22T10:39:11.972154+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.8ecGGJccgpchw3MNZMm3RHdtVVw_i_t_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3273559424867171437', time=2024-09-22T10:39:16.881307+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.vPP5ZPrulSDJyp_NrTZDnAmaA_lRLG5_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14173973175154880048', time=2024-09-22T10:39:49.784586+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.nzOOnXFqSqWdJCGbkWsrwwmxqDcumra_0 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1924316314538765084', time=2024-09-22T10:40:25.606765+0000, chain.objs.size()=1 2024-09-22T08:45:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.594+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.P3Cuq2logivV1ls6MA3hrVRbVULumRG_0 2024-09-22T08:45:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.598+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12549894597525023368', time=2024-09-22T10:40:28.768479+0000, chain.objs.size()=1 2024-09-22T08:45:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.598+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.LsD4qZFtWRNxqRLBeJAIODyMDSh-pwV_0 2024-09-22T08:45:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.598+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10702542040620939956', time=2024-09-22T10:40:30.720754+0000, chain.objs.size()=1 2024-09-22T08:45:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.BdDNhkydKdPKE9oJdOkkMEwKo-6Ay1s_0 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7830317630194632497', time=2024-09-22T10:41:03.860568+0000, chain.objs.size()=1 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.WAYIZmAUYsBX4X0DsI601ExgJosQn1-_0 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11165474731836661816', time=2024-09-22T10:41:40.356140+0000, chain.objs.size()=1 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.wPAgeEZgHA9lP-wkSOq30UE9htz1Jhq_0 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16165383985938337435', time=2024-09-22T10:41:43.651330+0000, chain.objs.size()=1 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.84dAeZgeoz4sWeXOdmmM2viD6hZfeX3_0 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3605270095187004768', time=2024-09-22T10:42:17.091185+0000, chain.objs.size()=1 2024-09-22T08:45:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.599+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.lqsM_TgW4h4o_-kKJ7dAg7YFj4s-NzY_0 2024-09-22T08:45:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.603+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.605+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:45:38.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5123027321257605170', time=2024-09-22T10:36:40.609292+0000, chain.objs.size()=3 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.1 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.2 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-LUKEWARM.2~r2O9WjnqIBfjFbLbsKyZbOKQdfwqk3-.3 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16999782863712473876', time=2024-09-22T10:36:40.630134+0000, chain.objs.size()=2 2024-09-22T08:45:38.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.gaDfhhUAbtHrHgXAeGJ5Ed_lmZLXtnu_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.gaDfhhUAbtHrHgXAeGJ5Ed_lmZLXtnu_1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7276072438021589347', time=2024-09-22T10:37:58.883993+0000, chain.objs.size()=1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.607+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.5cdt1rYupsD5epgzzJAe-JOUKbGWmcA_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6408908162278807712', time=2024-09-22T10:38:34.158737+0000, chain.objs.size()=1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.ZQ8244uSrdJOoMkEyoHFojjdJovOXvm_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14437166782652323097', time=2024-09-22T10:38:34.168794+0000, chain.objs.size()=1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.ZoyqCjUG9m2nFpJUvCR5Ej_Izc0frPy_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16264815174636242542', time=2024-09-22T10:38:40.480615+0000, chain.objs.size()=1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.eiyddtNqsCeT9F3k5zNc1S0XFwlgXLv_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8329753744567727949', time=2024-09-22T10:39:14.916732+0000, chain.objs.size()=1 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.fmJl9ef57BgApUalqmh8JfFr-MUoES5_0 2024-09-22T08:45:38.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6462909915200905531', time=2024-09-22T10:40:28.827924+0000, chain.objs.size()=1 2024-09-22T08:45:38.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.jPefdOkDJos7jSXITFpobXMey-nMkFX_0 2024-09-22T08:45:38.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10710521177339569668', time=2024-09-22T10:42:18.932907+0000, chain.objs.size()=1 2024-09-22T08:45:38.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.608+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.zs7CwAkf2Alk4IYnR4NHE_BMALY_8jI_0 2024-09-22T08:45:38.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.611+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17088751967077820799', time=2024-09-22T10:42:22.397888+0000, chain.objs.size()=1 2024-09-22T08:45:38.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.611+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.pw9QiQc_OSriywOFidEb-ZJPrCIuXKP_0 2024-09-22T08:45:38.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.613+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.615+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:45:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.617+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.617+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_p7AJDFOEoIUM2gnWgKrfE9ddKLXpdNJ', time=2024-09-22T10:36:40.543066+0000, chain.objs.size()=2 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CqMRPVsgL41-OkQ0L63akDosn8_VQLx_0 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CqMRPVsgL41-OkQ0L63akDosn8_VQLx_1 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_cFaPvXbsRWZ42dXpnMEH8dx5jb9ZMTV', time=2024-09-22T10:36:40.547264+0000, chain.objs.size()=2 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.QfY5a5WEMIzBCpp1lZMuH7xmYuI7vg9_0 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.QfY5a5WEMIzBCpp1lZMuH7xmYuI7vg9_1 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9558133607381011034', time=2024-09-22T10:37:58.909134+0000, chain.objs.size()=1 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.ZgB4TXeCRgCYg5DX35AyYnw1HuNJ2pp_0 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10795202602775209231', time=2024-09-22T10:37:58.920658+0000, chain.objs.size()=1 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.0vmaMi4G_scl105xQ2IGpLXAVsUGMPP_0 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15888511223612033327', time=2024-09-22T10:37:58.942549+0000, chain.objs.size()=1 2024-09-22T08:45:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.qAPyItTfhNKx3fiQNgWBqv8ju_QBoWY_0 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13063157960505719212', time=2024-09-22T10:38:00.699943+0000, chain.objs.size()=1 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.hPD-B6l_ItXm3bzmysTq4-ZukhRANIj_0 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12841315831453615165', time=2024-09-22T10:38:00.700651+0000, chain.objs.size()=1 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.0QdFh18QWtgSBXj2MfjjYjpoTHtjB_k_0 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15695350427706801050', time=2024-09-22T10:38:00.701289+0000, chain.objs.size()=1 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.eTo9a5lQ_a6zOidLtqYIA_iqgOi0BJW_0 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15098012464936004824', time=2024-09-22T10:38:00.701941+0000, chain.objs.size()=1 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.sRHvkaIMssIQhybiF46DJ2IfFqB5QO9_0 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17052499341908368071', time=2024-09-22T10:38:36.681474+0000, chain.objs.size()=1 2024-09-22T08:45:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.618+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.g1YJZ6FU7MuE3hNsGbHR59SgqoMVVHO_0 2024-09-22T08:45:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.621+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12257298597096038874', time=2024-09-22T10:38:36.753057+0000, chain.objs.size()=1 2024-09-22T08:45:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.621+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.0jtoHoEoq8RqF5TFDYy9Yd22HR-1KdY_0 2024-09-22T08:45:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.622+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14188802836171499457', time=2024-09-22T10:38:38.725653+0000, chain.objs.size()=1 2024-09-22T08:45:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.622+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.C62Ve5iyLo0cWwIyBOV5-nItg49SeSk_0 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1857981105734255891', time=2024-09-22T10:39:11.995200+0000, chain.objs.size()=1 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.usogINFugYx2VhVZim9HSnThiiWQkVp_0 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17060719576355372446', time=2024-09-22T10:39:14.888474+0000, chain.objs.size()=1 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.D_mM3cJW5kIEwneXfoRIErPWTcMkEU4_0 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10732205232449995080', time=2024-09-22T10:39:16.881819+0000, chain.objs.size()=1 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.D47J3fJmBgAqeyUQLVV0VsC6xAR6_N2_0 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5727814935182806269', time=2024-09-22T10:39:49.732525+0000, chain.objs.size()=1 2024-09-22T08:45:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.Fvma5PSdJ_jDqUGoUqEnSG4YPt7hgAv_0 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16938077938617475916', time=2024-09-22T10:39:52.737642+0000, chain.objs.size()=1 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.RpDqTFIDksWXy609nbpYm9sNgZdZSrP_0 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11417913788062353064', time=2024-09-22T10:39:54.333598+0000, chain.objs.size()=1 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.9xKJqzL9jYoI_KbY3u3KDYWrv879y1j_0 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13004807383873515764', time=2024-09-22T10:40:25.646838+0000, chain.objs.size()=1 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.0a9ENG6VRuEFY62_E1PFczfGeDwCP7x_0 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7387217410608639995', time=2024-09-22T10:40:27.659373+0000, chain.objs.size()=1 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.RRb7KeN1M8s7Vx4dfyDiDIfSRNZZhLx_0 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16740241963358261988', time=2024-09-22T10:40:28.824079+0000, chain.objs.size()=1 2024-09-22T08:45:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.623+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.PkqdD-glLq-7elGB1HS1WR5SYvPRFGc_0 2024-09-22T08:45:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.625+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11348927298820923800', time=2024-09-22T10:41:03.886709+0000, chain.objs.size()=1 2024-09-22T08:45:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.625+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.Mjc9VZpH6ZCty9EJklXHQY0O33YbEPl_0 2024-09-22T08:45:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.626+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524731792795602488', time=2024-09-22T10:41:06.576252+0000, chain.objs.size()=1 2024-09-22T08:45:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.626+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.gBM6Ll8Y-yZ2504V1L02aYK86zm7O-I_0 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.626+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8091336545588205212', time=2024-09-22T10:41:40.301926+0000, chain.objs.size()=1 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.626+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.nHQ_iwp5NIE2Z2_OrEtHZM1D9eX8W9A_0 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.627+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10714755298755496467', time=2024-09-22T10:41:43.595941+0000, chain.objs.size()=1 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.627+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.-1zV4NieT-5JkOfvVwxD9DGZJm-m6He_0 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.627+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17577428762728158790', time=2024-09-22T10:41:43.636018+0000, chain.objs.size()=1 2024-09-22T08:45:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.627+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.oJQyasCgMPSN9BjEuREJXYl2J_gzbB2_0 2024-09-22T08:45:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8064346585945717531', time=2024-09-22T10:42:17.107882+0000, chain.objs.size()=1 2024-09-22T08:45:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.RrlQu2g3r-6NcLBF1QeiTjdjpBj9dax_0 2024-09-22T08:45:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5899549891432098660', time=2024-09-22T10:42:19.842053+0000, chain.objs.size()=1 2024-09-22T08:45:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.DOrAtFhyl3FLaUtyFRudDMMujzgcIxd_0 2024-09-22T08:45:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11476484427656010846', time=2024-09-22T10:42:55.969492+0000, chain.objs.size()=1 2024-09-22T08:45:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.fpp-JjpRBJ4bctdmW9443ObfUr2c3Bk_0 2024-09-22T08:45:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4372134176846003545', time=2024-09-22T10:45:02.689457+0000, chain.objs.size()=1 2024-09-22T08:45:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.629+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.-9Mtlt2rLq8vAJH9rdZMycgZPeOhc6Z_0 2024-09-22T08:45:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.633+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.635+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:45:38.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.636+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-22T08:45:38.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1915819580818418341', time=2024-09-22T10:36:40.566531+0000, chain.objs.size()=3 2024-09-22T08:45:38.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.1 2024-09-22T08:45:38.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.2 2024-09-22T08:45:38.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.3 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4174296277426383729', time=2024-09-22T10:37:58.959464+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.KhTAQJf25dzrYbLqbpPbgd20_-0Caw7_0 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11026808943937609634', time=2024-09-22T10:38:00.676897+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.5FHSrTxpHcrxFzHBOcQYuFW4_uPlR2U_0 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10688487552105388110', time=2024-09-22T10:38:34.236615+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.637+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.3S6JFpBtIw4W-Rtqi1kCNBOtSYG80RJ_0 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11489403154721914640', time=2024-09-22T10:39:14.888536+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.RrWNjzqVEToIacHZ4lR5BMjJAVFlV46_0 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13954634913518583534', time=2024-09-22T10:39:49.779769+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.VXoVNKppgultxTQxQITpHabUpVUhR1j_0 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15327419323249305461', time=2024-09-22T10:39:49.826385+0000, chain.objs.size()=1 2024-09-22T08:45:38.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.BJeMInZf-njxoMYDThVNCGohKzaXfyN_0 2024-09-22T08:45:38.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9718100748629743598', time=2024-09-22T10:42:55.889254+0000, chain.objs.size()=1 2024-09-22T08:45:38.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.638+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.Lt--WfU75WGuj9L8XXyYj0JsXZr324a_0 2024-09-22T08:45:38.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.642+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.645+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:45:38.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.646+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.646+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_STr3LBU7zVaPZASSzZ74tKVGXb06CmP', time=2024-09-22T10:36:40.475658+0000, chain.objs.size()=1 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.wyC_NmSu63E3tdJgtVfV_pdMytJ78y5_0 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13972130294765185792', time=2024-09-22T10:36:40.551793+0000, chain.objs.size()=3 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.1 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.2 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-STANDARD.2~hvuvPCV3HirV9SjZOgCcJrZNSPBoltN.3 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_Ia5PYUWzmoSXM8WaVYQflKrej1LgIYJ', time=2024-09-22T10:36:40.575058+0000, chain.objs.size()=1 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.IYZZOs8msdquShKc2xM-UE9rEV4hfj1_0 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.538468266559054570', time=2024-09-22T10:37:58.897899+0000, chain.objs.size()=1 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.2UNkAAnjTCAAYoyEgPiHRQHoqdB1Cdx_0 2024-09-22T08:45:38.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16479314933066571784', time=2024-09-22T10:38:34.199838+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.Hrs9SrZbq9Gi2smKFfK0WMU3dlEJLx7_0 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9129324895935567987', time=2024-09-22T10:38:38.654776+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.ioAd_bf0BZQsO-gVHHxgkLIyslOMB0e_0 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10118477640710931232', time=2024-09-22T10:39:14.891384+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.J4mSHkuu8db5MsdnaDicK-YlpXlCkcW_0 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11869519062932947684', time=2024-09-22T10:39:16.894615+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.VnFVIxeKvopV6-KxMESNzGxRkUqNUnR_0 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12482710460316388327', time=2024-09-22T10:39:49.830152+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.qz4ptFswI3a2eAj-qT6meg5rWEqAoLm_0 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14507263630560541876', time=2024-09-22T10:39:52.703210+0000, chain.objs.size()=1 2024-09-22T08:45:38.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.647+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.sWlU-umeBjE1uVk0Z8m_EN-hIw8EFPM_0 2024-09-22T08:45:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.649+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10985806672688467027', time=2024-09-22T10:40:30.788374+0000, chain.objs.size()=1 2024-09-22T08:45:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.649+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.dhCVM5hnUlRdxLTFpw9oDyCyDXK6RPW_0 2024-09-22T08:45:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.650+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10764860257485341080', time=2024-09-22T10:41:40.271301+0000, chain.objs.size()=1 2024-09-22T08:45:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.650+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.2YlTLFSOzG2ISampK6YissiewEzmWTL_0 2024-09-22T08:45:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.651+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10545420472765145797', time=2024-09-22T10:42:22.418929+0000, chain.objs.size()=1 2024-09-22T08:45:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.651+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.TcNzQgy2FLY2rXT6neKsXBk6PUEuiQI_0 2024-09-22T08:45:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.654+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.657+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:45:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.658+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14252809720689713890', time=2024-09-22T10:36:40.303445+0000, chain.objs.size()=1 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.cYZT9ubj_UJPBBF1CCcvEDc5U5QSKUp_0 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11087786772624181342', time=2024-09-22T10:39:11.970352+0000, chain.objs.size()=1 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.W1w39sGZb2BOhL7F5iz8o9OuRxPeMN__0 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15740998290048700680', time=2024-09-22T10:39:16.850379+0000, chain.objs.size()=1 2024-09-22T08:45:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.PcLW7HsTQzteef8MgoQLSnhuQg2cs2d_0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.610971324299997513', time=2024-09-22T10:40:28.792669+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.OjPVhsIdQlKZ-QHbN-89h3DDKye4wew_0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9820217644344330819', time=2024-09-22T10:41:40.362186+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.nlzSWMoliK2eD9xXFcyKqu2Sun9pbDE_0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7015350461810670654', time=2024-09-22T10:42:17.061493+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.fBdpjWUpXLiiS_fdJxOSoX4ILrNP-m2_0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9907493486552395466', time=2024-09-22T10:42:19.850485+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.LEk2GNCzlPAp6M10c9rea_5crXlZ05__0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9807068748179857679', time=2024-09-22T10:42:19.851796+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.-DBCe9wlct4iHk18-Am9vb4T8tE-EES_0 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10290706358854396001', time=2024-09-22T10:42:19.887388+0000, chain.objs.size()=1 2024-09-22T08:45:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.n5PLJMgWH-gajdXhvQGN6JQNteKTkUC_0 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7340538653559230015', time=2024-09-22T10:42:22.446427+0000, chain.objs.size()=1 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.NF___bySf0uJsfFpRuAEST4Rm_Au2Rz_0 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14259243464542253094', time=2024-09-22T10:42:55.887975+0000, chain.objs.size()=1 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.UYGUPh6tE484PJMJhS8IuQJ4sD3w0r3_0 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11651862111613929307', time=2024-09-22T10:42:55.889228+0000, chain.objs.size()=1 2024-09-22T08:45:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.659+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.Ti-rkdE-eQ54TPchWp_a0Cy2NW4zWKH_0 2024-09-22T08:45:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.663+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3729173509701131390', time=2024-09-22T10:45:02.665948+0000, chain.objs.size()=1 2024-09-22T08:45:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.663+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.wls-NML8NLnILhnxUhQld_r2qYYZPv0_0 2024-09-22T08:45:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.664+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13827132268917489550', time=2024-09-22T10:45:15.026850+0000, chain.objs.size()=1 2024-09-22T08:45:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.664+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:2Ujj0rkluOQdyYPiB7BGxwOpIiNl9-H_.UJVYYi14f2ovitP0ecyT82kmLQ-X7IA_0 2024-09-22T08:45:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.666+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.668+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:45:38.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.670+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.670+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.670+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-22T08:45:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.670+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_5x4eu0-msB2zm0qmoNYYvl9O8s-GXBB', time=2024-09-22T10:36:40.556997+0000, chain.objs.size()=2 2024-09-22T08:45:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.-C-SzQDWlO3BcUKxUYs-tSY4xgbnmtu_0 2024-09-22T08:45:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.-C-SzQDWlO3BcUKxUYs-tSY4xgbnmtu_1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8867620006619743517', time=2024-09-22T10:36:40.605198+0000, chain.objs.size()=3 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.2 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-STANDARD.2~ct8RQdhT382xQG5yLzad6R1DKqYUe9W.3 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5780426437114056465', time=2024-09-22T10:38:00.700036+0000, chain.objs.size()=1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.NYazKMF_8YvEwfEWuLxWWi5btMQr6Yy_0 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11945060797307579598', time=2024-09-22T10:38:34.171719+0000, chain.objs.size()=1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.1zClESiNX8JRW_E6KgO1tOLoSrOZuAG_0 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1644756949688073155', time=2024-09-22T10:38:36.669199+0000, chain.objs.size()=1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.Bld5ojo7sqx9THHScd3kKZ-NCXWb4pX_0 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4021394202213413727', time=2024-09-22T10:40:30.704958+0000, chain.objs.size()=1 2024-09-22T08:45:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.C2MShjGRUptiIXFFJm-v4jz74qwn0F9_0 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10020909050023545616', time=2024-09-22T10:41:03.837349+0000, chain.objs.size()=1 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.-As6SAXQFDP4y1ShJyMLnASyqmwTkJ5_0 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16157878081009566227', time=2024-09-22T10:41:06.642321+0000, chain.objs.size()=1 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.RfZS6gPE9AKIKFDUJNJnTGjN62snBDo_0 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13410842849453675492', time=2024-09-22T10:41:06.669839+0000, chain.objs.size()=1 2024-09-22T08:45:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.671+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.s16hAQ5VN2x470mZl3zLa3Ut7EaE2ty_0 2024-09-22T08:45:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2978276813323814116', time=2024-09-22T10:41:43.636039+0000, chain.objs.size()=1 2024-09-22T08:45:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.FeiUIHCwVGg1xVImcJGZl9PCvmInzqL_0 2024-09-22T08:45:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5570629816346089675', time=2024-09-22T10:41:45.841096+0000, chain.objs.size()=1 2024-09-22T08:45:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.528it64tTLSulpaFkQ9y744imjwryAE_0 2024-09-22T08:45:38.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1467318552212827335', time=2024-09-22T10:42:22.455925+0000, chain.objs.size()=1 2024-09-22T08:45:38.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.675+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.Xt5PQQJaWg61BxcpBHwusbUgKLBn69c_0 2024-09-22T08:45:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.678+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.681+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:45:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.682+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8446989747852508084', time=2024-09-22T10:37:58.963877+0000, chain.objs.size()=1 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.h3XjLWNTCMmhn9m7U2R8xBscUUt0Al1_0 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4616376288267136816', time=2024-09-22T10:38:36.749073+0000, chain.objs.size()=1 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.M_HfeT9txUYGwm3mo_2PRvfWgGzxvyy_0 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9875956787410519611', time=2024-09-22T10:38:38.650207+0000, chain.objs.size()=1 2024-09-22T08:45:38.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.9sW9PX0CrN4R2ZjV-vjobSwff7xkJAo_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1246537402202079715', time=2024-09-22T10:39:11.970372+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.DEqf_Q0_iyi_Ph61D-7CJCa95ywc5O-_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6030160375066454126', time=2024-09-22T10:39:14.888105+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.LGPamKq1VYKt8D5tAFVeZQm22WVyHC9_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2496349907952720983', time=2024-09-22T10:39:16.902290+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.MSqTYroOtDjJ9CmKjPVcynVjp0LetLv_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.725122262793820230', time=2024-09-22T10:39:52.706199+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.hSXURxS-7m2xr5brbJtoIy1zCc7kXXv_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4634054346639773519', time=2024-09-22T10:40:25.673355+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.684+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.wqdsYckSeBS4w41kCaPlJF02s2AV6Z9_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7952470913444480497', time=2024-09-22T10:41:06.613999+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.MfBUc8Vmo7zGT2URW_G4x6YVmSKzap5_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13900538808016582707', time=2024-09-22T10:41:06.614692+0000, chain.objs.size()=1 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.0y7smafXi5PB4rn0ww82ZbwIK0RMr24_0 2024-09-22T08:45:38.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2913232215784134252', time=2024-09-22T10:41:40.327799+0000, chain.objs.size()=1 2024-09-22T08:45:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.GuH_PrRpHhIvALLO05zUhw9dfzfntNn_0 2024-09-22T08:45:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6703438777146003052', time=2024-09-22T10:41:43.650876+0000, chain.objs.size()=1 2024-09-22T08:45:38.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.685+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.TsSHSQx_tN1e4VXXhD_B3di4tAyiBVL_0 2024-09-22T08:45:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.688+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12638369616871113157', time=2024-09-22T10:42:19.810642+0000, chain.objs.size()=1 2024-09-22T08:45:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.688+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.5gsc0HuNKhN_z_XI_WMUH-QigsH682s_0 2024-09-22T08:45:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.688+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1312345202075302120', time=2024-09-22T10:42:19.820221+0000, chain.objs.size()=1 2024-09-22T08:45:38.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.688+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.kaGuUn3WZkabzte3-tP7gPfXlO8FJBn_0 2024-09-22T08:45:38.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.691+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.694+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:45:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.695+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.695+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-22T08:45:38.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_e0baqaj74mCspJSgR-h5NNxyMLZKUar', time=2024-09-22T10:36:40.460875+0000, chain.objs.size()=1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.o9YuudwYW-9g9IPw-IQ1f9yiMr0LjRp_0 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17678182596955150627', time=2024-09-22T10:36:40.561237+0000, chain.objs.size()=3 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.2 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-LUKEWARM.2~abMsiR7aMvAcJahCaSL55A1XnqsDHda.3 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2159898488647574552', time=2024-09-22T10:38:00.700005+0000, chain.objs.size()=1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.XM_zC5W8fsLpWPXVV__cIWdjlAGJdiM_0 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5746640473915079851', time=2024-09-22T10:38:36.675810+0000, chain.objs.size()=1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.SKyjmvfEaspJpJe70wK3Pbd2k2Q_lr2_0 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16849778546153433373', time=2024-09-22T10:38:38.701516+0000, chain.objs.size()=1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.coYxJzYs6jWqz2qpsqr33v-1CPbP-tg_0 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12723295599658357166', time=2024-09-22T10:38:38.725566+0000, chain.objs.size()=1 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.8ft5DqA3J9TlN6Q6NbaZ4SkebGEQZg5_0 2024-09-22T08:45:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2354254143067420988', time=2024-09-22T10:39:11.972349+0000, chain.objs.size()=1 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.BO0MBNX48LytHWpylbGq0eIze1-7k5o_0 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4558208753836028016', time=2024-09-22T10:39:16.898194+0000, chain.objs.size()=1 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.R84svXiyGsAsTwm2fMj440Qf-3xXNNH_0 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2827635261512819952', time=2024-09-22T10:39:49.816342+0000, chain.objs.size()=1 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.br-tudF5R7WtEWYApjjIEIjDdLtnwDb_0 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.801618219667289035', time=2024-09-22T10:39:52.689608+0000, chain.objs.size()=1 2024-09-22T08:45:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.696+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.jAgSyY_t81J1NR5e-VhoisVbq-A1Taj_0 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3255025439386415753', time=2024-09-22T10:41:03.886726+0000, chain.objs.size()=1 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.eE0eg6VxhqH2BPKF348Zc_5-sBfSTWh_0 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15853795631089407578', time=2024-09-22T10:41:06.642229+0000, chain.objs.size()=1 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.Qt2YSXJwK9QGEs1VlaqtFHcYQFHb3J0_0 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4826284198951079425', time=2024-09-22T10:41:43.689793+0000, chain.objs.size()=1 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.oirqMZ3wAC-OXeExTzD5lekzn1FEOQp_0 2024-09-22T08:45:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3125314825014448554', time=2024-09-22T10:42:22.480791+0000, chain.objs.size()=1 2024-09-22T08:45:38.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.r5pthix1bDCsdhRHVUrX_o-czdTW9FU_0 2024-09-22T08:45:38.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9677613190289192837', time=2024-09-22T10:45:02.678352+0000, chain.objs.size()=1 2024-09-22T08:45:38.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.700+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.6x995scCs6054udJdoSN3pkzNHSnZNU_0 2024-09-22T08:45:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.704+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.706+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:45:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.707+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.708+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11439022963743978123', time=2024-09-22T10:36:40.312089+0000, chain.objs.size()=1 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.ZrZQsRPGeZ0mI8wiVB-RtRwr3YSVR5M_0 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2498272717580941688', time=2024-09-22T10:36:40.438986+0000, chain.objs.size()=4 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.1 2024-09-22T08:45:38.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.2 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.3 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10__multipart_foo.2~AaEWyMSIDgwWZxSZJwIox6g-QH27GBB.4 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_0fHP5FFvTq9F4HSaojUViDGU4b23aRq', time=2024-09-22T10:36:40.479761+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.s0nZ4w_gCAqnL0qckl5BueD9ALVSOIn_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13903578691545509458', time=2024-09-22T10:37:58.942965+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.HZuDdylm7I0a1DkvCmusW1q398KeEFr_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15016919398940039536', time=2024-09-22T10:38:00.669838+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.69wG6r1JcDVEPMNznp7TlJuoHztF32N_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12435357336584675057', time=2024-09-22T10:38:00.748072+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.RvgCpN77IJ6qqILN-zz3kmcSEtk2b9B_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16648850039244186946', time=2024-09-22T10:38:34.199036+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.LXImEubECkLlxB11StLGKCjj2ZRJO1h_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14008198958603333181', time=2024-09-22T10:39:49.741413+0000, chain.objs.size()=1 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.vrEPQx_J-DpwnYWN-gqBsL6Ifu7ZGg2_0 2024-09-22T08:45:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8638190595256685474', time=2024-09-22T10:41:03.866410+0000, chain.objs.size()=1 2024-09-22T08:45:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.709+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.31zYw4XTJMm2OL8l55oaf9q-sbT-ODl_0 2024-09-22T08:45:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.711+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10305052905284089006', time=2024-09-22T10:41:03.867675+0000, chain.objs.size()=1 2024-09-22T08:45:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.711+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.z4_YNe43Ib6MftU1OS5eO9B-aa4LJ4i_0 2024-09-22T08:45:38.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.712+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15425903124942298770', time=2024-09-22T10:41:40.279478+0000, chain.objs.size()=1 2024-09-22T08:45:38.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.712+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.WbL_fTEXg0b_AZgdIQVYloqMiMEO7Wa_0 2024-09-22T08:45:38.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6694936775607045100', time=2024-09-22T10:41:40.351229+0000, chain.objs.size()=1 2024-09-22T08:45:38.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.mCAnpQbL5UM_U7QZx1Vg-ml2n8Z9gOx_0 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14282049721784483122', time=2024-09-22T10:41:43.653927+0000, chain.objs.size()=1 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.b0gw_j89y7i9lo0LDru1VCOM8TTxX2s_0 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6318338030753134410', time=2024-09-22T10:42:17.063326+0000, chain.objs.size()=1 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.dycyzm9Vuf7LLylA40n2F7KLba-DFEA_0 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15553294836112492132', time=2024-09-22T10:42:19.805573+0000, chain.objs.size()=1 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.ybt59ykxxilTd2d-ztRoRYSubQtwy6v_0 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11909876538581041617', time=2024-09-22T10:42:22.428033+0000, chain.objs.size()=1 2024-09-22T08:45:38.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.713+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.HL6fh3yfcJtlXdMJwsScBUHnmqwiphY_0 2024-09-22T08:45:38.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.717+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.720+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:45:38.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.721+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12505303030526008978', time=2024-09-22T10:37:58.902143+0000, chain.objs.size()=1 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.AjS0XtRObu1blYufopUnDbULI0zl2Di_0 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8183242276365697740', time=2024-09-22T10:37:58.929779+0000, chain.objs.size()=1 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.OKnz7wO400Pr5lXpbQZVb-SOCVEKBYV_0 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6147238397480409316', time=2024-09-22T10:38:36.704961+0000, chain.objs.size()=1 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.iq8fUCMPNTNzgoff40z7ouj3WFntK3P_0 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8228998349107923587', time=2024-09-22T10:38:36.705458+0000, chain.objs.size()=1 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.51Pxw2Okw9NFEgigHQbevdKUdg58CIc_0 2024-09-22T08:45:38.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4346011966301611804', time=2024-09-22T10:39:49.784321+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.d8IVbjU5K5fufojYLIJbFyAzkkLJ7Ws_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14987995924379556139', time=2024-09-22T10:40:25.638854+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.3j8n29w2OAPcubMiPGZIabXSGpr1Zki_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11316403586995777391', time=2024-09-22T10:40:30.783056+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.jbKfwX0gGOnHYkYyD2QH7viqs6iPrdJ_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1763807739033287189', time=2024-09-22T10:41:03.853441+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.2fuNiapKTqthSp7O6OH7r-gSxFVZIre_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2095141847296153811', time=2024-09-22T10:41:03.905076+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.UfFvBMJHfP7dUIVnTdRcUPpoOK1_s8A_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6570804108977025757', time=2024-09-22T10:42:17.085780+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.TNeS2z1ah2ziI1QlwkePgfSENhasmv__0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6246268602746196198', time=2024-09-22T10:42:19.846856+0000, chain.objs.size()=1 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.5Vi85K69oQ6n0mb7uNaeuoFkyQL118S_0 2024-09-22T08:45:38.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12207836838374406356', time=2024-09-22T10:42:22.384773+0000, chain.objs.size()=1 2024-09-22T08:45:38.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.722+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.EvyX99MML_S1O-deGJ-GPoGjrZPOlVQ_0 2024-09-22T08:45:38.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.725+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2485980259629678537', time=2024-09-22T10:42:22.459302+0000, chain.objs.size()=1 2024-09-22T08:45:38.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.725+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.5_CvoXlSFXVrF1hYC1E22IBI1ykZBDX_0 2024-09-22T08:45:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.727+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16826862549490571398', time=2024-09-22T10:42:55.927938+0000, chain.objs.size()=1 2024-09-22T08:45:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.727+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.wU8Lcf-yVTXn82bYqAwHF5YwOUiYZiv_0 2024-09-22T08:45:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.727+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.203005004554903336', time=2024-09-22T10:42:55.960919+0000, chain.objs.size()=1 2024-09-22T08:45:38.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.727+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.AGgaCrKLnrkK2H8oBAe9c-FHHxOaw-n_0 2024-09-22T08:45:38.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.730+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.733+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:45:38.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.734+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.734+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-22T08:45:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3948092353761421127', time=2024-09-22T10:36:40.491562+0000, chain.objs.size()=1 2024-09-22T08:45:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.bfMHiZi_Gi_bk2Cl-CELtzGnat26zNb_0 2024-09-22T08:45:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12377123036364499294', time=2024-09-22T10:36:40.601113+0000, chain.objs.size()=3 2024-09-22T08:45:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.2 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15__multipart_foo-FROZEN.2~nFrtnzf5MpL64WRTYmF7VJvfFA2dhaZ.3 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1529601610199811943', time=2024-09-22T10:36:40.724061+0000, chain.objs.size()=1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.fzbsHA_xphHmN7QeKRQItMXheFFMlN3_0 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.683857425254274319', time=2024-09-22T10:37:58.896660+0000, chain.objs.size()=1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.NHa0imuLe3r81U_pKwuy-jhsEQF4KBM_0 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7015486224641808861', time=2024-09-22T10:38:34.133993+0000, chain.objs.size()=1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.fdePd5j8d8zjfWyDejKxkllKS9NjFnu_0 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10191372170604469257', time=2024-09-22T10:38:36.722053+0000, chain.objs.size()=1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.zcZsIvPLxqrdd5QfAr9biziU1wBz469_0 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12596528403094951152', time=2024-09-22T10:38:38.700004+0000, chain.objs.size()=1 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.meL8gqgMfCYBwDP43TyQ2jHvSYdvqzs_0 2024-09-22T08:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10141191463091129169', time=2024-09-22T10:39:11.944643+0000, chain.objs.size()=1 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.X-b-fcxKH8jHQqC4OoFmpoFK45xucg-_0 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5178002868997668522', time=2024-09-22T10:39:14.881775+0000, chain.objs.size()=1 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.t_c-SJFXbDkeUu8Kg5YftuQS_CePt2l_0 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4496546572590046568', time=2024-09-22T10:39:14.891577+0000, chain.objs.size()=1 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.735+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.TIIIq1jXoiKeD4uWdFDAMaHBtJNTxi-_0 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.737+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8947963120359978080', time=2024-09-22T10:39:52.767483+0000, chain.objs.size()=1 2024-09-22T08:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.737+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.aKjLl8I7Z6xJsQlGl3gSs_YFyvjr5CH_0 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3744164321299261178', time=2024-09-22T10:40:25.626607+0000, chain.objs.size()=1 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.-LxywQaveovLZldjMw_sdzGWgT70rpu_0 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3947664444968639994', time=2024-09-22T10:41:40.300138+0000, chain.objs.size()=1 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.M3XkAaBbWlofilhnSGHJWXadR33L7RT_0 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15583886291454908283', time=2024-09-22T10:41:43.652266+0000, chain.objs.size()=1 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.lv8KFT5K5Cbug16LcxfSUI0kyR21A1Y_0 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7189443268329969296', time=2024-09-22T10:42:19.889808+0000, chain.objs.size()=1 2024-09-22T08:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.5WTcIP55seckWwSjtEB2DoXCCEyhUzT_0 2024-09-22T08:45:38.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.950071365436520007', time=2024-09-22T10:42:55.899858+0000, chain.objs.size()=1 2024-09-22T08:45:38.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.IpFhn0A4XzqadtmjTJdxHOy6lrBrPRO_0 2024-09-22T08:45:38.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11893822697078622787', time=2024-09-22T10:45:15.031392+0000, chain.objs.size()=1 2024-09-22T08:45:38.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.741+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:L4aFPqVkDg2x0S2dEwlgm49Monf0IaT_.S6Y3biKWwg-88zMuLVN5VTuP8IV0Q_m_0 2024-09-22T08:45:38.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.745+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.747+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:45:38.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13449246359536976596', time=2024-09-22T10:36:40.338589+0000, chain.objs.size()=1 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.8KK9mKdL1wH6WQUhIUSiSH9jQi87Dmr_0 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9918956401586122000', time=2024-09-22T10:36:40.634201+0000, chain.objs.size()=1 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.cfqrh0mdElmg-PytcrWiG7jgPnZxXKl_0 2024-09-22T08:45:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9368662949551905708', time=2024-09-22T10:38:35.990868+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.xD9hz_GKIn0SEvS5n3zUPJiuxUpqsZt_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8947836654058284104', time=2024-09-22T10:38:38.748693+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.vQAYM8jutGUPZHwGh4Pr8EehAQkd09W_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17722816355895548302', time=2024-09-22T10:39:12.014657+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.FB8jJ1tVJH1lv9lfhCX4Isj6rVgvHjS_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6278073303502121900', time=2024-09-22T10:39:13.996725+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.zDDFzza_PRmjZWt_tFmZ1ecfvQKOzw9_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5542437642999936310', time=2024-09-22T10:39:16.852835+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.5ky17Vsq-Gu51YZ7m726xII6qngt-eJ_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13538133258732483132', time=2024-09-22T10:39:16.895132+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.3RJvfYQxSdmziuFOWgP_9fsLh7sWMHd_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5935247243851886925', time=2024-09-22T10:40:28.804086+0000, chain.objs.size()=1 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.uX78Doz1Qbbu8pX4iYluHel04FNQWMX_0 2024-09-22T08:45:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15801505504748466091', time=2024-09-22T10:40:28.805372+0000, chain.objs.size()=1 2024-09-22T08:45:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.RPmwGlq_mCBl9-_T1pmN7dZIbeoiI7-_0 2024-09-22T08:45:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12247743570857402407', time=2024-09-22T10:40:30.778664+0000, chain.objs.size()=1 2024-09-22T08:45:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.H5uMjsJmeQOukh8sjqT1LvHh4ReZDI5_0 2024-09-22T08:45:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.749+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2959437947203729216', time=2024-09-22T10:40:30.788177+0000, chain.objs.size()=1 2024-09-22T08:45:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.750+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.TdETtufoqJsGPhWOD1RW0pFrioC-5L1_0 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5730306145230960626', time=2024-09-22T10:41:40.305819+0000, chain.objs.size()=1 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.lepoKUuDV_MnyVvOZXV1QYBtwgpNWw9_0 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13376701724039763120', time=2024-09-22T10:42:17.089828+0000, chain.objs.size()=1 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.9tiazezh-hwtkq1Xngx7vfTMFNKAIIC_0 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11557007907811792426', time=2024-09-22T10:42:19.857580+0000, chain.objs.size()=1 2024-09-22T08:45:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_._fl-eLTzSxeDDVymfyu3YArOmPxWZTn_0 2024-09-22T08:45:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9523046690555023443', time=2024-09-22T10:42:22.409589+0000, chain.objs.size()=1 2024-09-22T08:45:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.nZJ51-q881QJSZ3HlajfvGOH_2Lz3sx_0 2024-09-22T08:45:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4629246056617696310', time=2024-09-22T10:42:55.941996+0000, chain.objs.size()=1 2024-09-22T08:45:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.754+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.tC9_LL9guoolWUTNOl0u9IOp2fO5D1u_0 2024-09-22T08:45:38.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.758+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.760+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:45:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.762+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.762+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_x5klB0cTZz_Y2cGpXyK4u4agfTphLZ9', time=2024-09-22T10:36:40.530141+0000, chain.objs.size()=1 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.01MG3zfA0rhKVzk28EwvPvuAtTTf2Bb_0 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6484337337564679278', time=2024-09-22T10:36:40.638140+0000, chain.objs.size()=2 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.NUBoxh6wXiDjIm4Ab1MqQ1-w2bHnv5t_0 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14__shadow_.NUBoxh6wXiDjIm4Ab1MqQ1-w2bHnv5t_1 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17008343000236194991', time=2024-09-22T10:38:00.684373+0000, chain.objs.size()=1 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.BlKivuOVsoRqUUlgTXC9w1K3jVrPolp_0 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.424640187578353585', time=2024-09-22T10:38:36.689210+0000, chain.objs.size()=1 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.RPiHesDzde44UJVNVPAOKuaZKKqTEIL_0 2024-09-22T08:45:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3672736547100208901', time=2024-09-22T10:38:38.656508+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.pzKmjKp3vqSIyY29oC6OsJwOLR__7lj_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14165512727749687646', time=2024-09-22T10:39:14.892615+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.j_9v_OgvInh1hqt1p6BTQirKAeIbyBc_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15422430120636991455', time=2024-09-22T10:39:16.852908+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.tw8wtSkobIM-npqPrR0-yptkII37rUt_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1491210867006703924', time=2024-09-22T10:39:16.894992+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.JrVy2lSqo4VGwpgnKgqVdY_PqAOM_a-_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12010506923744475943', time=2024-09-22T10:39:52.743304+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.RDh4vfBR-1q9SdKxAcd82-pKWK5IP-v_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9717995070132434662', time=2024-09-22T10:40:25.626246+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.PxQiA5J2DyR_ujlk_qmrCt7yGXV4FUh_0 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9392908276912764602', time=2024-09-22T10:40:28.810956+0000, chain.objs.size()=1 2024-09-22T08:45:38.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.763+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.kz0bCPr0df70Amsl6BDuAqxMLYEpMed_0 2024-09-22T08:45:38.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.765+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5742311256884093306', time=2024-09-22T10:40:28.824885+0000, chain.objs.size()=1 2024-09-22T08:45:38.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.765+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.snWY-RjIdMN6g0B4ihB92uNTMcEozp1_0 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16131313768841882670', time=2024-09-22T10:41:03.836906+0000, chain.objs.size()=1 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.BGol6k7BlQnwTjChhDAw5mY-WBNG0rI_0 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18146871671725493725', time=2024-09-22T10:41:40.310888+0000, chain.objs.size()=1 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.vQ4dwj5TEMgnokiAD6hooPcVpG5bii-_0 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14756913719357752152', time=2024-09-22T10:41:42.529581+0000, chain.objs.size()=1 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.oNBOUH8BhlC7XDH2c-f3uYmwr3cpzcF_0 2024-09-22T08:45:38.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15123926821059051148', time=2024-09-22T10:41:43.611895+0000, chain.objs.size()=1 2024-09-22T08:45:38.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.HcjBSzrcY-w4DDIqHQ8oXMw8vH8Sq3w_0 2024-09-22T08:45:38.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13074265676817002287', time=2024-09-22T10:42:19.804563+0000, chain.objs.size()=1 2024-09-22T08:45:38.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.hoWcj6QCafJ9h2dIgGMgDsTAL-A61ZP_0 2024-09-22T08:45:38.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5462137983931368202', time=2024-09-22T10:42:22.496151+0000, chain.objs.size()=1 2024-09-22T08:45:38.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.768+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.0UoBSl98RGn0zdUKj6p2xbJl8fyCyMd_0 2024-09-22T08:45:38.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.772+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.774+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:45:38.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555078406106324417', time=2024-09-22T10:36:40.316739+0000, chain.objs.size()=1 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.zCu2EO9tYqr5l-OmdpAofL15w-aYluu_0 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5276182144388907360', time=2024-09-22T10:36:40.329941+0000, chain.objs.size()=1 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.-hMRU2ey07TJIKnGmw870ZmksgDuZBA_0 2024-09-22T08:45:38.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11860268674666089244', time=2024-09-22T10:36:40.334424+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.fCbAWP81LV2mA49cFs7Lcx0G3qWvLHf_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.776+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11547668791268700579', time=2024-09-22T10:38:34.198985+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_._EdkoL7NRQYqkOyQVWzpSknDw-sLacK_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.830448683835635743', time=2024-09-22T10:38:38.663026+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.YNH4Q_w-cG4FPbvKyIx_ehzOyvC_Sn7_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6958210510641390485', time=2024-09-22T10:39:14.914816+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.yKQL9sC3SC8RdQZDUC-j9dLb7ojRQZK_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2441979285320295907', time=2024-09-22T10:39:49.821735+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.xuO_T4FA9rtuyEYhewIpd35rktlrCPx_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5712467765211988402', time=2024-09-22T10:40:28.766930+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.HsDOjwtB5GQ2dKrr-ezASsqTW26dDHp_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18186695441970972674', time=2024-09-22T10:40:28.767506+0000, chain.objs.size()=1 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.13N43Rkwu8rv4hg9QPre6ft-LDm9cAv_0 2024-09-22T08:45:38.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12242130930245602724', time=2024-09-22T10:40:28.836473+0000, chain.objs.size()=1 2024-09-22T08:45:38.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.aLfJ9W1729qzKSV93Bnhe-2HK_OsO4m_0 2024-09-22T08:45:38.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9632942724123535227', time=2024-09-22T10:41:05.706927+0000, chain.objs.size()=1 2024-09-22T08:45:38.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.DQ_ONNdvJ4x7o6ogkMB8LfPQ_oZkY1f_0 2024-09-22T08:45:38.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18084705525810670890', time=2024-09-22T10:41:40.309197+0000, chain.objs.size()=1 2024-09-22T08:45:38.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.777+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.GP6yYtBYvrGnIAvreGhhGdsNhlj-sqS_0 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3098862986035490419', time=2024-09-22T10:42:17.096581+0000, chain.objs.size()=1 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.eYG39_Zie7yaEpnvcw07vzbOk6uWYPU_0 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1448666787069726866', time=2024-09-22T10:42:17.102011+0000, chain.objs.size()=1 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.RB1irNGyw-6gDhHPSN7qHzmV-rkZpL__0 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11795374795150702279', time=2024-09-22T10:42:17.150467+0000, chain.objs.size()=1 2024-09-22T08:45:38.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.781+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.A5p2uruwS0Nc7ep4fCy2peVOsDhJGGZ_0 2024-09-22T08:45:38.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.783+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17827272416478717027', time=2024-09-22T10:42:22.411027+0000, chain.objs.size()=1 2024-09-22T08:45:38.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.783+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_._IMoEnr41hZYBK8gCGXkwhbCgBUMpgn_0 2024-09-22T08:45:38.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.783+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6156026897054818804', time=2024-09-22T10:45:02.649006+0000, chain.objs.size()=1 2024-09-22T08:45:38.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.783+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.jQFfmIfqi7Y4kz6jYP5oFRwnP4hxqp6_0 2024-09-22T08:45:38.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.785+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.787+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:45:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T08:45:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3339498937385677691', time=2024-09-22T10:38:00.680946+0000, chain.objs.size()=1 2024-09-22T08:45:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.8gPSuna7FU7s8egwANUvTRdZD4-IaRf_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3183399287685500342', time=2024-09-22T10:38:34.212428+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.789+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.Xj64hdcqeeEb8Rb_OtWW5PP31EHKJp6_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.673650005557969658', time=2024-09-22T10:38:34.245507+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.0aeVTrTIbJwt7hP-Ek3vAtKMvWksWu8_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14056886992239203458', time=2024-09-22T10:38:36.681198+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.4QnUQ07CPEiGeh96hEdAsHlTZJRynAC_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18012714311917731391', time=2024-09-22T10:39:14.881704+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.vovn9ip_ipv4K0HJc3Nhb38NSoOHVDD_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9040396884991389219', time=2024-09-22T10:39:16.881980+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.EcqyGTduiLwOIbj6_7psbImAczwVJvK_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5942043453568419346', time=2024-09-22T10:40:25.575551+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.L1sR-LrDUHczhQwsLJzkos6cIEV6Ilj_0 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9765897496562553055', time=2024-09-22T10:40:25.628119+0000, chain.objs.size()=1 2024-09-22T08:45:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_._Krz0ZOqilTd1uWUiJJ1Bk7A8kNAHdf_0 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3000954699431431551', time=2024-09-22T10:40:28.780103+0000, chain.objs.size()=1 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.DwDk854OfUfxKID-vLXDt0TMHkaVQO__0 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9212390003007639005', time=2024-09-22T10:41:03.854252+0000, chain.objs.size()=1 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.yfxPoe-DaKJjB7UWEbHvU2NvNFZdR0q_0 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.187433976989364296', time=2024-09-22T10:41:06.608823+0000, chain.objs.size()=1 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.I0oWH30mDvVk4cJBmFwzDbZHFaHHaVY_0 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1217508251291821447', time=2024-09-22T10:41:06.634765+0000, chain.objs.size()=1 2024-09-22T08:45:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.790+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.79IJLC_bRqlbhie-k8i--r1Mxpl1--q_0 2024-09-22T08:45:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1522414295553261903', time=2024-09-22T10:41:43.651426+0000, chain.objs.size()=1 2024-09-22T08:45:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.x5R55AGrhZIvqOc2UayJsK-_eWrsQc7_0 2024-09-22T08:45:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3013923972215514412', time=2024-09-22T10:42:17.136359+0000, chain.objs.size()=1 2024-09-22T08:45:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.rQd9Av3AWhLw-JJC6ZSEVRoTXnDGL2I_0 2024-09-22T08:45:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10675221449661191136', time=2024-09-22T10:42:55.866494+0000, chain.objs.size()=1 2024-09-22T08:45:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.V5n7Cx3CM80VUo0ymJJUT9pG1EqYkxa_0 2024-09-22T08:45:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4531924954620033484', time=2024-09-22T10:42:55.913245+0000, chain.objs.size()=1 2024-09-22T08:45:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.794+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.GjxL8MK4Gs9mrwNR3LxakG970yr3row_0 2024-09-22T08:45:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.798+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.800+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:45:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.801+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.802+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4440803065802937280', time=2024-09-22T10:36:40.470021+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.TA74ryNAFpwDaaxFPfqjM4kUk-D1upQ_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8884698040480775690', time=2024-09-22T10:38:00.686214+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.CmgqWCAn5pLFU9cHYqRi6nSojFs6Bu1_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5284157628209266519', time=2024-09-22T10:38:34.198510+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.MvYce9adg_Qce8Xz4E3gg97YomFtg8Y_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15827145399576099944', time=2024-09-22T10:38:34.202216+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.mB7DuEo842bB3KTKBpiG8R6wR6jIOx0_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2322385515518010382', time=2024-09-22T10:38:38.639567+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.z9Qo-69EmgtGUaIXWEMiE8tK9u5ALd7_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9177969524292282228', time=2024-09-22T10:38:38.751354+0000, chain.objs.size()=1 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.djmRG9jSzgbczWW7wH_x45zdstdjpGo_0 2024-09-22T08:45:38.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6527375108528330571', time=2024-09-22T10:39:11.927558+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.BdkcHuZPdKT2Dnuc_QScmExxdgVsdaK_0 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5953116313799832972', time=2024-09-22T10:39:11.963710+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.aFGhzVjBtDpW_ndHH2peBIalkkBtNTp_0 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1265365715504938573', time=2024-09-22T10:39:14.893407+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.YSsoAbgigfo8xfR6rQfBEF_zJ6-CNbx_0 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9675624441659562767', time=2024-09-22T10:39:14.894860+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.g-1f7UPI8mL32mtZEit75rd0GHOACd8_0 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.150255233659486282', time=2024-09-22T10:39:52.692318+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.f6iLfKWLrzIOJZYnw_KeDYjZEpIz7zn_0 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12015632418910982135', time=2024-09-22T10:40:30.778661+0000, chain.objs.size()=1 2024-09-22T08:45:38.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.803+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.06Ax8uo9vpqiaCGlZne9uqkBEHbgu-d_0 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.808+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.403462259669725731', time=2024-09-22T10:40:30.845241+0000, chain.objs.size()=1 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.808+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.bg7USuMgUB5hveVXP29cbZESeAvAF1O_0 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.808+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13214571386257085131', time=2024-09-22T10:41:03.836910+0000, chain.objs.size()=1 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.808+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.aqgO7lHqzw-SYMhKOsRxcAw66n7EuSL_0 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17830894796620550922', time=2024-09-22T10:41:40.309561+0000, chain.objs.size()=1 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.wVyyUbe4XsJADZ2oK8hOPY37zt_UTaH_0 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7332722844987553218', time=2024-09-22T10:41:40.323672+0000, chain.objs.size()=1 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.Vv8xwB2USikd1smqPRQfRzEYTLIwhPw_0 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15454011041108195486', time=2024-09-22T10:42:17.089847+0000, chain.objs.size()=1 2024-09-22T08:45:38.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.qJpKgpxSxsEUmO9xrPVXTd1s8y8KGi0_0 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8651116913736690623', time=2024-09-22T10:42:22.397496+0000, chain.objs.size()=1 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.cH031szGn1is1R4otz7cpuQjst3p32R_0 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15569778847725685910', time=2024-09-22T10:42:55.948923+0000, chain.objs.size()=1 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.D0VAGhefN9SRsrxMyN2Bz9XUeTfqXWp_0 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15695743967902349177', time=2024-09-22T10:45:02.678805+0000, chain.objs.size()=1 2024-09-22T08:45:38.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.809+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.lN1VeQwsBKnGPKCXhS3Jorm04u4QWJv_0 2024-09-22T08:45:38.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.812+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.815+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:45:38.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15294605432572947880', time=2024-09-22T10:36:40.702599+0000, chain.objs.size()=1 2024-09-22T08:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.kn7sXQwC_55LKbVdtEn2FsFyxBSfPlK_0 2024-09-22T08:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10680912493367012590', time=2024-09-22T10:38:00.700499+0000, chain.objs.size()=1 2024-09-22T08:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.adyt8jSZnBpwLA5jMBaRx0ILXPPHKMw_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9563878821785759413', time=2024-09-22T10:38:34.142808+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.2yBz6_qcnuSqozDbZhmHe7xMg7Xwcai_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9017845452300429430', time=2024-09-22T10:38:38.678573+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.j9laEvdAXA7UdPeai_DmtU1XYfJy682_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2162211647285670226', time=2024-09-22T10:39:11.975475+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.CRnP3ysLXU9R4WVkc5O6LVk7I4zYyVs_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14888135946413684169', time=2024-09-22T10:39:16.921574+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.AjHsmS2wMBChuBYvbEMaWEPPQ2uY2ED_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12145463359880848183', time=2024-09-22T10:39:16.945731+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.mHVDy66OCa5NaK83mmtmug2HXLQ0ydO_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14685892099771892118', time=2024-09-22T10:40:25.603265+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.BizMNKZr7aOV4ZhF8bZ4H66PbTu1tmu_0 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103206739309566033', time=2024-09-22T10:40:25.621993+0000, chain.objs.size()=1 2024-09-22T08:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.THuYuR2ad5M-lqEphi1Rtde7RxighSP_0 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7948290928367490181', time=2024-09-22T10:41:43.606120+0000, chain.objs.size()=1 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.817+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.ccZZhCww4WU7X1_IEPA7XjFqC3aKKOG_0 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.818+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8120353425680891844', time=2024-09-22T10:42:17.087211+0000, chain.objs.size()=1 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.818+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.CiCbLuXqlMLZeMCVh_2ubqLxldYQ94I_0 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.818+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3326482952171757980', time=2024-09-22T10:42:17.146287+0000, chain.objs.size()=1 2024-09-22T08:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.818+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.v4T83C_R5fEevRb77L2qNnecpW9EK48_0 2024-09-22T08:45:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.821+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12406057701549843274', time=2024-09-22T10:45:02.648590+0000, chain.objs.size()=1 2024-09-22T08:45:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.821+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.Hn1s-oJ0iNhAelEGoxNGp2EAJ0AsVbj_0 2024-09-22T08:45:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.821+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12907455454506850124', time=2024-09-22T10:45:02.666309+0000, chain.objs.size()=1 2024-09-22T08:45:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.821+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.pV6tLHxNShxYIvW6WtHA943zVtZ-Xhw_0 2024-09-22T08:45:38.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.824+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.827+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:45:38.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.828+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.828+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5394790514280762534', time=2024-09-22T10:37:58.203934+0000, chain.objs.size()=1 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.EdNSeWl8qoAwBTRsXLOFajCK-4yCwiO_0 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6672958087729452188', time=2024-09-22T10:38:00.677027+0000, chain.objs.size()=1 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.VccC0JWYC3Ms_9HYc3SAZq4dzAeDesX_0 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8191392693425474632', time=2024-09-22T10:38:34.240399+0000, chain.objs.size()=1 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.szfz1HUi08YBd0GgY4c-6X4JDT0O1wh_0 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16412425931140227051', time=2024-09-22T10:38:36.710109+0000, chain.objs.size()=1 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.g3DKw5q1T-UeD57L3WAimU-5CuMOEXs_0 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6553676317530497574', time=2024-09-22T10:39:14.889079+0000, chain.objs.size()=1 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.rqQtz7JGRmONRmBzn9v1v1tarqRK1iz_0 2024-09-22T08:45:38.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16034834218584289638', time=2024-09-22T10:39:49.779748+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.nKlmvIdS-hqUTdqJpHBAsxBJDl4goLB_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17226466931971253189', time=2024-09-22T10:39:52.677443+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.4w_6zKQ49tM6rGJP75yYWR1C2wA9ErP_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.823971287741371602', time=2024-09-22T10:40:25.667232+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.iN5GZyzkXHwnibhrtAr6gBhWPVKOxg5_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10641496196300020832', time=2024-09-22T10:40:28.792689+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.caVcAn62o2YDDZXfs5ZjXVznD3nhijr_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4702537822555078881', time=2024-09-22T10:41:03.849331+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.DsY3FRpAn2n8X8l6PMSgKAtBVWvOW_-_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3893565573486038897', time=2024-09-22T10:41:03.909477+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.X8uzhvNAuzbi-jct_d-V1y2gihv9Ibs_0 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14697434588287404114', time=2024-09-22T10:41:40.272895+0000, chain.objs.size()=1 2024-09-22T08:45:38.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.829+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.TSAV4kRVlpV4fNjCdq7rZm7cJfqgXDH_0 2024-09-22T08:45:38.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.833+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17768617528294787602', time=2024-09-22T10:41:40.328440+0000, chain.objs.size()=1 2024-09-22T08:45:38.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.833+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.K8zVBASWPC6usKrrXyns3E1oa-V3Y3h_0 2024-09-22T08:45:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16628271719232075740', time=2024-09-22T10:41:40.329369+0000, chain.objs.size()=1 2024-09-22T08:45:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.fsVC_NVgcB-maQcD8Rdb2iHql0v1sRD_0 2024-09-22T08:45:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11128114700813542448', time=2024-09-22T10:42:17.104641+0000, chain.objs.size()=1 2024-09-22T08:45:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.qYlm81EcAYQs3Trk5g4pUcM_YMaatoS_0 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4854502528852750330', time=2024-09-22T10:42:17.112670+0000, chain.objs.size()=1 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.4Ajy3fd4sfKXJROpusW00awfkNHOdFh_0 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5748317229383880369', time=2024-09-22T10:42:19.809938+0000, chain.objs.size()=1 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.vWv_jBPpaPyBfhmLlBfFs4e0R-Ns3c2_0 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14986550143321994842', time=2024-09-22T10:42:19.881360+0000, chain.objs.size()=1 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.834+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.7fFZKYzf9ocI4HdI9m8GLDlDY_YOos-_0 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.835+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5714907448134273477', time=2024-09-22T10:42:55.941729+0000, chain.objs.size()=1 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.835+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.2iOSRInKRw0idt51myc_lq6jJipgj6b_0 2024-09-22T08:45:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.835+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13075014729270060011', time=2024-09-22T10:45:10.438045+0000, chain.objs.size()=1 2024-09-22T08:45:38.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.835+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.19__shadow:AwoNkbKsGOa-R.PkVRcocu7xJVBaRWO_.tYwyvFnbJAKT3_OppXhokyS-iYK8aqF_0 2024-09-22T08:45:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.838+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.842+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:45:38.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.843+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_K73NIYHt9fqJ5qWqPYrJyOskRhZ8cdF', time=2024-09-22T10:36:40.465826+0000, chain.objs.size()=1 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.-QoIvRf8Kc1acfpkZm-QGSFq98GoG9H_0 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2096373681473584530', time=2024-09-22T10:36:40.728161+0000, chain.objs.size()=1 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9__shadow_.ZjFTfPGm5o9BygtZPXhCLtBYy5u1mAr_0 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13837948373994742497', time=2024-09-22T10:37:58.945479+0000, chain.objs.size()=1 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.KxUoXcza_rEcJJzS5JeMn52SLgn6tiJ_0 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5183951166077789364', time=2024-09-22T10:37:58.945996+0000, chain.objs.size()=1 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.XRUOMjHIjGlSVxNmqJ4d4MaN7dDINSt_0 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2801221791924455568', time=2024-09-22T10:38:00.680933+0000, chain.objs.size()=1 2024-09-22T08:45:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.53DzZQofEpk9xSp3hZAasPV80Ht49m8_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16209551303485325798', time=2024-09-22T10:38:03.100723+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.oEVGAR61JANFSfuh4Lxt1HeR_CWJZQ1_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18287496070232818575', time=2024-09-22T10:39:14.953175+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.AOqeDPrIP_jyU1bKUEHTYKwlNJiyxFV_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3740085273038562768', time=2024-09-22T10:40:25.626674+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.tO5QviGuHxiHO2HjG5OXFdtloAgm-IA_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17465206760681349187', time=2024-09-22T10:40:28.828527+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.R3vyomEdKLV2t9yh2dsPdYXHcxzmpNh_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14822423289400548282', time=2024-09-22T10:40:30.778268+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.bnJZFhmXZxcIY7RSWl-31lmF6OD6GuM_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9723538357217087904', time=2024-09-22T10:41:03.911390+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.-9XjXukwVmFpMNXqrX9cYANZaQN0fS5_0 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12170345756136142663', time=2024-09-22T10:41:43.651363+0000, chain.objs.size()=1 2024-09-22T08:45:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.844+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.egrsNBz6UVlKFy7KO6zwSJLpNXTNBVj_0 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5781044745444517837', time=2024-09-22T10:42:17.090608+0000, chain.objs.size()=1 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.3fFB8e4pVa2qvITXItoqcPYxeIqaXux_0 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12018399063072254172', time=2024-09-22T10:42:24.445825+0000, chain.objs.size()=1 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.2cah9yE3eCup1kYLfd6ixdFBaI9Pplt_0 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3633264299056397875', time=2024-09-22T10:42:55.918123+0000, chain.objs.size()=1 2024-09-22T08:45:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.l-aOtppEgN2VkgbLe0wMOfsrUtw9N2v_0 2024-09-22T08:45:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3744818866552366472', time=2024-09-22T10:45:02.663926+0000, chain.objs.size()=1 2024-09-22T08:45:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.847+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.7yL3BpTBRqZGbVjBge4LsT6_4gJPoxA_0 2024-09-22T08:45:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.851+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.854+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:45:38.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.855+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.855+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T08:45:38.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_ukcK4Ky_di_sAIDyL3uuR9QOykPVWqT', time=2024-09-22T10:36:40.503999+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.qLAOF1ssxsX6sy8NUQDveT7Mb8vqM20_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1379424090286735631', time=2024-09-22T10:38:00.700633+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.t-Q1yFu5sxT53iMbAbAWa5LJiQvRfio_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15764463950190043882', time=2024-09-22T10:38:36.729781+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.-Pp0k-UaIy8z-PaBe0KFuiigUDNwNMI_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2844148627309705787', time=2024-09-22T10:38:38.701472+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.6ZTcXmbGF29JqlCySolkWirmfdlna3Y_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12926265187635772820', time=2024-09-22T10:39:16.847990+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.EAJyMhlbkKzNmuW-fnPjC_XXdhne-0G_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11570897908530146737', time=2024-09-22T10:39:16.870588+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.nFRxFSw525DBZ1jSRSnsBBTsl_cKDXu_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17879099440789436811', time=2024-09-22T10:39:49.754028+0000, chain.objs.size()=1 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.tayG4YAHu1DJUo65mzT9sZG0p8l0DRk_0 2024-09-22T08:45:38.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15667162414069008340', time=2024-09-22T10:39:52.727007+0000, chain.objs.size()=1 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.7osojO6EiOCMXVlQKMifgsbHUNNHdj8_0 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6051914889666742468', time=2024-09-22T10:39:52.766775+0000, chain.objs.size()=1 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.X7tS9G8-yjb68qK507PiPYkgCi42Syc_0 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15093272562065870206', time=2024-09-22T10:40:25.646908+0000, chain.objs.size()=1 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.Acb5mHi_lH2NPX-yeLr8Lbp72V6L28k_0 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1404103146166620094', time=2024-09-22T10:41:06.642328+0000, chain.objs.size()=1 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.2K0o_HBdHkgSF-7aZ5IsGtsEeyociNJ_0 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.670101596069239348', time=2024-09-22T10:41:06.643198+0000, chain.objs.size()=1 2024-09-22T08:45:38.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.856+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.hjaqv1E4k2robDRatI-A8WmsTQ_3ext_0 2024-09-22T08:45:38.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.859+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4195049038900308931', time=2024-09-22T10:41:40.301980+0000, chain.objs.size()=1 2024-09-22T08:45:38.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.859+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.35__shadow_.2jzPtcccDB-fny6DFQhkntUVb5wNkY7_0 2024-09-22T08:45:38.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.859+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18342627182905714053', time=2024-09-22T10:42:22.455883+0000, chain.objs.size()=1 2024-09-22T08:45:38.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.859+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.zUoSzb9FBJPai598fzfMNdnVC9QcW9e_0 2024-09-22T08:45:38.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.862+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.864+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:45:38.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.865+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9009750986217471806', time=2024-09-22T10:37:58.859432+0000, chain.objs.size()=1 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.KD8Z844v6TjaDO1Lg_gMNhbd3TLMr-h_0 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8332702011432328814', time=2024-09-22T10:38:36.638957+0000, chain.objs.size()=1 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.e6iEQq_Xl4OA1h-anm8XyreNw_kmEOv_0 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16596738642923464096', time=2024-09-22T10:39:11.944634+0000, chain.objs.size()=1 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.3vmws0JWrtdxrhOICGihXNz6zBUewPH_0 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17283928802048456676', time=2024-09-22T10:39:16.881315+0000, chain.objs.size()=1 2024-09-22T08:45:38.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.4AWpubSsFlqEw8MAJ9y-ACsBCfi5A88_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10607196712055186981', time=2024-09-22T10:39:16.944160+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.9bCHv0c65OFCmhwLHNDktF2_ulUHTzv_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12462102448963013943', time=2024-09-22T10:39:16.950141+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.gwQXfoWZDDRqf0PcSpenpOtzdog8cGz_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8934806151741302113', time=2024-09-22T10:39:49.712619+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.B1C_qmxF9Kas6vN3vhWwU4xNiqT7ef1_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16586304563144330291', time=2024-09-22T10:39:52.751902+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.9tgYeBe2A-luyEYdY5iFShDEaAdYxk5_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3641051968929622207', time=2024-09-22T10:40:25.627397+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_._zmEOyQPO2Zeh5W1opZlIOk2K2QlPeW_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1941398755070726813', time=2024-09-22T10:40:25.673437+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.30__shadow_.25cC0q1kfq9Nr_oYZ-gKYv01_StOoKP_0 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14246049204578210782', time=2024-09-22T10:41:03.853572+0000, chain.objs.size()=1 2024-09-22T08:45:38.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.gP7WgZXp0sxprEH9zOtFW361RC-cWvg_0 2024-09-22T08:45:38.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160567101335340310', time=2024-09-22T10:41:43.652076+0000, chain.objs.size()=1 2024-09-22T08:45:38.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.866+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.DNslQzdRaG6DA-aWHLFOl7UMVjos8Il_0 2024-09-22T08:45:38.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.869+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10892953018030949451', time=2024-09-22T10:42:19.843615+0000, chain.objs.size()=1 2024-09-22T08:45:38.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.869+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.m71T6o8FYHHBJoHsbKz28_hEEe0CDV0_0 2024-09-22T08:45:38.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.869+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6393687907437278498', time=2024-09-22T10:42:55.943482+0000, chain.objs.size()=1 2024-09-22T08:45:38.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.869+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.ybyoPuiYkCc1WmVF4zGX3VwlgicFm1w_0 2024-09-22T08:45:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.871+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4106885583214958094', time=2024-09-22T10:45:02.663913+0000, chain.objs.size()=1 2024-09-22T08:45:38.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.871+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.QOV2Xwb6l89U8ly9UuCiuYv1YbgZ1-g_0 2024-09-22T08:45:38.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.874+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.877+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:45:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.878+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.878+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5696456169338480988', time=2024-09-22T10:36:40.307833+0000, chain.objs.size()=1 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.IR9U3YbIympe0tXAhoGJTnZqQLm6UBb_0 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6376544789280000448', time=2024-09-22T10:36:40.361969+0000, chain.objs.size()=4 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.1 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.2 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.3 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12__multipart_foo.2~2mmHF013fTDjWWhK1De-TZtpNIuDTM5.4 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8937643622615014543', time=2024-09-22T10:36:40.483599+0000, chain.objs.size()=1 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16__shadow_.tIWUKAl9-Myu4RT1bP3xOoXaZ7IoqDX_0 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7848615742815598861', time=2024-09-22T10:36:40.538569+0000, chain.objs.size()=3 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.1 2024-09-22T08:45:38.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.2 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__multipart_foo-FROZEN.2~DT59WNvI_EUaY7SVt-ou_h77JFfh4iX.3 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14528430930489427833', time=2024-09-22T10:36:40.690152+0000, chain.objs.size()=1 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8__shadow_.CWn96TBEiamV-tJPJNmKJc-cZj4KYrq_0 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16895525075403646088', time=2024-09-22T10:37:58.929716+0000, chain.objs.size()=1 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.I9kFfu2R7Q231SECo8JWNFpYCMVRWZo_0 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1566198209106840299', time=2024-09-22T10:38:38.634309+0000, chain.objs.size()=1 2024-09-22T08:45:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.879+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.Ugn514UCK322IGfBWZPVTkPOy5owliq_0 2024-09-22T08:45:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.882+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15486300484256390966', time=2024-09-22T10:39:14.915396+0000, chain.objs.size()=1 2024-09-22T08:45:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.882+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.26__shadow_.OeQvUBiH-z520U5RvyuThpGf31iM0Ca_0 2024-09-22T08:45:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10834198926063593691', time=2024-09-22T10:39:16.871329+0000, chain.objs.size()=1 2024-09-22T08:45:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.9JovAmCYyuqPfTHwUeOxToYOsuuTaFZ_0 2024-09-22T08:45:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.627448397339227648', time=2024-09-22T10:39:16.922941+0000, chain.objs.size()=1 2024-09-22T08:45:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.27__shadow_.LPfDvNhZHHc-VUofbkamlRxdlAlcPvJ_0 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.707674392847256950', time=2024-09-22T10:39:49.763931+0000, chain.objs.size()=1 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.v-w2pU7gQQ_vgA1kfKR3e2kJc6froKM_0 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15661137197817678750', time=2024-09-22T10:39:52.708045+0000, chain.objs.size()=1 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.UCncTt-dU2-d0HFRRMPnoV3gbxNhGK9_0 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17823214594112496069', time=2024-09-22T10:40:30.720005+0000, chain.objs.size()=1 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.g0HaHhp7KSTeLbJxzjgCpRXdEIoJ-Ry_0 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6504469160020088183', time=2024-09-22T10:40:30.833945+0000, chain.objs.size()=1 2024-09-22T08:45:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.883+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.rhnzEDgY3A-WHHIdVb51yX_LuH46xB7_0 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5594358964055547324', time=2024-09-22T10:41:03.819901+0000, chain.objs.size()=1 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.2lh8cvNa7WHB0S5yY3HloT9k8QD1Ok2_0 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17166231191393770126', time=2024-09-22T10:41:06.612377+0000, chain.objs.size()=1 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.o8HN7AYYvikYohOvxDizf07N48frJyX_0 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6135673916412758147', time=2024-09-22T10:41:43.655915+0000, chain.objs.size()=1 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.Gyrgqyfj_eCQk6K4ao5tvI7rgdUqpBO_0 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15924666816121017703', time=2024-09-22T10:42:17.097887+0000, chain.objs.size()=1 2024-09-22T08:45:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.885+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.37__shadow_.PHcUb1zEP1YaOGg0YhxUCjkobHrZUu3_0 2024-09-22T08:45:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14330507478946761403', time=2024-09-22T10:42:19.826184+0000, chain.objs.size()=1 2024-09-22T08:45:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.38__shadow_.Emp3t_BTI01tpXH_QE8oP0_kNwqOMGM_0 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7050798163007779957', time=2024-09-22T10:42:22.463752+0000, chain.objs.size()=1 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.0edRKwTpXROeHjOQSiboKksY6RfwaoP_0 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15273228626794851343', time=2024-09-22T10:42:55.899014+0000, chain.objs.size()=1 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.5CP3vJKMKqxqHvEjYZb0_i8b4fQI_Bh_0 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.204885506276699488', time=2024-09-22T10:45:02.664648+0000, chain.objs.size()=1 2024-09-22T08:45:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.887+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18__shadow_.ya_o_TwVmsZPX36Jyotz1G1BItjVJbD_0 2024-09-22T08:45:38.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.892+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.895+0000 7f306432e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:45:38.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.896+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:38.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.896+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:38.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-22T08:45:38.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10406049797907352289', time=2024-09-22T10:36:40.325686+0000, chain.objs.size()=1 2024-09-22T08:45:38.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5__shadow_.5_b7tqx-ZYVxwqYZ29JStE73caToUdY_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='_KYvTO-f67Qo3qCxxKCIsqFy5D-L8MSA', time=2024-09-22T10:36:40.534196+0000, chain.objs.size()=2 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CGc_OqXeUI2T_EkQQkahCx2fFpDac75_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17__shadow_.CGc_OqXeUI2T_EkQQkahCx2fFpDac75_1 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7155145779113056282', time=2024-09-22T10:37:58.920277+0000, chain.objs.size()=1 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20__shadow_.MYC62ujWcVf8ibDRupBntvmi2GgzFmb_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9804331801802350179', time=2024-09-22T10:38:00.736269+0000, chain.objs.size()=1 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21__shadow_.lkzxiEQ7uSIYBaMeIIC9YXHVdpLWxl-_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1370588938412485171', time=2024-09-22T10:38:34.204193+0000, chain.objs.size()=1 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.22__shadow_.AdTghb8IU0gUsdXWJob0lPnVMaNO3FB_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10055384470390508751', time=2024-09-22T10:38:36.736358+0000, chain.objs.size()=1 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.3FkyuUrGxwWB0rrSkMKhmqgjAmZgFHo_0 2024-09-22T08:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15096078896330514589', time=2024-09-22T10:38:36.756659+0000, chain.objs.size()=1 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.23__shadow_.OFdBx-jDozg1Fal5NWK7nWxVxJ6IxW-_0 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8882671341223140204', time=2024-09-22T10:38:38.739810+0000, chain.objs.size()=1 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24__shadow_.wLzsI24PyfYQVF4-OIaMFZiGFsHQGbv_0 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4345359252866392919', time=2024-09-22T10:39:11.984670+0000, chain.objs.size()=1 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.25__shadow_.gvBeJolUpKW2cIX4UsL8gOSg6iLmhZG_0 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12000196875001505606', time=2024-09-22T10:39:49.786051+0000, chain.objs.size()=1 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.28__shadow_.DyhgkThyTQCsjvsw4L3oyyQrBgcFaB4_0 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14947489562525055716', time=2024-09-22T10:39:52.684877+0000, chain.objs.size()=1 2024-09-22T08:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.897+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.29__shadow_.egzUVHS92sxWYisuJwocMK9BZQLRRg9_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2507545532195047613', time=2024-09-22T10:40:28.745850+0000, chain.objs.size()=1 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.31__shadow_.GztbHnmrebYICp3TVaREvh4ZMkICTt6_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12902071962930904612', time=2024-09-22T10:40:30.731610+0000, chain.objs.size()=1 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.32__shadow_.y8_NbVgu0LuF2odhGn0hHcZnbeR1EUa_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13866819644966697111', time=2024-09-22T10:41:03.894265+0000, chain.objs.size()=1 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.33__shadow_.KVl1--21VBQquKvAJllqeKaMW588rCV_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8997148137140717041', time=2024-09-22T10:41:06.670762+0000, chain.objs.size()=1 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34__shadow_.JhXrQQSMMbcs91EukjM1TnmixKSAjPx_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14782894115414729132', time=2024-09-22T10:41:43.638805+0000, chain.objs.size()=1 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.36__shadow_.NEXb23JncEWz6vuR7uiC-WxCVWXBuYm_0 2024-09-22T08:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7933328766572903866', time=2024-09-22T10:42:22.440422+0000, chain.objs.size()=1 2024-09-22T08:45:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.fAvB6fLfeWRh3NvRSXb9VQwxAzMP7Lg_0 2024-09-22T08:45:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9615092343872031639', time=2024-09-22T10:42:22.441052+0000, chain.objs.size()=1 2024-09-22T08:45:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.39__shadow_.aCWQVe8kiGGXj3n4QLecWIfYKgrVazb_0 2024-09-22T08:45:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4727988685802804250', time=2024-09-22T10:42:55.887372+0000, chain.objs.size()=1 2024-09-22T08:45:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.902+0000 7f306432e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.40__shadow_.YLjo0ByBhFLqsGKxW_LU5EzHInqIdDs_0 2024-09-22T08:45:38.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.906+0000 7f306432e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:45:38.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.909+0000 7f2f167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.912+0000 7f306432e800 20 remove_watcher() i=0 2024-09-22T08:45:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.912+0000 7f306432e800 2 removed watcher, disabling cache 2024-09-22T08:45:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.913+0000 7f306432e800 20 remove_watcher() i=1 2024-09-22T08:45:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.913+0000 7f306432e800 20 remove_watcher() i=2 2024-09-22T08:45:38.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.914+0000 7f306432e800 20 remove_watcher() i=3 2024-09-22T08:45:38.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.915+0000 7f306432e800 20 remove_watcher() i=4 2024-09-22T08:45:38.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.917+0000 7f306432e800 20 remove_watcher() i=5 2024-09-22T08:45:38.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.917+0000 7f306432e800 20 remove_watcher() i=6 2024-09-22T08:45:38.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:38.918+0000 7f306432e800 20 remove_watcher() i=7 2024-09-22T08:45:38.930 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:45:39.022 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:45:39.022 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:45:39.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.058+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 realm 2024-09-22T08:45:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:45:39.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.060+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.061+0000 7f450972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:39.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.061+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.062+0000 7f450972c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:45:39.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.062+0000 7f450972c800 20 searching for the correct realm 2024-09-22T08:45:39.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.064+0000 7f4505b3f640 0 -- 172.21.15.78:0/4160893163 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f44fc08bce0 msgr2=0x7f44fc068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.268+0000 7f4504b3d640 0 -- 172.21.15.78:0/4160893163 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f450001e060 msgr2=0x7f4500087ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.273+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 zone default found 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 4 Realm: () 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 zonegroup default 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.274+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 rados->read ofs=0 len=0 2024-09-22T08:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 started sync module instance, tier type = 2024-09-22T08:45:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.275+0000 7f450972c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:45:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=0 2024-09-22T08:45:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=1 2024-09-22T08:45:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=2 2024-09-22T08:45:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=3 2024-09-22T08:45:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=4 2024-09-22T08:45:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=5 2024-09-22T08:45:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.283+0000 7f450972c800 20 add_watcher() i=6 2024-09-22T08:45:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.284+0000 7f450972c800 20 add_watcher() i=7 2024-09-22T08:45:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.284+0000 7f450972c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.286+0000 7f43bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.286+0000 7f450972c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.286+0000 7f450972c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:45:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.320+0000 7f43bafe5640 20 reqs_thread_entry: start 2024-09-22T08:45:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.320+0000 7f450972c800 20 init_complete bucket index max shards: 11 2024-09-22T08:45:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.320+0000 7f450972c800 20 Filter name: none 2024-09-22T08:45:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.320+0000 7f43b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:45:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.320+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:45:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.322+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.322+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.322+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.323+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:45:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.325+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.325+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.326+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.327+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:45:39.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.328+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.329+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.329+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.330+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:45:39.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.331+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.332+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.332+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.333+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:45:39.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.334+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.335+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.335+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.336+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:45:39.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.337+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.338+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.338+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.339+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:45:39.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.340+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.341+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.341+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.342+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:45:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.343+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.344+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.344+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.345+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:45:39.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.346+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.347+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.347+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.348+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:45:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.349+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.350+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.350+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.351+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:45:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.352+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.352+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.353+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.353+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:45:39.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.355+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.355+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.356+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.357+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:45:39.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.358+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.359+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.359+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.360+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:45:39.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.361+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.361+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.362+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.363+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:45:39.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.364+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.364+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.365+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.366+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:45:39.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.367+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.367+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.367+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.368+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:45:39.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.370+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.370+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.370+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.371+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:45:39.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.373+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.373+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.373+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.374+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:45:39.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.375+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.376+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.376+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.377+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:45:39.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.378+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.379+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.379+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.380+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:45:39.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.381+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.381+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.382+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.383+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:45:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.384+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.384+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.385+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.385+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:45:39.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.387+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.388+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.389+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.390+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:45:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.391+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.391+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.392+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.393+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:45:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.394+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.394+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.395+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.396+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:45:39.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.397+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.397+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.398+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.399+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:45:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.400+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.400+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.401+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.402+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:45:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.403+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.403+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.404+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.404+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:45:39.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.406+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.407+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.407+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.408+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:45:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.409+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.409+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.410+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.411+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:45:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.412+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.412+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.412+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.413+0000 7f450972c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:45:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.414+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.415+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:45:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.415+0000 7f450972c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:45:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.417+0000 7f43bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:45:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.419+0000 7f450972c800 20 remove_watcher() i=0 2024-09-22T08:45:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.419+0000 7f450972c800 2 removed watcher, disabling cache 2024-09-22T08:45:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.420+0000 7f450972c800 20 remove_watcher() i=1 2024-09-22T08:45:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.421+0000 7f450972c800 20 remove_watcher() i=2 2024-09-22T08:45:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.422+0000 7f450972c800 20 remove_watcher() i=3 2024-09-22T08:45:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.422+0000 7f450972c800 20 remove_watcher() i=4 2024-09-22T08:45:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.424+0000 7f450972c800 20 remove_watcher() i=5 2024-09-22T08:45:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.424+0000 7f450972c800 20 remove_watcher() i=6 2024-09-22T08:45:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:45:39.425+0000 7f450972c800 20 remove_watcher() i=7 2024-09-22T08:45:39.437 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-22T08:45:39.920 INFO:teuthology.orchestra.run.smithi078.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-22T08:45:43.621 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean UP-TO-DATE 2024-09-22T08:46:02.020 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-22T08:46:02.020 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-22T08:46:02.020 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-22T08:46:02.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:02.720 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-22T08:46:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:46:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:46:02.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:02.721 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:46:02.721 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-22T08:46:08.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:08.520 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-22T08:46:08.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:08.520 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-22T08:46:12.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-22T08:46:12.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:12.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-22T08:46:12.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:12.619 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-22T08:46:13.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:13.019 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-22T08:46:17.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:17.819 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-22T08:46:18.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:18.219 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T08:46:18.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:18.220 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T08:46:18.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:18.319 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-22T08:46:18.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:18.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-22T08:46:18.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:18.819 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-22T08:46:22.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:22.819 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-22T08:46:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:23.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-22T08:46:23.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:23.819 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-22T08:46:23.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22 08:46:23,729 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:46:50.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:50.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-22T08:46:51.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:51.219 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-22T08:46:51.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:51.319 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-22T08:46:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:51.719 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-22T08:46:51.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:51.819 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-22T08:46:52.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:52.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-22T08:46:56.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:56.719 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-22T08:46:57.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:57.119 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T08:46:57.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:57.219 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T08:46:57.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:46:57.319 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-22T08:47:03.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:03.119 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-22T08:47:03.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:03.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T08:47:19.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:19.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T08:47:20.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:20.119 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-22T08:47:22.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:22.219 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-22T08:47:22.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:47:22.619 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-22T08:48:51.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:48:51.920 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-22T08:48:52.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:48:52.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-22T08:48:57.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:48:57.520 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-22T08:48:57.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:48:57.919 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-22T08:49:01.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:01.619 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-22T08:49:02.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:02.119 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-22T08:49:03.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:03.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-22T08:49:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:10.319 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-22T08:49:10.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:10.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-22T08:49:10.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:10.919 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-22T08:49:10.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:10.919 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-22T08:49:11.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:11.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-22T08:49:11.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-22T08:49:11.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:11.922 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-22T08:49:12.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-22T08:49:12.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:12.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-22T08:49:12.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:12.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-22T08:49:12.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:12.919 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-22T08:49:13.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:13.019 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-22T08:49:13.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:13.419 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-22T08:49:13.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:13.620 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-22T08:49:14.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-22T08:49:22.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:22.519 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:49:23.020 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:49:23.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:23.021 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 3m 43s 2024-09-22T08:49:23.021 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-22T08:49:23.340 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:23.392 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.428+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.430+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.430+0000 7f58a3b32800 20 realm 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.430+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.431+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.431+0000 7f58a3b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:23.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.431+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.431+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.431+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.432+0000 7f58a3b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.432+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.433+0000 7f58a3b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:23.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.433+0000 7f58a3b32800 20 searching for the correct realm 2024-09-22T08:49:23.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.434+0000 7f589efbb640 0 -- 172.21.15.78:0/1486395034 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f589806cc10 msgr2=0x7f58980b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:49:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.640+0000 7f589ffbd640 0 -- 172.21.15.78:0/1486395034 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5561e50d5970 msgr2=0x5561e50d7d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.646+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 zone default found 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 4 Realm: () 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 zonegroup default 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.647+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 rados->read ofs=0 len=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 started sync module instance, tier type = 2024-09-22T08:49:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.648+0000 7f58a3b32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=0 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=1 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=2 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=3 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=4 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=5 2024-09-22T08:49:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.658+0000 7f58a3b32800 20 add_watcher() i=6 2024-09-22T08:49:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.659+0000 7f58a3b32800 20 add_watcher() i=7 2024-09-22T08:49:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.659+0000 7f58a3b32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.661+0000 7f5755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.662+0000 7f58a3b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.662+0000 7f58a3b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:23.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.701+0000 7f5754fe1640 20 reqs_thread_entry: start 2024-09-22T08:49:23.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.701+0000 7f58a3b32800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:23.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.701+0000 7f58a3b32800 20 Filter name: none 2024-09-22T08:49:23.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.701+0000 7f56ce7fc640 20 reqs_thread_entry: start 2024-09-22T08:49:23.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.701+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:23.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.702+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:49:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6193909245285650897', time=2024-09-22T10:46:50.572251+0000, chain.objs.size()=4 2024-09-22T08:49:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.47__shadow_.y_LC96Rz1eUvK0-jVcwyuIUeqNQv6T8_0 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.47__shadow_.y_LC96Rz1eUvK0-jVcwyuIUeqNQv6T8_1 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.47__shadow_.y_LC96Rz1eUvK0-jVcwyuIUeqNQv6T8_2 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.47__shadow_.y_LC96Rz1eUvK0-jVcwyuIUeqNQv6T8_3 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13859331830581741975', time=2024-09-22T10:47:19.647412+0000, chain.objs.size()=5 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file.mpg.2~dIEz02aKfn1HqIlZeZCgxIqrZYp7hFo.1 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file.mpg.2~dIEz02aKfn1HqIlZeZCgxIqrZYp7hFo.2 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file.mpg.2~dIEz02aKfn1HqIlZeZCgxIqrZYp7hFo.3 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.703+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file.mpg.2~dIEz02aKfn1HqIlZeZCgxIqrZYp7hFo.4 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.704+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file.mpg.2~dIEz02aKfn1HqIlZeZCgxIqrZYp7hFo.5 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.704+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11384036725746659737', time=2024-09-22T10:47:19.719805+0000, chain.objs.size()=5 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.704+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file2.mpg.2~ZmFcFKYVxkHrwisQo7D9W_F8dMVrgK1.1 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.704+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file2.mpg.2~ZmFcFKYVxkHrwisQo7D9W_F8dMVrgK1.2 2024-09-22T08:49:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.704+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file2.mpg.2~ZmFcFKYVxkHrwisQo7D9W_F8dMVrgK1.3 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.709+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file2.mpg.2~ZmFcFKYVxkHrwisQo7D9W_F8dMVrgK1.4 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.709+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__multipart_file2.mpg.2~ZmFcFKYVxkHrwisQo7D9W_F8dMVrgK1.5 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.709+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~p15RTpLy9QkEm-UAni1hRP37mzsymja', time=2024-09-22T10:47:22.458740+0000, chain.objs.size()=3 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.709+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.55__multipart_key1.2~p15RTpLy9QkEm-UAni1hRP37mzsymja.7 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.709+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.55__multipart_key1.2~p15RTpLy9QkEm-UAni1hRP37mzsymja.10 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.55__multipart_key1.2~p15RTpLy9QkEm-UAni1hRP37mzsymja.13 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12221306781561618896', time=2024-09-22T10:48:16.074509+0000, chain.objs.size()=10 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.1 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.2 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.3 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.4 2024-09-22T08:49:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.710+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.5 2024-09-22T08:49:23.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.712+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.6 2024-09-22T08:49:23.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.714+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.7 2024-09-22T08:49:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.715+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.8 2024-09-22T08:49:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.715+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.9 2024-09-22T08:49:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.716+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~VWFq1E1O53EKLswcH-V_Cvejg8DwuaZ.10 2024-09-22T08:49:23.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.721+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.724+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:23.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.725+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16900878609348272250', time=2024-09-22T10:49:01.772655+0000, chain.objs.size()=5 2024-09-22T08:49:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.58__multipart_key1.2~Bj7SB6rU6Wa14aTQKxMir3OTJiaXGPi.1 2024-09-22T08:49:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.58__multipart_key1.2~Bj7SB6rU6Wa14aTQKxMir3OTJiaXGPi.2 2024-09-22T08:49:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.58__multipart_key1.2~Bj7SB6rU6Wa14aTQKxMir3OTJiaXGPi.3 2024-09-22T08:49:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.58__multipart_key1.2~Bj7SB6rU6Wa14aTQKxMir3OTJiaXGPi.4 2024-09-22T08:49:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.726+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.58__multipart_key1.2~Bj7SB6rU6Wa14aTQKxMir3OTJiaXGPi.5 2024-09-22T08:49:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.729+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.731+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:23.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.733+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.733+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.733+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.733+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9425226030559448787', time=2024-09-22T10:46:23.213982+0000, chain.objs.size()=5 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.734+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.1 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.734+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.2 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.734+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.3 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.734+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.4 2024-09-22T08:49:23.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.734+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.5 2024-09-22T08:49:23.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.736+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.739+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.740+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.740+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.741+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.741+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.743+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.743+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.744+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.744+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.746+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.746+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.746+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.746+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13817505170416133144', time=2024-09-22T10:49:11.070474+0000, chain.objs.size()=1 2024-09-22T08:49:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.746+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.61__shadow_.pSf7gA9yqnk22ZZMmP5AxBjWJMA49yw_0 2024-09-22T08:49:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.748+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.750+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.752+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.752+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.752+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.753+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.755+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.755+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.756+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.756+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8309074384659286287', time=2024-09-22T10:49:13.144368+0000, chain.objs.size()=1 2024-09-22T08:49:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.756+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.65__shadow_.IojpReU8SVFKMHQN4rC6B00wvW8AIws_0 2024-09-22T08:49:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.757+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.759+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.760+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.761+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.761+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.762+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.763+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.763+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18192355941777851109', time=2024-09-22T10:47:40.067900+0000, chain.objs.size()=11 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.1 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.2 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.3 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.4 2024-09-22T08:49:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.5 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.6 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.7 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.8 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.9 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.10 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~qUpvTZFRngNoWZJJXrRti0SS1yfufik.11 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6260565063022807078', time=2024-09-22T10:49:12.624225+0000, chain.objs.size()=1 2024-09-22T08:49:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.764+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.64__shadow_.Jgwd1gUc12IV8rvXdhUZ559c5vzaG4q_0 2024-09-22T08:49:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.771+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.773+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.774+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11016425369074129483', time=2024-09-22T10:46:56.823487+0000, chain.objs.size()=5 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.52__multipart_key1.2~f54gmUswVpM91GKk_m3jdar5-iMCIEZ.1 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.52__multipart_key1.2~f54gmUswVpM91GKk_m3jdar5-iMCIEZ.2 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.52__multipart_key1.2~f54gmUswVpM91GKk_m3jdar5-iMCIEZ.3 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.52__multipart_key1.2~f54gmUswVpM91GKk_m3jdar5-iMCIEZ.4 2024-09-22T08:49:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.775+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.52__multipart_key1.2~f54gmUswVpM91GKk_m3jdar5-iMCIEZ.5 2024-09-22T08:49:23.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.778+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.780+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:23.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.177630723320832400', time=2024-09-22T10:46:47.990690+0000, chain.objs.size()=5 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~jKBPoD2-MeH7wO78ntv6LPkEpEOQIeD.1 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~jKBPoD2-MeH7wO78ntv6LPkEpEOQIeD.1_1 2024-09-22T08:49:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~jKBPoD2-MeH7wO78ntv6LPkEpEOQIeD.2 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~jKBPoD2-MeH7wO78ntv6LPkEpEOQIeD.2_1 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~jKBPoD2-MeH7wO78ntv6LPkEpEOQIeD.3 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15138220775202633377', time=2024-09-22T10:47:19.682999+0000, chain.objs.size()=1 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__shadow_.AOIyjiXK60F7y2ORRWKp1obJoHSr_77_0 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4446959399841942044', time=2024-09-22T10:48:52.056704+0000, chain.objs.size()=11 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.1 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.1_1 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.2 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.2_1 2024-09-22T08:49:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.3 2024-09-22T08:49:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.782+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.3_1 2024-09-22T08:49:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.785+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.4 2024-09-22T08:49:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.786+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.4_1 2024-09-22T08:49:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.787+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.5 2024-09-22T08:49:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.788+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.5_1 2024-09-22T08:49:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.788+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~tAT1mqGknDiTGymNzs6ILXOIGgqLXLg.6 2024-09-22T08:49:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.792+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.795+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.796+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7', time=2024-09-22T10:46:12.018662+0000, chain.objs.size()=5 2024-09-22T08:49:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41__multipart_key1.2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7.1 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41__multipart_key1.2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7.2 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41__multipart_key1.2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7.3 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41__multipart_key1.2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7.4 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41__multipart_key1.2~Hi3DBqpzTU-S_AJAWh3zllMGjz1eZR7.5 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15199847569936133485', time=2024-09-22T10:49:12.103745+0000, chain.objs.size()=1 2024-09-22T08:49:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.797+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.63__shadow_.jqSf5lQEzv-81winJbuNe_5H_5Ace8X_0 2024-09-22T08:49:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.800+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.802+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:23.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.803+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11677193361233923029', time=2024-09-22T10:48:43.838951+0000, chain.objs.size()=11 2024-09-22T08:49:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.1 2024-09-22T08:49:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.1_1 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.2 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.2_1 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.3 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.3_1 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.4 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.4_1 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.5 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.5_1 2024-09-22T08:49:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.804+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~PrFnvvMxpFKuRWowG66RPicPMsG9sBR.6 2024-09-22T08:49:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.811+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.813+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:23.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.814+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.446989027224061001', time=2024-09-22T10:46:31.864586+0000, chain.objs.size()=5 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~JgykPSp4Y8UoEEaWCoeTOaTzY-OlPTp.1 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~JgykPSp4Y8UoEEaWCoeTOaTzY-OlPTp.2 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~JgykPSp4Y8UoEEaWCoeTOaTzY-OlPTp.3 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~JgykPSp4Y8UoEEaWCoeTOaTzY-OlPTp.4 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~JgykPSp4Y8UoEEaWCoeTOaTzY-OlPTp.5 2024-09-22T08:49:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4701553444854864158', time=2024-09-22T10:49:11.582723+0000, chain.objs.size()=1 2024-09-22T08:49:23.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.815+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.62__shadow_.WMTKs6iwQgLU12unCSKJUwgTEbG8OWf_0 2024-09-22T08:49:23.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.819+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.822+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.823+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.823+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12931151672444344665', time=2024-09-22T10:48:56.481078+0000, chain.objs.size()=1 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__shadow_.cTvnkG8Jvek4zDXe8IMKPF52bW98dbv_0 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6353280480928647785', time=2024-09-22T10:48:57.580316+0000, chain.objs.size()=5 2024-09-22T08:49:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__multipart_key1.2~CDzHAo-Osy8zKUl1hoRAziFP7xUj0kJ.1 2024-09-22T08:49:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__multipart_key1.2~CDzHAo-Osy8zKUl1hoRAziFP7xUj0kJ.2 2024-09-22T08:49:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__multipart_key1.2~CDzHAo-Osy8zKUl1hoRAziFP7xUj0kJ.3 2024-09-22T08:49:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__multipart_key1.2~CDzHAo-Osy8zKUl1hoRAziFP7xUj0kJ.4 2024-09-22T08:49:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.824+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57__multipart_key1.2~CDzHAo-Osy8zKUl1hoRAziFP7xUj0kJ.5 2024-09-22T08:49:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.827+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.829+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.831+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.831+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.832+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.833+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.834+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.834+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.835+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.836+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.837+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6791151023658640900', time=2024-09-22T10:46:17.899205+0000, chain.objs.size()=5 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.43__multipart_key1.2~AzBgVkdx2JcmIJikZgCUGdEEJKRQHGB.1 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.43__multipart_key1.2~AzBgVkdx2JcmIJikZgCUGdEEJKRQHGB.2 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.43__multipart_key1.2~AzBgVkdx2JcmIJikZgCUGdEEJKRQHGB.3 2024-09-22T08:49:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.43__multipart_key1.2~AzBgVkdx2JcmIJikZgCUGdEEJKRQHGB.4 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.43__multipart_key1.2~AzBgVkdx2JcmIJikZgCUGdEEJKRQHGB.5 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2961482425617615089', time=2024-09-22T10:46:50.350617+0000, chain.objs.size()=5 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xbC8fe47Lhc0Uc-l8FLhcwPUcCsc5mc.1 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~xbC8fe47Lhc0Uc-l8FLhcwPUcCsc5mc.1_1 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xbC8fe47Lhc0Uc-l8FLhcwPUcCsc5mc.2 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~xbC8fe47Lhc0Uc-l8FLhcwPUcCsc5mc.2_1 2024-09-22T08:49:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.838+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xbC8fe47Lhc0Uc-l8FLhcwPUcCsc5mc.3 2024-09-22T08:49:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.843+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.846+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3375827906196234569', time=2024-09-22T10:48:51.836037+0000, chain.objs.size()=11 2024-09-22T08:49:23.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.1_1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.2 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.2_1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.3 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.3_1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.4 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.4_1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.5 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__shadow_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.5_1 2024-09-22T08:49:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.848+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~aTXcxE5bAAomuDIOM4vHgb4x1DVibxl.6 2024-09-22T08:49:23.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.853+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.857+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:23.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.858+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.858+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13517888436950754626', time=2024-09-22T10:47:03.240004+0000, chain.objs.size()=5 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.53__multipart_key1.2~pAw7Md0ArkY9neTxmdjMmhDZ9AZb8sn.1 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.53__multipart_key1.2~pAw7Md0ArkY9neTxmdjMmhDZ9AZb8sn.2 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.53__multipart_key1.2~pAw7Md0ArkY9neTxmdjMmhDZ9AZb8sn.3 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.53__multipart_key1.2~pAw7Md0ArkY9neTxmdjMmhDZ9AZb8sn.4 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.53__multipart_key1.2~pAw7Md0ArkY9neTxmdjMmhDZ9AZb8sn.5 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13701415747688266469', time=2024-09-22T10:48:07.789535+0000, chain.objs.size()=11 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.1 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.2 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.3 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.4 2024-09-22T08:49:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.5 2024-09-22T08:49:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.6 2024-09-22T08:49:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.859+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.7 2024-09-22T08:49:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.862+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.8 2024-09-22T08:49:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.862+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.9 2024-09-22T08:49:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.862+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.10 2024-09-22T08:49:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.862+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56__multipart_key1.2~x-c3XcVMyME1eq1nP5NyYWuDI5TdHpA.11 2024-09-22T08:49:23.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.867+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.870+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.871+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.871+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.872+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.873+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:23.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.874+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.874+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.875+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.875+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.877+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.878+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.878+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.878+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10461773212680223309', time=2024-09-22T10:49:10.553287+0000, chain.objs.size()=1 2024-09-22T08:49:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.878+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.60__shadow_.7xSV59_Jj2pIEyAl5CCg4sRm-cQvLf1_0 2024-09-22T08:49:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.879+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.881+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.883+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.883+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1895690788486148619', time=2024-09-22T10:46:37.152028+0000, chain.objs.size()=5 2024-09-22T08:49:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~ikiaiEiNlRTTxf3Yw44rI21XD8t1rz9.1 2024-09-22T08:49:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~ikiaiEiNlRTTxf3Yw44rI21XD8t1rz9.2 2024-09-22T08:49:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~ikiaiEiNlRTTxf3Yw44rI21XD8t1rz9.3 2024-09-22T08:49:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~ikiaiEiNlRTTxf3Yw44rI21XD8t1rz9.4 2024-09-22T08:49:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.884+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~ikiaiEiNlRTTxf3Yw44rI21XD8t1rz9.5 2024-09-22T08:49:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.887+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.890+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.891+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.891+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11293424161759535608', time=2024-09-22T10:46:34.826703+0000, chain.objs.size()=5 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xCAnjfyG1M2AEeBkJb4WUfNBvUMpnJI.1 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xCAnjfyG1M2AEeBkJb4WUfNBvUMpnJI.2 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xCAnjfyG1M2AEeBkJb4WUfNBvUMpnJI.3 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xCAnjfyG1M2AEeBkJb4WUfNBvUMpnJI.4 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~xCAnjfyG1M2AEeBkJb4WUfNBvUMpnJI.5 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9822850591569883629', time=2024-09-22T10:47:19.788271+0000, chain.objs.size()=1 2024-09-22T08:49:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__shadow_.E7eeh9Ilex0OKOJqjUqoQPNevPKONGX_0 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.045711+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.13 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.103674+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.14 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.160186+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.15 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.244844+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.16 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.262475+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.17 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.351836+0000, chain.objs.size()=1 2024-09-22T08:49:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.892+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.18 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.895+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.434102+0000, chain.objs.size()=1 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.895+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.19 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.895+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.495517+0000, chain.objs.size()=1 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.895+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.20 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.896+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:08.670013+0000, chain.objs.size()=55 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.896+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.1 2024-09-22T08:49:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.896+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.2 2024-09-22T08:49:23.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.896+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.3 2024-09-22T08:49:23.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.897+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.4 2024-09-22T08:49:23.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.897+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.5 2024-09-22T08:49:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.898+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.6 2024-09-22T08:49:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.898+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.7 2024-09-22T08:49:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.898+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.8 2024-09-22T08:49:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.898+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.9 2024-09-22T08:49:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.900+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.10 2024-09-22T08:49:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.900+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.11 2024-09-22T08:49:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.900+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.12 2024-09-22T08:49:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.900+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.qK8a0QIUqFVcwN8nsXvAovb3ndpDznuZ.13 2024-09-22T08:49:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.901+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.CtBZPe3rFX4pwNZizncyyv1kVYQr_NK3.14 2024-09-22T08:49:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.901+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.CC8z3JUBhaN2KJ10l5PYN0XnKcQiH5vD.15 2024-09-22T08:49:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.902+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.l4N3Itg0PJWJCDUr08BdrPw48e4obfCn.16 2024-09-22T08:49:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.902+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.QObSA3LlqMNV1z2cp50XLa1DX76pQDFY.17 2024-09-22T08:49:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.905+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.8ERGurDHYPotO9wyW7YsJdNUCZzmKGeW.18 2024-09-22T08:49:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.905+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.ox0y3l6HWsYXMpkCk8qStF5Rw--WSSe_.19 2024-09-22T08:49:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.905+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.AhmcD9KmMZ5LOql2FxkTlft_k8n8juiJ.20 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.21 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.22 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.23 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.24 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.25 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.26 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.27 2024-09-22T08:49:23.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.906+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.28 2024-09-22T08:49:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.909+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.29 2024-09-22T08:49:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.909+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.30 2024-09-22T08:49:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.909+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.31 2024-09-22T08:49:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.910+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.32 2024-09-22T08:49:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.911+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.33 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.34 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.35 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.36 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.37 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.38 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.39 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.40 2024-09-22T08:49:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.912+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.41 2024-09-22T08:49:23.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.915+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.42 2024-09-22T08:49:23.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.915+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.43 2024-09-22T08:49:23.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.915+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.44 2024-09-22T08:49:23.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.45 2024-09-22T08:49:23.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.46 2024-09-22T08:49:23.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.47 2024-09-22T08:49:23.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.48 2024-09-22T08:49:23.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.49 2024-09-22T08:49:23.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.918+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.50 2024-09-22T08:49:23.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.920+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.51 2024-09-22T08:49:23.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.920+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.52 2024-09-22T08:49:23.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.920+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.53 2024-09-22T08:49:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.920+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.54 2024-09-22T08:49:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.920+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.55 2024-09-22T08:49:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.921+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:09.064189+0000, chain.objs.size()=11 2024-09-22T08:49:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.921+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.56 2024-09-22T08:49:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.921+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.57 2024-09-22T08:49:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.921+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.58 2024-09-22T08:49:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.922+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.59 2024-09-22T08:49:23.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.923+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.60 2024-09-22T08:49:23.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.923+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.61 2024-09-22T08:49:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.925+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.62 2024-09-22T08:49:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.925+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.63 2024-09-22T08:49:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.925+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.64 2024-09-22T08:49:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.925+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.65 2024-09-22T08:49:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.925+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.66 2024-09-22T08:49:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.926+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN', time=2024-09-22T10:49:09.470152+0000, chain.objs.size()=10 2024-09-22T08:49:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.926+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.67 2024-09-22T08:49:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.926+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.68 2024-09-22T08:49:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.926+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.69 2024-09-22T08:49:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.927+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.70 2024-09-22T08:49:23.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.927+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.71 2024-09-22T08:49:23.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.927+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.72 2024-09-22T08:49:23.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.929+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.73 2024-09-22T08:49:23.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.930+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.74 2024-09-22T08:49:23.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.930+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.75 2024-09-22T08:49:23.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.930+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.59__multipart_key1.2~fCYhS8olOtBHq0LCHWoRWlAOg3YgpnN.76 2024-09-22T08:49:23.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.934+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.937+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:23.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17808740002968292939', time=2024-09-22T10:47:19.753353+0000, chain.objs.size()=1 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54__shadow_.wasTpjKhnBkQmNDBYxkqj48igqzVdwT_0 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15325415806259060110', time=2024-09-22T10:49:22.616075+0000, chain.objs.size()=11 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.1 2024-09-22T08:49:23.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.2 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.3 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.4 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.5 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.938+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.6 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.939+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.7 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.939+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.8 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.939+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.9 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.939+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.10 2024-09-22T08:49:23.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.939+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.67__multipart_key1.2~kytXtjRH66ny3rNG130UIsnm0ubIepx.11 2024-09-22T08:49:23.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.946+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.948+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:23.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.950+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.950+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.951+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.952+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:23.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.953+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.953+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9923262337564680766', time=2024-09-22T10:46:22.905999+0000, chain.objs.size()=5 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.1 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.2 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.3 2024-09-22T08:49:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.4 2024-09-22T08:49:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.954+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.45__multipart_key1.2~6GTUKXOjbN3z4GDe-ybnXKBaOnHbasG.5 2024-09-22T08:49:23.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.957+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.959+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:23.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.960+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.961+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.961+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.962+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.963+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.963+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.963+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.965+0000 7f58a3b32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:23.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.966+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:23.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:23.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:23.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9332740420972101322', time=2024-09-22T10:46:50.892726+0000, chain.objs.size()=5 2024-09-22T08:49:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~TsInEaj5246-kOzKafl_fOqXbXxPlbO.1 2024-09-22T08:49:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~TsInEaj5246-kOzKafl_fOqXbXxPlbO.1_1 2024-09-22T08:49:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~TsInEaj5246-kOzKafl_fOqXbXxPlbO.2 2024-09-22T08:49:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__shadow_key1.2~TsInEaj5246-kOzKafl_fOqXbXxPlbO.2_1 2024-09-22T08:49:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.967+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.48__multipart_key1.2~TsInEaj5246-kOzKafl_fOqXbXxPlbO.3 2024-09-22T08:49:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.970+0000 7f58a3b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.974+0000 7f5755fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.975+0000 7f58a3b32800 20 remove_watcher() i=0 2024-09-22T08:49:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.975+0000 7f58a3b32800 2 removed watcher, disabling cache 2024-09-22T08:49:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.976+0000 7f58a3b32800 20 remove_watcher() i=1 2024-09-22T08:49:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.977+0000 7f58a3b32800 20 remove_watcher() i=2 2024-09-22T08:49:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.978+0000 7f58a3b32800 20 remove_watcher() i=3 2024-09-22T08:49:23.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.979+0000 7f58a3b32800 20 remove_watcher() i=4 2024-09-22T08:49:23.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.980+0000 7f58a3b32800 20 remove_watcher() i=5 2024-09-22T08:49:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.981+0000 7f58a3b32800 20 remove_watcher() i=6 2024-09-22T08:49:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:23.982+0000 7f58a3b32800 20 remove_watcher() i=7 2024-09-22T08:49:23.994 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:24.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.081+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 20 realm 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.082+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.083+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.083+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.083+0000 7f097e220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.083+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.084+0000 7f097e220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.084+0000 7f097e220800 20 searching for the correct realm 2024-09-22T08:49:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.086+0000 7f097c512640 0 -- 172.21.15.78:0/2866713855 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f0964050400 msgr2=0x7f0964050860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.291+0000 7f097b510640 0 -- 172.21.15.78:0/2866713855 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f097407c040 msgr2=0x7f097406d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.295+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:24.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 zone default found 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 4 Realm: () 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 zonegroup default 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.296+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 started sync module instance, tier type = 2024-09-22T08:49:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.297+0000 7f097e220800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=0 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=1 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=2 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=3 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=4 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=5 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.305+0000 7f097e220800 20 add_watcher() i=6 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.306+0000 7f097e220800 20 add_watcher() i=7 2024-09-22T08:49:24.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.306+0000 7f097e220800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.308+0000 7f0831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.308+0000 7f097e220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.308+0000 7f097e220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:24.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.343+0000 7f0830fe1640 20 reqs_thread_entry: start 2024-09-22T08:49:24.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.343+0000 7f097e220800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:24.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.343+0000 7f097e220800 20 Filter name: none 2024-09-22T08:49:24.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.343+0000 7f07aa7fc640 20 reqs_thread_entry: start 2024-09-22T08:49:24.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.344+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:24.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.345+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.345+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.345+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.346+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:24.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.347+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.348+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.348+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.349+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:24.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.350+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.351+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.351+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.352+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.353+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.354+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.354+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.355+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:24.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.357+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.357+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.357+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.358+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:24.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.360+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.360+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.360+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.361+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:24.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.362+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.363+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.363+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.364+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:24.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.365+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.366+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.366+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.367+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:24.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.368+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.369+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.369+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.370+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:24.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.371+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.372+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.372+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.373+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.374+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.375+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.375+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.376+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.377+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.377+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.378+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.379+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:24.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.380+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.380+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.380+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.381+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.382+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.383+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.383+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.385+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.386+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.387+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.387+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.388+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.389+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.390+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.390+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.391+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:24.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.392+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.393+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.393+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.394+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:24.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.395+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.395+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.396+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.396+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:24.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.398+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.398+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.398+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.400+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.402+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.402+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.402+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.403+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.404+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.405+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.405+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.406+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:24.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.408+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.408+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.409+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.410+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.411+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.412+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.412+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.413+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.414+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.414+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.415+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.415+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:24.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.417+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.417+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.418+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.418+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:24.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.420+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.420+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.420+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.421+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:24.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.422+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.423+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.423+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.424+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:24.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.426+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.426+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.426+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.427+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:24.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.429+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.429+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.429+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.431+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:24.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.433+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.434+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.434+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.435+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.436+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.437+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.437+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.438+0000 7f097e220800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.439+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.440+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.440+0000 7f097e220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.442+0000 7f0831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.444+0000 7f097e220800 20 remove_watcher() i=0 2024-09-22T08:49:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.444+0000 7f097e220800 2 removed watcher, disabling cache 2024-09-22T08:49:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.445+0000 7f097e220800 20 remove_watcher() i=1 2024-09-22T08:49:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.446+0000 7f097e220800 20 remove_watcher() i=2 2024-09-22T08:49:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.447+0000 7f097e220800 20 remove_watcher() i=3 2024-09-22T08:49:24.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.448+0000 7f097e220800 20 remove_watcher() i=4 2024-09-22T08:49:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.449+0000 7f097e220800 20 remove_watcher() i=5 2024-09-22T08:49:24.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.450+0000 7f097e220800 20 remove_watcher() i=6 2024-09-22T08:49:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.451+0000 7f097e220800 20 remove_watcher() i=7 2024-09-22T08:49:24.463 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:24.514 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:24.514 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:24.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.550+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 20 realm 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.552+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.553+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.553+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.553+0000 7f5fcbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.553+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.554+0000 7f5fcbd2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:24.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.554+0000 7f5fcbd2c800 20 searching for the correct realm 2024-09-22T08:49:24.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.556+0000 7f5fc72ac640 0 -- 172.21.15.78:0/1055310404 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x561fc75f8b70 msgr2=0x561fc75faf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:24.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.559+0000 7f5fc72ac640 0 -- 172.21.15.78:0/1055310404 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f5fc0018040 msgr2=0x7f5fc006aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:49:24.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:24.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.766+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 zone default found 2024-09-22T08:49:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 4 Realm: () 2024-09-22T08:49:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 zonegroup default 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.767+0000 7f5fcbd2c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.768+0000 7f5fcbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.768+0000 7f5fcbd2c800 20 started sync module instance, tier type = 2024-09-22T08:49:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.768+0000 7f5fcbd2c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=0 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=1 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=2 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=3 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=4 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=5 2024-09-22T08:49:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.776+0000 7f5fcbd2c800 20 add_watcher() i=6 2024-09-22T08:49:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.777+0000 7f5fcbd2c800 20 add_watcher() i=7 2024-09-22T08:49:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.777+0000 7f5fcbd2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.778+0000 7f5e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.778+0000 7f5fcbd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.778+0000 7f5fcbd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.811+0000 7f5e7cfe1640 20 reqs_thread_entry: start 2024-09-22T08:49:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.811+0000 7f5fcbd2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.811+0000 7f5fcbd2c800 20 Filter name: none 2024-09-22T08:49:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.811+0000 7f5df67fc640 20 reqs_thread_entry: start 2024-09-22T08:49:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.811+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.813+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.813+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.814+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.815+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.816+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.817+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.817+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.818+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:24.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.819+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.820+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.820+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.821+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.823+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.823+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.824+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.825+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.826+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.827+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.827+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.828+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:24.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.829+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.830+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.830+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.831+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:24.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.832+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.833+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.833+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.834+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.835+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.836+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.836+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.837+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.838+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.839+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.839+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.840+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.841+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.841+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.842+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.842+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:24.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.844+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.844+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.845+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.846+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:24.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.847+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.848+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.848+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.849+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.850+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.851+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.851+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.852+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:24.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.853+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.853+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.854+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.855+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:24.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.857+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.857+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.857+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.858+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:24.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.860+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.860+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.860+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.861+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:24.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.863+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.863+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.863+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.864+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:24.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.866+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.867+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.867+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.868+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:24.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.870+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.870+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.870+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.872+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.873+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.873+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.873+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.874+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:24.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.875+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.876+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.876+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.877+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:24.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.879+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.880+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.880+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.881+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:24.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.882+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.883+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.883+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.884+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:24.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.885+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.886+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.886+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.887+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:24.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.888+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.888+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.889+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.890+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:24.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.891+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.891+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.891+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.892+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:24.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.894+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.894+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.894+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.895+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.896+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.897+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.897+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.898+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:24.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.899+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.900+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.900+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.901+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.902+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.902+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.903+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.904+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.905+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.905+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.906+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.906+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.908+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.908+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:24.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.908+0000 7f5fcbd2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:24.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.910+0000 7f5e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.912+0000 7f5fcbd2c800 20 remove_watcher() i=0 2024-09-22T08:49:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.912+0000 7f5fcbd2c800 2 removed watcher, disabling cache 2024-09-22T08:49:24.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.913+0000 7f5fcbd2c800 20 remove_watcher() i=1 2024-09-22T08:49:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.914+0000 7f5fcbd2c800 20 remove_watcher() i=2 2024-09-22T08:49:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.915+0000 7f5fcbd2c800 20 remove_watcher() i=3 2024-09-22T08:49:24.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.916+0000 7f5fcbd2c800 20 remove_watcher() i=4 2024-09-22T08:49:24.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.917+0000 7f5fcbd2c800 20 remove_watcher() i=5 2024-09-22T08:49:24.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.918+0000 7f5fcbd2c800 20 remove_watcher() i=6 2024-09-22T08:49:24.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:24.919+0000 7f5fcbd2c800 20 remove_watcher() i=7 2024-09-22T08:49:24.931 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:24.982 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:25.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.018+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 realm 2024-09-22T08:49:25.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:25.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.020+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.021+0000 7fec13c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:25.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.021+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.022+0000 7fec13c63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:25.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.022+0000 7fec13c63800 20 searching for the correct realm 2024-09-22T08:49:25.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.024+0000 7fec11f55640 0 -- 172.21.15.78:0/2535060318 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7febfc0441a0 msgr2=0x7febfc0488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:25.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.229+0000 7fec10f53640 0 -- 172.21.15.78:0/2535060318 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fec0c09ac00 msgr2=0x7fec0c064920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:25.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.234+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 zone default found 2024-09-22T08:49:25.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 4 Realm: () 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 zonegroup default 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.235+0000 7fec13c63800 20 rados->read ofs=0 len=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.236+0000 7fec13c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.236+0000 7fec13c63800 20 started sync module instance, tier type = 2024-09-22T08:49:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.236+0000 7fec13c63800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=0 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=1 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=2 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=3 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=4 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=5 2024-09-22T08:49:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.245+0000 7fec13c63800 20 add_watcher() i=6 2024-09-22T08:49:25.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.246+0000 7fec13c63800 20 add_watcher() i=7 2024-09-22T08:49:25.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.246+0000 7fec13c63800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:25.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.247+0000 7feac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:25.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.247+0000 7fec13c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:25.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.247+0000 7fec13c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.280+0000 7feac67e4640 20 reqs_thread_entry: start 2024-09-22T08:49:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.280+0000 7fec13c63800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.280+0000 7fec13c63800 20 Filter name: none 2024-09-22T08:49:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.280+0000 7fea37fff640 20 reqs_thread_entry: start 2024-09-22T08:49:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.280+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.281+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.282+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.282+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.283+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:25.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.284+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.285+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.285+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.286+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.288+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.288+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.288+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.289+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.291+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.291+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.292+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.293+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.294+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.294+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.295+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.296+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.297+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.298+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.298+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.299+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:25.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.300+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.301+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.301+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.302+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.303+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.303+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.304+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.305+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:25.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.306+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.306+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.306+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.308+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:25.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.309+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.309+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.310+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.310+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:25.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.312+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.312+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.313+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.314+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:25.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.315+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.315+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.315+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.316+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:25.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.318+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.318+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.318+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.319+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:25.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.320+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.321+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.321+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.322+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:25.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.324+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.324+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.325+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.326+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:25.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.327+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.328+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.328+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.329+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:25.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.330+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.330+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.331+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.332+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:25.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.333+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.334+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.334+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.335+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:25.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.336+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.337+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.337+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.338+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:25.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.339+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.340+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.340+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.341+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:25.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.342+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.342+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.342+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.343+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.344+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.345+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.345+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.346+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:25.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.347+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.348+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.348+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.349+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.350+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.350+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.351+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.352+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.353+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.353+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.354+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.354+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:25.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.356+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.356+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.356+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.357+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:25.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.359+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.359+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.359+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.360+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:25.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.361+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.362+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.362+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.364+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:25.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.366+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.366+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.366+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.367+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.368+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.369+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.369+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.370+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:25.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.371+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.372+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.372+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.373+0000 7fec13c63800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.375+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.375+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.375+0000 7fec13c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:25.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.377+0000 7feac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:25.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.379+0000 7fec13c63800 20 remove_watcher() i=0 2024-09-22T08:49:25.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.379+0000 7fec13c63800 2 removed watcher, disabling cache 2024-09-22T08:49:25.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.380+0000 7fec13c63800 20 remove_watcher() i=1 2024-09-22T08:49:25.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.381+0000 7fec13c63800 20 remove_watcher() i=2 2024-09-22T08:49:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.382+0000 7fec13c63800 20 remove_watcher() i=3 2024-09-22T08:49:25.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.383+0000 7fec13c63800 20 remove_watcher() i=4 2024-09-22T08:49:25.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.384+0000 7fec13c63800 20 remove_watcher() i=5 2024-09-22T08:49:25.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.386+0000 7fec13c63800 20 remove_watcher() i=6 2024-09-22T08:49:25.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:25.386+0000 7fec13c63800 20 remove_watcher() i=7 2024-09-22T08:49:25.399 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-22T08:49:25.898 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean 2024-09-22T08:49:26.594 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-22T08:49:26.594 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-22T08:49:26.594 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-22T08:49:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-22T08:49:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:49:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:49:27.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:49:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-22T08:49:29.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests STANDARD_OUT 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22 08:49:28,310 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.096 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-22T08:49:29.394 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.394 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-22T08:49:29.394 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.395 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-22T08:49:29.794 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.794 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-22T08:49:29.994 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:29.994 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-22T08:49:30.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.094 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-22T08:49:30.194 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.194 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-22T08:49:30.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.594 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-22T08:49:30.694 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.694 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-22T08:49:30.794 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.794 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-22T08:49:30.894 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:30.894 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-22T08:49:31.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-22T08:49:31.694 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:31.694 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-22T08:49:31.994 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:31.994 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-22T08:49:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:32.094 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-22T08:49:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------- 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------- 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 6s 2024-09-22T08:49:32.174 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 5 executed 2024-09-22T08:49:32.177 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:32.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.263+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 realm 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:32.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:32.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:32.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.265+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:32.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.266+0000 7f8308d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:32.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.266+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.267+0000 7f8308d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:32.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.267+0000 7f8308d75800 20 searching for the correct realm 2024-09-22T08:49:32.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.269+0000 7f8307060640 0 -- 172.21.15.78:0/2402635497 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f82f0029b60 msgr2=0x7f82f00283d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:32.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:32.877+0000 7f82fe05e640 0 -- 172.21.15.78:0/2402635497 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f830007c430 msgr2=0x7f830007c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.086+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 zone default found 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 4 Realm: () 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 zonegroup default 2024-09-22T08:49:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.087+0000 7f8308d75800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.088+0000 7f8308d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.088+0000 7f8308d75800 20 started sync module instance, tier type = 2024-09-22T08:49:33.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.088+0000 7f8308d75800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=0 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=1 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=2 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=3 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=4 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=5 2024-09-22T08:49:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.099+0000 7f8308d75800 20 add_watcher() i=6 2024-09-22T08:49:33.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.100+0000 7f8308d75800 20 add_watcher() i=7 2024-09-22T08:49:33.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.100+0000 7f8308d75800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.102+0000 7f81bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.102+0000 7f8308d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.102+0000 7f8308d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.140+0000 7f8137fff640 20 reqs_thread_entry: start 2024-09-22T08:49:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.140+0000 7f8308d75800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.141+0000 7f8308d75800 20 Filter name: none 2024-09-22T08:49:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.141+0000 7f8135ffb640 20 reqs_thread_entry: start 2024-09-22T08:49:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.141+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:33.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.142+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.143+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.143+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.144+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:33.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.145+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.146+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.146+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.147+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:33.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.148+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.149+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.149+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.150+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.152+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.152+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.152+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.153+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.155+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.155+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.155+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.156+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.158+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.158+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.159+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.160+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:33.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.161+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.162+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.162+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.163+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.165+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.165+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.166+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.167+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:33.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.168+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.169+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.169+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.170+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.172+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.172+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.172+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.173+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.175+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.175+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.175+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.177+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:33.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.178+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.178+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.179+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.179+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.181+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.182+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.182+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.183+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.185+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.185+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.185+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.186+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.188+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.188+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.188+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.189+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:33.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.191+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.191+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.192+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:33.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.192+0000 7f8308d75800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12371713686735599209', time=2024-09-22T10:49:30.307094+0000, chain.objs.size()=1 2024-09-22T08:49:33.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.192+0000 7f8308d75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.72__shadow_.mwHZutcwNZpVtckLz_17SVKD7MCiRz1_0 2024-09-22T08:49:33.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.193+0000 7f8308d75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:33.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.195+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:33.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.197+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.197+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.197+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.198+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:33.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.199+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.200+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.200+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.201+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:33.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.203+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.203+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.204+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.205+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:33.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.206+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.206+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.207+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.208+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:33.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.209+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.210+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.210+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.211+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:33.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.212+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.213+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.213+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.214+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:33.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.215+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.216+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.216+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.217+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:33.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.218+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.219+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.219+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.220+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:33.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.221+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.222+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.222+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.223+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:33.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.224+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.225+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.225+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.226+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.227+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.228+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.228+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.229+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.230+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.231+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.231+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.232+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.233+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.233+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.234+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.234+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.236+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.236+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.236+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.237+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.239+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.239+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.240+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.241+0000 7f8308d75800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.242+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.242+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.243+0000 7f8308d75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:49:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.243+0000 7f8308d75800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.510416582692536465', time=2024-09-22T10:49:31.265342+0000, chain.objs.size()=1 2024-09-22T08:49:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.243+0000 7f8308d75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.73__shadow_.6j-4J9_KnbEG9lam6Vnocs7Zg90X8K3_0 2024-09-22T08:49:33.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.244+0000 7f8308d75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:49:33.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.247+0000 7f81bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:33.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.249+0000 7f8308d75800 20 remove_watcher() i=0 2024-09-22T08:49:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.249+0000 7f8308d75800 2 removed watcher, disabling cache 2024-09-22T08:49:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.250+0000 7f8308d75800 20 remove_watcher() i=1 2024-09-22T08:49:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.251+0000 7f8308d75800 20 remove_watcher() i=2 2024-09-22T08:49:33.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.252+0000 7f8308d75800 20 remove_watcher() i=3 2024-09-22T08:49:33.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.253+0000 7f8308d75800 20 remove_watcher() i=4 2024-09-22T08:49:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.254+0000 7f8308d75800 20 remove_watcher() i=5 2024-09-22T08:49:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.255+0000 7f8308d75800 20 remove_watcher() i=6 2024-09-22T08:49:33.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.256+0000 7f8308d75800 20 remove_watcher() i=7 2024-09-22T08:49:33.269 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:33.320 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:33.320 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.357+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 20 realm 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.358+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.359+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.359+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.359+0000 7f88c0d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.359+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.360+0000 7f88c0d3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.360+0000 7f88c0d3c800 20 searching for the correct realm 2024-09-22T08:49:33.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.361+0000 7f88b7fff640 0 -- 172.21.15.78:0/2907333728 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f88b008c040 msgr2=0x7f88b008c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:33.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.566+0000 7f88bca81640 0 -- 172.21.15.78:0/2907333728 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x558b557d2510 msgr2=0x558b557d4960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:33.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.571+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 zone default found 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 4 Realm: () 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:33.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 zonegroup default 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 started sync module instance, tier type = 2024-09-22T08:49:33.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.572+0000 7f88c0d3c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=0 2024-09-22T08:49:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=1 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=2 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=3 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=4 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=5 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.581+0000 7f88c0d3c800 20 add_watcher() i=6 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.582+0000 7f88c0d3c800 20 add_watcher() i=7 2024-09-22T08:49:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.582+0000 7f88c0d3c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:33.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.584+0000 7f87737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:33.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.584+0000 7f88c0d3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:33.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.584+0000 7f88c0d3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.622+0000 7f87727e4640 20 reqs_thread_entry: start 2024-09-22T08:49:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.622+0000 7f88c0d3c800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.622+0000 7f88c0d3c800 20 Filter name: none 2024-09-22T08:49:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.622+0000 7f876bfff640 20 reqs_thread_entry: start 2024-09-22T08:49:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.622+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.623+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.624+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.624+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.625+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:33.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.626+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.627+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.627+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.628+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:33.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.629+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.630+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.630+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.631+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.633+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.633+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.634+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.635+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.636+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.636+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.637+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.638+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:33.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.639+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.639+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.639+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.641+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.642+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.642+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.643+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.644+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.645+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.645+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.646+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.646+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.648+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.649+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.649+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.650+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:33.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.651+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.652+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.652+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.653+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.654+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.655+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.655+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.656+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:33.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.657+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.658+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.658+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.659+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:33.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.660+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.661+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.661+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.662+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.664+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.664+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.665+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.667+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.668+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.669+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.669+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.670+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.671+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.672+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.672+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.673+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.675+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.675+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.675+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.676+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.677+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.678+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.678+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.679+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.680+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.681+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.681+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.682+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:33.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.684+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.684+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.685+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.686+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.687+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.688+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.688+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.689+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.690+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.690+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.691+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.692+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.693+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.693+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.694+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.695+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.696+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.696+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.697+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.698+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.699+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.699+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.699+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.700+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.702+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.702+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.702+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.703+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.704+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.705+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.705+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.706+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.707+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.708+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.708+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.709+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:33.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.710+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.711+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.711+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.712+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.714+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.714+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.714+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.715+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.716+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.717+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.717+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.718+0000 7f88c0d3c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.719+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.719+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.720+0000 7f88c0d3c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.722+0000 7f87737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:33.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.723+0000 7f88c0d3c800 20 remove_watcher() i=0 2024-09-22T08:49:33.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.723+0000 7f88c0d3c800 2 removed watcher, disabling cache 2024-09-22T08:49:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.724+0000 7f88c0d3c800 20 remove_watcher() i=1 2024-09-22T08:49:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.726+0000 7f88c0d3c800 20 remove_watcher() i=2 2024-09-22T08:49:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.727+0000 7f88c0d3c800 20 remove_watcher() i=3 2024-09-22T08:49:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.728+0000 7f88c0d3c800 20 remove_watcher() i=4 2024-09-22T08:49:33.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.729+0000 7f88c0d3c800 20 remove_watcher() i=5 2024-09-22T08:49:33.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.730+0000 7f88c0d3c800 20 remove_watcher() i=6 2024-09-22T08:49:33.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.731+0000 7f88c0d3c800 20 remove_watcher() i=7 2024-09-22T08:49:33.743 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:33.794 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:33.794 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:33.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.831+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.832+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.832+0000 7f9b2000e800 20 realm 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.832+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:33.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.833+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.834+0000 7f9b2000e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.834+0000 7f9b2000e800 20 searching for the correct realm 2024-09-22T08:49:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:33.835+0000 7f9b1b7bc640 0 -- 172.21.15.78:0/3276726159 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x563eff27d540 msgr2=0x563eff27fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:34.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.040+0000 7f9b1b7bc640 0 -- 172.21.15.78:0/3276726159 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f9b0c0a5890 msgr2=0x7f9b0c0ae450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.047+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:34.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 zone default found 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 4 Realm: () 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 zonegroup default 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.048+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 started sync module instance, tier type = 2024-09-22T08:49:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.049+0000 7f9b2000e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=0 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=1 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=2 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=3 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=4 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=5 2024-09-22T08:49:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.058+0000 7f9b2000e800 20 add_watcher() i=6 2024-09-22T08:49:34.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.059+0000 7f9b2000e800 20 add_watcher() i=7 2024-09-22T08:49:34.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.059+0000 7f9b2000e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:34.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.060+0000 7f99d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:34.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.060+0000 7f9b2000e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:34.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.060+0000 7f9b2000e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:34.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.094+0000 7f99d17e2640 20 reqs_thread_entry: start 2024-09-22T08:49:34.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.095+0000 7f9b2000e800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:34.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.095+0000 7f9b2000e800 20 Filter name: none 2024-09-22T08:49:34.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.095+0000 7f99ca7fc640 20 reqs_thread_entry: start 2024-09-22T08:49:34.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.095+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:34.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.096+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.096+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.097+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.098+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:34.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.099+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.100+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.100+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.101+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:34.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.102+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.103+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.103+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.104+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.105+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.106+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.106+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.107+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:34.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.108+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.109+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.109+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.110+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:34.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.111+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.112+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.112+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.113+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:34.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.114+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.115+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.115+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.116+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:34.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.117+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.117+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.118+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.119+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.120+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.120+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.120+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.121+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:34.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.122+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.123+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.123+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.124+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.125+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.126+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.126+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.127+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.128+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.128+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.129+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.129+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:34.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.132+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.132+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.133+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.134+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.135+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.135+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.136+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.137+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.138+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.138+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.138+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.139+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:34.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.141+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.142+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.142+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.143+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.145+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.145+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.145+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.146+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.147+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.148+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.148+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.149+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.150+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.151+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.151+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.152+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.153+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.154+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.154+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.155+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.157+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.158+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.158+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.159+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.160+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.160+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.161+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.162+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:34.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.163+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.163+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.163+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.164+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.166+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.166+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.166+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.167+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:34.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.169+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.169+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.169+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.170+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.172+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.172+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.172+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.173+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.175+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.175+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.175+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.176+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:34.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.177+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.178+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.178+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.179+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:34.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.181+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.181+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.182+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.183+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:34.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.184+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.184+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.185+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.186+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.187+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.187+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.188+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.189+0000 7f9b2000e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.190+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.190+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.191+0000 7f9b2000e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.192+0000 7f99d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:34.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.194+0000 7f9b2000e800 20 remove_watcher() i=0 2024-09-22T08:49:34.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.194+0000 7f9b2000e800 2 removed watcher, disabling cache 2024-09-22T08:49:34.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.195+0000 7f9b2000e800 20 remove_watcher() i=1 2024-09-22T08:49:34.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.196+0000 7f9b2000e800 20 remove_watcher() i=2 2024-09-22T08:49:34.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.197+0000 7f9b2000e800 20 remove_watcher() i=3 2024-09-22T08:49:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.198+0000 7f9b2000e800 20 remove_watcher() i=4 2024-09-22T08:49:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.199+0000 7f9b2000e800 20 remove_watcher() i=5 2024-09-22T08:49:34.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.200+0000 7f9b2000e800 20 remove_watcher() i=6 2024-09-22T08:49:34.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.201+0000 7f9b2000e800 20 remove_watcher() i=7 2024-09-22T08:49:34.215 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:49:34.266 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:49:34.266 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:49:34.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.302+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 realm 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.304+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.305+0000 7fbe2161d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.305+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.306+0000 7fbe2161d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:49:34.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.306+0000 7fbe2161d800 20 searching for the correct realm 2024-09-22T08:49:34.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.308+0000 7fbe1d5ec640 0 -- 172.21.15.78:0/3281885364 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fbe08037070 msgr2=0x7fbe080769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:34.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.514+0000 7fbe17fff640 0 -- 172.21.15.78:0/3281885364 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fbe18089b60 msgr2=0x7fbe18074540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:49:34.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:49:34.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:49:34.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.519+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 zone default found 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 4 Realm: () 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 zonegroup default 2024-09-22T08:49:34.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.520+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 rados->read ofs=0 len=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 started sync module instance, tier type = 2024-09-22T08:49:34.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.521+0000 7fbe2161d800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=0 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=1 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=2 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=3 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=4 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=5 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.530+0000 7fbe2161d800 20 add_watcher() i=6 2024-09-22T08:49:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.531+0000 7fbe2161d800 20 add_watcher() i=7 2024-09-22T08:49:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.531+0000 7fbe2161d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:49:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.533+0000 7fbcd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.533+0000 7fbe2161d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:49:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.533+0000 7fbe2161d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:49:34.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.566+0000 7fbcd27e4640 20 reqs_thread_entry: start 2024-09-22T08:49:34.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.566+0000 7fbe2161d800 20 init_complete bucket index max shards: 11 2024-09-22T08:49:34.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.566+0000 7fbe2161d800 20 Filter name: none 2024-09-22T08:49:34.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.566+0000 7fbccb7fe640 20 reqs_thread_entry: start 2024-09-22T08:49:34.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.566+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:49:34.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.567+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.568+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.568+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.569+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:49:34.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.571+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.571+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.571+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.572+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:49:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.574+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.574+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.574+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.575+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:49:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.577+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.577+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.577+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.578+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:49:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.580+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.580+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.580+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.581+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:49:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.583+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.583+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.583+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.584+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:49:34.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.585+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.586+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.586+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.587+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:49:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.588+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.589+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.589+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.590+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:49:34.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.591+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.592+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.592+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.593+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:49:34.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.594+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.595+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.595+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.596+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:49:34.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.598+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.598+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.599+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.600+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:49:34.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.601+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.601+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.602+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.603+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:49:34.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.604+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.604+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.604+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.605+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:49:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.607+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.607+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.608+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.609+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:49:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.610+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.610+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.611+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.611+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:49:34.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.613+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.613+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.613+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.614+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:49:34.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.616+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.616+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.616+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.617+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:49:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.618+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.619+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.619+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.620+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:49:34.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.621+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.622+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.622+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.623+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:49:34.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.624+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.625+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.625+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.626+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:49:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.627+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.627+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.628+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.629+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:49:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.630+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.631+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.631+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.632+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:49:34.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.633+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.634+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.634+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.635+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:49:34.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.636+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.637+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.637+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.638+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:49:34.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.639+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.640+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.640+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.641+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:49:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.642+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.643+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.643+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.644+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:49:34.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.645+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.645+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.646+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.647+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:49:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.648+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.649+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.649+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.650+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:49:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.651+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.652+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.652+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.653+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:49:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.654+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.655+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.655+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.656+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:49:34.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.657+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.658+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.658+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.659+0000 7fbe2161d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:49:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.661+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.661+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:49:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.661+0000 7fbe2161d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:49:34.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.663+0000 7fbcd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:49:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.665+0000 7fbe2161d800 20 remove_watcher() i=0 2024-09-22T08:49:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.665+0000 7fbe2161d800 2 removed watcher, disabling cache 2024-09-22T08:49:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.666+0000 7fbe2161d800 20 remove_watcher() i=1 2024-09-22T08:49:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.667+0000 7fbe2161d800 20 remove_watcher() i=2 2024-09-22T08:49:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.668+0000 7fbe2161d800 20 remove_watcher() i=3 2024-09-22T08:49:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.669+0000 7fbe2161d800 20 remove_watcher() i=4 2024-09-22T08:49:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.670+0000 7fbe2161d800 20 remove_watcher() i=5 2024-09-22T08:49:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.671+0000 7fbe2161d800 20 remove_watcher() i=6 2024-09-22T08:49:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:49:34.672+0000 7fbe2161d800 20 remove_watcher() i=7 2024-09-22T08:49:34.684 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-22T08:49:35.191 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean 2024-09-22T08:49:36.086 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-22T08:49:36.086 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-22T08:49:36.086 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-22T08:49:36.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:36.486 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-22T08:49:36.487 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T08:49:36.487 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T08:49:36.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:36.487 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T08:49:36.488 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-22T08:49:38.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests STANDARD_OUT 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22 08:49:37,702 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.387 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-22T08:49:38.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-22T08:49:38.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:38.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-22T08:49:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:39.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-22T08:49:39.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:39.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-22T08:49:39.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:39.485 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-22T08:49:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-22T08:49:42.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:42.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-22T08:49:42.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:42.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-22T08:49:42.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:42.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-22T08:49:42.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:42.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-22T08:49:43.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:43.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-22T08:49:43.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:43.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-22T08:49:43.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:43.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-22T08:49:43.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:43.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-22T08:49:43.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:43.886 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-22T08:49:45.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:45.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-22T08:49:45.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:45.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-22T08:49:45.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:45.886 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-22T08:49:46.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:46.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-22T08:49:46.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:46.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-22T08:49:46.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:46.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-22T08:49:46.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:46.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-22T08:49:47.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:47.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-22T08:49:47.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:47.285 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-22T08:49:47.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:47.585 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-22T08:49:47.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:47.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-22T08:49:48.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:48.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-22T08:49:48.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:48.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-22T08:49:48.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:48.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-22T08:49:48.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:48.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-22T08:49:48.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:48.985 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-22T08:49:51.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:51.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-22T08:49:51.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:49:51.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-22T08:50:22.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:22.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-22T08:50:22.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:22.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-22T08:50:22.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:22.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-22T08:50:23.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:23.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-22T08:50:23.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:23.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-22T08:50:23.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:23.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-22T08:50:25.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:25.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-22T08:50:26.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:26.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-22T08:50:26.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:26.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-22T08:50:26.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:26.485 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-22T08:50:29.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:29.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-22T08:50:29.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:29.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T08:50:33.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:33.886 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T08:50:34.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:34.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-22T08:50:36.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:36.185 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-22T08:50:36.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:36.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-22T08:50:48.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:48.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-22T08:50:49.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:49.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-22T08:50:52.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:52.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-22T08:50:52.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:52.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-22T08:50:54.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:54.485 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-22T08:50:54.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:54.885 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-22T08:50:55.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:50:55.885 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-22T08:51:08.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-22T08:51:08.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-22T08:51:08.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-22T08:51:08.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-22T08:51:08.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:08.886 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-22T08:51:09.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:09.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-22T08:51:09.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:09.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-22T08:51:09.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:09.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-22T08:51:09.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:09.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-22T08:51:10.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:10.085 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-22T08:51:10.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:10.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-22T08:51:10.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:10.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-22T08:51:10.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:10.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-22T08:51:10.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:10.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-22T08:51:11.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:11.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-22T08:51:11.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:11.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-22T08:51:11.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:11.885 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-22T08:51:12.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:12.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-22T08:51:12.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:12.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-22T08:51:13.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:13.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-22T08:51:13.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:13.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-22T08:51:13.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:13.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-22T08:51:14.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:14.485 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-22T08:51:14.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:14.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-22T08:51:15.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:15.085 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-22T08:51:15.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:15.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-22T08:51:15.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:15.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-22T08:51:15.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:15.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-22T08:51:16.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:16.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-22T08:51:16.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:16.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-22T08:51:17.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:17.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-22T08:51:17.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:17.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-22T08:51:17.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:17.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-22T08:51:18.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:18.085 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-22T08:51:18.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:18.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-22T08:51:18.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:18.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-22T08:51:19.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:19.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-22T08:51:19.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:19.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-22T08:51:19.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:19.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-22T08:51:19.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:19.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-22T08:51:20.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:20.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-22T08:51:20.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:20.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-22T08:51:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:21.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-22T08:51:21.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:21.386 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-22T08:51:21.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:21.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-22T08:51:21.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-22T08:51:22.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:22.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-22T08:51:22.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:22.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-22T08:51:23.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:23.185 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-22T08:51:23.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:23.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-22T08:51:23.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:23.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-22T08:51:23.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:23.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-22T08:51:24.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-22T08:51:24.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:24.662 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-22T08:51:24.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:24.985 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-22T08:51:25.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:25.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-22T08:51:25.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:25.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-22T08:51:25.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:25.686 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-22T08:51:26.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:26.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-22T08:51:26.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:26.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-22T08:51:26.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:26.486 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-22T08:51:26.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:26.586 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-22T08:51:26.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-22T08:51:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-22T08:51:27.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:27.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-22T08:51:27.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:27.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-22T08:51:28.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-22T08:51:28.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.086 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-22T08:51:28.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.185 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-22T08:51:28.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.286 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-22T08:51:28.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-22T08:51:28.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:28.886 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-22T08:51:29.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:29.185 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-22T08:51:29.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:29.385 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-22T08:51:29.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:29.685 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-22T08:51:29.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:29.785 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-22T08:51:30.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:30.185 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-22T08:51:40.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:40.786 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-22T08:51:41.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:41.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-22T08:51:43.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:43.186 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-22T08:51:43.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 2m 8s 2024-09-22T08:51:43.582 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 5 executed 2024-09-22T08:51:43.596 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:51:43.648 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:43.648 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.685+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 realm 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.687+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.688+0000 7f0fc61ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.688+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.689+0000 7f0fc61ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.689+0000 7f0fc61ad800 20 searching for the correct realm 2024-09-22T08:51:43.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.691+0000 7f0fc4498640 0 -- 172.21.15.78:0/3689740913 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f0fac07e490 msgr2=0x7f0fac07de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.896+0000 7f0fbb496640 0 -- 172.21.15.78:0/3689740913 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f0fbc07c080 msgr2=0x7f0fbc0bc9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:43.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.902+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 zone default found 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 4 Realm: () 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 zonegroup default 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados->read ofs=0 len=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.903+0000 7f0fc61ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.904+0000 7f0fc61ad800 20 started sync module instance, tier type = 2024-09-22T08:51:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.904+0000 7f0fc61ad800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=0 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=1 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=2 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=3 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=4 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=5 2024-09-22T08:51:43.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.913+0000 7f0fc61ad800 20 add_watcher() i=6 2024-09-22T08:51:43.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.915+0000 7f0fc61ad800 20 add_watcher() i=7 2024-09-22T08:51:43.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.915+0000 7f0fc61ad800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:43.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.917+0000 7f0e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:43.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.917+0000 7f0fc61ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:43.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.917+0000 7f0fc61ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.955+0000 7f0e78fe1640 20 reqs_thread_entry: start 2024-09-22T08:51:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.955+0000 7f0fc61ad800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.955+0000 7f0fc61ad800 20 Filter name: none 2024-09-22T08:51:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.955+0000 7f0df27fc640 20 reqs_thread_entry: start 2024-09-22T08:51:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.955+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:51:43.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.956+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14390499843297905976', time=2024-09-22T10:51:14.117249+0000, chain.objs.size()=1 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.117__shadow_.MdfgRTcVrbPqlQWpNEiplheka69cyyX_0 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15481304459744712497', time=2024-09-22T10:51:20.059681+0000, chain.objs.size()=1 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.126__shadow_.5Tzv3piMfSklhBNV3a_4hk_FCsSI-Bj_0 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2486283375023652193', time=2024-09-22T10:51:22.829807+0000, chain.objs.size()=1 2024-09-22T08:51:43.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.957+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.130__shadow_.WofSKKrMr-5KDwlvfNYjM-MV1yx87-t_0 2024-09-22T08:51:43.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.959+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:43.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.962+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:51:43.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.963+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.964+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.964+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:51:43.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.964+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6953868215332645170', time=2024-09-22T10:51:24.725622+0000, chain.objs.size()=1 2024-09-22T08:51:43.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.964+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.133__shadow_.ZMMpOYk55slekcGi-Qtt8QtYr5hgh3f_0 2024-09-22T08:51:43.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.966+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:43.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.968+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:51:43.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.969+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.970+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.970+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:51:43.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.970+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7589223389362738695', time=2024-09-22T10:50:52.118114+0000, chain.objs.size()=5 2024-09-22T08:51:43.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.970+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__multipart_key1.2~bS_M2ftEL7C7kDE5Ct2weqTuKT4e6Al.1 2024-09-22T08:51:43.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__multipart_key1.2~bS_M2ftEL7C7kDE5Ct2weqTuKT4e6Al.2 2024-09-22T08:51:43.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__multipart_key1.2~bS_M2ftEL7C7kDE5Ct2weqTuKT4e6Al.3 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__multipart_key1.2~bS_M2ftEL7C7kDE5Ct2weqTuKT4e6Al.4 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__multipart_key1.2~bS_M2ftEL7C7kDE5Ct2weqTuKT4e6Al.5 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15245772187103929390', time=2024-09-22T10:51:11.348554+0000, chain.objs.size()=1 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.113__shadow_.w3kThNA6KTJbI8hWkknL2acyTlbMar3_0 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1350832840488866305', time=2024-09-22T10:51:14.091856+0000, chain.objs.size()=1 2024-09-22T08:51:43.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.971+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.117__shadow_.HW7XdOiIHZOasKmG68zHnpP1d82P00E_0 2024-09-22T08:51:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.975+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:43.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.978+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:51:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.979+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:51:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2665336591907116752', time=2024-09-22T10:51:12.051514+0000, chain.objs.size()=1 2024-09-22T08:51:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.114__shadow_.ilh5Aq7YafyMtB7xyti2Ze6UR30fkJj_0 2024-09-22T08:51:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16127112901470487382', time=2024-09-22T10:51:22.097423+0000, chain.objs.size()=1 2024-09-22T08:51:43.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.980+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.129__shadow_.de-5S8XFHWyATPdu6sfrKLaO9OZxSPt_0 2024-09-22T08:51:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.982+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:43.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.984+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:51:43.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.985+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5955090906106476866', time=2024-09-22T10:50:18.808056+0000, chain.objs.size()=5 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~8meldfECNjNKPLZdxgdzsbjBD02H-k8.1 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~8meldfECNjNKPLZdxgdzsbjBD02H-k8.1_1 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~8meldfECNjNKPLZdxgdzsbjBD02H-k8.2 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~8meldfECNjNKPLZdxgdzsbjBD02H-k8.2_1 2024-09-22T08:51:43.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~8meldfECNjNKPLZdxgdzsbjBD02H-k8.3 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15751705652145498259', time=2024-09-22T10:51:08.458044+0000, chain.objs.size()=1 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.107__shadow_.vM_CmXmu0IdX4bPNuYxwJsA9OGwXd7O_0 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16300865344200471889', time=2024-09-22T10:51:20.113777+0000, chain.objs.size()=1 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.126__shadow_.-ti-D9RQUGNeHkTUgyDmlNnWKydskfA_0 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15747187886722221961', time=2024-09-22T10:51:24.674726+0000, chain.objs.size()=1 2024-09-22T08:51:43.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.986+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.133__shadow_.4ncB0bR_3rMl1T-rXYcHQCI8FohHBoN_0 2024-09-22T08:51:43.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.991+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:43.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.993+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:51:43.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.994+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:43.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7493065923370620668', time=2024-09-22T10:49:45.940140+0000, chain.objs.size()=1 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.85__shadow_.NWX3OwbvtUATw4MDZBWj_maRnLirC58_0 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16610518852681141976', time=2024-09-22T10:51:11.321137+0000, chain.objs.size()=1 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.113__shadow_.dxY8SRvWRrRXPCOSIaHxcZSUjSDxsNW_0 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1925335116671224591', time=2024-09-22T10:51:13.401036+0000, chain.objs.size()=1 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.116__shadow_.9-xwSCWi4Jq5hueBaLJygY9wPpSr9Iq_0 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4299061552592380971', time=2024-09-22T10:51:22.770846+0000, chain.objs.size()=1 2024-09-22T08:51:43.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.995+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.130__shadow_.oNLuq94PKhBUpriOkCqiJ5MBPJtFFJo_0 2024-09-22T08:51:43.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:43.998+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.000+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:51:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.001+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:51:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7685418086570227189', time=2024-09-22T10:50:29.506813+0000, chain.objs.size()=5 2024-09-22T08:51:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.100__multipart_key1.2~5clF_eI0wQQEpY9vOEx2Klsn5wmyjZy.1 2024-09-22T08:51:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.100__multipart_key1.2~5clF_eI0wQQEpY9vOEx2Klsn5wmyjZy.2 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.100__multipart_key1.2~5clF_eI0wQQEpY9vOEx2Klsn5wmyjZy.3 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.100__multipart_key1.2~5clF_eI0wQQEpY9vOEx2Klsn5wmyjZy.4 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.100__multipart_key1.2~5clF_eI0wQQEpY9vOEx2Klsn5wmyjZy.5 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7657393066069316726', time=2024-09-22T10:50:44.776251+0000, chain.objs.size()=5 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~TeqTNIJOCvzmXjT63Ik71Qhio0X43I8.1 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~TeqTNIJOCvzmXjT63Ik71Qhio0X43I8.2 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~TeqTNIJOCvzmXjT63Ik71Qhio0X43I8.3 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~TeqTNIJOCvzmXjT63Ik71Qhio0X43I8.4 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~TeqTNIJOCvzmXjT63Ik71Qhio0X43I8.5 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16931639736553996284', time=2024-09-22T10:51:14.143393+0000, chain.objs.size()=1 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.117__shadow_.tMYEhLDNvkDRV2jp_LsX10lPWkAMTy4_0 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14747777563082490141', time=2024-09-22T10:51:20.823251+0000, chain.objs.size()=1 2024-09-22T08:51:44.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.002+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.127__shadow_.r5ZtOQkrz0wGFJjzYePn-BzE7Ts62lz_0 2024-09-22T08:51:44.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.006+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5165286404261947339', time=2024-09-22T10:51:24.054247+0000, chain.objs.size()=1 2024-09-22T08:51:44.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.006+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.132__shadow_.iAPTF4CUYV7UvobrBBtv-UCZrTG3mfC_0 2024-09-22T08:51:44.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.008+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6274788993619118336', time=2024-09-22T10:51:24.699907+0000, chain.objs.size()=1 2024-09-22T08:51:44.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.008+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.133__shadow_.FcdjM6hlbTqRrhmbW1iq0c29ZSerbtN_0 2024-09-22T08:51:44.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.011+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.013+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:51:44.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.015+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.015+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14059693693726425304', time=2024-09-22T10:51:20.746087+0000, chain.objs.size()=1 2024-09-22T08:51:44.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.127__shadow_.WEHTnLxojEnBd1iwhbCGvZ5wavdXae5_0 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5601616302249368335', time=2024-09-22T10:51:22.797521+0000, chain.objs.size()=1 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.130__shadow_.lPgKIAMeX-UaM1k5U0IwTW0SitmlAFx_0 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10390240086403930952', time=2024-09-22T10:51:26.669413+0000, chain.objs.size()=1 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.137__shadow_.zhY4bfi7FtTkzZ9IDhYDHZ20irGer2y_0 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5823923154694536100', time=2024-09-22T10:51:27.097759+0000, chain.objs.size()=1 2024-09-22T08:51:44.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.016+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.138__shadow_.lktAsSTDrrFbeL5CpFmvIWv6fm88jPu_0 2024-09-22T08:51:44.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.018+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.021+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:51:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.022+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.022+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:51:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3852101452199438686', time=2024-09-22T10:50:42.826926+0000, chain.objs.size()=5 2024-09-22T08:51:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~FMNaYsM0g4_x0FCmoXpf0mlaYFjpNT3.1 2024-09-22T08:51:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~FMNaYsM0g4_x0FCmoXpf0mlaYFjpNT3.2 2024-09-22T08:51:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~FMNaYsM0g4_x0FCmoXpf0mlaYFjpNT3.3 2024-09-22T08:51:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~FMNaYsM0g4_x0FCmoXpf0mlaYFjpNT3.4 2024-09-22T08:51:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.023+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~FMNaYsM0g4_x0FCmoXpf0mlaYFjpNT3.5 2024-09-22T08:51:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.026+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.028+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:51:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.029+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.030+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.759565779894053597', time=2024-09-22T10:51:14.767080+0000, chain.objs.size()=1 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.118__shadow_.g9vofN_NFzHLcUKQtSuil5sDqjncfxN_0 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9857268493284713612', time=2024-09-22T10:51:21.471594+0000, chain.objs.size()=1 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.128__shadow_.-Txfq2XJbH3Ym8R3uOcwx9i9vcFeWko_0 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5141570444352788369', time=2024-09-22T10:51:27.581777+0000, chain.objs.size()=1 2024-09-22T08:51:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.031+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.139__shadow_.7hm5cH6ruV2DxKSwkJc0Ikdn0e52eeg_0 2024-09-22T08:51:44.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.033+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.035+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:51:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.037+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.037+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.037+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-22T08:51:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.037+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17393652324758078517', time=2024-09-22T10:50:21.972057+0000, chain.objs.size()=5 2024-09-22T08:51:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.037+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~6P_cURND_ouCaNprpk_m93J6siGRBxd.1 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~6P_cURND_ouCaNprpk_m93J6siGRBxd.1_1 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~6P_cURND_ouCaNprpk_m93J6siGRBxd.2 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~6P_cURND_ouCaNprpk_m93J6siGRBxd.2_1 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~6P_cURND_ouCaNprpk_m93J6siGRBxd.3 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14330562465695860468', time=2024-09-22T10:50:33.926874+0000, chain.objs.size()=5 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file.mpg.2~BXCU-sZyqWjWU2Ogi-czq5NwiULhKvj.1 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file.mpg.2~BXCU-sZyqWjWU2Ogi-czq5NwiULhKvj.2 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file.mpg.2~BXCU-sZyqWjWU2Ogi-czq5NwiULhKvj.3 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file.mpg.2~BXCU-sZyqWjWU2Ogi-czq5NwiULhKvj.4 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file.mpg.2~BXCU-sZyqWjWU2Ogi-czq5NwiULhKvj.5 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6302073661191289372', time=2024-09-22T10:51:13.470277+0000, chain.objs.size()=1 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.116__shadow_.9o-3K6t3qA5cVyh-sGTKXHqTG-DKaD0_0 2024-09-22T08:51:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11229824658077272081', time=2024-09-22T10:51:14.791940+0000, chain.objs.size()=1 2024-09-22T08:51:44.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.038+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.118__shadow_.-E_dmX2qdkIdBpklWmmsh3W3ehWBlwI_0 2024-09-22T08:51:44.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.041+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1692611471825569671', time=2024-09-22T10:51:15.423622+0000, chain.objs.size()=1 2024-09-22T08:51:44.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.041+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.119__shadow_.qLj0bz_2i2cxbAynDB3aBiY2ExQILUB_0 2024-09-22T08:51:44.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.041+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11142132978176455808', time=2024-09-22T10:51:16.176656+0000, chain.objs.size()=1 2024-09-22T08:51:44.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.041+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.120__shadow_.MCKC6bxnPoA6dpA_BNKXE7VQq90kOI4_0 2024-09-22T08:51:44.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.043+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12766297135846848184', time=2024-09-22T10:51:22.124734+0000, chain.objs.size()=1 2024-09-22T08:51:44.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.043+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.129__shadow_.tzTCnsioHmAXiUjuV9z6FTfvw1ibPoO_0 2024-09-22T08:51:44.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.046+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.048+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:51:44.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.049+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16248367554565725302', time=2024-09-22T10:49:51.642659+0000, chain.objs.size()=5 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.1 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.2 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.3 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.4 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.5 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7766874705065398106', time=2024-09-22T10:51:13.433108+0000, chain.objs.size()=1 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.116__shadow_.nYzn0KdwxegkWw06TWha6p1hcZfegqB_0 2024-09-22T08:51:44.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3560756811022003587', time=2024-09-22T10:51:16.846787+0000, chain.objs.size()=1 2024-09-22T08:51:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.121__shadow_.0nS1XqR_77wOVSz7TmQojedjIjp43Ch_0 2024-09-22T08:51:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11821367582285293069', time=2024-09-22T10:51:21.446038+0000, chain.objs.size()=1 2024-09-22T08:51:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.128__shadow_.3oFXw19V5uco98UJ5lZp_9fpH8V2nJ1_0 2024-09-22T08:51:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13967560166838363995', time=2024-09-22T10:51:22.151301+0000, chain.objs.size()=1 2024-09-22T08:51:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.050+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.129__shadow_.vcrdm9j4arNU_47g2EGxygVDWXWXPkg_0 2024-09-22T08:51:44.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.054+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.057+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:51:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.058+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:51:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14706488166727746916', time=2024-09-22T10:51:12.020366+0000, chain.objs.size()=1 2024-09-22T08:51:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.114__shadow_.ADH3o9sAj0w7uUe2vs-ij-yPNvMYcMo_0 2024-09-22T08:51:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1831508247020863792', time=2024-09-22T10:51:22.177131+0000, chain.objs.size()=1 2024-09-22T08:51:44.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.059+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.129__shadow_.odZgw4MR_n4C4YJ0xRLMU3SbVwZrpN0_0 2024-09-22T08:51:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.060+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.062+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:51:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.064+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.064+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6778368695084026207', time=2024-09-22T10:50:07.417625+0000, chain.objs.size()=5 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~OZOBa02LXRjH2B01pgGjM6ggKGKEe-6.1 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~OZOBa02LXRjH2B01pgGjM6ggKGKEe-6.2 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~OZOBa02LXRjH2B01pgGjM6ggKGKEe-6.3 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~OZOBa02LXRjH2B01pgGjM6ggKGKEe-6.4 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~OZOBa02LXRjH2B01pgGjM6ggKGKEe-6.5 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4218375457259780066', time=2024-09-22T10:50:34.036058+0000, chain.objs.size()=1 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__shadow_.achL4ytKf_0URWwX-CQQud6SNMqySqr_0 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8290676696737298413', time=2024-09-22T10:51:17.474724+0000, chain.objs.size()=1 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.122__shadow_.sPi5EEAj7hYuwqG-YNjPmvDKM70StJh_0 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5652380921578414094', time=2024-09-22T10:51:19.457045+0000, chain.objs.size()=1 2024-09-22T08:51:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.065+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.125__shadow_.9HkKOd6QsCq_zHNAINbqO0VZCCSoZJi_0 2024-09-22T08:51:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.068+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.071+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:51:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.072+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.072+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12961110096193193676', time=2024-09-22T10:50:00.771922+0000, chain.objs.size()=5 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~xUo6TXePE0lGpJGwDqiibHDrw0-hGJl.1 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~xUo6TXePE0lGpJGwDqiibHDrw0-hGJl.2 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~xUo6TXePE0lGpJGwDqiibHDrw0-hGJl.3 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~xUo6TXePE0lGpJGwDqiibHDrw0-hGJl.4 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~xUo6TXePE0lGpJGwDqiibHDrw0-hGJl.5 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8838712537380153135', time=2024-09-22T10:50:51.185077+0000, chain.objs.size()=1 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.104__shadow_.xcx432o4heIMkdzguF_O9znyp-VQHF7_0 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3718411128642727951', time=2024-09-22T10:51:12.709185+0000, chain.objs.size()=1 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.115__shadow_._q2viOw7E6MdJZuPMWJKT6qPq3TvXXu_0 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10524944826897192974', time=2024-09-22T10:51:20.797131+0000, chain.objs.size()=1 2024-09-22T08:51:44.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.073+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.127__shadow_.DLICJN_v24fDx0jGC6VqH7do6_wTHOY_0 2024-09-22T08:51:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.077+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.079+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:51:44.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.081+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14078458866220965056', time=2024-09-22T10:50:22.446202+0000, chain.objs.size()=4 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.94__shadow_.PXYDxSBCFbccBE-JXlSOA3f0SyvQABR_0 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.94__shadow_.PXYDxSBCFbccBE-JXlSOA3f0SyvQABR_1 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.94__shadow_.PXYDxSBCFbccBE-JXlSOA3f0SyvQABR_2 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.94__shadow_.PXYDxSBCFbccBE-JXlSOA3f0SyvQABR_3 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4512227629488812322', time=2024-09-22T10:50:26.076868+0000, chain.objs.size()=5 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.99__multipart_key1.2~67MBnk2IQVM391p-Atsf8U3KfiA39oQ.1 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.99__multipart_key1.2~67MBnk2IQVM391p-Atsf8U3KfiA39oQ.2 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.99__multipart_key1.2~67MBnk2IQVM391p-Atsf8U3KfiA39oQ.3 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.99__multipart_key1.2~67MBnk2IQVM391p-Atsf8U3KfiA39oQ.4 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.99__multipart_key1.2~67MBnk2IQVM391p-Atsf8U3KfiA39oQ.5 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.258360840265219352', time=2024-09-22T10:51:12.735516+0000, chain.objs.size()=1 2024-09-22T08:51:44.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.115__shadow_.HJkq1-mKUCT2jSt5Zr3UB8jAfZfBMeV_0 2024-09-22T08:51:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3028558096873370006', time=2024-09-22T10:51:28.923101+0000, chain.objs.size()=1 2024-09-22T08:51:44.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.082+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.141__shadow_.KMR3aqSUTjMej7owCRG3Bq_v5b4hJQm_0 2024-09-22T08:51:44.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.090+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.092+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:51:44.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.093+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~473-64WojjlOnUBdMtuzyidxfF0NOoM', time=2024-09-22T10:49:41.884076+0000, chain.objs.size()=5 2024-09-22T08:51:44.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.80__multipart_key1.2~473-64WojjlOnUBdMtuzyidxfF0NOoM.1 2024-09-22T08:51:44.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.80__multipart_key1.2~473-64WojjlOnUBdMtuzyidxfF0NOoM.2 2024-09-22T08:51:44.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.80__multipart_key1.2~473-64WojjlOnUBdMtuzyidxfF0NOoM.3 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.80__multipart_key1.2~473-64WojjlOnUBdMtuzyidxfF0NOoM.4 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.80__multipart_key1.2~473-64WojjlOnUBdMtuzyidxfF0NOoM.5 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7610461254009009779', time=2024-09-22T10:49:46.400808+0000, chain.objs.size()=1 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.86__shadow_.AQ5V-ibKkzGtllzLpKx5oTaom1fvprg_0 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17198101994361139621', time=2024-09-22T10:50:54.551556+0000, chain.objs.size()=5 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105__multipart_key1.2~zsoI46dA5FjfBzBC3-U9dZp3uSg1jUe.1 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105__multipart_key1.2~zsoI46dA5FjfBzBC3-U9dZp3uSg1jUe.2 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.094+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105__multipart_key1.2~zsoI46dA5FjfBzBC3-U9dZp3uSg1jUe.3 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.095+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105__multipart_key1.2~zsoI46dA5FjfBzBC3-U9dZp3uSg1jUe.4 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.095+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105__multipart_key1.2~zsoI46dA5FjfBzBC3-U9dZp3uSg1jUe.5 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.095+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5155189172813886108', time=2024-09-22T10:51:20.771362+0000, chain.objs.size()=1 2024-09-22T08:51:44.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.095+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.127__shadow_.0a_FhGGX6aAu5POJKQRJELw86NO_3lV_0 2024-09-22T08:51:44.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.102+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.104+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:51:44.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.105+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17894302902177423565', time=2024-09-22T10:49:38.783406+0000, chain.objs.size()=1 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.78__shadow_.xE7xydzCDH22n3ggeY_Eca8GPhbUJW6_0 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14533990572937547929', time=2024-09-22T10:51:14.741312+0000, chain.objs.size()=1 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.118__shadow_.J0pRBAdnjE8DNra2uG3-ncIItKOMWnm_0 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9107746682532469133', time=2024-09-22T10:51:16.125865+0000, chain.objs.size()=1 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.120__shadow_.uy6vXasI6YRRctudUI2hnCjtqSh8ASl_0 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8748363115213536908', time=2024-09-22T10:51:18.161578+0000, chain.objs.size()=1 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.123__shadow_.9GsVzEjRXyHSMiqX3t22A34RRhmFw66_0 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9009778495698274736', time=2024-09-22T10:51:19.430194+0000, chain.objs.size()=1 2024-09-22T08:51:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.106+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.125__shadow_.OtDoTrXLgKoUNng66TOpW2ADiw9pk40_0 2024-09-22T08:51:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.108+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.111+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:51:44.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.112+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.112+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-22T08:51:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14344400172630683776', time=2024-09-22T10:50:46.524172+0000, chain.objs.size()=5 2024-09-22T08:51:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~dks9wsdCxzaCCeduFwjPI86mNmpKRey.1 2024-09-22T08:51:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~dks9wsdCxzaCCeduFwjPI86mNmpKRey.1_1 2024-09-22T08:51:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~dks9wsdCxzaCCeduFwjPI86mNmpKRey.2 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~dks9wsdCxzaCCeduFwjPI86mNmpKRey.2_1 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~dks9wsdCxzaCCeduFwjPI86mNmpKRey.3 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:50:59.751069+0000, chain.objs.size()=71 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.1 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.2 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.3 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.4 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.5 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.113+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.6 2024-09-22T08:51:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.114+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.7 2024-09-22T08:51:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.116+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.8 2024-09-22T08:51:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.117+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.9 2024-09-22T08:51:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.117+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.10 2024-09-22T08:51:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.11 2024-09-22T08:51:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.12 2024-09-22T08:51:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.13 2024-09-22T08:51:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.14 2024-09-22T08:51:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.15 2024-09-22T08:51:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.16 2024-09-22T08:51:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.17 2024-09-22T08:51:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.118+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.18 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.122+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.19 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.122+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.20 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.124+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.21 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.124+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.22 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.23 2024-09-22T08:51:44.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.24 2024-09-22T08:51:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.25 2024-09-22T08:51:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.26 2024-09-22T08:51:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.27 2024-09-22T08:51:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.28 2024-09-22T08:51:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.125+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.29 2024-09-22T08:51:44.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.128+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.30 2024-09-22T08:51:44.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.128+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.31 2024-09-22T08:51:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.32 2024-09-22T08:51:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.33 2024-09-22T08:51:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.34 2024-09-22T08:51:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.35 2024-09-22T08:51:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.36 2024-09-22T08:51:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.37 2024-09-22T08:51:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.130+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.38 2024-09-22T08:51:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.131+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.39 2024-09-22T08:51:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.131+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.40 2024-09-22T08:51:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.133+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.41 2024-09-22T08:51:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.134+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.42 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.43 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.44 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.45 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.46 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.47 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.48 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.49 2024-09-22T08:51:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.135+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.50 2024-09-22T08:51:44.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.137+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.51 2024-09-22T08:51:44.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.138+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.52 2024-09-22T08:51:44.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.139+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.53 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.54 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.55 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.56 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.57 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.58 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.59 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.60 2024-09-22T08:51:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.141+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.61 2024-09-22T08:51:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.142+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.62 2024-09-22T08:51:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.142+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.63 2024-09-22T08:51:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.142+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.64 2024-09-22T08:51:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.146+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.65 2024-09-22T08:51:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.146+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.66 2024-09-22T08:51:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.146+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.67 2024-09-22T08:51:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.146+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.68 2024-09-22T08:51:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.146+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.69 2024-09-22T08:51:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.147+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.70 2024-09-22T08:51:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.147+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.71 2024-09-22T08:51:44.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.148+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:00.101998+0000, chain.objs.size()=9 2024-09-22T08:51:44.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.148+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.72 2024-09-22T08:51:44.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.148+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.73 2024-09-22T08:51:44.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.148+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.74 2024-09-22T08:51:44.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.149+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.75 2024-09-22T08:51:44.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.150+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.76 2024-09-22T08:51:44.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.151+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.77 2024-09-22T08:51:44.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.151+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.78 2024-09-22T08:51:44.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.151+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.79 2024-09-22T08:51:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.80 2024-09-22T08:51:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:00.446859+0000, chain.objs.size()=4 2024-09-22T08:51:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.81 2024-09-22T08:51:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.82 2024-09-22T08:51:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.83 2024-09-22T08:51:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.84 2024-09-22T08:51:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:00.949694+0000, chain.objs.size()=8 2024-09-22T08:51:44.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.153+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.85 2024-09-22T08:51:44.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.155+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.86 2024-09-22T08:51:44.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.155+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.87 2024-09-22T08:51:44.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.155+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.88 2024-09-22T08:51:44.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.156+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.89 2024-09-22T08:51:44.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.157+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.90 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.91 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.92 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:01.391889+0000, chain.objs.size()=9 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.93 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.94 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.95 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.96 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.97 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.98 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.99 2024-09-22T08:51:44.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.159+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.100 2024-09-22T08:51:44.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.160+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.101 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:01.848102+0000, chain.objs.size()=5 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.102 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.103 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.104 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.105 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.106 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:02.384782+0000, chain.objs.size()=15 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.107 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.108 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.109 2024-09-22T08:51:44.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.110 2024-09-22T08:51:44.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.111 2024-09-22T08:51:44.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.165+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.112 2024-09-22T08:51:44.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.168+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.113 2024-09-22T08:51:44.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.114 2024-09-22T08:51:44.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.115 2024-09-22T08:51:44.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.116 2024-09-22T08:51:44.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.117 2024-09-22T08:51:44.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.118 2024-09-22T08:51:44.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.171+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.119 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.120 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.121 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:02.781120+0000, chain.objs.size()=1 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.122 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:03.223013+0000, chain.objs.size()=9 2024-09-22T08:51:44.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.123 2024-09-22T08:51:44.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.173+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.124 2024-09-22T08:51:44.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.175+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.125 2024-09-22T08:51:44.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.175+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.126 2024-09-22T08:51:44.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.176+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.127 2024-09-22T08:51:44.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.176+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.128 2024-09-22T08:51:44.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.176+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.129 2024-09-22T08:51:44.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.176+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.130 2024-09-22T08:51:44.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.176+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.131 2024-09-22T08:51:44.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.178+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:03.574460+0000, chain.objs.size()=9 2024-09-22T08:51:44.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.178+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.132 2024-09-22T08:51:44.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.178+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.133 2024-09-22T08:51:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.178+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.134 2024-09-22T08:51:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.178+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.135 2024-09-22T08:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.179+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.136 2024-09-22T08:51:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.179+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.137 2024-09-22T08:51:44.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.138 2024-09-22T08:51:44.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.139 2024-09-22T08:51:44.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.140 2024-09-22T08:51:44.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:03.970153+0000, chain.objs.size()=3 2024-09-22T08:51:44.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.141 2024-09-22T08:51:44.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.183+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.142 2024-09-22T08:51:44.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.143 2024-09-22T08:51:44.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:04.436629+0000, chain.objs.size()=9 2024-09-22T08:51:44.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.144 2024-09-22T08:51:44.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.145 2024-09-22T08:51:44.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.146 2024-09-22T08:51:44.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.147 2024-09-22T08:51:44.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.185+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.148 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.149 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.150 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.151 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.152 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:04.971519+0000, chain.objs.size()=9 2024-09-22T08:51:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.153 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.154 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.155 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.156 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.157 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.189+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.158 2024-09-22T08:51:44.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.190+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.159 2024-09-22T08:51:44.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.193+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.160 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.162 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:05.296836+0000, chain.objs.size()=4 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.161 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.163 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.164 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.165 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:05.786680+0000, chain.objs.size()=9 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.166 2024-09-22T08:51:44.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.167 2024-09-22T08:51:44.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.168 2024-09-22T08:51:44.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.194+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.169 2024-09-22T08:51:44.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.196+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.170 2024-09-22T08:51:44.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.198+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.171 2024-09-22T08:51:44.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.199+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.172 2024-09-22T08:51:44.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.199+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.173 2024-09-22T08:51:44.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.199+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.175 2024-09-22T08:51:44.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.199+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl', time=2024-09-22T10:51:08.013235+0000, chain.objs.size()=212 2024-09-22T08:51:44.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.199+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.1 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.200+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.2 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.201+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.3 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.201+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.4 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.201+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.5 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.201+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.6 2024-09-22T08:51:44.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.201+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.7 2024-09-22T08:51:44.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.203+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.8 2024-09-22T08:51:44.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.203+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.9 2024-09-22T08:51:44.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.203+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.10 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.11 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.12 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.13 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.14 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.15 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.16 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.17 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.18 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.19 2024-09-22T08:51:44.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.20 2024-09-22T08:51:44.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.205+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.21 2024-09-22T08:51:44.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.207+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.22 2024-09-22T08:51:44.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.208+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.23 2024-09-22T08:51:44.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.24 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.25 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.26 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.27 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.28 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.29 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.30 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.31 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.32 2024-09-22T08:51:44.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.209+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.33 2024-09-22T08:51:44.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.211+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.34 2024-09-22T08:51:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.212+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.35 2024-09-22T08:51:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.212+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.36 2024-09-22T08:51:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.212+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.37 2024-09-22T08:51:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.38 2024-09-22T08:51:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.39 2024-09-22T08:51:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.40 2024-09-22T08:51:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.41 2024-09-22T08:51:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.42 2024-09-22T08:51:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.43 2024-09-22T08:51:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.44 2024-09-22T08:51:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.213+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.45 2024-09-22T08:51:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.215+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.46 2024-09-22T08:51:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.215+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.47 2024-09-22T08:51:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.215+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.48 2024-09-22T08:51:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.215+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.49 2024-09-22T08:51:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.215+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.50 2024-09-22T08:51:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.51 2024-09-22T08:51:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.52 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.53 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.54 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.55 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.56 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.216+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.57 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.217+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.58 2024-09-22T08:51:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.217+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.59 2024-09-22T08:51:44.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.218+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.60 2024-09-22T08:51:44.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.218+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.61 2024-09-22T08:51:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.218+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.62 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.219+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.63 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.219+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.64 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.219+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.65 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.66 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.67 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.68 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.69 2024-09-22T08:51:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.70 2024-09-22T08:51:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.220+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.71 2024-09-22T08:51:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.221+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.72 2024-09-22T08:51:44.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.222+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.73 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.222+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.74 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.222+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.75 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.222+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.76 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.77 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.78 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.79 2024-09-22T08:51:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.80 2024-09-22T08:51:44.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.81 2024-09-22T08:51:44.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.82 2024-09-22T08:51:44.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.223+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.83 2024-09-22T08:51:44.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.84 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.85 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.86 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.87 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.88 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.89 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.90 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.91 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.92 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.93 2024-09-22T08:51:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.225+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.94 2024-09-22T08:51:44.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.227+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.95 2024-09-22T08:51:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.228+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.96 2024-09-22T08:51:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.228+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.97 2024-09-22T08:51:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.98 2024-09-22T08:51:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.99 2024-09-22T08:51:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.100 2024-09-22T08:51:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.101 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.102 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.103 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.104 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.105 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.106 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.230+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.107 2024-09-22T08:51:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.231+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.108 2024-09-22T08:51:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.232+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.109 2024-09-22T08:51:44.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.232+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.110 2024-09-22T08:51:44.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.233+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.111 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.233+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.112 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.233+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.113 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.114 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.115 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.116 2024-09-22T08:51:44.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.117 2024-09-22T08:51:44.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.118 2024-09-22T08:51:44.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.234+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.119 2024-09-22T08:51:44.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.236+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.120 2024-09-22T08:51:44.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.236+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.121 2024-09-22T08:51:44.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.236+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.122 2024-09-22T08:51:44.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.236+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.123 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.124 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.125 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.126 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.127 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.128 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.129 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.130 2024-09-22T08:51:44.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.237+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.131 2024-09-22T08:51:44.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.239+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.132 2024-09-22T08:51:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.239+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.133 2024-09-22T08:51:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.240+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.134 2024-09-22T08:51:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.241+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.135 2024-09-22T08:51:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.241+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.136 2024-09-22T08:51:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.241+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.137 2024-09-22T08:51:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.241+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.138 2024-09-22T08:51:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.241+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.139 2024-09-22T08:51:44.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.242+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.140 2024-09-22T08:51:44.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.242+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.141 2024-09-22T08:51:44.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.242+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.142 2024-09-22T08:51:44.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.242+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.143 2024-09-22T08:51:44.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.243+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.144 2024-09-22T08:51:44.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.243+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.145 2024-09-22T08:51:44.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.243+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.146 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.244+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.147 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.244+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.148 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.244+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.149 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.245+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.150 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.245+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.151 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.245+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.152 2024-09-22T08:51:44.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.245+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.153 2024-09-22T08:51:44.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.245+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.154 2024-09-22T08:51:44.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.246+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.155 2024-09-22T08:51:44.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.246+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.156 2024-09-22T08:51:44.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.246+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.157 2024-09-22T08:51:44.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.158 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.159 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.160 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.161 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.162 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.163 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.164 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.165 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.166 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.167 2024-09-22T08:51:44.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.254+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.168 2024-09-22T08:51:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.257+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.169 2024-09-22T08:51:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.257+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.170 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.171 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.172 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.173 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.174 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.175 2024-09-22T08:51:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.176 2024-09-22T08:51:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.177 2024-09-22T08:51:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.178 2024-09-22T08:51:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.258+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.179 2024-09-22T08:51:44.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.259+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.180 2024-09-22T08:51:44.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.259+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.181 2024-09-22T08:51:44.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.261+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.182 2024-09-22T08:51:44.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.261+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.183 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.184 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.185 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.186 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.187 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.188 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.189 2024-09-22T08:51:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.262+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.190 2024-09-22T08:51:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.264+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.191 2024-09-22T08:51:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.264+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.192 2024-09-22T08:51:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.264+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.193 2024-09-22T08:51:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.265+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.194 2024-09-22T08:51:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.265+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.195 2024-09-22T08:51:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.265+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.196 2024-09-22T08:51:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.267+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.197 2024-09-22T08:51:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.267+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.198 2024-09-22T08:51:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.267+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.199 2024-09-22T08:51:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.267+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.200 2024-09-22T08:51:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.267+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.201 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.202 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.203 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.204 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.205 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.206 2024-09-22T08:51:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.270+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.207 2024-09-22T08:51:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.271+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.208 2024-09-22T08:51:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.271+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.209 2024-09-22T08:51:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.272+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.210 2024-09-22T08:51:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.272+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.211 2024-09-22T08:51:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.274+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.106__multipart_key1.2~yK7RrWTtWEn4CWrVcnK8NYZlICJDPBl.212 2024-09-22T08:51:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.274+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13604629263780927959', time=2024-09-22T10:51:11.400501+0000, chain.objs.size()=1 2024-09-22T08:51:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.274+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.113__shadow_.2Sp8MOEltiCRO7MR4N1huMhoNafpnPx_0 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17889536593641718859', time=2024-09-22T10:51:11.994232+0000, chain.objs.size()=1 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.114__shadow_.XtJyYOb1H0bjahk6UioL-avB_6HEcXQ_0 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8013499216981699517', time=2024-09-22T10:51:16.771593+0000, chain.objs.size()=1 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.121__shadow_.KmU5x3BbK5KDoj3fu8hLikZkV2F9obE_0 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16262239443265242205', time=2024-09-22T10:51:19.404035+0000, chain.objs.size()=1 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.125__shadow_.aMApfO1QFFOljlKAn2D83rVVZKp6H0r_0 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10275993721579978727', time=2024-09-22T10:51:23.433552+0000, chain.objs.size()=1 2024-09-22T08:51:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.276+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.131__shadow_.VvfgjCJ9TecyKbk502z1wE_83Lk-Qxj_0 2024-09-22T08:51:44.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.280+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.283+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:51:44.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.284+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:51:44.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13494463714610530157', time=2024-09-22T10:51:14.066537+0000, chain.objs.size()=1 2024-09-22T08:51:44.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.117__shadow_.IxEOPtRi_v-AaOWuQF_hz84PcYGHOAd_0 2024-09-22T08:51:44.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17236091350392044251', time=2024-09-22T10:51:16.796640+0000, chain.objs.size()=1 2024-09-22T08:51:44.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.285+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.121__shadow_.DeEGvSlhm6KXfJfw-hPLtphAWWggubf_0 2024-09-22T08:51:44.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.286+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.289+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:51:44.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.290+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.290+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='2~1ILghflr1byw43fdFo2K8oBhtj6iUYD', time=2024-09-22T10:50:36.380104+0000, chain.objs.size()=5 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.102__multipart_key1.2~1ILghflr1byw43fdFo2K8oBhtj6iUYD.7 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.102__multipart_key1.2~1ILghflr1byw43fdFo2K8oBhtj6iUYD.8 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.102__multipart_key1.2~1ILghflr1byw43fdFo2K8oBhtj6iUYD.9 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.102__multipart_key1.2~1ILghflr1byw43fdFo2K8oBhtj6iUYD.10 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.102__multipart_key1.2~1ILghflr1byw43fdFo2K8oBhtj6iUYD.11 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5821407308521184927', time=2024-09-22T10:51:13.366736+0000, chain.objs.size()=1 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.116__shadow_.eLXmneJm7aD-rK0jTDoIhajBp9aJxwG_0 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4144911616406099511', time=2024-09-22T10:51:15.476494+0000, chain.objs.size()=1 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.119__shadow_.Ksk4mITAcvtZhFIhn_kPFyGYDm9Yp16_0 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1749483709145843889', time=2024-09-22T10:51:18.187943+0000, chain.objs.size()=1 2024-09-22T08:51:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.123__shadow_.vFVYb-HZIeS96qJzwihLv0fjBnquFJf_0 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9917822306596808670', time=2024-09-22T10:51:18.214676+0000, chain.objs.size()=1 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.123__shadow_.VfXmrl814W33mGH-jP0P6knQTSQZ1wT_0 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13572924239258528252', time=2024-09-22T10:51:23.459090+0000, chain.objs.size()=1 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.131__shadow_.DBt1rJ_yrKAAnMaMZEk8O9iaCyFkNLA_0 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15249445177388939136', time=2024-09-22T10:51:24.106870+0000, chain.objs.size()=1 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.132__shadow_.JefCFJ3KiVhVugqQxvu0hEyLLQdHa56_0 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15696833240262190685', time=2024-09-22T10:51:40.849269+0000, chain.objs.size()=5 2024-09-22T08:51:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.291+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.144__multipart_key1.2~s_5dfdLcfR6pvkHepLVRleGJQNNBXmL.1 2024-09-22T08:51:44.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.294+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.144__multipart_key1.2~s_5dfdLcfR6pvkHepLVRleGJQNNBXmL.2 2024-09-22T08:51:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.295+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.144__multipart_key1.2~s_5dfdLcfR6pvkHepLVRleGJQNNBXmL.3 2024-09-22T08:51:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.295+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.144__multipart_key1.2~s_5dfdLcfR6pvkHepLVRleGJQNNBXmL.4 2024-09-22T08:51:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.296+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.144__multipart_key1.2~s_5dfdLcfR6pvkHepLVRleGJQNNBXmL.5 2024-09-22T08:51:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.296+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8119069982772574629', time=2024-09-22T10:51:43.294201+0000, chain.objs.size()=1 2024-09-22T08:51:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.296+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__shadow_.2TDrMDLy_VY9RjC0ERGQoHFVAA6E8x8_0 2024-09-22T08:51:44.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.300+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.302+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:51:44.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.303+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:51:44.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11385873783534291699', time=2024-09-22T10:50:33.953200+0000, chain.objs.size()=1 2024-09-22T08:51:44.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__shadow_.1jfBgvs376eSU7lczO56uqhaaxYX-EW_0 2024-09-22T08:51:44.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2220581759729494615', time=2024-09-22T10:51:17.528334+0000, chain.objs.size()=1 2024-09-22T08:51:44.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.304+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.122__shadow_.kxK3r3uT4OBE64RQntPcy1kzr48mhEG_0 2024-09-22T08:51:44.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.306+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.308+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:51:44.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.309+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.309+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.837262666265917192', time=2024-09-22T10:51:11.374410+0000, chain.objs.size()=1 2024-09-22T08:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.113__shadow_.edGDMwSyIquYO59ljpUVAaO3lkxJqtv_0 2024-09-22T08:51:44.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10950929027634123833', time=2024-09-22T10:51:22.859468+0000, chain.objs.size()=1 2024-09-22T08:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.130__shadow_.c5hECoMvtdnMcoB2hgTHCezhlV6sRfN_0 2024-09-22T08:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15632951801982938247', time=2024-09-22T10:51:25.348684+0000, chain.objs.size()=1 2024-09-22T08:51:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.310+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.134__shadow_.KEraPiFk_OwSh3A1uG3VWCf_iPO4XQ4_0 2024-09-22T08:51:44.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.311+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.315+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:51:44.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.316+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.316+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T08:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16324735292777130483', time=2024-09-22T10:50:04.169460+0000, chain.objs.size()=5 2024-09-22T08:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~Ai9zd96cCoaq8PBR_UGf18wkn9R798s.1 2024-09-22T08:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~Ai9zd96cCoaq8PBR_UGf18wkn9R798s.2 2024-09-22T08:51:44.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~Ai9zd96cCoaq8PBR_UGf18wkn9R798s.3 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~Ai9zd96cCoaq8PBR_UGf18wkn9R798s.4 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~Ai9zd96cCoaq8PBR_UGf18wkn9R798s.5 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8801896586334320388', time=2024-09-22T10:51:15.502312+0000, chain.objs.size()=1 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.119__shadow_.iW6eK9c5L9vaseBkaaCtTAVaL9s4M7e_0 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3255024442946205561', time=2024-09-22T10:51:20.140118+0000, chain.objs.size()=1 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.126__shadow_.773uVqyd2liwFh39DuF_huVcS1WUOHp_0 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6005082060197332003', time=2024-09-22T10:51:24.080586+0000, chain.objs.size()=1 2024-09-22T08:51:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.317+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.132__shadow_.65OTrWUCPXvyhFExQgm_nz_M0RgNoS5_0 2024-09-22T08:51:44.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.321+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.323+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:51:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.324+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T08:51:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10491405360242729865', time=2024-09-22T10:51:27.494847+0000, chain.objs.size()=1 2024-09-22T08:51:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.139__shadow_.r2LPrPv5Ky8dLUoU-OLIPLDA9KOyyfX_0 2024-09-22T08:51:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15988627808554551526', time=2024-09-22T10:51:28.418772+0000, chain.objs.size()=1 2024-09-22T08:51:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.325+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.140__shadow_.rELTCmWoZ8fCOJJNfvpSWF9ZVHuDE2h_0 2024-09-22T08:51:44.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.327+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.329+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:51:44.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12035396638681314247', time=2024-09-22T10:50:34.010265+0000, chain.objs.size()=1 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__shadow_.B8ZLXocZBoIIteEGIg6LPj71Yk1dnnz_0 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15391392925805499300', time=2024-09-22T10:51:15.450014+0000, chain.objs.size()=1 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.119__shadow_.RxSIkjyRh6v71WPkHFfxyP90xHInIF0_0 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1836536533431864486', time=2024-09-22T10:51:16.100394+0000, chain.objs.size()=1 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.120__shadow_.7y7BBWniMinQjsTItYtpWFSp2fKK-yI_0 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11057071032840531463', time=2024-09-22T10:51:16.150951+0000, chain.objs.size()=1 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.120__shadow_.G0uGwxdIgmyROH01bBV1f3hN-x8KZ79_0 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6499580280748511243', time=2024-09-22T10:51:16.821484+0000, chain.objs.size()=1 2024-09-22T08:51:44.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.331+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.121__shadow_.IFEuhstqFAkiG16u_eDMyjVC_ARMnwd_0 2024-09-22T08:51:44.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.334+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.336+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:51:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.337+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:51:44.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3842278132286673958', time=2024-09-22T10:50:33.982349+0000, chain.objs.size()=5 2024-09-22T08:51:44.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file2.mpg.2~xQ0jCpPXTLEn2_Q8wEvrJ3Vazm7n20f.1 2024-09-22T08:51:44.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file2.mpg.2~xQ0jCpPXTLEn2_Q8wEvrJ3Vazm7n20f.2 2024-09-22T08:51:44.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file2.mpg.2~xQ0jCpPXTLEn2_Q8wEvrJ3Vazm7n20f.3 2024-09-22T08:51:44.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file2.mpg.2~xQ0jCpPXTLEn2_Q8wEvrJ3Vazm7n20f.4 2024-09-22T08:51:44.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.338+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.101__multipart_file2.mpg.2~xQ0jCpPXTLEn2_Q8wEvrJ3Vazm7n20f.5 2024-09-22T08:51:44.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.342+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.345+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:51:44.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.346+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.346+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10509303941141901038', time=2024-09-22T10:49:45.477151+0000, chain.objs.size()=2 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.84__shadow_.cJi_ZavfNuNPLyv4ipFTIwMd1VRleau_0 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.84__shadow_.cJi_ZavfNuNPLyv4ipFTIwMd1VRleau_1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4908021804995539480', time=2024-09-22T10:50:22.165576+0000, chain.objs.size()=5 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~b-YNlFTIJsGxfIeh9kYAoLCiX0PK-Tg.1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~b-YNlFTIJsGxfIeh9kYAoLCiX0PK-Tg.1_1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~b-YNlFTIJsGxfIeh9kYAoLCiX0PK-Tg.2 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__shadow_key1.2~b-YNlFTIJsGxfIeh9kYAoLCiX0PK-Tg.2_1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.95__multipart_key1.2~b-YNlFTIJsGxfIeh9kYAoLCiX0PK-Tg.3 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17848209452819013706', time=2024-09-22T10:51:12.077579+0000, chain.objs.size()=1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.114__shadow_.6JiJnW8O962HZA66luNARBARXqMRL3B_0 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15379859643624429315', time=2024-09-22T10:51:12.763325+0000, chain.objs.size()=1 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.115__shadow_.rl6Jc67THiweu7BHu2YPyzOW6RODNDx_0 2024-09-22T08:51:44.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7938142642243659328', time=2024-09-22T10:51:17.501306+0000, chain.objs.size()=1 2024-09-22T08:51:44.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.122__shadow_.YjsoL9NFMFkEEdwirea4ifvAmxCEfTK_0 2024-09-22T08:51:44.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13188459902477456125', time=2024-09-22T10:51:21.497639+0000, chain.objs.size()=1 2024-09-22T08:51:44.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.347+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.128__shadow_.XLV-xZcaL6RCw0WX8Qfg4wj0bla3avt_0 2024-09-22T08:51:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.353+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.355+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:51:44.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.357+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.357+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14328573972618784305', time=2024-09-22T10:49:48.530197+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.91__shadow_.UY4cfDAAlciCIZAKaznPE04dpmkw-Ua_0 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14243103641416697050', time=2024-09-22T10:51:12.683908+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.115__shadow_.PzNHRc1NuoiIRZgD-dk2nm9qNQ0lYh8_0 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7097934140083654067', time=2024-09-22T10:51:18.135674+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.123__shadow_.yP_DhwISj8BTkVXSzk4BiL94IDZaJTk_0 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7383512879984460232', time=2024-09-22T10:51:20.086101+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.126__shadow_.UmQMxXJ0jewOjUwgkYGaxsBIj49v1E5_0 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2478607355846479784', time=2024-09-22T10:51:25.295917+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.134__shadow_.byMsQP0xS0a07HzNOvKI3j3mGEZ0mbS_0 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16365048328050850034', time=2024-09-22T10:51:25.321894+0000, chain.objs.size()=1 2024-09-22T08:51:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.358+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.134__shadow_.ukllP_9vAtHZYYhxTSRQmTGqkLOlaAz_0 2024-09-22T08:51:44.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.361+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.363+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:51:44.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:51:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17369970832231173391', time=2024-09-22T10:49:43.025152+0000, chain.objs.size()=1 2024-09-22T08:51:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.82__shadow_.HLTt1e5FQ55dfJd5-YENfG0Jf3zwh6s_0 2024-09-22T08:51:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18441734131247689343', time=2024-09-22T10:50:48.827266+0000, chain.objs.size()=5 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~Z_LF4Yd8euuI-akqFDgn8Z5LQuAsSyg.1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~Z_LF4Yd8euuI-akqFDgn8Z5LQuAsSyg.1_1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~Z_LF4Yd8euuI-akqFDgn8Z5LQuAsSyg.2 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~Z_LF4Yd8euuI-akqFDgn8Z5LQuAsSyg.2_1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~Z_LF4Yd8euuI-akqFDgn8Z5LQuAsSyg.3 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18126100989360288238', time=2024-09-22T10:50:49.018640+0000, chain.objs.size()=5 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~o-7a5CLRz2iVqTVfA4-9yI0V654lpCY.1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~o-7a5CLRz2iVqTVfA4-9yI0V654lpCY.1_1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~o-7a5CLRz2iVqTVfA4-9yI0V654lpCY.2 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.365+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__shadow_key1.2~o-7a5CLRz2iVqTVfA4-9yI0V654lpCY.2_1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.366+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~o-7a5CLRz2iVqTVfA4-9yI0V654lpCY.3 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.366+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1414940573775854071', time=2024-09-22T10:51:17.449618+0000, chain.objs.size()=1 2024-09-22T08:51:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.366+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.122__shadow_.nZm6y2yTEeCMd6lTCB5dM-3yuaNGWZe_0 2024-09-22T08:51:44.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.369+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13448130052293932271', time=2024-09-22T10:51:21.419754+0000, chain.objs.size()=1 2024-09-22T08:51:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.369+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.128__shadow_.3WznVQI58sh8E9i6D3bWPFwCXfgXAu6_0 2024-09-22T08:51:44.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.372+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.376+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:51:44.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1981565893458653644', time=2024-09-22T10:49:51.369975+0000, chain.objs.size()=5 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.1 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.2 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.3 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.4 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.92__multipart_key1.2~UjK9eR7q_yipyurSkwcro83q5PtJPY0.5 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15728721783730802413', time=2024-09-22T10:50:40.386403+0000, chain.objs.size()=5 2024-09-22T08:51:44.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~y2wUeb5QKScEitk_UaBnC-1lj9hw5O2.1 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~y2wUeb5QKScEitk_UaBnC-1lj9hw5O2.2 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~y2wUeb5QKScEitk_UaBnC-1lj9hw5O2.3 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~y2wUeb5QKScEitk_UaBnC-1lj9hw5O2.4 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.103__multipart_key1.2~y2wUeb5QKScEitk_UaBnC-1lj9hw5O2.5 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14209154133173204962', time=2024-09-22T10:51:18.806220+0000, chain.objs.size()=1 2024-09-22T08:51:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.378+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.124__shadow_.uSixEIp7t7WYT7DIADVQums7CcQ1ktH_0 2024-09-22T08:51:44.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.384+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.387+0000 7f0fc61ad800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:51:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.388+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.388+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T08:51:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2370741917101425228', time=2024-09-22T10:51:14.817773+0000, chain.objs.size()=1 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.118__shadow_.VpQIsFwftpeKQ0VPDQ-wCJwDpNTb2LF_0 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14869958997915776518', time=2024-09-22T10:51:18.780184+0000, chain.objs.size()=1 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.124__shadow_._mHj6cQ3SpsZz601jbDZ1wED0NE36re_0 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.224390643002363062', time=2024-09-22T10:51:18.832605+0000, chain.objs.size()=1 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.124__shadow_.gfeFGEMh-S8xA6pxmXD_6QXU7_Qr5am_0 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6861424544281661148', time=2024-09-22T10:51:23.484371+0000, chain.objs.size()=1 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.131__shadow_.__Qe8qS8T5wvKWrxGAOIHLGrGrROOKv_0 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10430611643212495206', time=2024-09-22T10:51:43.260843+0000, chain.objs.size()=5 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__multipart_key1/data/file.mpg.2~igx3BYEPMImRWrw0kfiUsOyS9kEWy-W.1 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__multipart_key1/data/file.mpg.2~igx3BYEPMImRWrw0kfiUsOyS9kEWy-W.2 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__multipart_key1/data/file.mpg.2~igx3BYEPMImRWrw0kfiUsOyS9kEWy-W.3 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__multipart_key1/data/file.mpg.2~igx3BYEPMImRWrw0kfiUsOyS9kEWy-W.4 2024-09-22T08:51:44.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.389+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.145__multipart_key1/data/file.mpg.2~igx3BYEPMImRWrw0kfiUsOyS9kEWy-W.5 2024-09-22T08:51:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.394+0000 7f0fc61ad800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:51:44.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.397+0000 7f0e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:44.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.399+0000 7f0fc61ad800 20 remove_watcher() i=0 2024-09-22T08:51:44.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.399+0000 7f0fc61ad800 2 removed watcher, disabling cache 2024-09-22T08:51:44.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.400+0000 7f0fc61ad800 20 remove_watcher() i=1 2024-09-22T08:51:44.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.401+0000 7f0fc61ad800 20 remove_watcher() i=2 2024-09-22T08:51:44.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.402+0000 7f0fc61ad800 20 remove_watcher() i=3 2024-09-22T08:51:44.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.403+0000 7f0fc61ad800 20 remove_watcher() i=4 2024-09-22T08:51:44.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.404+0000 7f0fc61ad800 20 remove_watcher() i=5 2024-09-22T08:51:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.405+0000 7f0fc61ad800 20 remove_watcher() i=6 2024-09-22T08:51:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.406+0000 7f0fc61ad800 20 remove_watcher() i=7 2024-09-22T08:51:44.419 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-22T08:51:44.470 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:44.471 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.506+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 20 realm 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.508+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.509+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.509+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.509+0000 7fc067896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.509+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.510+0000 7fc067896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.510+0000 7fc067896800 20 searching for the correct realm 2024-09-22T08:51:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.512+0000 7fc065b81640 0 -- 172.21.15.78:0/3061638885 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fc050045020 msgr2=0x7fc0500758e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:44.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.717+0000 7fc05cb7f640 0 -- 172.21.15.78:0/3061638885 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc060030060 msgr2=0x7fc06008e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 zone default found 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 4 Realm: () 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 zonegroup default 2024-09-22T08:51:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.722+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 rados->read ofs=0 len=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 started sync module instance, tier type = 2024-09-22T08:51:44.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.723+0000 7fc067896800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=0 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=1 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=2 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=3 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=4 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=5 2024-09-22T08:51:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=6 2024-09-22T08:51:44.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 20 add_watcher() i=7 2024-09-22T08:51:44.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.732+0000 7fc067896800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.734+0000 7fbf1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:44.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.735+0000 7fc067896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:44.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.735+0000 7fc067896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:44.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.769+0000 7fbf1afe5640 20 reqs_thread_entry: start 2024-09-22T08:51:44.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.769+0000 7fc067896800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.769+0000 7fc067896800 20 Filter name: none 2024-09-22T08:51:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.769+0000 7fbf18fe1640 20 reqs_thread_entry: start 2024-09-22T08:51:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.769+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:51:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.770+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.771+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.771+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.772+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:51:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.773+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.774+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.775+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.777+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:51:44.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.778+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.778+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.779+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.780+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:51:44.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.781+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.782+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.782+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.783+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:51:44.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.784+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.784+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.785+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.786+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:51:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.787+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.787+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.788+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.789+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:51:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.790+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.791+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.791+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.792+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:51:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.794+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.795+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.795+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.796+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:51:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.797+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.797+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.798+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.798+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:51:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.800+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.800+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.801+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.802+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:51:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.803+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.804+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.804+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.805+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:51:44.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.806+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.806+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.807+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.807+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:51:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.809+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.809+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.810+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.811+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:51:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.812+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.813+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.813+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.814+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:51:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.815+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.816+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.816+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.817+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:51:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.818+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.819+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.819+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.820+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:51:44.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.821+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.822+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.822+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.823+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:51:44.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.824+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.824+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.825+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.826+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:51:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.827+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.827+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.828+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.829+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:51:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.830+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.830+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.830+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.831+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:51:44.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.833+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.833+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.833+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.834+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:51:44.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.835+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.836+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.836+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.837+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:51:44.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.839+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.839+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.839+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.840+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:51:44.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.842+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.842+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.842+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.843+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:51:44.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.844+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.845+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.845+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.846+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:51:44.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.847+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.848+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.848+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.849+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:51:44.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.850+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.850+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.851+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.851+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:51:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.853+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.853+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.853+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.854+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:51:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.856+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.857+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.857+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.858+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:51:44.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.859+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.860+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.860+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.861+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:51:44.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.862+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.863+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.863+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.864+0000 7fc067896800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:51:44.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.865+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.866+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:51:44.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.866+0000 7fc067896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:51:44.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.868+0000 7fbf1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:44.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.870+0000 7fc067896800 20 remove_watcher() i=0 2024-09-22T08:51:44.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.870+0000 7fc067896800 2 removed watcher, disabling cache 2024-09-22T08:51:44.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.871+0000 7fc067896800 20 remove_watcher() i=1 2024-09-22T08:51:44.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.872+0000 7fc067896800 20 remove_watcher() i=2 2024-09-22T08:51:44.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.873+0000 7fc067896800 20 remove_watcher() i=3 2024-09-22T08:51:44.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.874+0000 7fc067896800 20 remove_watcher() i=4 2024-09-22T08:51:44.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.875+0000 7fc067896800 20 remove_watcher() i=5 2024-09-22T08:51:44.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.876+0000 7fc067896800 20 remove_watcher() i=6 2024-09-22T08:51:44.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:44.878+0000 7fc067896800 20 remove_watcher() i=7 2024-09-22T08:51:44.890 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-22T08:51:44.907 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-22T08:51:44.907 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-22T08:51:44.907 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-22T08:51:44.907 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T08:51:44.935 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-22T08:51:45.739 INFO:tasks.s3tests:Creating rgw users... 2024-09-22T08:51:45.740 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-22T08:51:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:45.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.872+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:45.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 20 realm 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.874+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.875+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.875+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:45.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.875+0000 7f1032811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:45.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.875+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:45.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.876+0000 7f1032811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:45.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.876+0000 7f1032811800 20 searching for the correct realm 2024-09-22T08:51:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:45.878+0000 7f102e793640 0 -- 172.21.15.78:0/3095025180 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f1018022020 msgr2=0x7f101802d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.083+0000 7f1025791640 0 -- 172.21.15.78:0/3095025180 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f102809f0a0 msgr2=0x7f102808b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.089+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 zone default found 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 4 Realm: () 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:46.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 zonegroup default 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.090+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.091+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.091+0000 7f1032811800 20 started sync module instance, tier type = 2024-09-22T08:51:46.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.091+0000 7f1032811800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=0 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=1 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=2 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=3 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=4 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=5 2024-09-22T08:51:46.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.100+0000 7f1032811800 20 add_watcher() i=6 2024-09-22T08:51:46.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.102+0000 7f1032811800 20 add_watcher() i=7 2024-09-22T08:51:46.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.102+0000 7f1032811800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.103+0000 7f0edf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.103+0000 7f1032811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.103+0000 7f1032811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 5 note: GC not initialized 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f0ede7fc640 20 reqs_thread_entry: start 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 Filter name: none 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f0e4ffff640 20 reqs_thread_entry: start 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-22T08:51:46.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-22T08:51:46.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-22T08:51:46.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.104+0000 7f1032811800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.105+0000 7f1032811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.105+0000 7f1032811800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.105+0000 7f1032811800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.105+0000 7f1032811800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f1032811800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f1032811800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f1032811800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f0f117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562672 cookie 94037653623632 notifier 8486 bl.length()=384 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f0f117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:51:46.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.106+0000 7f0f117fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f1032811800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T08:51:46.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f1032811800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f1032811800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-22T08:51:46.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f0f117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562673 cookie 94037653634176 notifier 8486 bl.length()=225 2024-09-22T08:51:46.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f0f117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T08:51:46.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.109+0000 7f0f117fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f1032811800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T08:51:46.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f1032811800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:51:46.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f1032811800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-22T08:51:46.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f0f117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94037653631872 notifier 8486 bl.length()=234 2024-09-22T08:51:46.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f0f117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T08:51:46.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.112+0000 7f0f117fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T08:51:46.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.115+0000 7f0edf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:46.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.117+0000 7f1032811800 20 remove_watcher() i=0 2024-09-22T08:51:46.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.117+0000 7f1032811800 2 removed watcher, disabling cache 2024-09-22T08:51:46.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.118+0000 7f1032811800 20 remove_watcher() i=1 2024-09-22T08:51:46.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.119+0000 7f1032811800 20 remove_watcher() i=2 2024-09-22T08:51:46.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.120+0000 7f1032811800 20 remove_watcher() i=3 2024-09-22T08:51:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.121+0000 7f1032811800 20 remove_watcher() i=4 2024-09-22T08:51:46.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.122+0000 7f1032811800 20 remove_watcher() i=5 2024-09-22T08:51:46.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.123+0000 7f1032811800 20 remove_watcher() i=6 2024-09-22T08:51:46.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.124+0000 7f1032811800 20 remove_watcher() i=7 2024-09-22T08:51:46.134 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:46.134 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW11111111111111111", 2024-09-22T08:51:46.134 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "", 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW11111111111111111", 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:46.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-22T08:51:46.136 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:46.137 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-22T08:51:46.137 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key SQEDPZUCYBGWMCDBIWDQ --secret 99LgSJNH5NHJSDG0onKYKLdMQqZFWJF2PaH4uMRPY71wQebyEmFrqA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-22T08:51:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:46.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.237+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 realm 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.239+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.240+0000 7f00fbd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:46.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.240+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.241+0000 7f00fbd32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:46.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.241+0000 7f00fbd32800 20 searching for the correct realm 2024-09-22T08:51:46.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.242+0000 7f00f79bc640 0 -- 172.21.15.78:0/1100074913 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x5641082acbb0 msgr2=0x5641082af070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.245+0000 7f00f79bc640 0 -- 172.21.15.78:0/1100074913 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f00e80609e0 msgr2=0x7f00e806d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:46.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.252+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 zone default found 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 4 Realm: () 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 zonegroup default 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.253+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.254+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.254+0000 7f00fbd32800 20 started sync module instance, tier type = 2024-09-22T08:51:46.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.254+0000 7f00fbd32800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=0 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=1 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=2 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=3 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=4 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=5 2024-09-22T08:51:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.263+0000 7f00fbd32800 20 add_watcher() i=6 2024-09-22T08:51:46.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.264+0000 7f00fbd32800 20 add_watcher() i=7 2024-09-22T08:51:46.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.264+0000 7f00fbd32800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.265+0000 7effadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.265+0000 7f00fbd32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.265+0000 7f00fbd32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 5 note: GC not initialized 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7effacfe1640 20 reqs_thread_entry: start 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 20 Filter name: none 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7eff267fc640 20 reqs_thread_entry: start 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.266+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ : miss 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ info.flags=0x0 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 adding default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ to cache LRU end 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-22T08:51:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.267+0000 7f00fbd32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.268+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ : hit (negative entry) 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.268+0000 7f00fbd32800 10 cache get: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ : hit (negative entry) 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:51:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7f00fbd32800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:46.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7f00fbd32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T08:51:46.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7effd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94837309893920 notifier 8501 bl.length()=673 2024-09-22T08:51:46.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7effd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:51:46.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.269+0000 7effd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.272+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.272+0000 7f00fbd32800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.272+0000 7f00fbd32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.273+0000 7effd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562674 cookie 94837309909904 notifier 8501 bl.length()=185 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.273+0000 7effd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T08:51:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.273+0000 7effd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T08:51:46.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7f00fbd32800 10 cache put: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ info.flags=0x7 2024-09-22T08:51:46.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7f00fbd32800 10 moving default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ to cache LRU end 2024-09-22T08:51:46.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7f00fbd32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:SQEDPZUCYBGWMCDBIWDQ, ofs0, ns] 2024-09-22T08:51:46.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7effd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 94837309893920 notifier 8501 bl.length()=186 2024-09-22T08:51:46.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7effd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ info.flags=0x7 2024-09-22T08:51:46.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.275+0000 7effd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SQEDPZUCYBGWMCDBIWDQ to cache LRU end 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.278+0000 7f00fbd32800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foo.client.0", 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foo+test@test.test", 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:46.279 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foo.client.0", 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "SQEDPZUCYBGWMCDBIWDQ", 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "99LgSJNH5NHJSDG0onKYKLdMQqZFWJF2PaH4uMRPY71wQebyEmFrqA==", 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:46.268952Z" 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:46.280 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:46.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW11111111111111111", 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:46.268941Z", 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:46.282 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.279+0000 7effadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.281+0000 7f00fbd32800 20 remove_watcher() i=0 2024-09-22T08:51:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.281+0000 7f00fbd32800 2 removed watcher, disabling cache 2024-09-22T08:51:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.282+0000 7f00fbd32800 20 remove_watcher() i=1 2024-09-22T08:51:46.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.283+0000 7f00fbd32800 20 remove_watcher() i=2 2024-09-22T08:51:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.284+0000 7f00fbd32800 20 remove_watcher() i=3 2024-09-22T08:51:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.285+0000 7f00fbd32800 20 remove_watcher() i=4 2024-09-22T08:51:46.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.286+0000 7f00fbd32800 20 remove_watcher() i=5 2024-09-22T08:51:46.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.287+0000 7f00fbd32800 20 remove_watcher() i=6 2024-09-22T08:51:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.288+0000 7f00fbd32800 20 remove_watcher() i=7 2024-09-22T08:51:46.300 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6570059686 --totp-seed G6V43ZBFC4NTU7T5DWLZQW2X2IREZBWKXWKBPNIM6XQN7XEXQRI3NZ2RCOUWELUV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:46.368 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:46.368 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:46.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.401+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 realm 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.403+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.404+0000 7f1364544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.404+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.405+0000 7f1364544800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.405+0000 7f1364544800 20 searching for the correct realm 2024-09-22T08:51:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.405+0000 7f13602f4640 0 -- 172.21.15.78:0/4214289895 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x55c9beca9f20 msgr2=0x55c9becac3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.610+0000 7f13602f4640 0 -- 172.21.15.78:0/4214289895 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f135001a070 msgr2=0x7f1350044410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.617+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 zone default found 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 4 Realm: () 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 zonegroup default 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.618+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 started sync module instance, tier type = 2024-09-22T08:51:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.619+0000 7f1364544800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:46.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=0 2024-09-22T08:51:46.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=1 2024-09-22T08:51:46.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=2 2024-09-22T08:51:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=3 2024-09-22T08:51:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=4 2024-09-22T08:51:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=5 2024-09-22T08:51:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.628+0000 7f1364544800 20 add_watcher() i=6 2024-09-22T08:51:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.629+0000 7f1364544800 20 add_watcher() i=7 2024-09-22T08:51:46.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.629+0000 7f1364544800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.631+0000 7f1216fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.631+0000 7f1364544800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.631+0000 7f1364544800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.631+0000 7f1364544800 5 note: GC not initialized 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f1215fdb640 20 reqs_thread_entry: start 2024-09-22T08:51:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f1364544800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f1364544800 20 Filter name: none 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f11877fe640 20 reqs_thread_entry: start 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f1364544800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.632+0000 7f1364544800 20 rados->read ofs=0 len=0 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.633+0000 7f1364544800 20 rados_obj.operate() r=0 bl.length=488 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.633+0000 7f1364544800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.633+0000 7f1364544800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:46.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:46.633+0000 7f1364544800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:48.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1364544800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:51:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1364544800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1364544800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T08:51:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94324977753360 notifier 9261 bl.length()=687 2024-09-22T08:51:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T08:51:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.554+0000 7f1236ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T08:51:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.557+0000 7f1216fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.559+0000 7f1364544800 20 remove_watcher() i=0 2024-09-22T08:51:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.559+0000 7f1364544800 2 removed watcher, disabling cache 2024-09-22T08:51:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.561+0000 7f1364544800 20 remove_watcher() i=1 2024-09-22T08:51:48.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.562+0000 7f1364544800 20 remove_watcher() i=2 2024-09-22T08:51:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.563+0000 7f1364544800 20 remove_watcher() i=3 2024-09-22T08:51:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.564+0000 7f1364544800 20 remove_watcher() i=4 2024-09-22T08:51:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.565+0000 7f1364544800 20 remove_watcher() i=5 2024-09-22T08:51:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.566+0000 7f1364544800 20 remove_watcher() i=6 2024-09-22T08:51:48.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.568+0000 7f1364544800 20 remove_watcher() i=7 2024-09-22T08:51:48.580 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-22T08:51:48.580 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key BBEQMXXZMSZLALFIGIVO --secret rlksJe2aPtz0MGQLQi+EWUzs+AX1GukVdy8EPcZUiGpV+tP0w/EJZg== --cluster ceph 2024-09-22T08:51:48.644 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:48.644 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.678+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 realm 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.680+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.681+0000 7f18f4f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:48.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.681+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.682+0000 7f18f4f1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:48.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.682+0000 7f18f4f1f800 20 searching for the correct realm 2024-09-22T08:51:48.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.684+0000 7f18f14aa640 0 -- 172.21.15.78:0/2031006896 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f18d80782a0 msgr2=0x7f18d8079990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:48.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.890+0000 7f18e84a8640 0 -- 172.21.15.78:0/2031006896 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f18ec040950 msgr2=0x7f18ec022450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:48.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.896+0000 7f18f4f1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 zone default found 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 4 Realm: () 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 zonegroup default 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 started sync module instance, tier type = 2024-09-22T08:51:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.897+0000 7f18f4f1f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:48.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=0 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=1 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=2 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=3 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=4 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=5 2024-09-22T08:51:48.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.907+0000 7f18f4f1f800 20 add_watcher() i=6 2024-09-22T08:51:48.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.908+0000 7f18f4f1f800 20 add_watcher() i=7 2024-09-22T08:51:48.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.908+0000 7f18f4f1f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:48.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.910+0000 7f17a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:48.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.910+0000 7f18f4f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:48.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.910+0000 7f18f4f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 5 note: GC not initialized 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f17a67e4640 20 reqs_thread_entry: start 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 20 Filter name: none 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f179ffff640 20 reqs_thread_entry: start 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T08:51:48.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.911+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:51:48.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 cache get: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO : miss 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO info.flags=0x0 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 adding default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO to cache LRU end 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 cache get: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO : hit (negative entry) 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.912+0000 7f18f4f1f800 10 cache get: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO : hit (negative entry) 2024-09-22T08:51:48.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.913+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:51:48.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.913+0000 7f18f4f1f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:48.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.913+0000 7f18f4f1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T08:51:48.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.914+0000 7f17c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497267 cookie 94428109674928 notifier 8531 bl.length()=645 2024-09-22T08:51:48.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.914+0000 7f17c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:51:48.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.914+0000 7f17c7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f18f4f1f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f18f4f1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f17c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497243 cookie 94428109694512 notifier 8531 bl.length()=185 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f17c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T08:51:48.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.917+0000 7f17c77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f18f4f1f800 10 cache put: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO info.flags=0x7 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f18f4f1f800 10 moving default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO to cache LRU end 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f18f4f1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:BBEQMXXZMSZLALFIGIVO, ofs0, ns] 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f17c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497268 cookie 94428109684480 notifier 8531 bl.length()=186 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f17c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO info.flags=0x7 2024-09-22T08:51:48.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.920+0000 7f17c7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BBEQMXXZMSZLALFIGIVO to cache LRU end 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "bar.client.0", 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.bar.client.0", 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "bar+test@test.test", 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "bar.client.0", 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "BBEQMXXZMSZLALFIGIVO", 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "rlksJe2aPtz0MGQLQi+EWUzs+AX1GukVdy8EPcZUiGpV+tP0w/EJZg==", 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:48.913480Z" 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:48.923 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:48.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:48.913467Z", 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:48.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:48.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.922+0000 7f17a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:48.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.924+0000 7f18f4f1f800 20 remove_watcher() i=0 2024-09-22T08:51:48.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.924+0000 7f18f4f1f800 2 removed watcher, disabling cache 2024-09-22T08:51:48.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.925+0000 7f18f4f1f800 20 remove_watcher() i=1 2024-09-22T08:51:48.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.927+0000 7f18f4f1f800 20 remove_watcher() i=2 2024-09-22T08:51:48.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.928+0000 7f18f4f1f800 20 remove_watcher() i=3 2024-09-22T08:51:48.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.929+0000 7f18f4f1f800 20 remove_watcher() i=4 2024-09-22T08:51:48.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.930+0000 7f18f4f1f800 20 remove_watcher() i=5 2024-09-22T08:51:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.931+0000 7f18f4f1f800 20 remove_watcher() i=6 2024-09-22T08:51:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:48.932+0000 7f18f4f1f800 20 remove_watcher() i=7 2024-09-22T08:51:48.944 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7604953472 --totp-seed 2DWRYT3ZZN77X3BXT4NNWUC6MHFA2XS34YZYDVSDGNK5MWZ77USYHJX3GB43VFVK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:49.010 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:49.010 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.043+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 realm 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.045+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.046+0000 7f890a732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.046+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.047+0000 7f890a732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.047+0000 7f890a732800 20 searching for the correct realm 2024-09-22T08:51:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.048+0000 7f8905bbb640 0 -- 172.21.15.78:0/1018580730 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f88f4002340 msgr2=0x7f8900074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.253+0000 7f8906bbd640 0 -- 172.21.15.78:0/1018580730 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x55c2bf9dad40 msgr2=0x55c2bf9dd1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.259+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 zone default found 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 4 Realm: () 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:49.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 zonegroup default 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.260+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 started sync module instance, tier type = 2024-09-22T08:51:49.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.261+0000 7f890a732800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=0 2024-09-22T08:51:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=1 2024-09-22T08:51:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=2 2024-09-22T08:51:49.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=3 2024-09-22T08:51:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=4 2024-09-22T08:51:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=5 2024-09-22T08:51:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.271+0000 7f890a732800 20 add_watcher() i=6 2024-09-22T08:51:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.272+0000 7f890a732800 20 add_watcher() i=7 2024-09-22T08:51:49.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.272+0000 7f890a732800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f87bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f890a732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f890a732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f890a732800 5 note: GC not initialized 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f87377fe640 20 reqs_thread_entry: start 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f890a732800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.274+0000 7f890a732800 20 Filter name: none 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f87357fa640 20 reqs_thread_entry: start 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T08:51:49.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:51:49.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-22T08:51:49.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:49.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.275+0000 7f890a732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:49.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f890a732800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:51:49.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f890a732800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:49.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f890a732800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T08:51:49.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f87e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497269 cookie 94294926803920 notifier 8546 bl.length()=659 2024-09-22T08:51:49.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f87e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T08:51:49.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.278+0000 7f87e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T08:51:49.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.280+0000 7f87bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.282+0000 7f890a732800 20 remove_watcher() i=0 2024-09-22T08:51:49.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.282+0000 7f890a732800 2 removed watcher, disabling cache 2024-09-22T08:51:49.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.283+0000 7f890a732800 20 remove_watcher() i=1 2024-09-22T08:51:49.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.284+0000 7f890a732800 20 remove_watcher() i=2 2024-09-22T08:51:49.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.285+0000 7f890a732800 20 remove_watcher() i=3 2024-09-22T08:51:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.286+0000 7f890a732800 20 remove_watcher() i=4 2024-09-22T08:51:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.287+0000 7f890a732800 20 remove_watcher() i=5 2024-09-22T08:51:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.288+0000 7f890a732800 20 remove_watcher() i=6 2024-09-22T08:51:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.289+0000 7f890a732800 20 remove_watcher() i=7 2024-09-22T08:51:49.302 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-22T08:51:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.397+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 realm 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.399+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.400+0000 7fa1043af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.400+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.401+0000 7fa1043af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:49.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.401+0000 7fa1043af800 20 searching for the correct realm 2024-09-22T08:51:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.403+0000 7fa10269a640 0 -- 172.21.15.78:0/440200920 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa0ec022040 msgr2=0x7fa0ec032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.407+0000 7fa101698640 0 -- 172.21.15.78:0/440200920 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa0fc0adcd0 msgr2=0x7fa0fc0a6810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.411+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 zone default found 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 4 Realm: () 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 zonegroup default 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.412+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.413+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.413+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.413+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.413+0000 7fa1043af800 20 started sync module instance, tier type = 2024-09-22T08:51:49.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.413+0000 7fa1043af800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=0 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=1 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=2 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=3 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=4 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=5 2024-09-22T08:51:49.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.422+0000 7fa1043af800 20 add_watcher() i=6 2024-09-22T08:51:49.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.423+0000 7fa1043af800 20 add_watcher() i=7 2024-09-22T08:51:49.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.423+0000 7fa1043af800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:49.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.425+0000 7f9fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.425+0000 7fa1043af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:49.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.425+0000 7fa1043af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:49.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 5 note: GC not initialized 2024-09-22T08:51:49.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7f9fb27fc640 20 reqs_thread_entry: start 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 Filter name: none 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7f9f23fff640 20 reqs_thread_entry: start 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.426+0000 7fa1043af800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.427+0000 7fa1043af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.427+0000 7fa1043af800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.427+0000 7fa1043af800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:51:49.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.427+0000 7fa1043af800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7fa1043af800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7fa1043af800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7fa1043af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7f9fe57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497270 cookie 94698819774384 notifier 8564 bl.length()=389 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7f9fe57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:51:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.428+0000 7f9fe57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7fa1043af800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T08:51:49.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7fa1043af800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7fa1043af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-22T08:51:49.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7f9fe57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497271 cookie 94698819787920 notifier 8564 bl.length()=230 2024-09-22T08:51:49.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7f9fe57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T08:51:49.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.431+0000 7f9fe57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7fa1043af800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7fa1043af800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7fa1043af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7f9fe4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94698819784288 notifier 8564 bl.length()=234 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7f9fe4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T08:51:49.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.434+0000 7f9fe4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T08:51:49.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.437+0000 7f9fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.439+0000 7fa1043af800 20 remove_watcher() i=0 2024-09-22T08:51:49.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.439+0000 7fa1043af800 2 removed watcher, disabling cache 2024-09-22T08:51:49.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.440+0000 7fa1043af800 20 remove_watcher() i=1 2024-09-22T08:51:49.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.441+0000 7fa1043af800 20 remove_watcher() i=2 2024-09-22T08:51:49.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.442+0000 7fa1043af800 20 remove_watcher() i=3 2024-09-22T08:51:49.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.443+0000 7fa1043af800 20 remove_watcher() i=4 2024-09-22T08:51:49.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.444+0000 7fa1043af800 20 remove_watcher() i=5 2024-09-22T08:51:49.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.445+0000 7fa1043af800 20 remove_watcher() i=6 2024-09-22T08:51:49.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.446+0000 7fa1043af800 20 remove_watcher() i=7 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW33333333333333333", 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "testx", 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW33333333333333333", 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-22T08:51:49.456 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-22T08:51:49.458 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-22T08:51:49.458 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-22T08:51:49.458 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:49.458 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-22T08:51:49.458 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:49.459 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-22T08:51:49.459 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key NAOMUJFWGATKAHYUYYTL --secret sd0ZdONrSBHWtXWGqYxjavcRgs0ORvIThYU11e6xsYEqjkYltIpSMA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-22T08:51:49.525 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:49.525 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:49.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.574+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.575+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.575+0000 7faebf546800 20 realm 2024-09-22T08:51:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.575+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.576+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.577+0000 7faebf546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:49.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.577+0000 7faebf546800 20 searching for the correct realm 2024-09-22T08:51:49.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.580+0000 7faebd838640 0 -- 172.21.15.78:0/529893042 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7faeb40724c0 msgr2=0x7faeb4067c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.790+0000 7faebc836640 0 -- 172.21.15.78:0/529893042 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7faeb8075020 msgr2=0x7faeb80213c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:49.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:49.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.796+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 zone default found 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 4 Realm: () 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:49.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 zonegroup default 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.797+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.798+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.798+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.798+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.798+0000 7faebf546800 20 started sync module instance, tier type = 2024-09-22T08:51:49.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.798+0000 7faebf546800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:49.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=0 2024-09-22T08:51:49.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=1 2024-09-22T08:51:49.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=2 2024-09-22T08:51:49.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=3 2024-09-22T08:51:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=4 2024-09-22T08:51:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=5 2024-09-22T08:51:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.808+0000 7faebf546800 20 add_watcher() i=6 2024-09-22T08:51:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.809+0000 7faebf546800 20 add_watcher() i=7 2024-09-22T08:51:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.809+0000 7faebf546800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:49.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7fad737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 5 note: GC not initialized 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7fad727e4640 20 reqs_thread_entry: start 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 20 Filter name: none 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7face3fff640 20 reqs_thread_entry: start 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T08:51:49.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.811+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-22T08:51:49.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache get: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL : miss 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL info.flags=0x0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 adding default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL to cache LRU end 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.812+0000 7faebf546800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 10 cache get: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL : hit (negative entry) 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.813+0000 7faebf546800 10 cache get: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL : hit (negative entry) 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7faebf546800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7faebf546800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T08:51:49.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7fada0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464540 cookie 94492083726528 notifier 9339 bl.length()=732 2024-09-22T08:51:49.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7fada0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:51:49.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.815+0000 7fada0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T08:51:49.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7faebf546800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:51:49.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7faebf546800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-22T08:51:49.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7fada0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464541 cookie 94492083737536 notifier 9339 bl.length()=215 2024-09-22T08:51:49.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7fada0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T08:51:49.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.818+0000 7fada0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T08:51:49.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.821+0000 7faebf546800 10 cache put: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL info.flags=0x7 2024-09-22T08:51:49.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.821+0000 7faebf546800 10 moving default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL to cache LRU end 2024-09-22T08:51:49.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.821+0000 7faebf546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NAOMUJFWGATKAHYUYYTL, ofs0, ns] 2024-09-22T08:51:49.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.822+0000 7fad8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94492083725312 notifier 9339 bl.length()=201 2024-09-22T08:51:49.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.822+0000 7fad8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL info.flags=0x7 2024-09-22T08:51:49.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.822+0000 7fad8ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NAOMUJFWGATKAHYUYYTL to cache LRU end 2024-09-22T08:51:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.824+0000 7faebf546800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "testx$tenanteduser.client.0", 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "NAOMUJFWGATKAHYUYYTL", 2024-09-22T08:51:49.826 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "sd0ZdONrSBHWtXWGqYxjavcRgs0ORvIThYU11e6xsYEqjkYltIpSMA==", 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:49.814255Z" 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:49.827 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:49.828 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW33333333333333333", 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:49.814244Z", 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:49.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:49.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.825+0000 7fad737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.827+0000 7faebf546800 20 remove_watcher() i=0 2024-09-22T08:51:49.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.827+0000 7faebf546800 2 removed watcher, disabling cache 2024-09-22T08:51:49.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.828+0000 7faebf546800 20 remove_watcher() i=1 2024-09-22T08:51:49.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.830+0000 7faebf546800 20 remove_watcher() i=2 2024-09-22T08:51:49.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.831+0000 7faebf546800 20 remove_watcher() i=3 2024-09-22T08:51:49.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.832+0000 7faebf546800 20 remove_watcher() i=4 2024-09-22T08:51:49.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.833+0000 7faebf546800 20 remove_watcher() i=5 2024-09-22T08:51:49.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.834+0000 7faebf546800 20 remove_watcher() i=6 2024-09-22T08:51:49.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.835+0000 7faebf546800 20 remove_watcher() i=7 2024-09-22T08:51:49.847 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5352336296 --totp-seed 4UBK5BGHSF7GRW3FEYAI23Q2324HUQLICGSKKDK4NKFNXDNTYEKMVGTOXYEIX365 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:49.913 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:49.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.945+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 realm 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.947+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.948+0000 7fc9da498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.948+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.949+0000 7fc9da498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.949+0000 7fc9da498800 20 searching for the correct realm 2024-09-22T08:51:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.951+0000 7fc9d8783640 0 -- 172.21.15.78:0/3913522316 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fc9cc00b040 msgr2=0x7fc9cc076c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:49.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.955+0000 7fc9d7781640 0 -- 172.21.15.78:0/3913522316 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fc9d008a040 msgr2=0x7fc9d006bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:49.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:49.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:49.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.960+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 zone default found 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 4 Realm: () 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:49.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 zonegroup default 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.961+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.962+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.962+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.962+0000 7fc9da498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.962+0000 7fc9da498800 20 started sync module instance, tier type = 2024-09-22T08:51:49.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.962+0000 7fc9da498800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=0 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=1 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=2 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=3 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=4 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=5 2024-09-22T08:51:49.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.971+0000 7fc9da498800 20 add_watcher() i=6 2024-09-22T08:51:49.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.972+0000 7fc9da498800 20 add_watcher() i=7 2024-09-22T08:51:49.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.972+0000 7fc9da498800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:49.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 5 note: GC not initialized 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc88cfe1640 20 reqs_thread_entry: start 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 20 Filter name: none 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc8067fc640 20 reqs_thread_entry: start 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T08:51:49.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.974+0000 7fc9da498800 20 rados->read ofs=0 len=0 2024-09-22T08:51:49.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.975+0000 7fc9da498800 20 rados_obj.operate() r=0 bl.length=532 2024-09-22T08:51:49.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.975+0000 7fc9da498800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-22T08:51:49.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.975+0000 7fc9da498800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.975+0000 7fc9da498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc9da498800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc9da498800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc9da498800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464542 cookie 94325494102160 notifier 8597 bl.length()=746 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T08:51:49.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.978+0000 7fc8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T08:51:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.980+0000 7fc88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:49.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.983+0000 7fc9da498800 20 remove_watcher() i=0 2024-09-22T08:51:49.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.983+0000 7fc9da498800 2 removed watcher, disabling cache 2024-09-22T08:51:49.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.984+0000 7fc9da498800 20 remove_watcher() i=1 2024-09-22T08:51:49.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.985+0000 7fc9da498800 20 remove_watcher() i=2 2024-09-22T08:51:49.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.986+0000 7fc9da498800 20 remove_watcher() i=3 2024-09-22T08:51:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.986+0000 7fc9da498800 20 remove_watcher() i=4 2024-09-22T08:51:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.988+0000 7fc9da498800 20 remove_watcher() i=5 2024-09-22T08:51:49.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.989+0000 7fc9da498800 20 remove_watcher() i=6 2024-09-22T08:51:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:49.990+0000 7fc9da498800 20 remove_watcher() i=7 2024-09-22T08:51:50.002 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-22T08:51:50.002 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key CZJOBAKWFZBNYLKTZSTJ --secret VP3kZLUWDqAdJQ1paa2k5XzZE+98/8aSzj7v7qXbHtUv2lLL0l9SDQ== --cluster ceph 2024-09-22T08:51:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.098+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 20 realm 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.100+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.101+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.101+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.101+0000 7f0628f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.101+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.102+0000 7f0628f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.102+0000 7f0628f39800 20 searching for the correct realm 2024-09-22T08:51:50.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.104+0000 7f06253cf640 0 -- 172.21.15.78:0/2057019125 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f060c03e070 msgr2=0x7f060c069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.309+0000 7f061c3cd640 0 -- 172.21.15.78:0/2057019125 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f0620061040 msgr2=0x7f06200b8f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.314+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 zone default found 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 4 Realm: () 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 zonegroup default 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.315+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.316+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.316+0000 7f0628f39800 20 started sync module instance, tier type = 2024-09-22T08:51:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.316+0000 7f0628f39800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=0 2024-09-22T08:51:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=1 2024-09-22T08:51:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=2 2024-09-22T08:51:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=3 2024-09-22T08:51:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=4 2024-09-22T08:51:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=5 2024-09-22T08:51:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=6 2024-09-22T08:51:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 20 add_watcher() i=7 2024-09-22T08:51:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.325+0000 7f0628f39800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.327+0000 7f04db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.327+0000 7f0628f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.327+0000 7f0628f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.327+0000 7f0628f39800 5 note: GC not initialized 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.327+0000 7f04da7e4640 20 reqs_thread_entry: start 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 Filter name: none 2024-09-22T08:51:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f04d3fff640 20 reqs_thread_entry: start 2024-09-22T08:51:50.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:51:50.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 10 cache get: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ : miss 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.328+0000 7f0628f39800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.329+0000 7f0628f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.329+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ info.flags=0x0 2024-09-22T08:51:50.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.329+0000 7f0628f39800 10 adding default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ to cache LRU end 2024-09-22T08:51:50.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.329+0000 7f0628f39800 10 cache get: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ : hit (negative entry) 2024-09-22T08:51:50.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.329+0000 7f0628f39800 10 cache get: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ : hit (negative entry) 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f0628f39800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f0628f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f04fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464543 cookie 94039182709168 notifier 9378 bl.length()=660 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f04fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:50.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.330+0000 7f04fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f0628f39800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f0628f39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f04fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464568 cookie 94039182686528 notifier 9378 bl.length()=191 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f04fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T08:51:50.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.333+0000 7f04fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T08:51:50.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f0628f39800 10 cache put: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ info.flags=0x7 2024-09-22T08:51:50.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f0628f39800 10 moving default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ to cache LRU end 2024-09-22T08:51:50.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f0628f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:CZJOBAKWFZBNYLKTZSTJ, ofs0, ns] 2024-09-22T08:51:50.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f04fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464544 cookie 94039182709168 notifier 9378 bl.length()=189 2024-09-22T08:51:50.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f04fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ info.flags=0x7 2024-09-22T08:51:50.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.336+0000 7f04fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CZJOBAKWFZBNYLKTZSTJ to cache LRU end 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foobar.client.0", 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foobar+test@test.test", 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:50.339 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foobar.client.0", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "CZJOBAKWFZBNYLKTZSTJ", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "VP3kZLUWDqAdJQ1paa2k5XzZE+98/8aSzj7v7qXbHtUv2lLL0l9SDQ==", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:50.330038Z" 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:50.340 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:51:50.341 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:50.330028Z", 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:50.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.338+0000 7f04db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:50.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.341+0000 7f0628f39800 20 remove_watcher() i=0 2024-09-22T08:51:50.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.341+0000 7f0628f39800 2 removed watcher, disabling cache 2024-09-22T08:51:50.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.342+0000 7f0628f39800 20 remove_watcher() i=1 2024-09-22T08:51:50.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.343+0000 7f0628f39800 20 remove_watcher() i=2 2024-09-22T08:51:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.344+0000 7f0628f39800 20 remove_watcher() i=3 2024-09-22T08:51:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.345+0000 7f0628f39800 20 remove_watcher() i=4 2024-09-22T08:51:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.346+0000 7f0628f39800 20 remove_watcher() i=5 2024-09-22T08:51:50.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.347+0000 7f0628f39800 20 remove_watcher() i=6 2024-09-22T08:51:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.348+0000 7f0628f39800 20 remove_watcher() i=7 2024-09-22T08:51:50.361 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 3717310809 --totp-seed KA7RFLGMTGUSKHKE4KPJH437M4EMV5P2SISKK5DIG3X62JKLW6WHYFOD2SZB7DAF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:50.427 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:50.427 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:50.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.459+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 realm 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.461+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.462+0000 7f0b0db34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:50.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.462+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.463+0000 7f0b0db34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:50.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.463+0000 7f0b0db34800 20 searching for the correct realm 2024-09-22T08:51:50.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.465+0000 7f0b0a0b8640 0 -- 172.21.15.78:0/1917451402 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f0af401e030 msgr2=0x7f0af4046060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:50.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.671+0000 7f0b090b6640 0 -- 172.21.15.78:0/1917451402 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f0b0407b070 msgr2=0x7f0b040a2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.675+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 zone default found 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 4 Realm: () 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 zonegroup default 2024-09-22T08:51:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.676+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.677+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.677+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.677+0000 7f0b0db34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.677+0000 7f0b0db34800 20 started sync module instance, tier type = 2024-09-22T08:51:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.677+0000 7f0b0db34800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=0 2024-09-22T08:51:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=1 2024-09-22T08:51:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=2 2024-09-22T08:51:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=3 2024-09-22T08:51:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=4 2024-09-22T08:51:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=5 2024-09-22T08:51:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.686+0000 7f0b0db34800 20 add_watcher() i=6 2024-09-22T08:51:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.687+0000 7f0b0db34800 20 add_watcher() i=7 2024-09-22T08:51:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.687+0000 7f0b0db34800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f09bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f0b0db34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f0b0db34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f0b0db34800 5 note: GC not initialized 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f09ba7fc640 20 reqs_thread_entry: start 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.689+0000 7f0b0db34800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 20 Filter name: none 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f092bfff640 20 reqs_thread_entry: start 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:51:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 20 rados_obj.operate() r=0 bl.length=472 2024-09-22T08:51:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T08:51:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.690+0000 7f0b0db34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f0b0db34800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f0b0db34800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f0b0db34800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f09ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464545 cookie 94280590563040 notifier 8627 bl.length()=674 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f09ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.693+0000 7f09ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:50.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.695+0000 7f09bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.698+0000 7f0b0db34800 20 remove_watcher() i=0 2024-09-22T08:51:50.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.698+0000 7f0b0db34800 2 removed watcher, disabling cache 2024-09-22T08:51:50.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.699+0000 7f0b0db34800 20 remove_watcher() i=1 2024-09-22T08:51:50.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.700+0000 7f0b0db34800 20 remove_watcher() i=2 2024-09-22T08:51:50.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.701+0000 7f0b0db34800 20 remove_watcher() i=3 2024-09-22T08:51:50.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.702+0000 7f0b0db34800 20 remove_watcher() i=4 2024-09-22T08:51:50.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.703+0000 7f0b0db34800 20 remove_watcher() i=5 2024-09-22T08:51:50.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.704+0000 7f0b0db34800 20 remove_watcher() i=6 2024-09-22T08:51:50.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.705+0000 7f0b0db34800 20 remove_watcher() i=7 2024-09-22T08:51:50.717 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-22T08:51:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.807+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 realm 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.809+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.810+0000 7f927eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.810+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.811+0000 7f927eb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.811+0000 7f927eb26800 20 searching for the correct realm 2024-09-22T08:51:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:50.812+0000 7f9279f08640 0 -- 172.21.15.78:0/4196745806 >> [v2:172.21.15.78:6818/3367866564,v1:172.21.15.78:6819/3367866564] conn(0x7f926c055900 msgr2=0x7f926c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.017+0000 7f927a709640 0 -- 172.21.15.78:0/4196745806 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x5560e816d6f0 msgr2=0x5560e816fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:51.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.023+0000 7f927eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 zone default found 2024-09-22T08:51:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 4 Realm: () 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 zonegroup default 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.024+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.025+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.025+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.025+0000 7f927eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.025+0000 7f927eb26800 20 started sync module instance, tier type = 2024-09-22T08:51:51.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.025+0000 7f927eb26800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=0 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=1 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=2 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=3 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=4 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=5 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=6 2024-09-22T08:51:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 20 add_watcher() i=7 2024-09-22T08:51:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.034+0000 7f927eb26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.036+0000 7f9130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.036+0000 7f927eb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.036+0000 7f927eb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f927eb26800 5 note: GC not initialized 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f90ab7fe640 20 reqs_thread_entry: start 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f927eb26800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f927eb26800 20 Filter name: none 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f90a97fa640 20 reqs_thread_entry: start 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f927eb26800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.037+0000 7f927eb26800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.038+0000 7f927eb26800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T08:51:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.038+0000 7f927eb26800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T08:51:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.038+0000 7f927eb26800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.038+0000 7f927eb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.039+0000 7f927eb26800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.039+0000 7f927eb26800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.039+0000 7f927eb26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T08:51:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.040+0000 7f915dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464546 cookie 93874699114624 notifier 8642 bl.length()=727 2024-09-22T08:51:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.040+0000 7f915dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T08:51:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.040+0000 7f915dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T08:51:51.042 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:51.042 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foobar.client.0", 2024-09-22T08:51:51.042 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foobar+test@test.test", 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foobar.client.0", 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "CZJOBAKWFZBNYLKTZSTJ", 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "VP3kZLUWDqAdJQ1paa2k5XzZE+98/8aSzj7v7qXbHtUv2lLL0l9SDQ==", 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:50.330038Z" 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:51.043 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [ 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "oidc-provider", 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "roles", 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "user-policy", 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:51.044 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.045 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [ 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "3717310809" 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-22T08:51:51.046 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:51.047 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:50.330028Z", 2024-09-22T08:51:51.047 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:51.047 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:51.047 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:51.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.042+0000 7f9130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.044+0000 7f927eb26800 20 remove_watcher() i=0 2024-09-22T08:51:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.044+0000 7f927eb26800 2 removed watcher, disabling cache 2024-09-22T08:51:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.045+0000 7f927eb26800 20 remove_watcher() i=1 2024-09-22T08:51:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.046+0000 7f927eb26800 20 remove_watcher() i=2 2024-09-22T08:51:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.048+0000 7f927eb26800 20 remove_watcher() i=3 2024-09-22T08:51:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.049+0000 7f927eb26800 20 remove_watcher() i=4 2024-09-22T08:51:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.050+0000 7f927eb26800 20 remove_watcher() i=5 2024-09-22T08:51:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.051+0000 7f927eb26800 20 remove_watcher() i=6 2024-09-22T08:51:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.052+0000 7f927eb26800 20 remove_watcher() i=7 2024-09-22T08:51:51.064 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-22T08:51:51.124 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:51.124 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.156+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 realm 2024-09-22T08:51:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.158+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.159+0000 7f617e440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.159+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.160+0000 7f617e440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:51.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.160+0000 7f617e440800 20 searching for the correct realm 2024-09-22T08:51:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.161+0000 7f617c72b640 0 -- 172.21.15.78:0/1826338033 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x556ee48d0260 msgr2=0x556ee48d26f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.165+0000 7f617c72b640 0 -- 172.21.15.78:0/1826338033 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x556ee48d7e40 msgr2=0x556ee48da230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 zone default found 2024-09-22T08:51:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 4 Realm: () 2024-09-22T08:51:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 zonegroup default 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.170+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 started sync module instance, tier type = 2024-09-22T08:51:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.171+0000 7f617e440800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=0 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=1 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=2 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=3 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=4 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=5 2024-09-22T08:51:51.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=6 2024-09-22T08:51:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 20 add_watcher() i=7 2024-09-22T08:51:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.180+0000 7f617e440800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.182+0000 7f6031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.182+0000 7f617e440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.182+0000 7f617e440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.182+0000 7f617e440800 5 note: GC not initialized 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f6030fe1640 20 reqs_thread_entry: start 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 Filter name: none 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f5faa7fc640 20 reqs_thread_entry: start 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-22T08:51:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.183+0000 7f617e440800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f617e440800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f617e440800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f617e440800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f605affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464569 cookie 93934769247520 notifier 8660 bl.length()=384 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f605affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:51:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.185+0000 7f605affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f617e440800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T08:51:51.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f617e440800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f617e440800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-22T08:51:51.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f605affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464570 cookie 93934769273840 notifier 8660 bl.length()=225 2024-09-22T08:51:51.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f605affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T08:51:51.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.188+0000 7f605affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f617e440800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T08:51:51.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f617e440800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:51:51.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f617e440800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-22T08:51:51.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f605affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 93934769216320 notifier 8660 bl.length()=234 2024-09-22T08:51:51.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f605affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T08:51:51.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.191+0000 7f605affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T08:51:51.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.194+0000 7f6031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.196+0000 7f617e440800 20 remove_watcher() i=0 2024-09-22T08:51:51.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.196+0000 7f617e440800 2 removed watcher, disabling cache 2024-09-22T08:51:51.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.197+0000 7f617e440800 20 remove_watcher() i=1 2024-09-22T08:51:51.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.198+0000 7f617e440800 20 remove_watcher() i=2 2024-09-22T08:51:51.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.199+0000 7f617e440800 20 remove_watcher() i=3 2024-09-22T08:51:51.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.200+0000 7f617e440800 20 remove_watcher() i=4 2024-09-22T08:51:51.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.201+0000 7f617e440800 20 remove_watcher() i=5 2024-09-22T08:51:51.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.202+0000 7f617e440800 20 remove_watcher() i=6 2024-09-22T08:51:51.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.203+0000 7f617e440800 20 remove_watcher() i=7 2024-09-22T08:51:51.212 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:51.212 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW88888888888888888", 2024-09-22T08:51:51.212 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "", 2024-09-22T08:51:51.212 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW88888888888888888", 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-22T08:51:51.214 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:51.215 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-22T08:51:51.215 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key BCANQDHMNYACADEWVRVB --secret Ws5MsLLGecVpbFQydhT1fzLqvfZezdL6hEqw9obd66lE4KfGprDZBg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-22T08:51:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:51.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.316+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.317+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.317+0000 7fbe56725800 20 realm 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.317+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.318+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.318+0000 7fbe56725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.318+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.318+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.318+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.319+0000 7fbe56725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.319+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.320+0000 7fbe56725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:51.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.320+0000 7fbe56725800 20 searching for the correct realm 2024-09-22T08:51:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.321+0000 7fbe49ca1640 0 -- 172.21.15.78:0/2286339370 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x562f258eded0 msgr2=0x562f258f0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.325+0000 7fbe49ca1640 0 -- 172.21.15.78:0/2286339370 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fbe4c03e030 msgr2=0x7fbe4c057950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:51.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.532+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 20 zone default found 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.533+0000 7fbe56725800 4 Realm: () 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 zonegroup default 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 started sync module instance, tier type = 2024-09-22T08:51:51.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.534+0000 7fbe56725800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=0 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=1 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=2 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=3 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=4 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=5 2024-09-22T08:51:51.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.543+0000 7fbe56725800 20 add_watcher() i=6 2024-09-22T08:51:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.544+0000 7fbe56725800 20 add_watcher() i=7 2024-09-22T08:51:51.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.544+0000 7fbe56725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.546+0000 7fbd08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.546+0000 7fbe56725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.546+0000 7fbe56725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.546+0000 7fbe56725800 5 note: GC not initialized 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.546+0000 7fbc837fe640 20 reqs_thread_entry: start 2024-09-22T08:51:51.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:51.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 20 Filter name: none 2024-09-22T08:51:51.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbc817fa640 20 reqs_thread_entry: start 2024-09-22T08:51:51.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T08:51:51.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.547+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 cache get: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB : miss 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB info.flags=0x0 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 adding default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB to cache LRU end 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.548+0000 7fbe56725800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.549+0000 7fbe56725800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.549+0000 7fbe56725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.549+0000 7fbe56725800 10 cache get: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB : hit (negative entry) 2024-09-22T08:51:51.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.549+0000 7fbe56725800 10 cache get: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB : hit (negative entry) 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbe56725800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbe56725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbd35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464571 cookie 94760493618752 notifier 8678 bl.length()=681 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbd35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:51:51.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.550+0000 7fbd35ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.553+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.554+0000 7fbe56725800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.554+0000 7fbe56725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.554+0000 7fbd35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464547 cookie 94760493632112 notifier 8678 bl.length()=189 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.554+0000 7fbd35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T08:51:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.554+0000 7fbd35ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T08:51:51.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbe56725800 10 cache put: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB info.flags=0x7 2024-09-22T08:51:51.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbe56725800 10 moving default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB to cache LRU end 2024-09-22T08:51:51.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbe56725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:BCANQDHMNYACADEWVRVB, ofs0, ns] 2024-09-22T08:51:51.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbd357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464572 cookie 94760493618752 notifier 8678 bl.length()=188 2024-09-22T08:51:51.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbd357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB info.flags=0x7 2024-09-22T08:51:51.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.557+0000 7fbd357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BCANQDHMNYACADEWVRVB to cache LRU end 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.559+0000 7fbe56725800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "root1.client.0", 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "root1+test@test.test", 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:51.561 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "root1.client.0", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "BCANQDHMNYACADEWVRVB", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "Ws5MsLLGecVpbFQydhT1fzLqvfZezdL6hEqw9obd66lE4KfGprDZBg==", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:51.549991Z" 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:51.562 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-22T08:51:51.563 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW88888888888888888", 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:51.549977Z", 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:51.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.560+0000 7fbd08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.563+0000 7fbe56725800 20 remove_watcher() i=0 2024-09-22T08:51:51.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.563+0000 7fbe56725800 2 removed watcher, disabling cache 2024-09-22T08:51:51.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.564+0000 7fbe56725800 20 remove_watcher() i=1 2024-09-22T08:51:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.565+0000 7fbe56725800 20 remove_watcher() i=2 2024-09-22T08:51:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.566+0000 7fbe56725800 20 remove_watcher() i=3 2024-09-22T08:51:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.567+0000 7fbe56725800 20 remove_watcher() i=4 2024-09-22T08:51:51.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.568+0000 7fbe56725800 20 remove_watcher() i=5 2024-09-22T08:51:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.569+0000 7fbe56725800 20 remove_watcher() i=6 2024-09-22T08:51:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.570+0000 7fbe56725800 20 remove_watcher() i=7 2024-09-22T08:51:51.582 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 5273309925 --totp-seed H24MZ363WM4XBHM2SZ34UWI5DYOOF3GLXHBQJFKD4KESSPCWLSP7HRUJJQPZUHQ6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:51.649 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:51.649 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:51.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.682+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 realm 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.684+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.685+0000 7fe16e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.685+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.686+0000 7fe16e62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:51.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.686+0000 7fe16e62f800 20 searching for the correct realm 2024-09-22T08:51:51.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.688+0000 7fe16c91a640 0 -- 172.21.15.78:0/3922998741 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fe15407ac20 msgr2=0x7fe1540627c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:51.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.691+0000 7fe16b918640 0 -- 172.21.15.78:0/3922998741 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fe15c06ce00 msgr2=0x7fe15c06b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.696+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 zone default found 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 4 Realm: () 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 zonegroup default 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.697+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.698+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.698+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.698+0000 7fe16e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.698+0000 7fe16e62f800 20 started sync module instance, tier type = 2024-09-22T08:51:51.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.698+0000 7fe16e62f800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:51.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=0 2024-09-22T08:51:51.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=1 2024-09-22T08:51:51.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=2 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=3 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=4 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=5 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.706+0000 7fe16e62f800 20 add_watcher() i=6 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.707+0000 7fe16e62f800 20 add_watcher() i=7 2024-09-22T08:51:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.707+0000 7fe16e62f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:51.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe022fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 5 note: GC not initialized 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe021fdb640 20 reqs_thread_entry: start 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 20 Filter name: none 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fdf937fe640 20 reqs_thread_entry: start 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T08:51:51.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.709+0000 7fe16e62f800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.710+0000 7fe16e62f800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T08:51:51.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.710+0000 7fe16e62f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-22T08:51:51.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.710+0000 7fe16e62f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.710+0000 7fe16e62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:51.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe16e62f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:51:51.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe16e62f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe16e62f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T08:51:51.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe0437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464573 cookie 94601825908048 notifier 9474 bl.length()=695 2024-09-22T08:51:51.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe0437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T08:51:51.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.713+0000 7fe0437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T08:51:51.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.716+0000 7fe022fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:51.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.718+0000 7fe16e62f800 20 remove_watcher() i=0 2024-09-22T08:51:51.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.718+0000 7fe16e62f800 2 removed watcher, disabling cache 2024-09-22T08:51:51.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.719+0000 7fe16e62f800 20 remove_watcher() i=1 2024-09-22T08:51:51.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.720+0000 7fe16e62f800 20 remove_watcher() i=2 2024-09-22T08:51:51.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.721+0000 7fe16e62f800 20 remove_watcher() i=3 2024-09-22T08:51:51.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.722+0000 7fe16e62f800 20 remove_watcher() i=4 2024-09-22T08:51:51.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.723+0000 7fe16e62f800 20 remove_watcher() i=5 2024-09-22T08:51:51.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.724+0000 7fe16e62f800 20 remove_watcher() i=6 2024-09-22T08:51:51.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.725+0000 7fe16e62f800 20 remove_watcher() i=7 2024-09-22T08:51:51.737 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-22T08:51:51.796 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:51.796 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.828+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 realm 2024-09-22T08:51:51.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:51.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:51.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.830+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.831+0000 7fa3e9487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:51.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.831+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:51.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.832+0000 7fa3e9487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:51.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.832+0000 7fa3e9487800 20 searching for the correct realm 2024-09-22T08:51:51.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:51.834+0000 7fa3e7772640 0 -- 172.21.15.78:0/1989567217 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7fa3d0050a60 msgr2=0x7fa3d004f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:52.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.039+0000 7fa3dffff640 0 -- 172.21.15.78:0/1989567217 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fa3e0087130 msgr2=0x7fa3e005fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:52.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:52.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.044+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 zone default found 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 4 Realm: () 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 zonegroup default 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.045+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.046+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.046+0000 7fa3e9487800 20 started sync module instance, tier type = 2024-09-22T08:51:52.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.046+0000 7fa3e9487800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=0 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=1 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=2 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=3 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=4 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.054+0000 7fa3e9487800 20 add_watcher() i=5 2024-09-22T08:51:52.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.055+0000 7fa3e9487800 20 add_watcher() i=6 2024-09-22T08:51:52.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.056+0000 7fa3e9487800 20 add_watcher() i=7 2024-09-22T08:51:52.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.056+0000 7fa3e9487800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.058+0000 7fa29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.058+0000 7fa3e9487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.058+0000 7fa3e9487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.058+0000 7fa3e9487800 5 note: GC not initialized 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.058+0000 7fa217fff640 20 reqs_thread_entry: start 2024-09-22T08:51:52.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 Filter name: none 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa215ffb640 20 reqs_thread_entry: start 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-22T08:51:52.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.059+0000 7fa3e9487800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.060+0000 7fa3e9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.060+0000 7fa3e9487800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.060+0000 7fa3e9487800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:51:52.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.060+0000 7fa3e9487800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa3e9487800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa3e9487800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa3e9487800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa2ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464574 cookie 94269569609824 notifier 9495 bl.length()=384 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa2ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:51:52.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.061+0000 7fa2ca7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa3e9487800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T08:51:52.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa3e9487800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa3e9487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-22T08:51:52.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa2ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464575 cookie 94269569619904 notifier 9495 bl.length()=225 2024-09-22T08:51:52.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa2ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T08:51:52.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.064+0000 7fa2ca7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa3e9487800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T08:51:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa3e9487800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:51:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa3e9487800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-22T08:51:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa2c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94269569610880 notifier 9495 bl.length()=234 2024-09-22T08:51:52.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa2c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T08:51:52.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.067+0000 7fa2c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T08:51:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.069+0000 7fa29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.072+0000 7fa3e9487800 20 remove_watcher() i=0 2024-09-22T08:51:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.072+0000 7fa3e9487800 2 removed watcher, disabling cache 2024-09-22T08:51:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.073+0000 7fa3e9487800 20 remove_watcher() i=1 2024-09-22T08:51:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.074+0000 7fa3e9487800 20 remove_watcher() i=2 2024-09-22T08:51:52.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.075+0000 7fa3e9487800 20 remove_watcher() i=3 2024-09-22T08:51:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.076+0000 7fa3e9487800 20 remove_watcher() i=4 2024-09-22T08:51:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.077+0000 7fa3e9487800 20 remove_watcher() i=5 2024-09-22T08:51:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.079+0000 7fa3e9487800 20 remove_watcher() i=6 2024-09-22T08:51:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.080+0000 7fa3e9487800 20 remove_watcher() i=7 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW99999999999999999", 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "", 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW99999999999999999", 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:52.090 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-22T08:51:52.091 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:52.092 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-22T08:51:52.093 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key POZUCHDOUJOKCQEBTNFX --secret i5iZfLLfJUDbgF+54OdpGooAzz/+aUR4BY9mf5iYh4NnDB0GupMdrQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-22T08:51:52.159 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:52.160 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:52.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.191+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 20 realm 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.193+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.194+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.194+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.194+0000 7f3fe0522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.194+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.195+0000 7f3fe0522800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.195+0000 7f3fe0522800 20 searching for the correct realm 2024-09-22T08:51:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.197+0000 7f3fdc9d3640 0 -- 172.21.15.78:0/3257288899 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f3fd001e060 msgr2=0x7f3fd0074b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:51:52.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.402+0000 7f3fdb9d1640 0 -- 172.21.15.78:0/3257288899 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f3fd4018040 msgr2=0x7f3fd4038420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.407+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:52.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:52.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 zone default found 2024-09-22T08:51:52.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 4 Realm: () 2024-09-22T08:51:52.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:52.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 zonegroup default 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.408+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.409+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.409+0000 7f3fe0522800 20 started sync module instance, tier type = 2024-09-22T08:51:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.409+0000 7f3fe0522800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=0 2024-09-22T08:51:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=1 2024-09-22T08:51:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=2 2024-09-22T08:51:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=3 2024-09-22T08:51:52.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=4 2024-09-22T08:51:52.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=5 2024-09-22T08:51:52.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.418+0000 7f3fe0522800 20 add_watcher() i=6 2024-09-22T08:51:52.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.419+0000 7f3fe0522800 20 add_watcher() i=7 2024-09-22T08:51:52.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.419+0000 7f3fe0522800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:52.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.420+0000 7f3e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.420+0000 7f3fe0522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:52.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.420+0000 7f3fe0522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.420+0000 7f3fe0522800 5 note: GC not initialized 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3e91fdb640 20 reqs_thread_entry: start 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 20 Filter name: none 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3e037fe640 20 reqs_thread_entry: start 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T08:51:52.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.421+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:51:52.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX : miss 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX info.flags=0x0 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 adding default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX to cache LRU end 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.422+0000 7f3fe0522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.423+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX : hit (negative entry) 2024-09-22T08:51:52.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.423+0000 7f3fe0522800 10 cache get: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX : hit (negative entry) 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3fe0522800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3fe0522800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3eb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464576 cookie 94730879047680 notifier 8732 bl.length()=681 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3eb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:51:52.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.424+0000 7f3eb37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T08:51:52.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3fe0522800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:51:52.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3fe0522800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-22T08:51:52.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3eb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464548 cookie 94730879057760 notifier 8732 bl.length()=189 2024-09-22T08:51:52.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3eb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T08:51:52.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.427+0000 7f3eb2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T08:51:52.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3fe0522800 10 cache put: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX info.flags=0x7 2024-09-22T08:51:52.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3fe0522800 10 moving default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX to cache LRU end 2024-09-22T08:51:52.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3fe0522800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:POZUCHDOUJOKCQEBTNFX, ofs0, ns] 2024-09-22T08:51:52.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3eb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 94730879051408 notifier 8732 bl.length()=188 2024-09-22T08:51:52.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3eb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX info.flags=0x7 2024-09-22T08:51:52.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.430+0000 7f3eb37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+POZUCHDOUJOKCQEBTNFX to cache LRU end 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.433+0000 7f3fe0522800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "root2.client.0", 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "root2+test@test.test", 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-22T08:51:52.434 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "root2.client.0", 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "POZUCHDOUJOKCQEBTNFX", 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "i5iZfLLfJUDbgF+54OdpGooAzz/+aUR4BY9mf5iYh4NnDB0GupMdrQ==", 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:52.423925Z" 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-22T08:51:52.435 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-22T08:51:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW99999999999999999", 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-22T08:51:52.423912Z", 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T08:51:52.437 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:51:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.433+0000 7f3e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.435+0000 7f3fe0522800 20 remove_watcher() i=0 2024-09-22T08:51:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.435+0000 7f3fe0522800 2 removed watcher, disabling cache 2024-09-22T08:51:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.436+0000 7f3fe0522800 20 remove_watcher() i=1 2024-09-22T08:51:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.437+0000 7f3fe0522800 20 remove_watcher() i=2 2024-09-22T08:51:52.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.438+0000 7f3fe0522800 20 remove_watcher() i=3 2024-09-22T08:51:52.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.439+0000 7f3fe0522800 20 remove_watcher() i=4 2024-09-22T08:51:52.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.440+0000 7f3fe0522800 20 remove_watcher() i=5 2024-09-22T08:51:52.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.441+0000 7f3fe0522800 20 remove_watcher() i=6 2024-09-22T08:51:52.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.442+0000 7f3fe0522800 20 remove_watcher() i=7 2024-09-22T08:51:52.454 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1999418515 --totp-seed WRY5NOFOBTVK5CCOWB2SZHQO6OL7NRRMBVRKPCJ4YEKAVQOX4EDLLZKWJSBC5FIC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T08:51:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:52.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.554+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 realm 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.556+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.557+0000 7fbb9532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.557+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.558+0000 7fbb9532e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:51:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.558+0000 7fbb9532e800 20 searching for the correct realm 2024-09-22T08:51:52.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.560+0000 7fbb908dc640 0 -- 172.21.15.78:0/1153739540 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x563b7490f8b0 msgr2=0x563b74911ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:52.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.563+0000 7fbb908dc640 0 -- 172.21.15.78:0/1153739540 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7fbb8c031060 msgr2=0x7fbb8c066f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:51:52.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.769+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:51:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:51:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 zone default found 2024-09-22T08:51:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 4 Realm: () 2024-09-22T08:51:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 zonegroup default 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.770+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 started sync module instance, tier type = 2024-09-22T08:51:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.771+0000 7fbb9532e800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=0 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=1 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=2 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=3 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=4 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=5 2024-09-22T08:51:52.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.780+0000 7fbb9532e800 20 add_watcher() i=6 2024-09-22T08:51:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.781+0000 7fbb9532e800 20 add_watcher() i=7 2024-09-22T08:51:52.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.781+0000 7fbb9532e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:51:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fba47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 5 note: GC not initialized 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fba46fe5640 20 reqs_thread_entry: start 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 20 init_complete bucket index max shards: 11 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 20 Filter name: none 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fba44fe1640 20 reqs_thread_entry: start 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.783+0000 7fbb9532e800 20 rados->read ofs=0 len=0 2024-09-22T08:51:52.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.784+0000 7fbb9532e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T08:51:52.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.784+0000 7fbb9532e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-22T08:51:52.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.784+0000 7fbb9532e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.784+0000 7fbb9532e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:51:52.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.786+0000 7fbb9532e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:51:52.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.786+0000 7fbb9532e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.786+0000 7fbb9532e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T08:51:52.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.787+0000 7fba74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464577 cookie 94813358766128 notifier 8750 bl.length()=695 2024-09-22T08:51:52.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.787+0000 7fba74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T08:51:52.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.787+0000 7fba74ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T08:51:52.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.789+0000 7fba47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:51:52.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.791+0000 7fbb9532e800 20 remove_watcher() i=0 2024-09-22T08:51:52.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.791+0000 7fbb9532e800 2 removed watcher, disabling cache 2024-09-22T08:51:52.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.792+0000 7fbb9532e800 20 remove_watcher() i=1 2024-09-22T08:51:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.794+0000 7fbb9532e800 20 remove_watcher() i=2 2024-09-22T08:51:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.795+0000 7fbb9532e800 20 remove_watcher() i=3 2024-09-22T08:51:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.796+0000 7fbb9532e800 20 remove_watcher() i=4 2024-09-22T08:51:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.797+0000 7fbb9532e800 20 remove_watcher() i=5 2024-09-22T08:51:52.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.798+0000 7fbb9532e800 20 remove_watcher() i=6 2024-09-22T08:51:52.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T08:51:52.798+0000 7fbb9532e800 20 remove_watcher() i=7 2024-09-22T08:51:52.810 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-22T08:51:52.811 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:51:52.811 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-22T08:51:52.840 INFO:tasks.s3tests:Configuring boto... 2024-09-22T08:51:52.840 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T08:51:52.840 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T08:51:52.909 DEBUG:teuthology.orchestra.run.smithi078:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T08:51:53.087 INFO:teuthology.orchestra.run.smithi078.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-22T08:51:53.264 INFO:teuthology.orchestra.run.smithi078.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-22T08:51:53.526 INFO:teuthology.orchestra.run.smithi078.stdout:py installdeps: -rrequirements.txt 2024-09-22T08:53:44.498 INFO:teuthology.orchestra.run.smithi078.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-22T08:53:45.915 INFO:teuthology.orchestra.run.smithi078.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.1,gevent==24.2.1,greenlet==3.1.1,httplib2==0.22.0,idna==3.10,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.6,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.8.0,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=6d57b2fff70cd0884044f1e4e90e6ef43b5dac3936a0556d8fd6c0d4815784a3,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.20.0,urllib3==1.26.20,virtualenv==20.26.5,zope.event==5.0,zope.interface==7.0.3 2024-09-22T08:53:45.915 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test-pre: PYTHONHASHSEED='4273022510' 2024-09-22T08:53:45.915 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T08:53:46.047 INFO:teuthology.orchestra.run.smithi078.stdout:============================= test session starts ============================== 2024-09-22T08:53:46.047 INFO:teuthology.orchestra.run.smithi078.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-22T08:53:46.047 INFO:teuthology.orchestra.run.smithi078.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T08:53:46.047 INFO:teuthology.orchestra.run.smithi078.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T08:53:46.047 INFO:teuthology.orchestra.run.smithi078.stdout:configfile: pytest.ini 2024-09-22T08:53:47.786 INFO:teuthology.orchestra.run.smithi078.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-22T08:53:47.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T08:53:48.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-22T08:53:48.483 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-22T08:53:48.855 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-22T08:53:49.233 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-22T08:53:49.545 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-22T08:53:49.883 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-22T08:53:50.307 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-22T08:53:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-22T08:53:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-22T08:53:50.845 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-22T08:53:51.151 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-22T08:53:51.463 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-22T08:53:51.766 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-22T08:53:52.072 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-22T08:53:52.193 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-22T08:53:52.314 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-22T08:53:52.389 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.464 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.539 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.614 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.690 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.766 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-22T08:53:52.841 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T08:53:52.916 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T08:53:52.991 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T08:53:53.066 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T08:53:53.141 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-22T08:53:53.215 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-22T08:53:53.291 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-22T08:53:53.367 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.443 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.518 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.593 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.669 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.744 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.893 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-22T08:53:53.969 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.044 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.119 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.194 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.269 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.347 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.423 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-22T08:53:54.500 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.575 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.650 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.801 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.874 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T08:53:54.950 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T08:53:55.025 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-22T08:53:55.099 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-22T08:53:55.669 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-22T08:53:59.197 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-22T08:54:03.177 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-22T08:54:08.308 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-22T08:54:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-22T08:54:16.571 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-22T08:54:19.164 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-22T08:54:19.934 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-22T08:54:20.191 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-22T08:54:20.582 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-22T08:54:20.968 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-22T08:54:21.673 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-22T08:54:22.064 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-22T08:54:22.314 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-22T08:54:22.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T08:54:22.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T08:54:22.316 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-22T08:54:22.317 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-22T08:54:22.318 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T08:54:22.319 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T08:54:22.320 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-22T08:54:22.321 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.322 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.323 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.323 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-22T08:54:22.325 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.326 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.326 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T08:54:22.327 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:54:22.328 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:54:22.329 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:54:22.329 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T08:54:22.330 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-22T08:54:22.331 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-22T08:54:22.332 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-22T08:54:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-22T08:54:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-22T08:54:22.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-22T08:54:22.335 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-22T08:54:22.336 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-22T08:54:22.420 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-22T08:54:22.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-22T08:54:23.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-22T08:54:30.559 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-22T08:54:30.982 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-22T08:54:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-22T08:54:31.998 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-22T08:54:32.496 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-22T08:54:32.997 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-22T08:54:33.361 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-22T08:54:33.893 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-22T08:54:34.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-22T08:54:34.822 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-22T08:54:35.208 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-22T08:54:35.577 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-22T08:54:35.944 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-22T08:54:36.069 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-22T08:54:36.495 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-22T08:54:36.981 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-22T08:54:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-22T08:54:37.882 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-22T08:54:38.253 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-22T08:54:38.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-22T08:54:39.022 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-22T08:54:39.397 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-22T08:54:39.754 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-22T08:54:40.107 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-22T08:54:40.238 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-22T08:54:40.406 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-22T08:54:40.543 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-22T08:54:40.685 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-22T08:54:40.821 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-22T08:54:41.181 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-22T08:54:41.324 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:54:41.507 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-22T08:54:41.835 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-22T08:54:42.136 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-22T08:54:42.276 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:54:42.614 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-22T08:54:42.912 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-22T08:54:43.368 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T08:54:43.611 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-22T08:54:43.912 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-22T08:54:44.223 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-22T08:54:44.851 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T08:54:45.383 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T08:54:45.845 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T08:54:46.401 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:47.140 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:48.269 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:49.844 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:50.540 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:51.241 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T08:54:51.767 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-22T08:54:52.447 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-22T08:54:52.831 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-22T08:54:54.042 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-22T08:54:54.765 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-22T08:54:55.684 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-22T08:54:57.752 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-22T08:55:00.562 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-22T08:55:02.035 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-22T08:55:03.375 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-22T08:55:04.378 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-22T08:55:04.926 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-22T08:55:06.114 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-22T08:55:06.883 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-22T08:55:07.988 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-22T08:55:08.695 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-22T08:55:10.185 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-22T08:55:11.335 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-22T08:55:13.054 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-22T08:55:14.697 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-22T08:55:15.766 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-22T08:55:16.731 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-22T08:55:17.466 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-22T08:55:19.537 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-22T08:55:20.963 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-22T08:55:22.663 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-22T08:55:24.287 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-22T08:55:25.755 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-22T08:55:27.232 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-22T08:55:28.413 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-22T08:55:29.184 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-22T08:55:30.094 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-22T08:55:31.957 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-22T08:55:34.469 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-22T08:55:35.440 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-22T08:55:36.963 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-22T08:55:38.487 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-22T08:55:39.878 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-22T08:55:41.308 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-22T08:55:42.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-22T08:55:44.232 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-22T08:55:45.592 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-22T08:55:46.507 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-22T08:55:47.212 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-22T08:55:47.905 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-22T08:55:48.607 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-22T08:55:49.945 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-22T08:55:51.320 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-22T08:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-22T08:55:54.021 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-22T08:55:55.415 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-22T08:55:56.736 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-22T08:55:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-22T08:55:59.464 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-22T08:56:00.767 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-22T08:56:02.162 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T08:56:03.467 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-22T08:56:04.901 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-22T08:56:05.717 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-22T08:56:06.533 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-22T08:56:07.265 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T08:56:08.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-22T08:56:08.541 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-22T08:56:09.323 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-22T08:56:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-22T08:56:10.586 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-22T08:56:11.240 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-22T08:56:11.866 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-22T08:56:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-22T08:56:13.079 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-22T08:56:13.730 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-22T08:56:14.637 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-22T08:56:15.527 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-22T08:56:16.028 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T08:56:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T08:56:17.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-22T08:56:17.779 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-22T08:56:18.687 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T08:56:19.585 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T08:56:20.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-22T08:56:20.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-22T08:56:21.428 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-22T08:56:22.048 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-22T08:56:22.652 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-22T08:56:23.254 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-22T08:56:23.863 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-22T08:56:24.475 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-22T08:56:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-22T08:56:25.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-22T08:56:26.385 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-22T08:56:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-22T08:56:27.545 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-22T08:56:28.114 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-22T08:56:28.679 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-22T08:56:29.328 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-22T08:56:29.935 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-22T08:57:17.253 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-22T08:57:17.860 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-22T08:57:18.419 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-22T08:57:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-22T08:57:19.560 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-22T08:57:20.130 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-22T08:57:20.702 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-22T08:57:21.273 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-22T08:57:21.880 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-22T08:57:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-22T08:57:23.019 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-22T08:57:23.578 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-22T08:57:24.143 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-22T08:57:24.750 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T08:57:25.353 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T08:57:26.012 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T08:57:26.621 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T08:57:27.220 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-22T08:57:27.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-22T08:57:28.422 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:57:29.034 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:57:29.650 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:57:30.293 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T08:57:30.968 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-22T08:57:31.651 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-22T08:57:32.275 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-22T08:57:32.875 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-22T08:57:33.477 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-22T08:57:34.130 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-22T08:57:34.293 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-22T08:57:34.788 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-22T08:57:36.680 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-22T08:57:38.775 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-22T08:57:39.414 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-22T08:57:40.021 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-22T08:57:40.626 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-22T08:57:41.223 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-22T08:57:41.895 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-22T08:57:42.583 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-22T08:57:43.181 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-22T08:57:43.828 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-22T08:57:44.435 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-22T08:57:45.033 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-22T08:57:45.635 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-22T08:57:46.239 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-22T08:57:47.103 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-22T08:57:48.207 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-22T08:57:48.661 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-22T08:57:49.086 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-22T08:57:49.465 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-22T08:57:49.851 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-22T08:57:49.993 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-22T08:57:50.136 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-22T08:57:50.278 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-22T08:57:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-22T08:57:52.399 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-22T08:57:52.541 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-22T08:57:53.016 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-22T08:57:53.382 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-22T08:57:53.766 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-22T08:57:54.155 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-22T08:57:55.976 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-22T08:57:56.775 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-22T08:57:57.545 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-22T08:58:45.343 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-22T08:59:33.216 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-22T08:59:33.693 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-22T08:59:34.163 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-22T08:59:34.652 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-22T08:59:35.139 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-22T08:59:35.750 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-22T08:59:36.240 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-22T08:59:36.737 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-22T08:59:37.337 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-22T08:59:37.886 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-22T08:59:38.415 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-22T08:59:38.959 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-22T08:59:39.553 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-22T08:59:40.088 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-22T08:59:40.474 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-22T08:59:40.931 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-22T08:59:41.389 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-22T08:59:42.088 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-22T08:59:42.631 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-22T08:59:43.097 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-22T08:59:43.561 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-22T08:59:44.052 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-22T08:59:44.610 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-22T08:59:44.998 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-22T08:59:45.382 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-22T08:59:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-22T08:59:46.156 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-22T08:59:46.576 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-22T08:59:46.962 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-22T08:59:47.452 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-22T08:59:47.857 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-22T08:59:48.247 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-22T08:59:48.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-22T08:59:49.022 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-22T08:59:49.668 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-22T08:59:50.099 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-22T08:59:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-22T08:59:50.867 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-22T08:59:51.257 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-22T08:59:51.654 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-22T08:59:52.045 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-22T08:59:52.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-22T08:59:53.794 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-22T08:59:54.180 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-22T08:59:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-22T08:59:55.283 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-22T08:59:55.776 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-22T08:59:56.311 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-22T08:59:56.843 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-22T08:59:58.349 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-22T08:59:58.882 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-22T08:59:59.418 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-22T09:00:00.063 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-22T09:00:00.761 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-22T09:00:01.396 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-22T09:00:01.903 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-22T09:00:02.559 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-22T09:00:03.224 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-22T09:00:03.754 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-22T09:00:04.417 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-22T09:00:04.889 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-22T09:00:05.306 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-22T09:00:05.696 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-22T09:00:06.150 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-22T09:00:06.546 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-22T09:00:06.687 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-22T09:00:07.341 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-22T09:00:07.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-22T09:00:08.288 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-22T09:00:11.269 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-22T09:00:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-22T09:00:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-22T09:00:12.750 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-22T09:00:13.237 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-22T09:00:13.667 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-22T09:00:14.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-22T09:00:14.680 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-22T09:00:15.221 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-22T09:00:15.842 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-22T09:00:16.328 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-22T09:00:16.791 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-22T09:00:17.268 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-22T09:00:17.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-22T09:00:18.245 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-22T09:00:18.735 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-22T09:00:19.258 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-22T09:00:19.743 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-22T09:00:19.889 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-22T09:00:20.036 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-22T09:00:20.178 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-22T09:00:20.541 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-22T09:00:20.903 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-22T09:00:21.266 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-22T09:00:21.633 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-22T09:00:22.078 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-22T09:00:22.224 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-22T09:00:22.374 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-22T09:00:22.756 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-22T09:00:22.901 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-22T09:00:23.043 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-22T09:00:23.191 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-22T09:00:23.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-22T09:00:23.759 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-22T09:00:24.184 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-22T09:00:24.580 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-22T09:00:25.050 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-22T09:00:25.473 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-22T09:00:25.857 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-22T09:00:26.278 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-22T09:00:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-22T09:00:27.210 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T09:00:27.658 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T09:00:28.179 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-22T09:00:28.705 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-22T09:00:29.321 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-22T09:00:29.845 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T09:00:30.415 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T09:00:30.999 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-22T09:00:31.623 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-22T09:00:32.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-22T09:00:32.840 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-22T09:00:33.240 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-22T09:00:33.864 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-22T09:00:34.480 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-22T09:00:35.106 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-22T09:00:35.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-22T09:00:36.376 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-22T09:00:37.042 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-22T09:00:37.622 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-22T09:00:38.210 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-22T09:00:38.852 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-22T09:00:39.460 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-22T09:00:39.881 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-22T09:00:40.418 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-22T09:00:40.967 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-22T09:00:41.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-22T09:00:41.853 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-22T09:00:42.489 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-22T09:00:43.322 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-22T09:00:44.168 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-22T09:00:44.983 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-22T09:00:45.795 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-22T09:00:46.605 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-22T09:00:47.412 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-22T09:00:48.271 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-22T09:00:49.089 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-22T09:00:49.929 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-22T09:00:50.874 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-22T09:00:51.715 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-22T09:00:52.603 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-22T09:00:54.044 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-22T09:00:55.416 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-22T09:00:55.548 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-22T09:00:55.690 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-22T09:00:55.828 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-22T09:00:56.232 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-22T09:00:56.641 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-22T09:00:57.006 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-22T09:00:57.367 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-22T09:00:58.002 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-22T09:01:00.091 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-22T09:01:00.828 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-22T09:01:01.455 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-22T09:01:04.301 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-22T09:01:04.939 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-22T09:01:05.577 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-22T09:01:06.130 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-22T09:01:06.712 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-22T09:01:07.678 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-22T09:01:08.428 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-22T09:01:09.137 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-22T09:01:09.833 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-22T09:01:11.028 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-22T09:01:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-22T09:01:12.620 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-22T09:01:13.007 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-22T09:01:15.059 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-22T09:01:15.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-22T09:01:24.189 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-22T09:01:24.622 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-22T09:01:25.277 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-22T09:01:27.889 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-22T09:01:28.511 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-22T09:01:29.636 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-22T09:01:35.482 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-22T09:01:44.203 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-22T09:01:57.236 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-22T09:02:48.683 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-22T09:02:56.761 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-22T09:03:07.598 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-22T09:03:08.533 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-22T09:03:11.820 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-22T09:03:14.562 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-22T09:03:16.445 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-22T09:03:16.970 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-22T09:03:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-22T09:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-22T09:03:20.820 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-22T09:03:21.357 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-22T09:03:38.531 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-22T09:03:41.260 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-22T09:03:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-22T09:03:42.275 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-22T09:03:42.862 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-22T09:03:46.803 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-22T09:03:50.289 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-22T09:03:53.731 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-22T09:03:54.253 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-22T09:03:54.806 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-22T09:03:55.320 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-22T09:03:55.842 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-22T09:03:56.360 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-22T09:03:56.879 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-22T09:03:57.449 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-22T09:03:58.318 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-22T09:03:59.872 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-22T09:04:02.574 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-22T09:04:03.642 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-22T09:04:05.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-22T09:04:08.894 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-22T09:04:10.116 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-22T09:04:12.660 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-22T09:04:17.063 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-22T09:04:18.116 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-22T09:04:18.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-22T09:04:19.780 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-22T09:04:20.317 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-22T09:04:25.634 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-22T09:04:26.165 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-22T09:04:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-22T09:04:27.232 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-22T09:04:27.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-22T09:04:28.522 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-22T09:04:39.933 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-22T09:04:41.046 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-22T09:04:41.750 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-22T09:04:42.710 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-22T09:04:43.664 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-22T09:04:48.313 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-22T09:04:49.270 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-22T09:04:54.976 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-22T09:05:16.302 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-22T09:05:27.605 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-22T09:05:29.784 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-22T09:05:31.935 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-22T09:05:32.808 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-22T09:05:33.729 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-22T09:05:34.398 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-22T09:05:35.443 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-22T09:05:36.343 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-22T09:05:37.975 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-22T09:05:38.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-22T09:05:38.924 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-22T09:05:39.389 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-22T09:05:39.784 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-22T09:05:40.214 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-22T09:05:40.721 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-22T09:05:41.128 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-22T09:05:41.519 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-22T09:05:42.069 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-22T09:05:42.480 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-22T09:05:42.922 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-22T09:05:43.346 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-22T09:05:43.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-22T09:05:44.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-22T09:05:44.738 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-22T09:05:45.284 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-22T09:05:46.071 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-22T09:05:46.606 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-22T09:05:47.150 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-22T09:05:47.687 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-22T09:05:48.255 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-22T09:05:48.682 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-22T09:05:49.149 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-22T09:05:49.577 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-22T09:05:50.003 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-22T09:06:16.943 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-22T09:06:43.458 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-22T09:06:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-22T09:06:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-22T09:07:52.281 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-22T09:08:53.423 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-22T09:08:53.993 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-22T09:08:54.522 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-22T09:08:55.164 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-22T09:08:55.583 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-22T09:09:14.040 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-22T09:09:20.360 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-22T09:09:26.698 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-22T09:09:27.240 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-22T09:09:27.771 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-22T09:09:28.304 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-22T09:09:29.078 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-22T09:09:29.614 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-22T09:09:30.146 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-22T09:09:30.681 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-22T09:09:31.215 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-22T09:09:31.889 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-22T09:09:32.491 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-22T09:09:33.029 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-22T09:09:33.561 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-22T09:09:34.557 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-22T09:09:35.559 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-22T09:09:37.004 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-22T09:09:38.333 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-22T09:09:39.701 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-22T09:09:41.072 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-22T09:09:42.517 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-22T09:09:43.872 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-22T09:09:45.322 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-22T09:09:46.832 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-22T09:09:48.847 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-22T09:09:49.435 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-22T09:09:49.924 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-22T09:09:50.525 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-22T09:09:52.015 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-22T09:09:53.432 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-22T09:09:54.883 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-22T09:09:56.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-22T09:10:13.684 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-22T09:10:14.501 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-22T09:10:15.419 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T09:10:16.279 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T09:10:17.527 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-22T09:10:18.669 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-22T09:10:19.242 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-22T09:10:20.249 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-22T09:10:20.635 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-22T09:10:21.018 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-22T09:10:21.407 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-22T09:10:21.790 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-22T09:10:22.380 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-22T09:10:22.866 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-22T09:10:23.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-22T09:10:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-22T09:10:24.687 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-22T09:10:25.111 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-22T09:10:25.536 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-22T09:10:25.963 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-22T09:10:26.446 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-22T09:10:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-22T09:10:27.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-22T09:10:27.821 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-22T09:10:28.244 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-22T09:10:28.825 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-22T09:10:29.353 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-22T09:10:29.964 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-22T09:10:30.536 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-22T09:10:31.069 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-22T09:10:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-22T09:10:32.266 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-22T09:10:32.905 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-22T09:10:33.515 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-22T09:10:34.131 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-22T09:10:34.747 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-22T09:10:35.320 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-22T09:10:36.027 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-22T09:10:36.745 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-22T09:10:37.376 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-22T09:10:37.968 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-22T09:10:38.491 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-22T09:10:39.038 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-22T09:10:39.764 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-22T09:10:40.285 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-22T09:10:40.903 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T09:10:41.646 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T09:10:42.154 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-22T09:10:42.795 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-22T09:10:43.342 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-22T09:10:53.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-22T09:10:54.276 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-22T09:11:04.338 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-22T09:11:04.991 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-22T09:11:05.609 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-22T09:11:06.001 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-22T09:11:06.457 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:11:06.915 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:11:07.406 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:11:07.887 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-22T09:11:08.393 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-22T09:11:08.789 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-22T09:11:09.296 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-22T09:11:09.863 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-22T09:11:10.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-22T09:11:10.947 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-22T09:11:11.513 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-22T09:11:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-22T09:11:12.410 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-22T09:11:13.180 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-22T09:11:20.020 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-22T09:11:20.424 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:11:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:11:21.477 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:11:22.008 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-22T09:11:23.352 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-22T09:11:23.929 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-22T09:11:25.000 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-22T09:11:28.275 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-22T09:11:29.246 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-22T09:11:33.958 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-22T09:11:37.989 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-22T09:11:38.578 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-22T09:11:39.340 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-22T09:11:52.212 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-22T09:12:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-22T09:12:15.066 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-22T09:12:16.888 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-22T09:12:18.834 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-22T09:12:21.112 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-22T09:12:21.681 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-22T09:12:25.058 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-22T09:12:29.055 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-22T09:12:44.501 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-22T09:12:46.763 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-22T09:12:48.507 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-22T09:12:50.037 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-22T09:12:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-22T09:12:55.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-22T09:12:58.635 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-22T09:12:59.370 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-22T09:13:00.396 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-22T09:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-22T09:13:08.335 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-22T09:13:13.179 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-22T09:13:14.738 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-22T09:13:14.860 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-22T09:13:18.053 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-22T09:13:21.319 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-22T09:13:23.291 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-22T09:13:26.732 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-22T09:13:27.807 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-22T09:14:02.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-22T09:14:02.438 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-22T09:14:03.374 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-22T09:14:04.093 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-22T09:14:04.857 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-22T09:14:05.768 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-22T09:14:05.784 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-22T09:14:05.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.784 INFO:teuthology.orchestra.run.smithi078.stdout:=============================== warnings summary =============================== 2024-09-22T09:14:05.784 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: import imp 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py:120 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: if boto_type is 'S3Connection': 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py:124 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: elif boto_type is 'HTTPRequest': 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py:359 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-22T09:14:05.785 INFO:teuthology.orchestra.run.smithi078.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:176 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: if k is 'BucketName': 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:253 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.timeout(10) 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.s3website_routing_rules 2024-09-22T09:14:05.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-22T09:14:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.789 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T09:14:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1219.74s (0:20:19) = 2024-09-22T09:14:05.912 INFO:teuthology.orchestra.run.smithi078.stdout:___________________________________ summary ____________________________________ 2024-09-22T09:14:05.912 INFO:teuthology.orchestra.run.smithi078.stdout: py: commands succeeded 2024-09-22T09:14:05.912 INFO:teuthology.orchestra.run.smithi078.stdout: congratulations :) 2024-09-22T09:14:05.929 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-22T09:14:05.929 DEBUG:teuthology.orchestra.run.smithi078:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T09:14:06.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:14:06.040 INFO:tasks.s3tests:Cleaning up boto... 2024-09-22T09:14:06.040 DEBUG:teuthology.orchestra.run.smithi078:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T09:14:06.068 INFO:tasks.s3tests:Removing s3-tests... 2024-09-22T09:14:06.069 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T09:14:06.260 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T09:14:06.276 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:14:06.276 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T09:14:06.276 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:14:06.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T09:14:06.305 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:14:06.373 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T09:14:06.373 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T09:14:06.441 INFO:tasks.workunit:timeout=3h 2024-09-22T09:14:06.441 INFO:tasks.workunit:cleanup=True 2024-09-22T09:14:06.442 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:14:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T09:15:05.606 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-22T09:15:05.607 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:05.608 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T09:15:05.611 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T09:15:05.679 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T09:15:05.681 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:15:05.681 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T09:15:05.730 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T09:15:05.778 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T09:15:05.817 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:15:05.819 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:15:05.819 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T09:15:05.857 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:15:05.861 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-22T09:15:05.861 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T09:15:05.933 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-22T09:15:05.934 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-22T09:15:05.934 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T09:15:06.007 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T09:15:06.008 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:15:06.008 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T09:15:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-22T09:15:08.305 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T09:15:08.305 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:15:08.305 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-22T09:15:08.305 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:15:08.306 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-22T09:15:08.307 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-22T09:15:08.530 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T09:15:08.712 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-22T09:15:08.717 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T09:15:08.761 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-22T09:15:08.761 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-22T09:15:08.762 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 21.3.1 2024-09-22T09:15:08.908 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-21.3.1: 2024-09-22T09:15:08.913 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T09:15:09.639 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-22T09:15:09.687 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-22T09:15:10.457 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-22T09:15:10.459 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T09:15:10.984 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T09:15:10.985 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T09:15:11.033 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T09:15:11.034 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T09:15:11.081 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T09:15:11.082 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T09:15:11.131 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:15:11.132 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T09:15:11.208 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:15:11.209 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T09:15:11.354 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:15:11.355 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T09:15:11.359 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T09:15:11.360 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T09:15:11.370 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T09:15:11.371 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T09:15:11.372 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T09:15:11.374 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T09:15:11.375 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T09:15:11.447 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T09:15:12.435 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T09:15:12.554 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-22T09:15:12.676 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-22T09:15:12.710 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:12.710 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:12.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.948+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.949+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.949+0000 7fb756122800 20 realm 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.949+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.950+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.950+0000 7fb756122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:15:12.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.950+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.950+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.950+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.951+0000 7fb756122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:12.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.951+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.952+0000 7fb756122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:15:12.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.952+0000 7fb756122800 20 searching for the correct realm 2024-09-22T09:15:12.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.954+0000 7fb7495ad640 0 -- 172.21.15.78:0/2891201958 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x560a11a5fef0 msgr2=0x560a11a62320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:12.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.957+0000 7fb7525af640 0 -- 172.21.15.78:0/2891201958 >> [v2:172.21.15.171:6808/3588151379,v1:172.21.15.171:6809/3588151379] conn(0x560a11a63750 msgr2=0x560a11a65b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:15:12.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 20 zone default found 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.963+0000 7fb756122800 4 Realm: () 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:15:12.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 zonegroup default 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 started sync module instance, tier type = 2024-09-22T09:15:12.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.964+0000 7fb756122800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:15:12.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=0 2024-09-22T09:15:12.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=1 2024-09-22T09:15:12.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=2 2024-09-22T09:15:12.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=3 2024-09-22T09:15:12.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=4 2024-09-22T09:15:12.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.979+0000 7fb756122800 20 add_watcher() i=5 2024-09-22T09:15:12.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.981+0000 7fb756122800 20 add_watcher() i=6 2024-09-22T09:15:12.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.985+0000 7fb756122800 20 add_watcher() i=7 2024-09-22T09:15:12.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.985+0000 7fb756122800 2 all 8 watchers are set, enabling cache 2024-09-22T09:15:12.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb6037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 5 note: GC not initialized 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb6027fc640 20 reqs_thread_entry: start 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 20 init_complete bucket index max shards: 11 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 20 Filter name: none 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb573fff640 20 reqs_thread_entry: start 2024-09-22T09:15:12.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.987+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-22T09:15:12.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 20 rados->read ofs=0 len=0 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.988+0000 7fb756122800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.989+0000 7fb756122800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.989+0000 7fb756122800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.989+0000 7fb756122800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-22T09:15:12.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.990+0000 7fb6357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466156 cookie 94601245808368 notifier 8768 bl.length()=613 2024-09-22T09:15:12.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.990+0000 7fb6357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T09:15:12.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.990+0000 7fb6357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:15:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb756122800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T09:15:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb756122800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:15:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb756122800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-22T09:15:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb6357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466157 cookie 94601245806720 notifier 8768 bl.length()=191 2024-09-22T09:15:12.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb6357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T09:15:12.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.993+0000 7fb6357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:15:12.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.995+0000 7fb6037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:12.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.998+0000 7fb756122800 20 remove_watcher() i=0 2024-09-22T09:15:12.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.998+0000 7fb756122800 2 removed watcher, disabling cache 2024-09-22T09:15:13.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:12.999+0000 7fb756122800 20 remove_watcher() i=1 2024-09-22T09:15:13.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.002+0000 7fb756122800 20 remove_watcher() i=2 2024-09-22T09:15:13.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.003+0000 7fb756122800 20 remove_watcher() i=3 2024-09-22T09:15:13.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.004+0000 7fb756122800 20 remove_watcher() i=4 2024-09-22T09:15:13.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.006+0000 7fb756122800 20 remove_watcher() i=5 2024-09-22T09:15:13.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.008+0000 7fb756122800 20 remove_watcher() i=6 2024-09-22T09:15:13.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.010+0000 7fb756122800 20 remove_watcher() i=7 2024-09-22T09:15:13.271 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-22T09:15:13.271 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:13.397 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T09:15:13.425 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:13.426 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:13.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.462+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 20 realm 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.464+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.465+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.465+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.465+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:13.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.465+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.466+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:15:13.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.466+0000 7ff7af325800 20 searching for the correct realm 2024-09-22T09:15:13.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.467+0000 7ff7ab0a2640 0 -- 172.21.15.78:0/262207626 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x56063e1d9b10 msgr2=0x56063e1dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:13.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.672+0000 7ff7ab0a2640 0 -- 172.21.15.78:0/262207626 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7ff79c074920 msgr2=0x7ff79c08c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:13.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:15:13.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.680+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 zone default found 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 4 Realm: () 2024-09-22T09:15:13.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 zonegroup default 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.681+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.682+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.682+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.682+0000 7ff7af325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:13.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.682+0000 7ff7af325800 20 started sync module instance, tier type = 2024-09-22T09:15:13.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.682+0000 7ff7af325800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=0 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=1 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=2 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=3 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=4 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=5 2024-09-22T09:15:13.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.705+0000 7ff7af325800 20 add_watcher() i=6 2024-09-22T09:15:13.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.707+0000 7ff7af325800 20 add_watcher() i=7 2024-09-22T09:15:13.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.707+0000 7ff7af325800 2 all 8 watchers are set, enabling cache 2024-09-22T09:15:13.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff7af325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff7af325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff7af325800 5 note: GC not initialized 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff660fe1640 20 reqs_thread_entry: start 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.709+0000 7ff7af325800 20 init_complete bucket index max shards: 11 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.710+0000 7ff7af325800 20 Filter name: none 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.710+0000 7ff5da7fc640 20 reqs_thread_entry: start 2024-09-22T09:15:13.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.710+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.710+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.710+0000 7ff7af325800 20 rados->read ofs=0 len=0 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T09:15:13.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 INFO: main: starting shard=0 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.0 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 INFO: main: starting shard=1 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.711+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.1 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 INFO: main: starting shard=2 2024-09-22T09:15:13.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.2 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 INFO: main: starting shard=3 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.712+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.3 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 INFO: main: starting shard=4 2024-09-22T09:15:13.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.4 2024-09-22T09:15:13.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 INFO: main: starting shard=5 2024-09-22T09:15:13.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.713+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.5 2024-09-22T09:15:13.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 INFO: main: starting shard=6 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.6 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 INFO: main: starting shard=7 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.714+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.7 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.715+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.715+0000 7ff7af325800 20 INFO: main: starting shard=8 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.715+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.8 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 INFO: main: starting shard=9 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.9 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 INFO: main: starting shard=10 2024-09-22T09:15:13.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.716+0000 7ff7af325800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.10 2024-09-22T09:15:13.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.717+0000 7ff7af325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:13.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.717+0000 7ff7af325800 20 INFO: main: done 2024-09-22T09:15:13.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.718+0000 7ff661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:13.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.720+0000 7ff7af325800 20 remove_watcher() i=0 2024-09-22T09:15:13.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.720+0000 7ff7af325800 2 removed watcher, disabling cache 2024-09-22T09:15:13.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.721+0000 7ff7af325800 20 remove_watcher() i=1 2024-09-22T09:15:13.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.724+0000 7ff7af325800 20 remove_watcher() i=2 2024-09-22T09:15:13.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.725+0000 7ff7af325800 20 remove_watcher() i=3 2024-09-22T09:15:13.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.726+0000 7ff7af325800 20 remove_watcher() i=4 2024-09-22T09:15:13.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.727+0000 7ff7af325800 20 remove_watcher() i=5 2024-09-22T09:15:13.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.730+0000 7ff7af325800 20 remove_watcher() i=6 2024-09-22T09:15:13.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.733+0000 7ff7af325800 20 remove_watcher() i=7 2024-09-22T09:15:13.745 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.data ls | grep b65039fc-d4a9-4431-9d91-5f5e46155d58 2024-09-22T09:15:13.768 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:13.768 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:13.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:13.847+0000 7f27bb800640 0 -- 172.21.15.78:0/3384528943 >> [v2:172.21.15.78:6810/3985180551,v1:172.21.15.78:6811/3985180551] conn(0x7f27ac063070 msgr2=0x7f27ac061860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:13.857 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-22T09:15:13.857 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:13.858 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T09:15:15.299 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T09:15:15.692 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T09:15:15.719 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:15.720 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:15.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.756+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 realm 2024-09-22T09:15:15.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.758+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.759+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:15.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.759+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.760+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:15:15.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.760+0000 7efed6014800 20 searching for the correct realm 2024-09-22T09:15:15.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.763+0000 7efed1ecc640 0 -- 172.21.15.78:0/3274795522 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7efebc075040 msgr2=0x7efebc062280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:15:15.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.969+0000 7efec8eca640 0 -- 172.21.15.78:0/3274795522 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7efecc061040 msgr2=0x7efecc009b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:15:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:15:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:15:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:15:15.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:15:15.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:15:15.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.975+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 zone default found 2024-09-22T09:15:15.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 4 Realm: () 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 zonegroup default 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.976+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.977+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.977+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.977+0000 7efed6014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.977+0000 7efed6014800 20 started sync module instance, tier type = 2024-09-22T09:15:15.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.977+0000 7efed6014800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:15:15.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=0 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=1 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=2 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=3 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=4 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=5 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.988+0000 7efed6014800 20 add_watcher() i=6 2024-09-22T09:15:15.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.989+0000 7efed6014800 20 add_watcher() i=7 2024-09-22T09:15:15.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.989+0000 7efed6014800 2 all 8 watchers are set, enabling cache 2024-09-22T09:15:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efd87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efed6014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efed6014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efed6014800 5 note: GC not initialized 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efd86fe5640 20 reqs_thread_entry: start 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efed6014800 20 init_complete bucket index max shards: 11 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.992+0000 7efed6014800 20 Filter name: none 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.993+0000 7efd84fe1640 20 reqs_thread_entry: start 2024-09-22T09:15:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.993+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.993+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.993+0000 7efed6014800 20 rados->read ofs=0 len=0 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.993+0000 7efed6014800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-22T09:15:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: starting shard=0 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.0 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: starting shard=1 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.1 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 INFO: main: starting shard=2 2024-09-22T09:15:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.994+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.2 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 INFO: main: starting shard=3 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.3 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 INFO: main: starting shard=4 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.995+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.4 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 INFO: main: starting shard=5 2024-09-22T09:15:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.5 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 INFO: main: starting shard=6 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.996+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.6 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 INFO: main: starting shard=7 2024-09-22T09:15:15.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.7 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 INFO: main: starting shard=8 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.997+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.8 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 INFO: main: starting shard=9 2024-09-22T09:15:15.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.9 2024-09-22T09:15:16.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:16.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 INFO: main: starting shard=10 2024-09-22T09:15:16.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.998+0000 7efed6014800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.10 2024-09-22T09:15:16.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.999+0000 7efed6014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:15:16.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:15.999+0000 7efed6014800 20 INFO: main: done 2024-09-22T09:15:16.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.000+0000 7efd87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:16.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.003+0000 7efed6014800 20 remove_watcher() i=0 2024-09-22T09:15:16.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.003+0000 7efed6014800 2 removed watcher, disabling cache 2024-09-22T09:15:16.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.004+0000 7efed6014800 20 remove_watcher() i=1 2024-09-22T09:15:16.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.005+0000 7efed6014800 20 remove_watcher() i=2 2024-09-22T09:15:16.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.008+0000 7efed6014800 20 remove_watcher() i=3 2024-09-22T09:15:16.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.010+0000 7efed6014800 20 remove_watcher() i=4 2024-09-22T09:15:16.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.011+0000 7efed6014800 20 remove_watcher() i=5 2024-09-22T09:15:16.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.012+0000 7efed6014800 20 remove_watcher() i=6 2024-09-22T09:15:16.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.013+0000 7efed6014800 20 remove_watcher() i=7 2024-09-22T09:15:16.026 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.data ls | grep 738ef482-d002-4d14-abf7-5c2a96c05161 2024-09-22T09:15:16.048 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:16.048 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:16.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:16.127+0000 7f075b039640 0 -- 172.21.15.78:0/1820179659 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x5634db161db0 msgr2=0x5634db162190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:15:16.139 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-22T09:15:16.139 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:16.251 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T09:15:17.752 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T09:15:17.754 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T09:15:18.202 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-22T09:15:18.202 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-22T09:15:18.370 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-22T09:15:21.874 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-22T09:15:22.279 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-22T09:15:22.309 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:22.309 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:22.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.345+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 20 realm 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.347+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.348+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.348+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.348+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:22.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.348+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.349+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:15:22.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.349+0000 7f35d1d46800 20 searching for the correct realm 2024-09-22T09:15:22.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.352+0000 7f35d0038640 0 -- 172.21.15.78:0/2106600260 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7f35b8031060 msgr2=0x7f35b8066830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:22.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.558+0000 7f35c7036640 0 -- 172.21.15.78:0/2106600260 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f35c8075560 msgr2=0x7f35c80a4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:22.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:22.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.564+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 zone default found 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 4 Realm: () 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 zonegroup default 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.565+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.566+0000 7f35d1d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.566+0000 7f35d1d46800 20 started sync module instance, tier type = 2024-09-22T09:15:22.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.566+0000 7f35d1d46800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=0 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=1 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=2 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=3 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=4 2024-09-22T09:15:22.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.578+0000 7f35d1d46800 20 add_watcher() i=5 2024-09-22T09:15:22.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.581+0000 7f35d1d46800 20 add_watcher() i=6 2024-09-22T09:15:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.583+0000 7f35d1d46800 20 add_watcher() i=7 2024-09-22T09:15:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.583+0000 7f35d1d46800 2 all 8 watchers are set, enabling cache 2024-09-22T09:15:22.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.586+0000 7f3485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:22.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 5 note: GC not initialized 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f3484fe1640 20 reqs_thread_entry: start 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 20 init_complete bucket index max shards: 11 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 20 Filter name: none 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f33fe7fc640 20 reqs_thread_entry: start 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-22T09:15:22.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.587+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783 : miss 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 20 rados->read ofs=0 len=0 2024-09-22T09:15:22.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783 info.flags=0x17 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783 to cache LRU end 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.588+0000 7f35d1d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.589+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.0 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.589+0000 7f35d1d46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T09:15:22.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.589+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.1 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.589+0000 7f35d1d46800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.589+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.2 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.590+0000 7f35d1d46800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.590+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.3 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.590+0000 7f35d1d46800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-22T09:15:22.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.590+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.4 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.591+0000 7f35d1d46800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.591+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.5 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.591+0000 7f35d1d46800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.591+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.6 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.592+0000 7f35d1d46800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-22T09:15:22.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.592+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.7 2024-09-22T09:15:22.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.593+0000 7f35d1d46800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-22T09:15:22.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.593+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.8 2024-09-22T09:15:22.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.593+0000 7f35d1d46800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-22T09:15:22.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.593+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.9 2024-09-22T09:15:22.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.594+0000 7f35d1d46800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-22T09:15:22.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.594+0000 7f35d1d46800 20 bucket index object: :.dir.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783.10 2024-09-22T09:15:22.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.594+0000 7f35d1d46800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-22T09:15:22.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.594+0000 7f35d1d46800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T09:15:22.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.595+0000 7f3485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:22.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.598+0000 7f35d1d46800 20 remove_watcher() i=0 2024-09-22T09:15:22.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.598+0000 7f35d1d46800 2 removed watcher, disabling cache 2024-09-22T09:15:22.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.600+0000 7f35d1d46800 20 remove_watcher() i=1 2024-09-22T09:15:22.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.601+0000 7f35d1d46800 20 remove_watcher() i=2 2024-09-22T09:15:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.602+0000 7f35d1d46800 20 remove_watcher() i=3 2024-09-22T09:15:22.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.603+0000 7f35d1d46800 20 remove_watcher() i=4 2024-09-22T09:15:22.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.604+0000 7f35d1d46800 20 remove_watcher() i=5 2024-09-22T09:15:22.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.606+0000 7f35d1d46800 20 remove_watcher() i=6 2024-09-22T09:15:22.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-22T09:15:22.609+0000 7f35d1d46800 20 remove_watcher() i=7 2024-09-22T09:15:22.620 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket versioning-bucket 2024-09-22T09:15:22.800 INFO:tasks.workunit.client.0.smithi078.stderr:Completed bucket versioning tests 2024-09-22T09:15:22.800 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-22T09:15:22.859 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-22T09:15:22.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-22T09:15:22.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T09:15:22.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-22T09:15:22.860 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-22T09:15:22.860 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-22T09:15:22.861 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T09:15:22.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T09:15:22.941 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-22T09:15:22.941 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T09:15:23.293 DEBUG:teuthology.parallel:result is None 2024-09-22T09:15:23.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:15:23.331 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:15:23.331 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:15:23.399 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:15:23.400 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-22T09:15:23.409 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-22T09:15:23.421 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-22T09:15:23.422 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-22T09:15:23.422 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-22T09:15:23.502 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-22T09:15:23.502 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-22T09:15:23.560 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:15:23.560 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.593+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:23.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.594+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:23.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.594+0000 7ff19df2c800 20 realm 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.594+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.595+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.596+0000 7ff19df2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:15:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.596+0000 7ff19df2c800 20 searching for the correct realm 2024-09-22T09:15:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:23.599+0000 7ff19a450640 0 -- 172.21.15.78:0/1720933300 >> [v2:172.21.15.78:6802/670624169,v1:172.21.15.78:6803/670624169] conn(0x7ff190036060 msgr2=0x7ff190067640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:24.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.006+0000 7ff19944e640 0 -- 172.21.15.78:0/1720933300 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7ff19409ea70 msgr2=0x7ff19408b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.213+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:24.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:15:24.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 zone default found 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 4 Realm: () 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 zonegroup default 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.214+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.215+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.215+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.215+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.215+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.216+0000 7ff19df2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:15:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.216+0000 7ff19df2c800 20 started sync module instance, tier type = 2024-09-22T09:15:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.216+0000 7ff19df2c800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=0 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=1 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=2 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=3 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=4 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=5 2024-09-22T09:15:24.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.233+0000 7ff19df2c800 20 add_watcher() i=6 2024-09-22T09:15:24.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.236+0000 7ff19df2c800 20 add_watcher() i=7 2024-09-22T09:15:24.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.236+0000 7ff19df2c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:15:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.238+0000 7ff04bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.239+0000 7ff19df2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:15:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.239+0000 7ff19df2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.283+0000 7ff04affd640 20 reqs_thread_entry: start 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.283+0000 7ff19df2c800 20 init_complete bucket index max shards: 11 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.283+0000 7ff19df2c800 20 Filter name: none 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.283+0000 7ff048ff9640 20 reqs_thread_entry: start 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T09:15:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 20 rados->read ofs=0 len=0 2024-09-22T09:15:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 20 rados_obj.operate() r=0 bl.length=482 2024-09-22T09:15:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-22T09:15:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T09:15:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.284+0000 7ff19df2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:15:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.285+0000 7ff19df2c800 10 removing key index: WFXYLZUDNXPCPGZCEGEB 2024-09-22T09:15:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.286+0000 7ff19df2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:WFXYLZUDNXPCPGZCEGEB, ofs0, ns] 2024-09-22T09:15:24.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.286+0000 7ff07d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464821 cookie 94018396114400 notifier 8870 bl.length()=170 2024-09-22T09:15:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.288+0000 7ff19df2c800 10 removing email index: tester.client.0_test@test.test 2024-09-22T09:15:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.289+0000 7ff19df2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T09:15:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.289+0000 7ff07d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986465400 cookie 94018396110560 notifier 8870 bl.length()=181 2024-09-22T09:15:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.290+0000 7ff19df2c800 10 removing user buckets index 2024-09-22T09:15:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.292+0000 7ff19df2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-22T09:15:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.292+0000 7ff07cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466160 cookie 94018396111616 notifier 8870 bl.length()=172 2024-09-22T09:15:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.293+0000 7ff19df2c800 10 removing user index: tester.client.0 2024-09-22T09:15:24.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.295+0000 7ff19df2c800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-22T09:15:24.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.295+0000 7ff19df2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T09:15:24.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.295+0000 7ff07d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466161 cookie 94018396119392 notifier 8870 bl.length()=164 2024-09-22T09:15:24.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.297+0000 7ff04bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:15:24.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.300+0000 7ff19df2c800 20 remove_watcher() i=0 2024-09-22T09:15:24.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.300+0000 7ff19df2c800 2 removed watcher, disabling cache 2024-09-22T09:15:24.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.301+0000 7ff19df2c800 20 remove_watcher() i=1 2024-09-22T09:15:24.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.302+0000 7ff19df2c800 20 remove_watcher() i=2 2024-09-22T09:15:24.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.303+0000 7ff19df2c800 20 remove_watcher() i=3 2024-09-22T09:15:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.304+0000 7ff19df2c800 20 remove_watcher() i=4 2024-09-22T09:15:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.305+0000 7ff19df2c800 20 remove_watcher() i=5 2024-09-22T09:15:24.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.307+0000 7ff19df2c800 20 remove_watcher() i=6 2024-09-22T09:15:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:15:24.308+0000 7ff19df2c800 20 remove_watcher() i=7 2024-09-22T09:15:24.320 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-22T09:15:24.330 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-22T09:15:24.344 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-22T09:15:24.400 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-22T09:15:24.410 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-22T09:15:24.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:15:24.421 INFO:tasks.rgw.client.0.smithi078.stdout:2024-09-22T09:15:24.414+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46533) UID: 0 2024-09-22T09:15:24.421 INFO:tasks.rgw.client.0.smithi078.stdout:2024-09-22T09:15:24.416+0000 a1c2240 -1 shutting down 2024-09-22T09:15:58.167 INFO:tasks.rgw.client.0.smithi078.stderr:==00:00:58:06.900 46537== could not unlink /tmp/vgdb-pipe-from-vgdb-to-46537-by-root-on-??? 2024-09-22T09:15:58.167 INFO:tasks.rgw.client.0.smithi078.stderr:==00:00:58:06.900 46537== could not unlink /tmp/vgdb-pipe-to-vgdb-from-46537-by-root-on-??? 2024-09-22T09:15:58.167 INFO:tasks.rgw.client.0.smithi078.stderr:==00:00:58:06.900 46537== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-46537-by-root-on-??? 2024-09-22T09:16:01.018 INFO:tasks.rgw.client.0:Stopped 2024-09-22T09:16:01.018 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-22T09:16:01.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/vault-root-token 2024-09-22T09:16:01.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-22T09:16:01.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-22T09:16:01.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-22T09:16:01.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-22T09:16:01.219 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-22T09:16:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:01.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.354+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.355+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.355+0000 7f56fdd25800 20 realm 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.355+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.356+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.356+0000 7f56fdd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.356+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.356+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.356+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.357+0000 7f56fdd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:01.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.357+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.358+0000 7f56fdd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:01.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.358+0000 7f56fdd25800 20 searching for the correct realm 2024-09-22T09:16:01.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.361+0000 7f56f9933640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x5570d49935e0 msgr2=0x5570d4995aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:01.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.364+0000 7f56f1132640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.78:6826/1196772508,v1:172.21.15.78:6827/1196772508] conn(0x7f56f4020070 msgr2=0x7f56f402d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:01.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got zonegroup_info.196e9416-559b-46d2-ab63-85ee8305cb0d 2024-09-22T09:16:01.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got zone_info.bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 2024-09-22T09:16:01.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:01.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:01.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:01.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:01.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.368+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:01.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 zone default found 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 4 Realm: () 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 4 ZoneGroup: default (196e9416-559b-46d2-ab63-85ee8305cb0d) 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 4 Zone: default (bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2) 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 zonegroup default 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.369+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.370+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.370+0000 7f56fdd25800 20 rados->read ofs=0 len=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.370+0000 7f56fdd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.370+0000 7f56fdd25800 20 started sync module instance, tier type = 2024-09-22T09:16:01.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.370+0000 7f56fdd25800 20 started zone id=bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2 (name=default) with tier type = 2024-09-22T09:16:01.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=0 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=1 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=2 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=3 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=4 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=5 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.379+0000 7f56fdd25800 20 add_watcher() i=6 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.380+0000 7f56fdd25800 20 add_watcher() i=7 2024-09-22T09:16:01.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.380+0000 7f56fdd25800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:01.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.382+0000 7f55ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:01.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.382+0000 7f56fdd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:01.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.382+0000 7f56fdd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.420+0000 7f55aa7fc640 20 reqs_thread_entry: start 2024-09-22T09:16:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.420+0000 7f56fdd25800 20 init_complete bucket index max shards: 11 2024-09-22T09:16:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.420+0000 7f56fdd25800 20 Filter name: none 2024-09-22T09:16:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.420+0000 7f551bfff640 20 reqs_thread_entry: start 2024-09-22T09:16:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:01.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.421+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46907' 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4559869993614055609', time=2024-09-22T10:54:07.439073+0000, chain.objs.size()=2 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.TlgQuD_kThHLG4RvI0pip6sYrvBA5Pp_0 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.TlgQuD_kThHLG4RvI0pip6sYrvBA5Pp_1 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_j92TE8stwznVBOmBtHQo5rdaCxw8Xco', time=2024-09-22T10:54:11.881736+0000, chain.objs.size()=2 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.hjC52ng69tUaWDbq2RsC4X3S8i0oHmT_0 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.hjC52ng69tUaWDbq2RsC4X3S8i0oHmT_1 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_DXLaIHrVChEbBRjL2m1JsztEjMioq8B', time=2024-09-22T10:54:18.986389+0000, chain.objs.size()=2 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.166__shadow_.M2B21I-SkskGwC08ORbx63yQPJzzBtW_0 2024-09-22T09:16:01.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.166__shadow_.M2B21I-SkskGwC08ORbx63yQPJzzBtW_1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18111432313567627521', time=2024-09-22T10:56:15.297613+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.423+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239__shadow_.L5vRFGLnqZCHnPzK4geECruI-N6swIJ_0 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.163720325643175495', time=2024-09-22T10:56:15.305503+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239__shadow_.QJTJtd3EsiWbwOr5et5nuLerxPlTEpC_0 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8412174356688813713', time=2024-09-22T10:56:16.278280+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.241__shadow_.JAjRviZDUXo6UcJBhTPiIKJWy8ozfeN_0 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7831312906459629389', time=2024-09-22T10:56:20.568286+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.247__shadow_.UX9Yk6MhFoRRSyJ5U5Uu63cmF-U0EFW_0 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6253253176169962608', time=2024-09-22T10:56:23.643741+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.252__shadow_.1-hGyGJhDZxauGD0RKt0IH5jUPjY4VX_0 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.505180246437649131', time=2024-09-22T10:57:05.946631+0000, chain.objs.size()=1 2024-09-22T09:16:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.424+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9GYB9rKi_goQfKAWwRY87XUl_7supmZ_0 2024-09-22T09:16:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17051230645885678413', time=2024-09-22T10:57:06.009099+0000, chain.objs.size()=1 2024-09-22T09:16:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GBj5NHgWT4OinyZNV6g_NJK3cDfVpZ3_0 2024-09-22T09:16:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10670755374573818548', time=2024-09-22T10:57:06.202927+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.a8z0u6Kxf64NxxIxP76MdyW2HFnDBac_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5357251282934842128', time=2024-09-22T10:57:06.868311+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vAq57V7rOpfnlm6_VLkbR5AqkCjGE65_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5012703804101385141', time=2024-09-22T10:57:08.405845+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ewA1MxpLhNAGXOtrtEcNP9V0xZLP-Gj_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13197862153386365719', time=2024-09-22T10:57:08.554976+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ix3PKdbP_fSqpsn0QttjH8nbmXzydXf_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9925106235141255533', time=2024-09-22T10:57:09.602803+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1-AYihMoQZ-ZLUnf1xgokywmUE54Tkf_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7742285406114464037', time=2024-09-22T10:57:09.934442+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vSmUbjDZiLSidGmuPZ4QUaewzhkQc_6_0 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3792567789650087619', time=2024-09-22T10:57:10.530535+0000, chain.objs.size()=1 2024-09-22T09:16:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.poFMSCy-sOtGGpcwsQRNhv8vC-MPuAS_0 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17536611217320499596', time=2024-09-22T10:57:11.334241+0000, chain.objs.size()=1 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BWDCFCZaGR-mqyjzJ1QouuEBf0ccnyW_0 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3170770612768297799', time=2024-09-22T10:57:11.978721+0000, chain.objs.size()=1 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lqJdIPVfSrVmn3QQ3VrJFcDOJ3hV15u_0 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6142072402602859997', time=2024-09-22T10:57:12.186913+0000, chain.objs.size()=1 2024-09-22T09:16:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.429+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9YG33xtwLSUbrpFkO6wDP1KZljUHKuC_0 2024-09-22T09:16:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.432+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1422353814060078329', time=2024-09-22T10:57:13.221133+0000, chain.objs.size()=1 2024-09-22T09:16:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.432+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZGCDs8q2V5TNZmklXWP1ep8LAwvS07r_0 2024-09-22T09:16:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.83858859747074743', time=2024-09-22T10:57:13.374625+0000, chain.objs.size()=1 2024-09-22T09:16:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wTuFASwW5zlTNaGnQMGlm7Azw7vXzg-_0 2024-09-22T09:16:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16689579288023237398', time=2024-09-22T10:57:13.387072+0000, chain.objs.size()=1 2024-09-22T09:16:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AG02eMKm0ww95ijBpouLEqK5Z-Nia-s_0 2024-09-22T09:16:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5598347046344540301', time=2024-09-22T10:57:14.057248+0000, chain.objs.size()=1 2024-09-22T09:16:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.433+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EFAh2BmFixEBVmDsdV9X634WEQTP_mj_0 2024-09-22T09:16:01.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14990464325825399183', time=2024-09-22T10:57:14.058032+0000, chain.objs.size()=1 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZYZGMTzf_fmbWHDOfFnwqKcoQSDd0ey_0 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10564594503575948119', time=2024-09-22T10:57:14.421754+0000, chain.objs.size()=1 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fOYqeRuSpCaq3EWqqceVEvZlWIwDybN_0 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5619934779617147304', time=2024-09-22T10:57:15.533178+0000, chain.objs.size()=1 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ex8PEdppQbnGuQqxT1mcPX_ckslXZa-_0 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684325933105601701', time=2024-09-22T10:57:15.622960+0000, chain.objs.size()=1 2024-09-22T09:16:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.435+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Py_KhH-nphOaNsqzRBn3c9zp1SYR8zC_0 2024-09-22T09:16:01.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.436+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1314765080748409629', time=2024-09-22T10:57:15.853993+0000, chain.objs.size()=1 2024-09-22T09:16:01.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.436+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.OJZk1rvUjTj68SZQyHY2xo4zJCHjk4i_0 2024-09-22T09:16:01.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1516440408857743113', time=2024-09-22T10:57:16.487674+0000, chain.objs.size()=1 2024-09-22T09:16:01.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yb7AGOPwSA0myMlG9bCHLAvfYZSdpkC_0 2024-09-22T09:16:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3759155044849872393', time=2024-09-22T10:57:16.910422+0000, chain.objs.size()=1 2024-09-22T09:16:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zVVyI8y5y3LDB0qa5tF7JBTbkJKaopb_0 2024-09-22T09:16:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14398798822291520955', time=2024-09-22T10:57:16.993009+0000, chain.objs.size()=1 2024-09-22T09:16:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.437+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.skvbr3mft91QJt53HJXbOUxrBXGJ83A_0 2024-09-22T09:16:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1665313906365677917', time=2024-09-22T10:57:22.794660+0000, chain.objs.size()=1 2024-09-22T09:16:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.273__shadow_.ox7uAnTz2g_gfxVh8RdYzPTp4d7LZfr_0 2024-09-22T09:16:01.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9775446947890030340', time=2024-09-22T10:57:36.427800+0000, chain.objs.size()=1 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.0B8lKwsHUMT20GE24PtmQ5DyGaxKeWp_0 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8009020828126746233', time=2024-09-22T10:57:36.428341+0000, chain.objs.size()=1 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.obxhBoKj9knW44Weeny6awKIOd3euNK_0 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.439+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15350370906142190905', time=2024-09-22T10:57:42.354070+0000, chain.objs.size()=1 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.439+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.300__shadow_.vLQsfhW3A6T1B2zfcJYCusieRehrIYu_0 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.439+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8424573210402520296', time=2024-09-22T10:57:42.357030+0000, chain.objs.size()=1 2024-09-22T09:16:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.439+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.300__shadow_.lznCBpW3JI3wCTz06KdW0Dc6sUHW5Vv_0 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10260239140708186806', time=2024-09-22T10:57:46.859997+0000, chain.objs.size()=1 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.307__shadow_.exZGOHxKpUfVyEDTTD01jN-D5WIFbk5_0 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9795713562506355890', time=2024-09-22T10:57:50.546422+0000, chain.objs.size()=1 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.314__shadow_.6nhdioiiPae-IdBosbymd_ASqZApaEs_0 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11793760937822669678', time=2024-09-22T10:58:34.989889+0000, chain.objs.size()=1 2024-09-22T09:16:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qsUwOeIInjemwY5SSekQ5MfI9u1CcDe_0 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12470211002648943247', time=2024-09-22T10:58:36.034246+0000, chain.objs.size()=1 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.k1gZk1Q8z2GdAGTiZm3rKIMrVQ4nqbY_0 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2614425880269753856', time=2024-09-22T10:58:36.290909+0000, chain.objs.size()=1 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.djfTtDAi6OH8G7LL2amMFy-ylpkoblH_0 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7772253459255344300', time=2024-09-22T10:58:36.620358+0000, chain.objs.size()=1 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.U-LotuC2VHVLDH7xVX0i8IYl56dSbhZ_0 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6466609433559027992', time=2024-09-22T10:58:36.647319+0000, chain.objs.size()=1 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5Y7CjosjtZ9-lhiyxSxuLShjeGFXDq5_0 2024-09-22T09:16:01.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2518110953101903704', time=2024-09-22T10:58:36.802877+0000, chain.objs.size()=1 2024-09-22T09:16:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BRValt5BXGAiEltF-4j37L0iTyT4sQz_0 2024-09-22T09:16:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8216122267106015467', time=2024-09-22T10:58:36.919152+0000, chain.objs.size()=1 2024-09-22T09:16:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KLiom5f1I1fnUDuxs60p5NHvek0d9E3_0 2024-09-22T09:16:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10245549468803613914', time=2024-09-22T10:58:37.488611+0000, chain.objs.size()=1 2024-09-22T09:16:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.444+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8SS9HISdQ8S3wE3GxOhLiYnPiQlWJPI_0 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3996095036250187825', time=2024-09-22T10:58:37.760825+0000, chain.objs.size()=1 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WoPNQa1-tevyAzP_SYsCPISpaWSQFDb_0 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7694224519920919680', time=2024-09-22T10:58:37.921549+0000, chain.objs.size()=1 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.anMvsJ2bQs3yVCVuUIY9yZX58Z3KLO0_0 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16349479976270858626', time=2024-09-22T10:58:37.966813+0000, chain.objs.size()=1 2024-09-22T09:16:01.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.447+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.eywhRddZLPmCBEjk3pnOW9R1u_cPOht_0 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10755115299864123128', time=2024-09-22T10:58:38.875622+0000, chain.objs.size()=1 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FKt8NWwreZfg75dYamH9kOJlj3iXnt3_0 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6876161212086147492', time=2024-09-22T10:58:39.069383+0000, chain.objs.size()=1 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iske0AlQBZTKm8mjam2ASLtEhWN83rY_0 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11406758487436049221', time=2024-09-22T10:58:39.177064+0000, chain.objs.size()=1 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.m8j2W7idK9Xc2XQmoVjD4Ez6T7exxFl_0 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13179881488577379527', time=2024-09-22T10:58:40.269673+0000, chain.objs.size()=1 2024-09-22T09:16:01.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._zLAFA50BuBe8YaWziXF5e4KPWgvi3a_0 2024-09-22T09:16:01.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.449+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.87309774862739306', time=2024-09-22T10:58:40.433159+0000, chain.objs.size()=1 2024-09-22T09:16:01.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.449+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tnKz2YmxoWoX81FXOblJiX-Z2aeLFN__0 2024-09-22T09:16:01.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.449+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8389297326421671423', time=2024-09-22T10:58:41.053193+0000, chain.objs.size()=1 2024-09-22T09:16:01.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.449+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SiweFMc9YtaNdaaLyZwlxkW8nqWROLW_0 2024-09-22T09:16:01.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4450580171505936642', time=2024-09-22T10:58:41.283868+0000, chain.objs.size()=1 2024-09-22T09:16:01.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qT9T7V9HIwceYyVxTLGr5JQNs74eyyY_0 2024-09-22T09:16:01.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17275607757487670316', time=2024-09-22T10:58:41.611782+0000, chain.objs.size()=1 2024-09-22T09:16:01.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.A145NgJy6gLWD5b38r8pghGI47hWJew_0 2024-09-22T09:16:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.453+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17608522677341615581', time=2024-09-22T10:58:41.633136+0000, chain.objs.size()=1 2024-09-22T09:16:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.453+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CDjoJDiJyCpPBwVa0l7_Xd-ZGT5RH2__0 2024-09-22T09:16:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13014377930097942868', time=2024-09-22T10:58:42.066463+0000, chain.objs.size()=1 2024-09-22T09:16:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JM-1iBpP4martFGWsTBl42BW7qtPYqz_0 2024-09-22T09:16:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9816356137879538115', time=2024-09-22T10:58:42.448493+0000, chain.objs.size()=1 2024-09-22T09:16:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._3EsIkF6K3aRYbB37but_zTm6AviMrf_0 2024-09-22T09:16:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14494207295960610748', time=2024-09-22T10:58:42.551031+0000, chain.objs.size()=1 2024-09-22T09:16:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.454+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XoXpGE66YtsCg4fjc51nZIcpqrfA6Kh_0 2024-09-22T09:16:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14628668065369891993', time=2024-09-22T10:58:43.278698+0000, chain.objs.size()=1 2024-09-22T09:16:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5JguxVm9j2jOA81U6GI70JPmZHxoKKW_0 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15073049885308796230', time=2024-09-22T10:58:43.285280+0000, chain.objs.size()=1 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O1q-c6g7Bqwt19Oh7lu3s7HLOk2sjHD_0 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17741935193797208071', time=2024-09-22T10:58:43.286002+0000, chain.objs.size()=1 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IyPyBi4T-Hfq8urzI95TGIHHeZN7FNS_0 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8293276776468434864', time=2024-09-22T10:58:43.343914+0000, chain.objs.size()=1 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4u_8DaYLNmPg-bFoUcPzura7hayHhQ1_0 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3174647798133897856', time=2024-09-22T10:58:44.286350+0000, chain.objs.size()=1 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.a5E7Z3o6Ny5aXjazRieHUj21VGSGHIf_0 2024-09-22T09:16:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13375222680347685306', time=2024-09-22T10:58:44.316399+0000, chain.objs.size()=1 2024-09-22T09:16:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qzwjKtGf-QPKglxr8ZYe0d4tuOAObGM_0 2024-09-22T09:16:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17552032132456873483', time=2024-09-22T10:58:44.411769+0000, chain.objs.size()=1 2024-09-22T09:16:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z1aMcRpFdMwYXuB0b22M3aE2C4L7nJn_0 2024-09-22T09:16:01.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.460+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15538132626060690249', time=2024-09-22T10:58:44.533736+0000, chain.objs.size()=1 2024-09-22T09:16:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CiiXDE6vRmYsf7yTCp98IJ8N6EbpYzF_0 2024-09-22T09:16:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.460+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13371710187804031421', time=2024-09-22T10:58:44.565606+0000, chain.objs.size()=1 2024-09-22T09:16:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jIrebfAmpuLfZwN1RrCGvbfNtcnnrSl_0 2024-09-22T09:16:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14701403182009802922', time=2024-09-22T10:58:44.706651+0000, chain.objs.size()=1 2024-09-22T09:16:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PRYjRXBFSlQs74vTxrycOQkhLD6wOcW_0 2024-09-22T09:16:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8238027562008109845', time=2024-09-22T10:58:44.731054+0000, chain.objs.size()=1 2024-09-22T09:16:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.obEwdcLU3_dN0VmDhhcGTHeKF96YyeS_0 2024-09-22T09:16:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11540509065560470230', time=2024-09-22T10:58:45.098157+0000, chain.objs.size()=1 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HDQtRoiYyM3SxdUQCBzWPjYkQp6dtC1_0 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6513225393400191346', time=2024-09-22T10:59:22.007001+0000, chain.objs.size()=1 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.462+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ya1F7E3I6ynNtR1KXKk-hbuYdTAD4j__0 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.462+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17821554389429686822', time=2024-09-22T10:59:22.357508+0000, chain.objs.size()=1 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.462+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.s9bcGo-sXE0FfDY9mLYgCZlIiosGQmB_0 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.462+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7194282452293563363', time=2024-09-22T10:59:22.623201+0000, chain.objs.size()=1 2024-09-22T09:16:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.462+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.y3ifJPhQGxDj464wUTyilypPzoONdUO_0 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14140022333313606647', time=2024-09-22T10:59:22.763190+0000, chain.objs.size()=1 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rzcjtkIbKdsss9YqiZyek_WXx_thRv__0 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11129963398053629670', time=2024-09-22T10:59:23.046846+0000, chain.objs.size()=1 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Y20ysqy_3_Cy295KgNft6Rv0DywXf2u_0 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4667792628886192174', time=2024-09-22T10:59:23.852291+0000, chain.objs.size()=1 2024-09-22T09:16:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.463+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mswydSFTZopsfRcD9KfXM47nqh77ux2_0 2024-09-22T09:16:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.465+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10014539020361946469', time=2024-09-22T10:59:24.522681+0000, chain.objs.size()=1 2024-09-22T09:16:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.465+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ApJ7HLyu3eU4Tbi3bMEMwaZ8uur_ODA_0 2024-09-22T09:16:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.465+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5346778294742484063', time=2024-09-22T10:59:25.974874+0000, chain.objs.size()=1 2024-09-22T09:16:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.465+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QEfUR0dBm8MzKWpBOU3mEquZT9SovNo_0 2024-09-22T09:16:01.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5063860009400549991', time=2024-09-22T10:59:27.319739+0000, chain.objs.size()=1 2024-09-22T09:16:01.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HYbzqQYKct2DRQnYg7E4w--dKP5kfFW_0 2024-09-22T09:16:01.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7492712764773590753', time=2024-09-22T10:59:27.416932+0000, chain.objs.size()=1 2024-09-22T09:16:01.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.l5JFconjWuDl-OSld3dYOh_KMLLkVkL_0 2024-09-22T09:16:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.467+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4862721927922078488', time=2024-09-22T10:59:27.650649+0000, chain.objs.size()=1 2024-09-22T09:16:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.467+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fWW0jeW69fkqJ6t08zb1okulrlbIfj7_0 2024-09-22T09:16:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.468+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4735281416951607960', time=2024-09-22T10:59:28.678402+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.468+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.74cFGbNT6G3MD4iDW_Bws8_0ybT6LXO_0 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13494856451640908862', time=2024-09-22T10:59:28.697618+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BHfyQoNzfEtlKs7RfsXP6h5Oi-YfHEQ_0 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15220269730157803890', time=2024-09-22T10:59:28.748976+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9akFX6iBchlqrqW2DTnaKrv7KfnyzW3_0 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14924328405062945196', time=2024-09-22T10:59:29.042402+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mIdlLz3n_dDKXiLNCQA883qBw0pmDn7_0 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8904829139228531934', time=2024-09-22T10:59:29.782066+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KWtVZA5SqzktbEVLht6g_NP_7at0Fxi_0 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11627568800502931775', time=2024-09-22T10:59:29.810605+0000, chain.objs.size()=1 2024-09-22T09:16:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.469+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Md-nUU5uWTnkG7x-zrcB6IYpUFnrXPt_0 2024-09-22T09:16:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.470+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10114821370864431738', time=2024-09-22T10:59:30.040607+0000, chain.objs.size()=1 2024-09-22T09:16:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.470+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FTYKGzB9i15KqC84-eX81LbxrF9VIOg_0 2024-09-22T09:16:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.471+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9368394561387774321', time=2024-09-22T10:59:30.342185+0000, chain.objs.size()=1 2024-09-22T09:16:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.471+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MKwkOJCOn0Ok-xlHbFhruFw0ePjVyCh_0 2024-09-22T09:16:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1147751992660447562', time=2024-09-22T10:59:30.515436+0000, chain.objs.size()=1 2024-09-22T09:16:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Tm-9CMhESGpzgbPfdmPc-hnSnYVCQE2_0 2024-09-22T09:16:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16825639436312480312', time=2024-09-22T10:59:30.523884+0000, chain.objs.size()=1 2024-09-22T09:16:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FU4daqirX9fZgb3WlaDpfo2kqQ1cSYK_0 2024-09-22T09:16:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17986576325834995106', time=2024-09-22T10:59:30.848361+0000, chain.objs.size()=1 2024-09-22T09:16:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.W7uFYvvx9IehNxeIgGYswyQ4-e2dnsu_0 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3150525574089006734', time=2024-09-22T10:59:31.186385+0000, chain.objs.size()=1 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IV53WN4-8Q4LMKowGRuJc_ZIEN-b2a9_0 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5873103593004326071', time=2024-09-22T10:59:31.866976+0000, chain.objs.size()=1 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Se27Kg7ei72q1LHfqjBLHgjnKVLiOM4_0 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14696369290622619898', time=2024-09-22T10:59:32.160957+0000, chain.objs.size()=1 2024-09-22T09:16:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lSGcXGOwsR3VyOSptY5VZ9Ds6F7OvH-_0 2024-09-22T09:16:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.475+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15513496507304863068', time=2024-09-22T10:59:32.262244+0000, chain.objs.size()=1 2024-09-22T09:16:01.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.475+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QBvXdDmGbaHPnT-mhuWTQjVzdlw0nqm_0 2024-09-22T09:16:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46907 2024-09-22T09:16:01.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-22T09:16:01.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13853824076039584071', time=2024-09-22T10:59:32.346951+0000, chain.objs.size()=1 2024-09-22T09:16:01.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mK0rgOKFrRmNvM8YPvyQ8-2d2D5y9BD_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7084844205691635301', time=2024-09-22T10:59:32.404334+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SsX_5ZwMFwdfj3VObHbgzRi79CaHzCe_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4219446520963280587', time=2024-09-22T10:59:32.475050+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0hL53unkgh8TGylteVIOK-eqyXXrWN__0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10339371027685354444', time=2024-09-22T10:59:32.567136+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x4sKieRMV3cySdF_vh7nZR7stMe1_t5_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13865962974823438198', time=2024-09-22T10:59:44.359030+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.347__shadow_.ACU1RxjW4ocGlk7wLf5i4JD8ogGi5PY_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8926638348517857733', time=2024-09-22T11:00:50.646088+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.465__shadow_.HzuONK3alP7GtvFMSeGNazb-FOYmgee_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.452532146803678909', time=2024-09-22T11:01:00.588941+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.485__shadow_.mq-SL2odjL4LHM6FkULsYG3xdfRr1HP_0 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16689399542235304492', time=2024-09-22T11:01:28.228783+0000, chain.objs.size()=1 2024-09-22T09:16:01.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.515__shadow_.w3eHiZaC5QMiFMfCx-EBbFj9nZZXWEF_0 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12189861909539130127', time=2024-09-22T11:04:30.358648+0000, chain.objs.size()=1 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:HlvkzTfe9hNYEHpPKf.4wiuKn50rLwb_.bbMsI6yQDTG2ak7oUbxzTZqZ8QxfKQD_0 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4782133724250143941', time=2024-09-22T11:04:40.559226+0000, chain.objs.size()=1 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.571__shadow:fsH7BLaXW174Cn.H44N77SUGOZjowW2_.sAdg6Z5jx1TGZ0OhSviCVky-6oxcWwK_0 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14935287020417759675', time=2024-09-22T11:04:40.706776+0000, chain.objs.size()=1 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.571__shadow:CxZ7wMHXvnHem-xqRhW5Lj8Ivdf41Xb_.ySUUefdIrlonKZz3P8G-LbcuZZ0TAek_0 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11049470182621732219', time=2024-09-22T11:04:44.827817+0000, chain.objs.size()=1 2024-09-22T09:16:01.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:gpLTKmhdm1rf33gQhn.kGFgNMQqgxZi_.QuIenItzL2eOK5dtqF_SzVcZUdyxkBv_0 2024-09-22T09:16:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.484+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17462679549935600738', time=2024-09-22T11:04:48.967917+0000, chain.objs.size()=1 2024-09-22T09:16:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.576__shadow:38bKhqVcJTZ6Y1gQ817aTjMRo03hdM3_.mexy2oUooX-QGeK-m1WOWpl850ZGfis_0 2024-09-22T09:16:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.485+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9045831053283007819', time=2024-09-22T11:09:39.458654+0000, chain.objs.size()=1 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.645__shadow_.LMhuPmMlWv4xyn8uqENkjwkA5f8iHNh_0 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7433012250029043398', time=2024-09-22T11:10:17.043073+0000, chain.objs.size()=1 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667__shadow_.PARyhh7hjaY2Rum5MQj9FS9HZHFS_6i_0 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6203490930594927712', time=2024-09-22T11:13:14.484115+0000, chain.objs.size()=1 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.774__shadow_.GkmCicRPj1kjJ0a8brqfbyQr_WXf24q_0 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9938034823529239503', time=2024-09-22T11:13:21.072894+0000, chain.objs.size()=1 2024-09-22T09:16:01.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.486+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.776__shadow_.g0z9wmqJI4o6UYNusWTvWtjXADk3W0i_0 2024-09-22T09:16:01.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.490+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:01.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.494+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.494+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46656' 2024-09-22T09:16:01.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10159628259143883432', time=2024-09-22T10:56:11.623799+0000, chain.objs.size()=1 2024-09-22T09:16:01.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.234__shadow_.lu6pgrniZvg3C-jnuYkN9VxVZbj3F4B_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8435780435442294032', time=2024-09-22T10:56:13.500839+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.237__shadow_.R6n-dAmEDBshalG5uHO0juPkbfYMNDQ_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8891446169809665894', time=2024-09-22T10:56:14.410614+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.238__shadow_.tRXxlVeN9E3cKgmUz_yjkLnRTMQOnLh_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.460963334515182380', time=2024-09-22T10:56:19.351299+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.245__shadow_.Gv2QXxTVTQ_UvL6Gy0sludqEy6XtEqr_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13831126454402769953', time=2024-09-22T10:56:23.636945+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.252__shadow_.M76j9Vdd_53jOCRgaRrwYc9z3p_JVVx_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15537122063887468903', time=2024-09-22T10:57:06.031384+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rT6UHRBMfEed6J3rwI45TwieePQiUND_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1007599131565123799', time=2024-09-22T10:57:06.165468+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-cmBHrMOBX1GvMcGNVHYikqwWqZeDEQ_0 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15053235783397941834', time=2024-09-22T10:57:06.284679+0000, chain.objs.size()=1 2024-09-22T09:16:01.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Y--c0yG_33xpc81jt636B-iB6jrUUuX_0 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14992972584879649907', time=2024-09-22T10:57:06.454553+0000, chain.objs.size()=1 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6snxp89NVsb75EICrlMe5PQeRafkQto_0 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12839062066235564918', time=2024-09-22T10:57:06.712023+0000, chain.objs.size()=1 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yTZsFDTokHZDccIbaDyFtzn-Jaqr8EP_0 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6615963404228332010', time=2024-09-22T10:57:06.765451+0000, chain.objs.size()=1 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.00-xcGklrZ2RpOibkVMvLXWrN7UZ56d_0 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.550375119328943429', time=2024-09-22T10:57:07.637899+0000, chain.objs.size()=1 2024-09-22T09:16:01.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.495+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qvnSe92WWg5da7ULK3DpClzemtnJEbI_0 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8026974363562509676', time=2024-09-22T10:57:07.638492+0000, chain.objs.size()=1 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.t_XqNgzbDvW6WbLdlAxl26z_d5B-zuU_0 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18085257888697221538', time=2024-09-22T10:57:07.827740+0000, chain.objs.size()=1 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-20-zZjTTZxXd3ewy8J3mhLQXH0niZh_0 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13258741216379603504', time=2024-09-22T10:57:07.976025+0000, chain.objs.size()=1 2024-09-22T09:16:01.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.499+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Nl0t6t4BOl5D-NZ73jJMeym1h7huVEI_0 2024-09-22T09:16:01.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16726649541777713499', time=2024-09-22T10:57:08.123115+0000, chain.objs.size()=1 2024-09-22T09:16:01.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.f88sOJC7aeHAIvGAKQXcORuo94SWzQN_0 2024-09-22T09:16:01.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8725001239474086290', time=2024-09-22T10:57:08.245053+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xbRH6XeG6YmDCb0EjuEhfRZFK9IJjyi_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14397302454713288790', time=2024-09-22T10:57:08.281078+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AOiXt31mfKW6OBnwRiZJFzaxP_H9z1M_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12220185773440082954', time=2024-09-22T10:57:08.314433+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.K0eeeqgAa0gtSGIJc1StlCpn48MUze2_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18120984477188176945', time=2024-09-22T10:57:08.429530+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Vt7OUBH3JspMevbtues6Y-_wFfkfn24_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8300356879302369332', time=2024-09-22T10:57:09.451842+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.O0Bi3AV4fyJgryYzW8rbdRYVJWmD822_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17819500754073869357', time=2024-09-22T10:57:09.613755+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MDSnkomJniicfFZesW-P5NAIBXoT1KC_0 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11662629384678364680', time=2024-09-22T10:57:10.940772+0000, chain.objs.size()=1 2024-09-22T09:16:01.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IiF34bXUjGlbdwjGH77FefRBTYQWvim_0 2024-09-22T09:16:01.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9460857542762848525', time=2024-09-22T10:57:11.806472+0000, chain.objs.size()=1 2024-09-22T09:16:01.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4JUWZ_s61fnvDFsQLjHHvPo6U3FkJ7V_0 2024-09-22T09:16:01.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17371793291310725859', time=2024-09-22T10:57:12.125014+0000, chain.objs.size()=1 2024-09-22T09:16:01.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k847qlrqnsXNkEkzBm1M0OzhUSt8WRF_0 2024-09-22T09:16:01.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5332771729847041365', time=2024-09-22T10:57:12.191122+0000, chain.objs.size()=1 2024-09-22T09:16:01.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pj9cc9QX8XT02YRc-JSyD-E4AZMo-4S_0 2024-09-22T09:16:01.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2627740262819135176', time=2024-09-22T10:57:12.547663+0000, chain.objs.size()=1 2024-09-22T09:16:01.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.505+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GKu6gkLGlezSqnAuA_O4KU_IyHX6xjY_0 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6304290442156538053', time=2024-09-22T10:57:12.837497+0000, chain.objs.size()=1 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.D_rUpTRo_XkOfFPjYEQ9cSAFy4hwHzQ_0 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16601757005734871477', time=2024-09-22T10:57:13.594419+0000, chain.objs.size()=1 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iPLC8fSu08lx6ZMEbcuAAn3IXdYkaPg_0 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13254726066994900915', time=2024-09-22T10:57:13.977273+0000, chain.objs.size()=1 2024-09-22T09:16:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AGZk8o5zYUQNKQ_hnn2sEvGv_dummLp_0 2024-09-22T09:16:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10944399726453927488', time=2024-09-22T10:57:14.189066+0000, chain.objs.size()=1 2024-09-22T09:16:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LCJwf0vquSAa51e63o1IHX9eXoteTVv_0 2024-09-22T09:16:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6283605251784383302', time=2024-09-22T10:57:14.874175+0000, chain.objs.size()=1 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.n0oRy5SSLyPlAskEk8nlI8LG11xywM2_0 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7056269706397299375', time=2024-09-22T10:57:15.260889+0000, chain.objs.size()=1 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.s3B7x4e9taDFM4Qlo6WlEo3ib-TGs08_0 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4967391097860217927', time=2024-09-22T10:57:15.424228+0000, chain.objs.size()=1 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SddnTr3wznpWspH8oRbixO4_FoIHuCS_0 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8866709427772612945', time=2024-09-22T10:57:15.535817+0000, chain.objs.size()=1 2024-09-22T09:16:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.507+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zsss5htig2Y-PkcQhQRCm4VJserPipF_0 2024-09-22T09:16:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17466773478226937985', time=2024-09-22T10:57:15.700754+0000, chain.objs.size()=1 2024-09-22T09:16:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VVB-yCsPd9cb6g5rqp136XcewpptkLh_0 2024-09-22T09:16:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9574216934064649554', time=2024-09-22T10:57:16.125063+0000, chain.objs.size()=1 2024-09-22T09:16:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6cTRPOo_p8SPUgh3_3B6IsRzrwInfnf_0 2024-09-22T09:16:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1332387336321775127', time=2024-09-22T10:57:16.317653+0000, chain.objs.size()=1 2024-09-22T09:16:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vs8P29MXkrqioy0xWG0NtHZ3fWr2h3e_0 2024-09-22T09:16:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7720015843595496375', time=2024-09-22T10:57:16.318452+0000, chain.objs.size()=1 2024-09-22T09:16:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iq0OPwMoNZFMXxshaK6YtZdtWw-401o_0 2024-09-22T09:16:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9276415502059813655', time=2024-09-22T10:57:16.777533+0000, chain.objs.size()=1 2024-09-22T09:16:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mQfrmUl9SV04K37qftcMgK_PuYV2mDi_0 2024-09-22T09:16:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10706054664162121474', time=2024-09-22T10:57:16.990812+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g2WgvzCroCpw5eZbBBfNJw2HrrziStE_0 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4681988109396502088', time=2024-09-22T10:57:17.590598+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.264__shadow_.nDmbzGPXJZxmAkNZTR9TtmHZxnbvAHz_0 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7055586562880644674', time=2024-09-22T10:57:18.193141+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.265__shadow_.PV2cR6YL4-zRxra_VXWzFDUljbInBlP_0 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7172686017349120804', time=2024-09-22T10:57:19.902273+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.268__shadow_.vEhW4EX7NW03Ew3xzyel-apAGMwUFYH_0 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4925858713976701399', time=2024-09-22T10:57:21.043840+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.270__shadow_.qUiaV6o51OvjhfBuAoIjO01yidgbIf6_0 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11288320596867655452', time=2024-09-22T10:57:23.349595+0000, chain.objs.size()=1 2024-09-22T09:16:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.274__shadow_.gCGKCVpNefmi_WqqiP62IZ-Sy1yVWCY_0 2024-09-22T09:16:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10240046874705044569', time=2024-09-22T10:57:23.350211+0000, chain.objs.size()=1 2024-09-22T09:16:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.274__shadow_.EEc6_RIJMyR1Mt3pQSM8FOtcnnfGBfy_0 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13570800414997888129', time=2024-09-22T10:57:23.914772+0000, chain.objs.size()=1 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.275__shadow_.LRGbGRufcCb8j_5HD-G7udvEVf_Mk9Z_0 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9632703870533133949', time=2024-09-22T10:57:25.783731+0000, chain.objs.size()=1 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.278__shadow_.HELQ8AUhR0gAf7Rk3kdotoh4aEpP9r__0 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18130000933935689189', time=2024-09-22T10:57:25.791170+0000, chain.objs.size()=1 2024-09-22T09:16:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.278__shadow_.P8AiNYEB9zZJswV0ahVpQGwhHWpMoX9_0 2024-09-22T09:16:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.517+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13913462777131092274', time=2024-09-22T10:57:38.228770+0000, chain.objs.size()=1 2024-09-22T09:16:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.ehu2oXoTFfV6iT1eAjGs97IFNfwSiGK_0 2024-09-22T09:16:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3606900945686121958', time=2024-09-22T10:58:34.422997+0000, chain.objs.size()=1 2024-09-22T09:16:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0hEtbhOqKWPjuOmwVkXYhjar-eqjtUc_0 2024-09-22T09:16:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13517585851989392861', time=2024-09-22T10:58:34.467504+0000, chain.objs.size()=1 2024-09-22T09:16:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.s0dl-7ASls0QZljQC4PKP_pMaB6MOT7_0 2024-09-22T09:16:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.519+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1973009734105771485', time=2024-09-22T10:58:34.596976+0000, chain.objs.size()=1 2024-09-22T09:16:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.519+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h7UIJcaeFdPASnG70ArgWARt7IhhQQH_0 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.519+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10454951432675797017', time=2024-09-22T10:58:34.788627+0000, chain.objs.size()=1 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.519+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2zxMLBm6jqs3qWPHgDCoOIu83IJzUnq_0 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5535379758205688580', time=2024-09-22T10:58:35.139916+0000, chain.objs.size()=1 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dbC0kzL5TojHhS9RZSZJ4MzbAeLjkkr_0 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10568914559369985360', time=2024-09-22T10:58:35.428689+0000, chain.objs.size()=1 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QRNlZ-t0BRG6qv6ywnt71bAqJVTJzgJ_0 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11788152403231752937', time=2024-09-22T10:58:35.429484+0000, chain.objs.size()=1 2024-09-22T09:16:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.520+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3QYFI-_8nMIf1OijtvgJbhEn_s484Cx_0 2024-09-22T09:16:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6123026923316674708', time=2024-09-22T10:58:36.512345+0000, chain.objs.size()=1 2024-09-22T09:16:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5mSFHoY6Su-e9y6FczUspsizErVkinr_0 2024-09-22T09:16:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17653905512357575963', time=2024-09-22T10:58:36.513016+0000, chain.objs.size()=1 2024-09-22T09:16:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QuGUyBp8PQGIOYg8aL-OnMG_VzCtfsY_0 2024-09-22T09:16:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14024159250691018425', time=2024-09-22T10:58:36.527738+0000, chain.objs.size()=1 2024-09-22T09:16:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.521+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xOp6Ojk54uyZA3uXQFmi7n49_V_ER9s_0 2024-09-22T09:16:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.522+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13457168806538648014', time=2024-09-22T10:58:36.739850+0000, chain.objs.size()=1 2024-09-22T09:16:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.522+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.phsT2NxVF3oVHrHKkqEVU5iBUTzUVBU_0 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10265668457796298885', time=2024-09-22T10:58:36.879671+0000, chain.objs.size()=1 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FzSM75sw7_VYSA3pPHMqaUP1GA0CKuK_0 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14202585700239737245', time=2024-09-22T10:58:39.064949+0000, chain.objs.size()=1 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.es-tUmLWlwSpyNsbtBt6yXB0UP3qJFL_0 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9044966628515613123', time=2024-09-22T10:58:39.090717+0000, chain.objs.size()=1 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PHH67e4Ab0M6OBg8LLZQUq6gfJyfYu5_0 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11721954346691175042', time=2024-09-22T10:58:39.137973+0000, chain.objs.size()=1 2024-09-22T09:16:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YCuTJI0bS64-xZr7U9L56e_veLK0L87_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3884526020371154638', time=2024-09-22T10:58:39.586189+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AqNdg3Mtjcan-TmudTYep_GRHPMuZCY_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11594944703769126687', time=2024-09-22T10:58:39.656219+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dTz89mkY4DwqJ54bR51u7AjqAjOEVKi_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8307235087028698652', time=2024-09-22T10:58:39.690619+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.huwnJKKlIb1EFNT44nhkMHPgxuHdHpT_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15938557134669439058', time=2024-09-22T10:58:39.843104+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KMnOnSmBAsiRV9lOQ-sZqDWJmejMtTO_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11458452935806286244', time=2024-09-22T10:58:41.174332+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XSDMKyJHE7TbdZGBVrAO98CXAOLR28U_0 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3602187345401518878', time=2024-09-22T10:58:41.720564+0000, chain.objs.size()=1 2024-09-22T09:16:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.526+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yjVv3EHNC9nDLq-NV-NhtA2Hzg0PuAW_0 2024-09-22T09:16:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.527+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9733898805648189698', time=2024-09-22T10:58:41.893640+0000, chain.objs.size()=1 2024-09-22T09:16:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.527+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ug-fTvZpFeFec9H_RAWbaWDVXGMIA6x_0 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14617268353421997702', time=2024-09-22T10:58:42.200310+0000, chain.objs.size()=1 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.evoSbAuJVuoXeHbUzKmFk14fN5e8gZf_0 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13828253601311593895', time=2024-09-22T10:58:42.312297+0000, chain.objs.size()=1 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZNUPaS_iHRZPaDv7uDth4axPmFgr7dU_0 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9209647621306484962', time=2024-09-22T10:58:42.634575+0000, chain.objs.size()=1 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.aFiArznXA20hIwtbxhBH-f39FkNFvY5_0 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14933698441317559337', time=2024-09-22T10:58:42.975917+0000, chain.objs.size()=1 2024-09-22T09:16:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hErtq6ji3m8ovlhU0OhwnnaFP5747pW_0 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9718010094045603850', time=2024-09-22T10:58:43.029273+0000, chain.objs.size()=1 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t26v8JrYayOj9pojavmnf0sf4S6-CoR_0 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4311908834465713908', time=2024-09-22T10:58:43.582730+0000, chain.objs.size()=1 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LO1iVFCyLEE1kzQSbHNePzFzy0z6Q3R_0 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1594402423488050441', time=2024-09-22T10:58:44.663257+0000, chain.objs.size()=1 2024-09-22T09:16:01.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1tEVvjFzCEYl3uJfOurW_zCG9XzsO4H_0 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3459506751717819781', time=2024-09-22T10:59:22.667287+0000, chain.objs.size()=1 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QJmutS84gv5_fcIj7dv9NjEwBwGlIab_0 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2698946378463930152', time=2024-09-22T10:59:23.555845+0000, chain.objs.size()=1 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1U8NgnlLF9MPIjPYBT-dx8lY5u0ejk2_0 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14874612414500167467', time=2024-09-22T10:59:23.556666+0000, chain.objs.size()=1 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Tc-x9MXNf5G9x9qJlZdeCc2vKFDun6z_0 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5663331277646486335', time=2024-09-22T10:59:23.690748+0000, chain.objs.size()=1 2024-09-22T09:16:01.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.535+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Bhyc9w9-cjqPqOrfSmjtnpf-DnxsG59_0 2024-09-22T09:16:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12906303204548723938', time=2024-09-22T10:59:23.888853+0000, chain.objs.size()=1 2024-09-22T09:16:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.faxgr7fXM2_Sks1u9V-o2j19SmHSVpj_0 2024-09-22T09:16:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.735326839199525119', time=2024-09-22T10:59:23.889637+0000, chain.objs.size()=1 2024-09-22T09:16:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.35mszRnB-iog8Q7kMsh9REdwTansOkQ_0 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10668925188787652992', time=2024-09-22T10:59:24.250547+0000, chain.objs.size()=1 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sDDb0Zpch1YIySvcopsY60CGqcVj5BC_0 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9182666893768444728', time=2024-09-22T10:59:24.353437+0000, chain.objs.size()=1 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sS3Fmak49PZGvtNahzph5WiS-qjvPfM_0 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4850503219431389069', time=2024-09-22T10:59:24.582927+0000, chain.objs.size()=1 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UW4GVBfg1x6pSl02J6yqK_0RTU4UACv_0 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11315924934914792321', time=2024-09-22T10:59:25.024531+0000, chain.objs.size()=1 2024-09-22T09:16:01.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7gfcFCmIUv3gaVIc9wJz2Hoen3FQT-W_0 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18348744264931438883', time=2024-09-22T10:59:25.300851+0000, chain.objs.size()=1 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3QQebV6vKI6BeHXiuybfTWeDakUK1oi_0 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13372790726279530578', time=2024-09-22T10:59:25.466650+0000, chain.objs.size()=1 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.M3TXg4uf1jrkk-CWg6vgCg9eS0mgoqH_0 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4237203508567583658', time=2024-09-22T10:59:26.027552+0000, chain.objs.size()=1 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.irV-2FsL-0oXsTG-y9xsUequt-JdU6S_0 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10260372620746360280', time=2024-09-22T10:59:26.628339+0000, chain.objs.size()=1 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nnN-mkasT-crSwtJaiQNcX0fw5cIMDo_0 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4857234420014191468', time=2024-09-22T10:59:27.246723+0000, chain.objs.size()=1 2024-09-22T09:16:01.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._DsEclbBcZ4r0EMeoU3e9Xxj2CcxBBb_0 2024-09-22T09:16:01.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15580053952341268225', time=2024-09-22T10:59:27.546954+0000, chain.objs.size()=1 2024-09-22T09:16:01.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.D8pPJa7OBxTk4ppA2GvECTdsN7qiMyX_0 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13007277256357169113', time=2024-09-22T10:59:27.581660+0000, chain.objs.size()=1 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RU6fu6I94i-_VS-8wIfBrZ2mWHIyZVN_0 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5007077292784159531', time=2024-09-22T10:59:27.634442+0000, chain.objs.size()=1 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2QFLiUNesqdTELh-kUDVPOfCFjV1I36_0 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16969671374721320031', time=2024-09-22T10:59:27.700914+0000, chain.objs.size()=1 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QRuLqN-nam0OLchZIF8ym4WBr-MwKjs_0 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10888103708602736295', time=2024-09-22T10:59:27.701593+0000, chain.objs.size()=1 2024-09-22T09:16:01.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Uan8SPvIykWFPeh_DQkXba22BPKLS3t_0 2024-09-22T09:16:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.551+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46656 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11946396319249365710', time=2024-09-22T10:59:27.731716+0000, chain.objs.size()=1 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sAuyvRz--WtZ7k55UDNMWXfzL4uyVne_0 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4738238559435581074', time=2024-09-22T10:59:28.185784+0000, chain.objs.size()=1 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jM0wNixbyTtRoB4EIMi_vSRwFMGIN9q_0 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13334438998874652663', time=2024-09-22T10:59:28.447983+0000, chain.objs.size()=1 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tINo4HzvIhM34v_YBFtcPjEJDOG44Ue_0 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3058111568609280454', time=2024-09-22T10:59:28.721163+0000, chain.objs.size()=1 2024-09-22T09:16:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SG1FjgrjG3fx1e17M8Zr7Wyvlmn5dgx_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18254543569139705303', time=2024-09-22T10:59:29.953279+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xCCODLadujA0y4fhkj7Q7y93PaDnHZc_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9630131609522882466', time=2024-09-22T10:59:30.058242+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ilq8CxdLMMDnbTP6TxHgWuhdVt28cla_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3961342019237150839', time=2024-09-22T10:59:30.271845+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.W6HAS7xPb9qur19fs1QFdJusZvd4qj4_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7355749014866172258', time=2024-09-22T10:59:30.312603+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RQkeMGfMa2NxryG6gnqU_xLoX0czXtw_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3703414750723423987', time=2024-09-22T10:59:30.396605+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-9SMON2HccsjeHesxIdyC_f5NT5K1HK_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10806389306300654099', time=2024-09-22T10:59:30.513223+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GDUAqlYGS74Ber5HP89V3lrWzDOtZKv_0 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14511320954706657738', time=2024-09-22T10:59:30.916718+0000, chain.objs.size()=1 2024-09-22T09:16:01.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IpmdrRh-cb3H2JcM_bv8uDdopaR_-Bg_0 2024-09-22T09:16:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4608532663122075503', time=2024-09-22T10:59:31.036335+0000, chain.objs.size()=1 2024-09-22T09:16:01.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.556+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Hj-uJFspr3veLnBxAA3n_qmSwGmed6I_0 2024-09-22T09:16:01.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.561+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16866598611522548921', time=2024-09-22T10:59:31.036818+0000, chain.objs.size()=1 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.561+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xrcAhuZUvKf8-mgaqpqfrZXQVH0oZo3_0 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.561+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9767399136254397335', time=2024-09-22T10:59:31.158358+0000, chain.objs.size()=1 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.561+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6qMhm7BnR59xx6pRsMVvR7kLUcX_9uy_0 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7740966761378721246', time=2024-09-22T10:59:31.511108+0000, chain.objs.size()=1 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wBc8R7jvWImGx9jPbH-03OhGmGsOXfa_0 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6425509844031839978', time=2024-09-22T10:59:31.732034+0000, chain.objs.size()=1 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bcTvBlGFIJfZ17CQNyrD42yByFA_5RZ_0 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14127061654826353498', time=2024-09-22T10:59:32.309634+0000, chain.objs.size()=1 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nCMjrgAr1lnT3BHdW3iDydZu5Lz3vUd_0 2024-09-22T09:16:01.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9069526283370310786', time=2024-09-22T10:59:32.482642+0000, chain.objs.size()=1 2024-09-22T09:16:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KfENKkb3x0rIA4uyoeoka5VU-FvI3ec_0 2024-09-22T09:16:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2176398451894133214', time=2024-09-22T10:59:32.970762+0000, chain.objs.size()=1 2024-09-22T09:16:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lfLyhkpIJtDhRyNyRMPYnG4fKcukpWT_0 2024-09-22T09:16:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14128330911346661389', time=2024-09-22T10:59:34.893320+0000, chain.objs.size()=1 2024-09-22T09:16:01.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.562+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.329__shadow_.Bih74-Jk8xVutJkBqApWtrMd-uLIn-E_0 2024-09-22T09:16:01.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.724503941578356140', time=2024-09-22T10:59:37.095291+0000, chain.objs.size()=1 2024-09-22T09:16:01.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.333__shadow_.HyYH38UmWeIhDqkMGukkEEql59Mmgdz_0 2024-09-22T09:16:01.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9421129926850152651', time=2024-09-22T11:00:31.988946+0000, chain.objs.size()=1 2024-09-22T09:16:01.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.437__shadow_.vYPzRFQjOdxAJ5YR9dIsGYW7QaAuWOi_0 2024-09-22T09:16:01.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11716657382203498612', time=2024-09-22T11:04:03.196623+0000, chain.objs.size()=1 2024-09-22T09:16:01.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.564+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.554__shadow_.xolK7wLtQ50iX9hrNJYXd8fFG4itU72_0 2024-09-22T09:16:01.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11534591735436898454', time=2024-09-22T11:04:25.389855+0000, chain.objs.size()=2 2024-09-22T09:16:01.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.564__shadow_.Cg0MvFcmpLABtR69lyQ_F4qiBvlZztp_0 2024-09-22T09:16:01.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.564__shadow_.Cg0MvFcmpLABtR69lyQ_F4qiBvlZztp_1 2024-09-22T09:16:01.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18375223768011232564', time=2024-09-22T11:04:38.136216+0000, chain.objs.size()=1 2024-09-22T09:16:01.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:viItjTZx6bIWBGYhWOkeIQV1rnNfdMw_.7MOpyKQL6AIMV5a1WZDCJd_CcgwId7D_0 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1976134151842530128', time=2024-09-22T11:04:39.272742+0000, chain.objs.size()=1 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:nHCktFRwrWljllRu-3rlWi8PK53uBjz_.Y8T3bPh-JM8U5jssdt3xfDJPlpZRHpn_0 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1009031097752270947', time=2024-09-22T11:04:44.474741+0000, chain.objs.size()=1 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow_.UV5Rspoqmx6r8Q2j3wsj6tmHW6UIaJ5_0 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8829962299821314748', time=2024-09-22T11:04:46.976983+0000, chain.objs.size()=1 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:DIlkiOh5X67xEmNE7pKANQEP-pnTsvF_.LhL3tU7Fb4Z5LiS8xlKOlSHKuxRHDH9_0 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8693109036664702650', time=2024-09-22T11:04:52.140876+0000, chain.objs.size()=1 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:z.WjFlnZO2mUukJkFag3EFMeywivKoI_.ArAGyCjRUWm_yoLgi6R8_aGm6FzRYUn_0 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12491684933430044421', time=2024-09-22T11:04:53.218199+0000, chain.objs.size()=1 2024-09-22T09:16:01.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:oK8.u4C3dOF49xuo1bhzmULGSSVRk9G_.18b6-NdMbtdXleJ3Dg_joKLciUEOOwG_0 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17630912263660901413', time=2024-09-22T11:05:11.391827+0000, chain.objs.size()=1 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:EqCcJJoExGddpF6s5K3QD0F3.7sE9IF_.kOH5YNiAbwepAB1zsvS8Omu0I_q4ido_0 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6324868556008605771', time=2024-09-22T11:05:41.827947+0000, chain.objs.size()=1 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.597__shadow_.6-CKhd_JDnREa5k0SmJqLZ0V9g0NnYS_0 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11351957439140295290', time=2024-09-22T11:09:28.834436+0000, chain.objs.size()=1 2024-09-22T09:16:01.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.630__shadow_.HZM1feAJLc9_fb6kQLHB-Wk8-x5q_IC_0 2024-09-22T09:16:01.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11266492848206918904', time=2024-09-22T11:10:15.185472+0000, chain.objs.size()=1 2024-09-22T09:16:01.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.665__shadow_.5rVw01CA8dRUEiHQrZRW8gblL0g8OAx_0 2024-09-22T09:16:01.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2822716323677402371', time=2024-09-22T11:10:17.034152+0000, chain.objs.size()=1 2024-09-22T09:16:01.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667__shadow_.KGfcRNixwsecfF-aVd_8DiUwaDfccBp_0 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9217263579190987867', time=2024-09-22T11:10:23.543060+0000, chain.objs.size()=1 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.680__shadow_.W3r01pTUoFzrFWg1lq1hGZb9ccsXUQB_0 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.650580849162782917', time=2024-09-22T11:11:33.705435+0000, chain.objs.size()=1 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.746__shadow_.oS1vCoPO4ct89zedd_JVg2pwVsXZ_TC_0 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4823745252115338525', time=2024-09-22T11:11:39.097029+0000, chain.objs.size()=1 2024-09-22T09:16:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.749__shadow_.M6fMFPg9RKbdmUw_uoDjKQye477S55V_0 2024-09-22T09:16:01.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:01.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43882' 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_Xe1GH7jCCXpH1pfTtMvlEAb54YP77iv', time=2024-09-22T10:54:08.154623+0000, chain.objs.size()=2 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.fQAhJVYw83-aysG23iBg4wLg6qSpcln_0 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.fQAhJVYw83-aysG23iBg4wLg6qSpcln_1 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.921523265365252810', time=2024-09-22T10:56:20.559418+0000, chain.objs.size()=1 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.247__shadow_.wBBM1hsddk1P0V4mAaV499AA5Cubmf6_0 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17526097997854655029', time=2024-09-22T10:56:21.205579+0000, chain.objs.size()=1 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.248__shadow_.BA2VQnXd8xG1ke1ML5GkBABaMJ0nPoo_0 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2513657919784782185', time=2024-09-22T10:56:23.023290+0000, chain.objs.size()=1 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.251__shadow_.ZiVcIW2uXYRC0QvLy92d0aFBtt_IREt_0 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.79800307230699765', time=2024-09-22T10:56:29.094287+0000, chain.objs.size()=1 2024-09-22T09:16:01.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.261__shadow_.3bBNs1S-vnHPKaZgFjDQRaIad7Q_uAj_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10306972429236616621', time=2024-09-22T10:56:29.099095+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.261__shadow_.hZArx6uBkv8IqKnQWKwDqjQ80bzsIqI_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8297737031829563016', time=2024-09-22T10:57:06.321217+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CtuBvHGQ7wWEs9iJB3Dm367mQOiBuO5_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2164687721750631839', time=2024-09-22T10:57:07.014086+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FTXeVA-9O6n4Qi-C51cz6hbbz81AdGc_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.285196278660111871', time=2024-09-22T10:57:07.927827+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.urZiYftJ4t_p7l_JeNFqwVxFlvSFz-1_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5019565647874262601', time=2024-09-22T10:57:07.979032+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bcvWGFfiLcB9zkx6Fv-InvbTSXoaXtK_0 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7706610233079354356', time=2024-09-22T10:57:08.183697+0000, chain.objs.size()=1 2024-09-22T09:16:01.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.594+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SwiVXKIKmlhLY0j-6I_uaI38uymRDAP_0 2024-09-22T09:16:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9613695104914709954', time=2024-09-22T10:57:09.161247+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._6D6C7AZlJhJMAIjYS8haMj7tR2rm-r_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14911890048078405678', time=2024-09-22T10:57:09.161996+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Iy1AvHjH8YgLo67XYuIYZXnriftyWKj_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18280865548766253722', time=2024-09-22T10:57:09.430491+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vvLDrs6HKYKkJoa6Az7HnAi7UEmEhsP_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7361166636666817299', time=2024-09-22T10:57:09.431177+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9spnCz_5ZEyzUA1Y057Y9zzjt_-5aTP_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16901466796837379844', time=2024-09-22T10:57:09.970408+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GakEoz09qVV_YKy7IwnqmgHmUCTazfR_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14131402053892198814', time=2024-09-22T10:57:10.642182+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._OJbiiKQlTHkFqfjxHR6MSRnH2i0JuZ_0 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13961333504307023934', time=2024-09-22T10:57:10.678845+0000, chain.objs.size()=1 2024-09-22T09:16:01.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MCV0eR3pfKTR9YE7MYd1zmigLr_F3Ml_0 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13799528759805527539', time=2024-09-22T10:57:10.993825+0000, chain.objs.size()=1 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.NgfIMLhNIv6TzpyJlQXzpHyVAam7xXG_0 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14350553708476598281', time=2024-09-22T10:57:11.349211+0000, chain.objs.size()=1 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5eKNzTB5-CnN2Qwk6CEqrFbrfb0jAlA_0 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16770190680405063439', time=2024-09-22T10:57:11.894775+0000, chain.objs.size()=1 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rkplg6NGNiPNVNhfMHZo2fXAbTJ1Myg_0 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5700585535682293641', time=2024-09-22T10:57:12.397072+0000, chain.objs.size()=1 2024-09-22T09:16:01.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.s61bWnlh4hN1PNAeExDNWHfdSyaHvLQ_0 2024-09-22T09:16:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.604+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5181301977306293709', time=2024-09-22T10:57:12.624806+0000, chain.objs.size()=1 2024-09-22T09:16:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.604+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.T2t46PRB_XIhrpRhcOcqcRXLZo48rz-_0 2024-09-22T09:16:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.604+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4336993196696111679', time=2024-09-22T10:57:12.704595+0000, chain.objs.size()=1 2024-09-22T09:16:01.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.604+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.i_c-MtFRBEwkDrLl4Houvgnz5kdBEu__0 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13632611585530314617', time=2024-09-22T10:57:12.890370+0000, chain.objs.size()=1 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mX_3evbLjwZJlYTQ2OdORtnWo9K3mhm_0 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6713839139020524304', time=2024-09-22T10:57:13.450760+0000, chain.objs.size()=1 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.msumiFANtCsN0VRYyyrSqCj4EU3wvSJ_0 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3959243668626901008', time=2024-09-22T10:57:14.422034+0000, chain.objs.size()=1 2024-09-22T09:16:01.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wu3UcRRYUTGuE7jV1xECmMPmnCC-BJF_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4788078701294547639', time=2024-09-22T10:57:15.347011+0000, chain.objs.size()=1 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k7LrAhlPZ1Zddg8rKe4qeOmvJ6TqE1b_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8129059499892897480', time=2024-09-22T10:57:15.774623+0000, chain.objs.size()=1 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.37Z_5sx0frHmPJFc7_QcwWsLkRr1u4F_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15270817157733517782', time=2024-09-22T10:57:16.347362+0000, chain.objs.size()=1 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qcjh9qfp_YHJSOnia-HALxi3jrw3EA0_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9063297827676075664', time=2024-09-22T10:57:16.396675+0000, chain.objs.size()=1 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.d4QfiylnEY4Bpq8okzpMY5Ocy6i_jjS_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7624354826020617429', time=2024-09-22T10:57:16.429802+0000, chain.objs.size()=1 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2BBQan55FwDFoJ6om2HVJt7oQPq6_Ge_0 2024-09-22T09:16:01.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.499387509995342703', time=2024-09-22T10:57:16.798200+0000, chain.objs.size()=1 2024-09-22T09:16:01.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qxo1Rkq6gNSewh3461ihG6pjQPlCLsl_0 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4787612616386213525', time=2024-09-22T10:57:16.965718+0000, chain.objs.size()=1 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fXQgXkKd5rw4MyV6aJbeBthWjLiV3yi_0 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3468790750514284930', time=2024-09-22T10:57:26.987032+0000, chain.objs.size()=1 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.280__shadow_.MdIuEWE-yfERCCwMQBnQilDyqlicwSS_0 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5134410937689604226', time=2024-09-22T10:57:38.320737+0000, chain.objs.size()=1 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.pYf_MJugFPKblBjT7ZkT5n1TVLIEdgj_0 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13118407879346192815', time=2024-09-22T10:57:39.143113+0000, chain.objs.size()=1 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.295__shadow_.sp7o8Ulfn2F3Mg9H6hCQmA67AZr2YSf_0 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14078253898040211665', time=2024-09-22T10:57:42.350196+0000, chain.objs.size()=1 2024-09-22T09:16:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.300__shadow_.clgUfGHc35Kzw1znHMrZIC5lIzmpwyo_0 2024-09-22T09:16:01.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18344984769033181391', time=2024-09-22T10:57:52.767017+0000, chain.objs.size()=1 2024-09-22T09:16:01.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.316__shadow_.9AqJb8Qg-7XCXjd5vLjGrdM8eJJ5g_H_0 2024-09-22T09:16:01.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8212864375773584709', time=2024-09-22T10:58:34.412745+0000, chain.objs.size()=1 2024-09-22T09:16:01.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IjbQ7OvgaC8HKNCFTudeDcKU_MpRDQc_0 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11207559783551793318', time=2024-09-22T10:58:34.419868+0000, chain.objs.size()=1 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lws6PgA1-sCYeCdDgy4ozcs-ONYvyYs_0 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3300015118609425901', time=2024-09-22T10:58:34.445723+0000, chain.objs.size()=1 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oSf7hHWajCw7znXf11NWXoI1v9cxrAX_0 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17460955349739292091', time=2024-09-22T10:58:34.829175+0000, chain.objs.size()=1 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ceufZRyRH0vLFLZQGypk4Q6doKbHD4M_0 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16293128857853044359', time=2024-09-22T10:58:35.446545+0000, chain.objs.size()=1 2024-09-22T09:16:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._dUfx4t-bYNiZMfXDUQqKyc1iTFViFp_0 2024-09-22T09:16:01.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13342623657829152640', time=2024-09-22T10:58:36.437919+0000, chain.objs.size()=1 2024-09-22T09:16:01.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ywpbyscn9UtoU-hC8Sg2z2niX1EC5gc_0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9334310155755826585', time=2024-09-22T10:58:37.595672+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TJcbPdoNRTtnyFClQnfQsfJXe3Y7gN__0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12678996210833492497', time=2024-09-22T10:58:37.610821+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ea-dKmMTc1CiQ-ro-DQBI6FOGPYioC2_0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11572632592823666930', time=2024-09-22T10:58:37.693543+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bZKTeUDyvRAPJltj4_ICaJmorZNq3-n_0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9593557389718074823', time=2024-09-22T10:58:37.953717+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uis3AOuf598eepfXlQ5S_sUExE6Huf2_0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12020513835618484900', time=2024-09-22T10:58:38.090667+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.U4XmcsNryvDm6NLvPeiF6v6nSbUwYUK_0 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13831774383206996360', time=2024-09-22T10:58:38.374985+0000, chain.objs.size()=1 2024-09-22T09:16:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kI7j7RbHTkHm6lLrCGjzRmktQXv_HWL_0 2024-09-22T09:16:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.615+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4023588155248847018', time=2024-09-22T10:58:38.376017+0000, chain.objs.size()=1 2024-09-22T09:16:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.615+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KEYIYRlXDw68bQb7-4oe0HFvuEQV2w9_0 2024-09-22T09:16:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16400459568985268303', time=2024-09-22T10:58:39.339268+0000, chain.objs.size()=1 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._dTTjWEe83xzKvDXb3Id1MMTHCLVPkS_0 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3775538484721834469', time=2024-09-22T10:58:39.432271+0000, chain.objs.size()=1 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UySUVsQluiYCukEbOxStaC_4xmn7P2f_0 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12930555412501034244', time=2024-09-22T10:58:39.776022+0000, chain.objs.size()=1 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uscLwSs1de2_hJKIBuyJ9GAYoPdc4fP_0 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15169344127752283086', time=2024-09-22T10:58:39.913600+0000, chain.objs.size()=1 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.a9G6un57TYr7empz44pNenPc_DmBUo-_0 2024-09-22T09:16:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8041330676824262925', time=2024-09-22T10:58:43.638793+0000, chain.objs.size()=1 2024-09-22T09:16:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4_xmghcB608gMA_Q6Prjk1jMG6ViV-o_0 2024-09-22T09:16:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15518141956662573387', time=2024-09-22T10:58:44.268499+0000, chain.objs.size()=1 2024-09-22T09:16:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SJnjU6xfIjDW4hDZQ_o2-WQ3zhVILpu_0 2024-09-22T09:16:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13988925047546445023', time=2024-09-22T10:58:44.587583+0000, chain.objs.size()=1 2024-09-22T09:16:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.620+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Xs37aeMjBHLWN0FqKmI1RZERbRp1Cl-_0 2024-09-22T09:16:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17652783426190812615', time=2024-09-22T10:58:44.651316+0000, chain.objs.size()=1 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.401JEwjdQmfs5XIZt7JsJlV-p-zbWVG_0 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16108360171593572312', time=2024-09-22T10:58:44.909145+0000, chain.objs.size()=1 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xRzY9rNMk10ip3yt433QtcBjT8wY7G__0 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3322343685850856997', time=2024-09-22T10:58:44.975101+0000, chain.objs.size()=1 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qkh_Qh6EpieRyKwcWIuNKjp--SIY2ZZ_0 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8746749227820497965', time=2024-09-22T10:59:22.007397+0000, chain.objs.size()=1 2024-09-22T09:16:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.626+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1eXfp7owTiPSuEKBq8LFag_M7wly1Di_0 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9631430492959456751', time=2024-09-22T10:59:22.203135+0000, chain.objs.size()=1 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dSDp6SZZWGgOMzNmGPewNWkhtT2-N2l_0 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6329522208818046550', time=2024-09-22T10:59:22.203822+0000, chain.objs.size()=1 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.omwfZDcOsEtACDkYn-W5bxUiB8aI5jc_0 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9617946107831697786', time=2024-09-22T10:59:22.315041+0000, chain.objs.size()=1 2024-09-22T09:16:01.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eIksIr-QWltAuHzblDyEqYUjOWKjkfu_0 2024-09-22T09:16:01.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9003284230987952280', time=2024-09-22T10:59:22.361516+0000, chain.objs.size()=1 2024-09-22T09:16:01.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ogBcnKrx9ispE641fzi_g83oB_punRd_0 2024-09-22T09:16:01.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11201482361564434492', time=2024-09-22T10:59:23.709335+0000, chain.objs.size()=1 2024-09-22T09:16:01.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.LQScjfRYnpqZu2wucBKgKDdJ0SH0cIc_0 2024-09-22T09:16:01.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11203105899824509217', time=2024-09-22T10:59:23.741364+0000, chain.objs.size()=1 2024-09-22T09:16:01.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x2iA1yW1vAPnIJ7OTcpcsr1cJJip2Aa_0 2024-09-22T09:16:01.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9332434442960040623', time=2024-09-22T10:59:24.153934+0000, chain.objs.size()=1 2024-09-22T09:16:01.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HtGY0eecPHEJefjKUZlUjZKP5eF9NNK_0 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.21711025568631445', time=2024-09-22T10:59:24.247684+0000, chain.objs.size()=1 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HM_a7DSJYzj_yu-ZTS9GfCJKKH7hyQh_0 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16102738021849783551', time=2024-09-22T10:59:24.313844+0000, chain.objs.size()=1 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nimlZZq80RlFjTWP02_Skbyvp1At4Uj_0 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13444530270299365295', time=2024-09-22T10:59:24.387430+0000, chain.objs.size()=1 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.633+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pfiA9NCpBGep9Jp2etDI-mZ8R178o0j_0 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.634+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17134195909219188102', time=2024-09-22T10:59:24.564380+0000, chain.objs.size()=1 2024-09-22T09:16:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.634+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QRn6gD-i9-82f6iWn1Th9eLWkuWZ6o1_0 2024-09-22T09:16:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.635+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5927186826388611616', time=2024-09-22T10:59:25.026070+0000, chain.objs.size()=1 2024-09-22T09:16:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.635+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4EzBzSnejagSjPcOZiCWQKYmPGQDxjQ_0 2024-09-22T09:16:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.635+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15000401059532104553', time=2024-09-22T10:59:25.042004+0000, chain.objs.size()=1 2024-09-22T09:16:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.635+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UM__o09frlOSh_ns2YP3SWBwfGTu1Uu_0 2024-09-22T09:16:01.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7773313695261560795', time=2024-09-22T10:59:25.140793+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6OOPjgyNckt-wDXZZ20Qw2TY7lxEqbA_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17984532682798785450', time=2024-09-22T10:59:25.374470+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QXOh9W9JTtLtf4cQbwHH0FpuJi5EJMy_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8541371486522448182', time=2024-09-22T10:59:25.630103+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xgR3JMrJ-u82mvZEWvFvfakWLv9z6BE_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7123199006169661459', time=2024-09-22T10:59:25.743006+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.m3D0sWc4C35h0MsNVsdlAyYfkYyFMMR_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10368714345026917506', time=2024-09-22T10:59:25.869127+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.j_qPsizGPOuI3QdrexxDwk6ziHLxPxF_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8035023558188434413', time=2024-09-22T10:59:26.041152+0000, chain.objs.size()=1 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.acusuSBDMXHq7DTLk8EHKigDd5ZCkCF_0 2024-09-22T09:16:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16235734535255106340', time=2024-09-22T10:59:26.712381+0000, chain.objs.size()=1 2024-09-22T09:16:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.638+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XyFywnnZNZvK9ss_gvXpATHGQx--LuC_0 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.641+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3991480156561425961', time=2024-09-22T10:59:27.360915+0000, chain.objs.size()=1 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.641+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FgH9C4MOiIYs-R5R-gVBPtpmygQHNbc_0 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.641+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13368829202128623046', time=2024-09-22T10:59:27.490355+0000, chain.objs.size()=1 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.641+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8Z6JLo1xqDn4XzS9sD-9cbW90S3UP_A_0 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.642+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4455552556332628487', time=2024-09-22T10:59:27.607652+0000, chain.objs.size()=1 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.642+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eX7oi87sKTK1-78UDUT1b73uU4p2jlv_0 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.642+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11980320044602419080', time=2024-09-22T10:59:28.196840+0000, chain.objs.size()=1 2024-09-22T09:16:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.642+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lcsK2HjU5fSeKQupVdOGblUKAEhXKQa_0 2024-09-22T09:16:01.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12920180708961925436', time=2024-09-22T10:59:28.319403+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ykPesio_cAZDK2wbbhpB0d2pCHn34-M_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12143551816040003916', time=2024-09-22T10:59:28.452125+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ds15FUvMrcCfWqEUpJHYsXVNb2CwRP3_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.710892409391259598', time=2024-09-22T10:59:28.630851+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._mYXo6E4cRe58yqN728mcJX0TANtY-z_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.510712997885079955', time=2024-09-22T10:59:28.631671+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xDKHfxEMKMJ8pAJqLRS0PlVTquIWyy8_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12885548198936825351', time=2024-09-22T10:59:28.673397+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rA6uSlxOOM-5WXjoQ-uqPlZstUkaDr0_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18264990701426592442', time=2024-09-22T10:59:29.512058+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FNw1E8miR0XNguFIJZzj8F4LDB5RtBx_0 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10874818407504472695', time=2024-09-22T10:59:31.415783+0000, chain.objs.size()=1 2024-09-22T09:16:01.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AXUlamgljEjmITaPFCyuCe5QEySGfZ5_0 2024-09-22T09:16:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7503917670512875249', time=2024-09-22T10:59:31.684141+0000, chain.objs.size()=1 2024-09-22T09:16:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.U7dTeYHIJEOBRjKGRUEuxlBUTYbutqI_0 2024-09-22T09:16:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15463756161939447866', time=2024-09-22T10:59:31.740774+0000, chain.objs.size()=1 2024-09-22T09:16:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.40J7X52-2xsOTKU92fseJmRavSu7qVK_0 2024-09-22T09:16:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3377444967594943046', time=2024-09-22T10:59:31.861529+0000, chain.objs.size()=1 2024-09-22T09:16:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iUiutzcmei_IzxCjmnBXr_ewHAVaU3o_0 2024-09-22T09:16:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.650+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9082616290777361760', time=2024-09-22T10:59:31.873638+0000, chain.objs.size()=1 2024-09-22T09:16:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.650+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5z-hxS2TQ0uKqaxHK_TGN4UXLeVqPyb_0 2024-09-22T09:16:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.650+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7185077253878720596', time=2024-09-22T10:59:32.354229+0000, chain.objs.size()=1 2024-09-22T09:16:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.650+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fjQQ_1dMYqRSDPKGlu5OFwEhT4m17WC_0 2024-09-22T09:16:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16168594694538315330', time=2024-09-22T10:59:32.474363+0000, chain.objs.size()=1 2024-09-22T09:16:01.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.652+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.X-uNl3Y9TpR8EG5wCnBjExkbMN-582E_0 2024-09-22T09:16:01.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.657+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43882 2024-09-22T09:16:01.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-22T09:16:01.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5601175645893898194', time=2024-09-22T10:59:32.630428+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6CkV5Z_E_FCq4VP7Hr8h1agmWpekkqS_0 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14881562353036627893', time=2024-09-22T10:59:32.778452+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.u6p8fieg-mDTPHg9Fr0Da5x8SD44rzl_0 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8679796301248151975', time=2024-09-22T10:59:32.808604+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6u48sxUvfIUJ6cjIUyFBXKBf2un7VqK_0 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2374161268255414791', time=2024-09-22T11:00:07.106718+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.391__shadow_.kFrwA4hTAwFN-XneH6gRNokg7OfJ5OM_0 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6790235376710441248', time=2024-09-22T11:00:52.085156+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.467__shadow_.v1wlTNIem2NcyX5YTx6sS-JcpjLTqsh_0 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8399871801190420556', time=2024-09-22T11:01:34.608165+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.519__multipart_mymultipart.2~6aSXoKzeOfwLvZ0mqUyt14LpRRXftO1.1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13406770374691880521', time=2024-09-22T11:04:16.552906+0000, chain.objs.size()=1 2024-09-22T09:16:01.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.559__shadow_._BhX6cKOxJzNu4ThtYNs-U637Ed6Tbh_0 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13201525205039295787', time=2024-09-22T11:04:36.305920+0000, chain.objs.size()=1 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:dTBHmHzgUWZ901cRT.hRMVuF4w-b5iP_.Yh1cMO4S4PiobFv0DsX1l3qcN23BfZm_0 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15894391674710342540', time=2024-09-22T11:04:45.465534+0000, chain.objs.size()=1 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:.rvvoIbHbeHHYc5gFno69jyWm9jFhyU_.QWBofu_5NkR5y-z1ui0mBACkTXENszt_0 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9436229359021195179', time=2024-09-22T11:05:31.714943+0000, chain.objs.size()=1 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:Ek1a7JFr6ThV6S3t5W31WptIrMCm3Xv_.O94syB9TynRekP0-4I1x4UpjAU15SIn_0 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13607390204180996828', time=2024-09-22T11:05:36.056189+0000, chain.objs.size()=1 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.587__shadow:EnOfE1qvStAoxGRi9Xokry81r6yoGoe_.Ip8IQjJlXlhD4PGNsIHaWhGL2CH7avO_0 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3728274269656392658', time=2024-09-22T11:05:41.823515+0000, chain.objs.size()=1 2024-09-22T09:16:01.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.597__shadow_.dH2NsELiUKTnW6qFN1yYwnHy_rSLcB8_0 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.665+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13522381312843763848', time=2024-09-22T11:09:30.437572+0000, chain.objs.size()=1 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.665+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.633__shadow_.nk1xPzLCtvbyPCPKLd8Y0lu5fXGAIpf_0 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10844979154998262013', time=2024-09-22T11:10:32.546429+0000, chain.objs.size()=1 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.698__shadow:6z-iXuH9SNvv7E43bf8GTfleEaIMFbu_.OzuTEi95LjXyJcLXl1wZ-GJqhTtMFuE_0 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11352801273673346622', time=2024-09-22T11:11:19.780404+0000, chain.objs.size()=10 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.1 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.2 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.3 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.4 2024-09-22T09:16:01.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.5 2024-09-22T09:16:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.6 2024-09-22T09:16:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.7 2024-09-22T09:16:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.8 2024-09-22T09:16:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.9 2024-09-22T09:16:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736__multipart_foo.2~JD-0gZcnz1FC6jXuyAdhjjHhBI3ggsX.10 2024-09-22T09:16:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1652209038255492183', time=2024-09-22T11:12:44.249770+0000, chain.objs.size()=1 2024-09-22T09:16:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.762__shadow_.d_pGwKxA-UWcUgYaq92IaVVU-z3_p7t_0 2024-09-22T09:16:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16703674993514983673', time=2024-09-22T11:13:12.931606+0000, chain.objs.size()=1 2024-09-22T09:16:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.773__shadow_.YIADGJiqFGDqjPM26QH3U_-pQsBt4oK_0 2024-09-22T09:16:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.677+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.680+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:01.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.681+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46445' 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_Fux-uUHdIl2HtWFb0vY9qBnmlPl91rn', time=2024-09-22T10:54:14.519294+0000, chain.objs.size()=1 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.lA-q4HMk1ttnoHZqP9Y3U0Y78vJscSz_0 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18037335353072861253', time=2024-09-22T10:56:12.844074+0000, chain.objs.size()=1 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.236__shadow_.jmgTMNtjbzMRK3fhrZl4foPhkwFMaXt_0 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13330269549434884765', time=2024-09-22T10:56:18.462504+0000, chain.objs.size()=1 2024-09-22T09:16:01.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.244__shadow_.JyJNhXg6tgN4bs6URaqtHrx4vj4elU8_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.648805647978199167', time=2024-09-22T10:56:23.028400+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.251__shadow_.phwvUu4XsB-7fqFVvME3K7wgSpHBKud_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18110777787642026304', time=2024-09-22T10:56:26.157542+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.256__shadow_.9rS74VCwrQpfwyiQ67c1H-I7DFmP72t_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.978196476638527088', time=2024-09-22T10:56:28.457765+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.260__shadow_.vJVBIBYAF31AYVIdSIaNL3kps3di3-g_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8337982768734086453', time=2024-09-22T10:57:06.165477+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.C5fQTwYPO0qc-GvFiwoZDhDWHzqZ46k_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17494983671249409279', time=2024-09-22T10:57:06.495147+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9MHEIuw0bNbM--NH7X8tug1nLVjIpDz_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2118802577788662527', time=2024-09-22T10:57:06.551432+0000, chain.objs.size()=1 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rZ8a-MR_eQz9bZP113__ozOqw_8NG4J_0 2024-09-22T09:16:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17371786833776863688', time=2024-09-22T10:57:06.907608+0000, chain.objs.size()=1 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xRFQLh31x1bM6RIHtQkfS1pxY6cFLEY_0 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8935225781919836931', time=2024-09-22T10:57:06.954879+0000, chain.objs.size()=1 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5Jnal5TDPo7IB1soBmp_Wkj9vHAO3Z3_0 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3122701647678049256', time=2024-09-22T10:57:06.990265+0000, chain.objs.size()=1 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5vcSAVfeiEDvPFxU80QgbD-FYZvX1Xd_0 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.685+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15845296086290967858', time=2024-09-22T10:57:07.511596+0000, chain.objs.size()=1 2024-09-22T09:16:01.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.685+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DOKxVr8dqN6Bu5hhmo3p9tHAcv0tH2E_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16944851812181796684', time=2024-09-22T10:57:07.532088+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.p9eQ9AEue2i4SLTQue28HYR6WkbkZeY_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5080323280454368695', time=2024-09-22T10:57:07.827929+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zd6i2yTAuX5oDYZ6Tu4AiB18_oDRLgf_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3483013777012905475', time=2024-09-22T10:57:08.541051+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MyA-kj4mkj8_yGx6H_KJTzqnZSS89Gw_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11476867080024245457', time=2024-09-22T10:57:09.373033+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.L-zqJMDUYkHo_ToY1LJTD05cEZBuuFx_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1462910609962734263', time=2024-09-22T10:57:09.672060+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.s1BIz1iCbUkkvL6tf1ndLCnP_IYxjnW_0 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9904463103565472787', time=2024-09-22T10:57:10.411086+0000, chain.objs.size()=1 2024-09-22T09:16:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lN0-JJXdp-KWYoM073VkT0d1rTZcNNM_0 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6093716011756964222', time=2024-09-22T10:57:10.595722+0000, chain.objs.size()=1 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gfLo4njSXLBeMmI8EZS6_DI1_Nq4Ytf_0 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8530481610509633780', time=2024-09-22T10:57:10.862677+0000, chain.objs.size()=1 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.19NTBMgfof1BejMzeN-Qs-HTQSowxQd_0 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12621836932160152134', time=2024-09-22T10:57:10.912940+0000, chain.objs.size()=1 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pZ8Ya9Mi5nRKA8mRdwp-DS_vbvPsAnc_0 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2424599742395645728', time=2024-09-22T10:57:11.092081+0000, chain.objs.size()=1 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pq0BVeCyJ2zLb-PtpqDQDAdVk1JBlVn_0 2024-09-22T09:16:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15911954465996164468', time=2024-09-22T10:57:11.128595+0000, chain.objs.size()=1 2024-09-22T09:16:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zWrOaRHC3-XTBhB5W2r9NBvRknYiiT7_0 2024-09-22T09:16:01.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.691+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1941409801813057045', time=2024-09-22T10:57:11.150453+0000, chain.objs.size()=1 2024-09-22T09:16:01.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.691+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.t6Z5Id1Aa7uCSAzOjJtNTLFT4ppB7ab_0 2024-09-22T09:16:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11570554652057722411', time=2024-09-22T10:57:11.433817+0000, chain.objs.size()=1 2024-09-22T09:16:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dFEYARBl2NE-AiU9rXvQxPP-jysKzz8_0 2024-09-22T09:16:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15635692283146191385', time=2024-09-22T10:57:11.896850+0000, chain.objs.size()=1 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KQVywKjw_A3S7-iDPjDHcpc1WbhNlR8_0 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6028980720855047207', time=2024-09-22T10:57:12.046646+0000, chain.objs.size()=1 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fAPLbUTOePjYF1STXOJnDNpsRsn7PtW_0 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9381972785842844833', time=2024-09-22T10:57:12.085931+0000, chain.objs.size()=1 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x_03POaOZoadsebbCBiqvUA5mdz9Ht7_0 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16922401593334704044', time=2024-09-22T10:57:12.124998+0000, chain.objs.size()=1 2024-09-22T09:16:01.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IDobvj-WJ3-T387Jp_AY-I_E23stmxm_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10263788018352015870', time=2024-09-22T10:57:12.191653+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Jk9NUL-BGg3z4w-2K3g-DsECdY_R7LK_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.168717595705116704', time=2024-09-22T10:57:12.814403+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Wmg5lAf735STbqgOaEkxI4p-qkzcPba_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5042730997257240571', time=2024-09-22T10:57:12.837572+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GrgKjlt3ngTlNJ-uE0VGKH4CPx4cfip_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3650447057924521046', time=2024-09-22T10:57:13.485918+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4YmZjm1WoTNWfx4qlhRZVUHo9I_5vgI_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.825919079242378862', time=2024-09-22T10:57:13.544098+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.695+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SM7K12Yrp2pbcZiPo4cS1Y1sON2ap3v_0 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.696+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12863957860746168859', time=2024-09-22T10:57:13.869474+0000, chain.objs.size()=1 2024-09-22T09:16:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.696+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Y4NZwXWz0gIBcBJS8DdiupSDYfZzLzA_0 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.697+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7417577842147306506', time=2024-09-22T10:57:16.243401+0000, chain.objs.size()=1 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.697+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6QPrtlFGr7-37b7X3NMDxFcrCJLiLwP_0 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14717247734560573731', time=2024-09-22T10:57:16.278409+0000, chain.objs.size()=1 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DqiJ676IBAMOfWlhwDsy-lINgBMIVBT_0 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17864191151191214454', time=2024-09-22T10:57:16.376238+0000, chain.objs.size()=1 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jU7Aws4jC9PiB5JLAgP3CIfWMyyys_V_0 2024-09-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1107457131683078556', time=2024-09-22T10:57:16.554862+0000, chain.objs.size()=1 2024-09-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.698+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g8oCmcBrrabmUBgmJLbWXgoMD53r1sD_0 2024-09-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.700+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16011347918816092653', time=2024-09-22T10:57:16.620100+0000, chain.objs.size()=1 2024-09-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.700+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UHNFOrCEbrClyMj_My4g8Vd8PYiWxNN_0 2024-09-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9198729404730209125', time=2024-09-22T10:57:16.717686+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.R_XCxfQ-n4sFr-5Dqnok3Frz1WqOkez_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1013135368405789842', time=2024-09-22T10:57:16.984849+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7_Sg0pS2YMT6iLOPEKljrH-shlahAZm_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8359590149488337953', time=2024-09-22T10:57:20.465058+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.269__shadow_.TnZeIDZ7kcjR5bdoU8dk195TocJTHJh_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15640705674494033265', time=2024-09-22T10:57:21.049729+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.270__shadow_.py6oyQAEd99xxpyZERKSKKNDPAJ3Gfu_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.423513026868019798', time=2024-09-22T10:57:22.228193+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.272__shadow_.2Hf4Zl-Eeoo9_U9yNTIcKMims6nMP_6_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12641154250643679975', time=2024-09-22T10:57:22.787889+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.273__shadow_.L3WByvvKZQ5KXyPZmfDtjQMP0gtelqk_0 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10589076794726809651', time=2024-09-22T10:57:31.429307+0000, chain.objs.size()=1 2024-09-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.287__shadow_.9gqKnw3qWL1PGe8ZlM9NSflbsZ9qaEG_0 2024-09-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.703+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11830427463639465426', time=2024-09-22T10:57:33.896486+0000, chain.objs.size()=1 2024-09-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.703+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.291__shadow_.8ZpPPHhl9OcP3YjyfATgFggrKuf1Ikf_0 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8079689538225628900', time=2024-09-22T10:57:33.897090+0000, chain.objs.size()=1 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.291__shadow_.ae689toEyF6Tqu8EvDw_fWg6VYgeeO9_0 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1024554650525295516', time=2024-09-22T10:57:36.445989+0000, chain.objs.size()=1 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.9uWFiuyjxvwXv8KdIMY4_mxVYaXgt2H_0 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9118359784391883183', time=2024-09-22T10:57:39.139890+0000, chain.objs.size()=1 2024-09-22T09:16:01.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.705+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.295__shadow_.Bi85IEDh1Rs5PGxu8nA0jDlfrxwjWEf_0 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12747068111844445438', time=2024-09-22T10:58:34.547420+0000, chain.objs.size()=1 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2RhahtGarXwnq4p0Boh-si0KfDVfL03_0 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14028352438600793785', time=2024-09-22T10:58:34.548193+0000, chain.objs.size()=1 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.A9QSngLX5ABS38MQcdor-Iejl9NGhR8_0 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17680583652786770785', time=2024-09-22T10:58:34.788575+0000, chain.objs.size()=1 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5-nbxBloGl1nxdMOtCTMySSlt2JFdt6_0 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1809544439173909717', time=2024-09-22T10:58:35.215993+0000, chain.objs.size()=1 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KNg45e-RD9SR2ptjPRGJBcTthKR7qFv_0 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8085649461873202284', time=2024-09-22T10:58:36.139123+0000, chain.objs.size()=1 2024-09-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.sR-U6FZvOLdA4M6jvVvvs7it1Nc6E5z_0 2024-09-22T09:16:01.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.710+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17781443279328578761', time=2024-09-22T10:58:36.357861+0000, chain.objs.size()=1 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.710+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t-V78HIxEF4NQeS16IzuHdMb0XozKXm_0 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.973098220367783554', time=2024-09-22T10:58:36.957989+0000, chain.objs.size()=1 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t4DKpnaYM3lvWLgcgzKEeKWo9uq9W7b_0 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10189598425425209447', time=2024-09-22T10:58:37.733745+0000, chain.objs.size()=1 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1kjbzNi3dWC583ftsIg80Ak9EHSlMp0_0 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17644414533172432962', time=2024-09-22T10:58:38.280018+0000, chain.objs.size()=1 2024-09-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.a3dk5l44oq4YlaspiEEA9yrrAmgPzAJ_0 2024-09-22T09:16:01.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17173635717121156110', time=2024-09-22T10:58:38.281481+0000, chain.objs.size()=1 2024-09-22T09:16:01.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.81ZajYejoBoYwvO7sO8m0GYOoVoeH0x_0 2024-09-22T09:16:01.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8691538902445893129', time=2024-09-22T10:58:38.297473+0000, chain.objs.size()=1 2024-09-22T09:16:01.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lnsZRusLMqc_vIutEG_sOwZXawzVBiD_0 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1023945885686847276', time=2024-09-22T10:58:38.401545+0000, chain.objs.size()=1 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zQHsDM6WlpHBmfxCptM54QhRx_Ss_BA_0 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14561556818621632678', time=2024-09-22T10:58:38.405152+0000, chain.objs.size()=1 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rkhU_UfyK_7JbF5A7qLd-eYRWd-OfMj_0 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3982647691210242204', time=2024-09-22T10:58:39.235441+0000, chain.objs.size()=1 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.S89JMgLA97e3lr9yILmHOtmag9oU4ad_0 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.714+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13393574083192409671', time=2024-09-22T10:58:39.877980+0000, chain.objs.size()=1 2024-09-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.714+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Hlm6OZriIEbb0omcGY3Ge82fPQT94wA_0 2024-09-22T09:16:01.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.715+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6660580633857759750', time=2024-09-22T10:58:40.296112+0000, chain.objs.size()=1 2024-09-22T09:16:01.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.715+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cIfeGHgn-2JeL7Pb9MMVB4flWlCl_jb_0 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.446608988363860885', time=2024-09-22T10:58:40.640355+0000, chain.objs.size()=1 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N3PaTQzEB9REeKKiVqWGebKAE6ocUXM_0 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4682592978669128586', time=2024-09-22T10:58:40.641172+0000, chain.objs.size()=1 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I35voGLjqQ3xB6d4NVVI9JpmeHQSbPZ_0 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7175613955974433571', time=2024-09-22T10:58:40.797842+0000, chain.objs.size()=1 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XJ158bBOGch-24nY0FtXeIIs0_WVvMB_0 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10892310578237897718', time=2024-09-22T10:58:40.936785+0000, chain.objs.size()=1 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wr5qiuT0BcnUyTtKxPuf18DAL42lCp4_0 2024-09-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12001083869998678138', time=2024-09-22T10:58:41.094000+0000, chain.objs.size()=1 2024-09-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BFjU5Z1w9VL8PhQPEFQp7nAIESmHHtV_0 2024-09-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9986634362966442556', time=2024-09-22T10:58:41.206152+0000, chain.objs.size()=1 2024-09-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.717+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dFPQpUygXOt1x8NA3ncIwmSqRoh2trO_0 2024-09-22T09:16:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.719+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4194779501823435189', time=2024-09-22T10:58:41.247004+0000, chain.objs.size()=1 2024-09-22T09:16:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.719+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OH5_QpsGI0x51Z4fuMhz9Jft5-hdxMS_0 2024-09-22T09:16:01.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11246746132712779195', time=2024-09-22T10:58:42.340640+0000, chain.objs.size()=1 2024-09-22T09:16:01.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h_1tsAGQ7yZxkK9lo2EPvE9W5xr4RJa_0 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9197521663360360613', time=2024-09-22T10:58:42.408754+0000, chain.objs.size()=1 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.z7BXfWzY_kl2lovLJwWOyDiuvNT7Gbi_0 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13952704899026343014', time=2024-09-22T10:58:42.671072+0000, chain.objs.size()=1 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.o39KD2zpuclOYO4jTOwYXcm7JmSfjqw_0 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14493984580836113765', time=2024-09-22T10:58:43.319342+0000, chain.objs.size()=1 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BnspPEzi5mePnYqw58YCvV8_2pqLRpp_0 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6723672719690453466', time=2024-09-22T10:58:43.333802+0000, chain.objs.size()=1 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TEuSL62OFeR16UpBYV08llGjl4zHtfm_0 2024-09-22T09:16:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8843641916362773202', time=2024-09-22T10:58:43.561144+0000, chain.objs.size()=1 2024-09-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FiCpWN94dHx29MZozkqf3V_CD6iWz0z_0 2024-09-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5884216323729150095', time=2024-09-22T10:58:43.688915+0000, chain.objs.size()=1 2024-09-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NRUczKkHs5e9wcgITSqIKCHlShBgaMw_0 2024-09-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5986573657889472908', time=2024-09-22T10:58:43.728963+0000, chain.objs.size()=1 2024-09-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.723+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._5CZUs2_r3g7qZmj910KJZ-WnTobLXi_0 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6139941845928299719', time=2024-09-22T10:58:43.751426+0000, chain.objs.size()=1 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RLRm_a0jc1L7yXgY1n7EtZJlQ_L6iqy_0 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.424053844792135118', time=2024-09-22T10:58:44.975309+0000, chain.objs.size()=1 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ur2XwPMg7_eAAyaksBvr04p9Upby8fN_0 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9467412235988417948', time=2024-09-22T10:59:21.997276+0000, chain.objs.size()=1 2024-09-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.725+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Nh3Q3NurseX4iRdWphv5R-FSrlh8hN2_0 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9049573485142682579', time=2024-09-22T10:59:22.826241+0000, chain.objs.size()=1 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.730tMQuGTAEtZgGQZGnLc69GQvwYg1z_0 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8410404575795390141', time=2024-09-22T10:59:23.556091+0000, chain.objs.size()=1 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G5J5UgVnzG4nkaGfIWb5E329D1l-aMC_0 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10007793191006041428', time=2024-09-22T10:59:24.368629+0000, chain.objs.size()=1 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.a7aqFTP_TaxsAJP6qDA8F9SQiO7nivI_0 2024-09-22T09:16:01.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14317928018297440261', time=2024-09-22T10:59:25.025834+0000, chain.objs.size()=1 2024-09-22T09:16:01.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UMjyUQdXA3QYMTl-tEaJCXFV2WiQebd_0 2024-09-22T09:16:01.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1657183611385145635', time=2024-09-22T10:59:25.027301+0000, chain.objs.size()=1 2024-09-22T09:16:01.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZYEcWJq_2XAMJPPMO4QffJGClYhEUm8_0 2024-09-22T09:16:01.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.730+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11100492968012753085', time=2024-09-22T10:59:25.028194+0000, chain.objs.size()=1 2024-09-22T09:16:01.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.730+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MyB9ZLyvuF3M4vadsdv-XTjV-kgEUaB_0 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3366649985332162614', time=2024-09-22T10:59:25.190789+0000, chain.objs.size()=1 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Dp9mkhZKZm7laR4pGHxEYJwvgf-meQb_0 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6427612412332996307', time=2024-09-22T10:59:25.535997+0000, chain.objs.size()=1 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.v68YYYs5YfEfSMcX_vUR6cccWwQSHuV_0 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18116762102599744862', time=2024-09-22T10:59:25.599953+0000, chain.objs.size()=1 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.khnp3Wl4Nvjxa5L3bxqPCfy21J9Kf8b_0 2024-09-22T09:16:01.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15304866155377996454', time=2024-09-22T10:59:26.681431+0000, chain.objs.size()=1 2024-09-22T09:16:01.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oP0GwDwGS04K7HEmq2FX6Z-u6RdRuYd_0 2024-09-22T09:16:01.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2313197527171814763', time=2024-09-22T10:59:26.714036+0000, chain.objs.size()=1 2024-09-22T09:16:01.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CiNdktkM_TNldXKj4swHri5XBqjsKvw_0 2024-09-22T09:16:01.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2713491212200450459', time=2024-09-22T10:59:26.880262+0000, chain.objs.size()=1 2024-09-22T09:16:01.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jx-nshCNXpaZpPBC_Tut_0ix1NBbbVr_0 2024-09-22T09:16:01.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7116990105614551355', time=2024-09-22T10:59:26.933836+0000, chain.objs.size()=1 2024-09-22T09:16:01.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nxvtq7xAeqpvSvZEUPBCvBL2MRBZyPN_0 2024-09-22T09:16:01.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11205420705595435536', time=2024-09-22T10:59:27.757169+0000, chain.objs.size()=1 2024-09-22T09:16:01.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.733+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CRhIFzUptj3knIpjU-iN7oxy-9gozBX_0 2024-09-22T09:16:01.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.739+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46445 2024-09-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9230836907345042346', time=2024-09-22T10:59:28.185784+0000, chain.objs.size()=1 2024-09-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WR_d_Z2mzcCRP_YUnlrT0eknOajDWKS_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1707108635347034284', time=2024-09-22T10:59:28.282411+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.D2zEbw7GLehcmQhj27XuEi9m2L9II5P_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14790228237487263964', time=2024-09-22T10:59:28.429539+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zezful5B2cIaohWUUVXtP2R4_mgeeCa_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4724343640941189393', time=2024-09-22T10:59:28.532131+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VUnVdLZS-u_51bmOqGYvUjynfMicwVr_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3075989271509047561', time=2024-09-22T10:59:28.682655+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5vJNmMgc5yuEBEGjvkzaOX-BZrWl3Pa_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.105057332792536448', time=2024-09-22T10:59:29.150144+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xr_SoMggJFwim_1SBldebP_QwqJPh38_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6609480029492806717', time=2024-09-22T10:59:30.225044+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pou60FvkVYVlhwhQNddIaCFH9OJoPO2_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9829558968517888350', time=2024-09-22T10:59:30.489509+0000, chain.objs.size()=1 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.a6WBGvJYkyWt-3t9Mfo9gFMWmHCf1JZ_0 2024-09-22T09:16:01.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5307343608629113266', time=2024-09-22T10:59:30.490237+0000, chain.objs.size()=1 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sVLGOaSsD5FuOEvzBskq0EVX69R-N6T_0 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17802604669336218062', time=2024-09-22T10:59:30.849107+0000, chain.objs.size()=1 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6uPqsHZIv2T7m21gDvlwSVgnq9Jz1BQ_0 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10455407834504605360', time=2024-09-22T10:59:30.916751+0000, chain.objs.size()=1 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Nt85BvTUwA4JYeNiu5ofgNpXbfo6eHN_0 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17670028602159619037', time=2024-09-22T10:59:31.158433+0000, chain.objs.size()=1 2024-09-22T09:16:01.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jP1lAAfwLJh8W1THkDbG7ornC_nVyn2_0 2024-09-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9567711062114378633', time=2024-09-22T10:59:31.732827+0000, chain.objs.size()=1 2024-09-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tP-3iOimJ0RKbLlcX-mnWonkGm8321b_0 2024-09-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12171872139328206409', time=2024-09-22T10:59:32.570732+0000, chain.objs.size()=1 2024-09-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yKTh95w_MJthwI9oMICNslBmR-hlXZZ_0 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10555277323749983667', time=2024-09-22T10:59:32.669799+0000, chain.objs.size()=1 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6I7-1GHCrliPtFcjb5TdU45cOl0IJ7v_0 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9481111388341497343', time=2024-09-22T10:59:53.550481+0000, chain.objs.size()=1 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.368__shadow_.TF9lViIWSKTW7ChK6-UXEC4r4l7yL1Z_0 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3939026745023540619', time=2024-09-22T11:00:36.128794+0000, chain.objs.size()=1 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.444__shadow_.8_ivoo_Gv5Xo9sxDzD2vkYTxnirgvrb_0 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11920339212328707117', time=2024-09-22T11:00:36.803850+0000, chain.objs.size()=1 2024-09-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.445__shadow_.1-wwG-JlwN-2tUnzHHglGJ8g-1D_dSV_0 2024-09-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3802976741526420871', time=2024-09-22T11:00:43.084191+0000, chain.objs.size()=1 2024-09-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.456__shadow_.As2n9n5ZP5W3TgxMmDXj4kvlhop7Lgx_0 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3724579731351820704', time=2024-09-22T11:00:50.180695+0000, chain.objs.size()=1 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.465__shadow_._VNz_KI4Aey2CZD3OSyoOa0NuNZB9Ot_0 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13358223066760695334', time=2024-09-22T11:00:59.859831+0000, chain.objs.size()=1 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.88ohi4HvCxpxsAkWN0TA1Iud7IcDd-i_0 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1478995998246824469', time=2024-09-22T11:01:23.701046+0000, chain.objs.size()=6 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:01.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.750+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.753+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.753+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.753+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9627352061031388352', time=2024-09-22T11:01:35.230888+0000, chain.objs.size()=1 2024-09-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.519__multipart_mymultipart.2~oRcDR8syexBEa_8I0tCRYucmNydk-OV.1 2024-09-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~6mwlt5rkgK6wu0Um77ndM2FYzTH5xYj', time=2024-09-22T11:03:21.201467+0000, chain.objs.size()=1 2024-09-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.535__multipart_mymultipart.2~6mwlt5rkgK6wu0Um77ndM2FYzTH5xYj.1 2024-09-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9743426320258539588', time=2024-09-22T11:04:09.493305+0000, chain.objs.size()=1 2024-09-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.557__shadow_.afqouvNeI4EK_J2j_VfJl3tpzaFkeVa_0 2024-09-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.913174075663546238', time=2024-09-22T11:04:28.974480+0000, chain.objs.size()=1 2024-09-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:cJSiplMpijMByV2MUUOLDRXrV7bKPoG_.8RNw7JH8KjfI4-_Jk_xoaShHdh0V6mT_0 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16127051019097433734', time=2024-09-22T11:04:34.036200+0000, chain.objs.size()=1 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:ghkoGFY1NXMhObumBGeHDefTLfVpXqT_.SdOzIFKnpeaa-GVXerO8WawG854eORw_0 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.756+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16245862991359754191', time=2024-09-22T11:04:42.221292+0000, chain.objs.size()=1 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.757+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.573__shadow_.Q_hBUprk6hoZAalW9fsYftnxaWtZ3BY_0 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.757+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13089186535735359247', time=2024-09-22T11:05:29.453828+0000, chain.objs.size()=1 2024-09-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.757+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:X8xjQhkUTvCq65PImmSBBU04PwwlVNc_.wcZTGHN5X50c08H76AWAzz1UiiGB7hB_0 2024-09-22T09:16:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15152840318332413101', time=2024-09-22T11:05:35.182509+0000, chain.objs.size()=1 2024-09-22T09:16:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.586__shadow:xzhZZcg3BOCDsAUaRuJgrhS8KgWxBrM_.aFxNi078tON8OiV2I2xCg9yKpk1OiAh_0 2024-09-22T09:16:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9595609659263604180', time=2024-09-22T11:10:18.174409+0000, chain.objs.size()=1 2024-09-22T09:16:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.669__shadow_.PWh2HS864G4Ong1HWL7N0gWQbEHLZGJ_0 2024-09-22T09:16:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4422757703247786751', time=2024-09-22T11:10:23.543162+0000, chain.objs.size()=1 2024-09-22T09:16:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.680__shadow_.vwfh35MgiDzOSz5ueCpFUkCPYAY8BVv_0 2024-09-22T09:16:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4992783849745685116', time=2024-09-22T11:10:31.349693+0000, chain.objs.size()=1 2024-09-22T09:16:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.696__shadow_.eJA8jkStLT2I8-aHyBlk_EFAQYGG7gV_0 2024-09-22T09:16:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2728301921525572143', time=2024-09-22T11:11:04.095239+0000, chain.objs.size()=1 2024-09-22T09:16:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.718__shadow:N7dYoRHXj3waIPOSlKTWqC-bDwkIZVA_.0IYjGQZ4ufpSWR_BSZ9BNMxcFlT7zkg_0 2024-09-22T09:16:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14282330677121265465', time=2024-09-22T11:12:58.379313+0000, chain.objs.size()=1 2024-09-22T09:16:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.761+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.768__shadow_.-63hW3S8Gr_G0E83cm1fqc3MgQPz3s5_0 2024-09-22T09:16:01.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:01.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51577' 2024-09-22T09:16:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9718510055773600845', time=2024-09-22T10:53:59.019620+0000, chain.objs.size()=2 2024-09-22T09:16:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.159__shadow_.IvIBtL36iBCUVbyB-Ck8-sV7YH1H5Mq_0 2024-09-22T09:16:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.159__shadow_.IvIBtL36iBCUVbyB-Ck8-sV7YH1H5Mq_1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607776940345133473', time=2024-09-22T10:54:19.784979+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.167__shadow_.4OJo6C1KaCvvbovtZhrgVmaATnN_s28_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5452706765388848091', time=2024-09-22T10:56:17.550690+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.243__shadow_.Sm8Pe0EsVrO4juMAATplRPbleUDKn3o_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16908433335552341960', time=2024-09-22T10:56:29.703291+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.262__shadow_.sN0XgJdx06L4E3PT6Kyt9T5VsjNNAQk_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14676209945801422151', time=2024-09-22T10:57:06.298001+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qjPt7jZVwOnFI1XKyz3JrQJGV-3FywR_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14878648175594234756', time=2024-09-22T10:57:07.634105+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rSxvbfoGn5X5sNu6XDrpGkh4pgMkwlP_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18189935455362132207', time=2024-09-22T10:57:07.817131+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EebVFW34cbuXBnzuBpODUkWoy8XEa0k_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10268542026005142598', time=2024-09-22T10:57:07.946887+0000, chain.objs.size()=1 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.r7AOPxrcJ1_QVNVba4cr24vqJrc0wkB_0 2024-09-22T09:16:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17497989748826204904', time=2024-09-22T10:57:08.363566+0000, chain.objs.size()=1 2024-09-22T09:16:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vQz4u1uIHdmP9DIVbn_Pgibnr-9c8Gi_0 2024-09-22T09:16:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3688200667798196695', time=2024-09-22T10:57:09.125218+0000, chain.objs.size()=1 2024-09-22T09:16:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u4TBV3OTW_VtmZKsX05FeTI0ppM00q5_0 2024-09-22T09:16:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.310029649627548008', time=2024-09-22T10:57:09.204466+0000, chain.objs.size()=1 2024-09-22T09:16:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8oa0Stxg4R-X8RNhVnM0RZuCbqRVzMI_0 2024-09-22T09:16:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5991595544749106856', time=2024-09-22T10:57:09.979105+0000, chain.objs.size()=1 2024-09-22T09:16:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x6u212Uvbf0lACzENXQm3c9nWhGcjcJ_0 2024-09-22T09:16:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15509850128845466898', time=2024-09-22T10:57:10.022296+0000, chain.objs.size()=1 2024-09-22T09:16:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1FjDEAnGktvF9m6SpUyc24vqEU1qOI5_0 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13618678709965416161', time=2024-09-22T10:57:10.522228+0000, chain.objs.size()=1 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.42ZfzJeeGF2TAm-vRuQgJkVCFAieD9-_0 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5876723965233236411', time=2024-09-22T10:57:11.359383+0000, chain.objs.size()=1 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cTwqJnwdQW7uSCN_Pm3BHo-j63PU885_0 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2447460909076941707', time=2024-09-22T10:57:12.149677+0000, chain.objs.size()=1 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SrTMzHl4D5Hb1Sz0KF-40_3oqB4aSU1_0 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10885009138974757093', time=2024-09-22T10:57:12.356900+0000, chain.objs.size()=1 2024-09-22T09:16:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.V36hPdUjnFXhGLLr2XMB3U72tl93hSB_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8425970829467422162', time=2024-09-22T10:57:12.870395+0000, chain.objs.size()=1 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.adYA5iTqVGsg-Ca2i2DerLgzNF5FcYH_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13360962506386228767', time=2024-09-22T10:57:13.641697+0000, chain.objs.size()=1 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B-VKY6DoZAbfH5wq4bwCQNfa_wGKrIm_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7037419475704817199', time=2024-09-22T10:57:13.704986+0000, chain.objs.size()=1 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-KkLFc2ElJ3Pz1BsrhbtcCVQIs1wnsl_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17929325000997238257', time=2024-09-22T10:57:14.046231+0000, chain.objs.size()=1 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xJhuZr8YSr-YIQrEAxtSwkkmsxVnmPN_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4293579830050714333', time=2024-09-22T10:57:14.782130+0000, chain.objs.size()=1 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.776+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3RnKT9BTCcO0ggoXSdGemZc1ia5G9LN_0 2024-09-22T09:16:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5533054425387524849', time=2024-09-22T10:57:14.807257+0000, chain.objs.size()=1 2024-09-22T09:16:01.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2l1kIet8TGKFbzXIGvWiZBm8QCZkmZI_0 2024-09-22T09:16:01.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15126131745674298816', time=2024-09-22T10:57:14.839918+0000, chain.objs.size()=1 2024-09-22T09:16:01.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TA8L20Xv_t_AW3v5BTY7_1YAyV2HKDx_0 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.781+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17821844720753446963', time=2024-09-22T10:57:15.191863+0000, chain.objs.size()=1 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.781+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.foup_Cw_I7vwhFzFzRmbddAoBlt0RC-_0 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.781+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12605698165604802160', time=2024-09-22T10:57:16.293744+0000, chain.objs.size()=1 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.781+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GpK-tVJJBSAwDa1CpR9fgRyYChsSK8t_0 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15148883946035109122', time=2024-09-22T10:57:16.852533+0000, chain.objs.size()=1 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lL9m3h8sgYMDirSdVFjgJbZ-YI_HJWX_0 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8055854396336329336', time=2024-09-22T10:57:16.949964+0000, chain.objs.size()=1 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._HwJyJ4w6jV0QqFiPd8Bg9hCIdvHBpY_0 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14221532235590034206', time=2024-09-22T10:57:19.322988+0000, chain.objs.size()=1 2024-09-22T09:16:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.267__shadow_.lbJqsieEy6G1gwURNdg3qOH9JrmYRgC_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12410352616556077244', time=2024-09-22T10:57:24.521822+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.276__shadow_.xVOB9c-dsSG5Qmv7tUOwaenxHalh1dd_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.475562753418233847', time=2024-09-22T10:57:27.592274+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.281__shadow_.dn365RgxidEJ-se5ynYeVUqgBNkjxzu_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4730346937655412018', time=2024-09-22T10:57:36.373852+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.eOW5ZUMX7sSPWF7Ff2Qqd_xxtPZtdB4_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18146041875402903654', time=2024-09-22T10:57:38.238008+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.dc3yxP4KARGLnK6hYVvUQfkdY9jd0Na_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15311791663949303552', time=2024-09-22T10:57:38.340538+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.Re7uBwj-gmt6bPgVsLTHQzv5iOeQL6o_0 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11829084912928679839', time=2024-09-22T10:57:41.672356+0000, chain.objs.size()=1 2024-09-22T09:16:01.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.299__shadow_.nFySM92Vp2kGgHV2XV8UoiqhUIE1iza_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17369099301384779718', time=2024-09-22T10:57:44.806289+0000, chain.objs.size()=1 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.304__shadow_.oL69OYKUcrkTbPOqhUVl_wHGMS4DYqG_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16840452763440654203', time=2024-09-22T10:57:47.963316+0000, chain.objs.size()=1 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.308__shadow:2vRmbaRQlSdaR8w4Kt2MBfzyluAzvUt_.0lNaBNnYLd9guEBRPnpoWNiTkncxgV3_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9348470973461307820', time=2024-09-22T10:58:34.419592+0000, chain.objs.size()=1 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kVukOGh3WQF9LtT_zRpWyFLIqOGO5rz_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17968266767036614252', time=2024-09-22T10:58:34.551960+0000, chain.objs.size()=1 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O84CO53shENz5j8gmXAhBZAcFeyK6XS_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.591226148563682605', time=2024-09-22T10:58:35.283644+0000, chain.objs.size()=1 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6NHbocG0m5FZBuWFNTd5GuRmmeslLIP_0 2024-09-22T09:16:01.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1307712438002767672', time=2024-09-22T10:58:35.979913+0000, chain.objs.size()=1 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SmQdsFUdCOaO0hHmIEfN069qlK8DJOb_0 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13042957061550755915', time=2024-09-22T10:58:35.982096+0000, chain.objs.size()=1 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.786+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WtI18SJm7VtBRH69T-QXpn8kzqfaHv9_0 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.787+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.674021636953879473', time=2024-09-22T10:58:36.062390+0000, chain.objs.size()=1 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.787+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BfS81pDPXHGNrUvkLjmBcK4XHind5jn_0 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.787+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.808251588719454566', time=2024-09-22T10:58:36.175169+0000, chain.objs.size()=1 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.787+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cQjC3T6xaAyJek8274mzotWahbQhBWg_0 2024-09-22T09:16:01.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4895565868572291704', time=2024-09-22T10:58:36.399950+0000, chain.objs.size()=1 2024-09-22T09:16:01.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Yvr47t0b_BTBst282BTlDJCrJ5WQT9K_0 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9760262788236098344', time=2024-09-22T10:58:36.679016+0000, chain.objs.size()=1 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HqUvUiE6kP09wcI2MViv0nntiNa7ZsF_0 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12915519488360888285', time=2024-09-22T10:58:37.453471+0000, chain.objs.size()=1 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QHOd1Q1HEsKaL3cbrwbAQo8pyOnstz2_0 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14793612242931297600', time=2024-09-22T10:58:37.736282+0000, chain.objs.size()=1 2024-09-22T09:16:01.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nGGTRg9h5AE2yQRCLcLhfEHnWQ1nO7R_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16968319866786144981', time=2024-09-22T10:58:37.924275+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NdzXtlr1h4AzoR5LVqh71uouxo5u6JJ_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3621019721775234812', time=2024-09-22T10:58:38.886011+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3SqxdbuefPjxu_Co-cBiYbfsIxL3mbx_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11975637991099487376', time=2024-09-22T10:58:40.265519+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NCEvaXTkb14saHPrAuRMMhjIPIooEIf_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1706206895611768260', time=2024-09-22T10:58:40.430016+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oRiADhc1jKDoakd7NiaEaj4KX9GhkIK_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2331347352739001024', time=2024-09-22T10:58:40.595014+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cHGPgGQdSK3_oIPiyE1VJGnvIRdjsfP_0 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3170073982948815064', time=2024-09-22T10:58:41.223628+0000, chain.objs.size()=1 2024-09-22T09:16:01.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0VNASTo6_S4QqvNKOoMeIA8jv57eOSx_0 2024-09-22T09:16:01.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17116880174975497912', time=2024-09-22T10:58:41.934164+0000, chain.objs.size()=1 2024-09-22T09:16:01.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-Fod2p58nS1h9-0rathmerzl2C60sgO_0 2024-09-22T09:16:01.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11127511109303685485', time=2024-09-22T10:58:42.066566+0000, chain.objs.size()=1 2024-09-22T09:16:01.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.eFxh4v6i7F56L9MvZ66Kgnc2vb08LQj_0 2024-09-22T09:16:01.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.796+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1896168970264551288', time=2024-09-22T10:58:42.343471+0000, chain.objs.size()=1 2024-09-22T09:16:01.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.796+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SYtWiYcONp_EPZpiqORVLx63Ny18hSC_0 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14970219340833636249', time=2024-09-22T10:58:42.462795+0000, chain.objs.size()=1 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Fd7gERhgD3VTeqEDpoLLKm26KMdk0W8_0 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2514108510477364710', time=2024-09-22T10:58:43.509870+0000, chain.objs.size()=1 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ok2n-wusSS2zxBbKvFA3PSt-oYDuU6p_0 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6556944370835071928', time=2024-09-22T10:58:43.941587+0000, chain.objs.size()=1 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.c5tmUNTqmHDy4ChaVbrN-eOei35IQ_q_0 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15481447234164846555', time=2024-09-22T10:58:43.992468+0000, chain.objs.size()=1 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FlzWxW2ljWrBLnfKF9fuSOnWCRnmApc_0 2024-09-22T09:16:01.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12405308082156665958', time=2024-09-22T10:59:22.458224+0000, chain.objs.size()=1 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FFlSdpYaJf74tKtFE8AMMSIWtBb7cSz_0 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3137767063441916264', time=2024-09-22T10:59:22.956080+0000, chain.objs.size()=1 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.LUa8O34wl-fwhS46ospJcFiwL2P0LuI_0 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.799+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18347237643038543643', time=2024-09-22T10:59:23.559970+0000, chain.objs.size()=1 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.799+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EOq3LkOUTzYQ2Yacicx2KSe-cwXia2C_0 2024-09-22T09:16:01.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.799+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15392510970376426908', time=2024-09-22T10:59:24.008004+0000, chain.objs.size()=1 2024-09-22T09:16:01.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.799+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XtfLZ96junwURaf1kShC_leGxTWGvAH_0 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9274384784828813800', time=2024-09-22T10:59:24.281963+0000, chain.objs.size()=1 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xH0RfBaf9KZ7M5DGSNPo0ncqTCHVrcE_0 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18216231662835727367', time=2024-09-22T10:59:24.458428+0000, chain.objs.size()=1 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Z_-8GqjdGYqnJ43OujC9e5rT-f06e5U_0 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.91887322403609412', time=2024-09-22T10:59:25.190077+0000, chain.objs.size()=1 2024-09-22T09:16:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.801+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WzBL9NQQF7CT3f3ojWVbilTkeGHS8xW_0 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.803+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9901752805521086564', time=2024-09-22T10:59:25.191360+0000, chain.objs.size()=1 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.803+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kX2Ua6Ek5doR1qIws-DDNOm6e_ZuQQk_0 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11651451215319720034', time=2024-09-22T10:59:25.758484+0000, chain.objs.size()=1 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JDzK8C75mXk3vtarHIjkcz4k3UkV-Yp_0 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3080195033033975236', time=2024-09-22T10:59:25.771929+0000, chain.objs.size()=1 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qEZvbbUW_F5Si-cIgSURxhiejfcdO3u_0 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.991153250969973489', time=2024-09-22T10:59:25.965371+0000, chain.objs.size()=1 2024-09-22T09:16:01.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.plT7oZVjuROa_6WgoQn7Oosg6ZawpI4_0 2024-09-22T09:16:01.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17584063269955581217', time=2024-09-22T10:59:26.001193+0000, chain.objs.size()=1 2024-09-22T09:16:01.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.804+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uIq4J3gxrchoyA9sPtiltnqQYO_vnM3_0 2024-09-22T09:16:01.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.805+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16511650976974614170', time=2024-09-22T10:59:26.005688+0000, chain.objs.size()=1 2024-09-22T09:16:01.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.805+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.R5YR49kcsoSSTTp1jmJGdTWeS1xOXfh_0 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4855465599053470387', time=2024-09-22T10:59:26.022127+0000, chain.objs.size()=1 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nR7ArkaRr8XLLfUdrq8tnt_VhZsJmDV_0 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10447580955568093348', time=2024-09-22T10:59:26.426009+0000, chain.objs.size()=1 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JGEGwM4wwofx36GAvAVJT7BaJxQDwLy_0 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.24865216251670480', time=2024-09-22T10:59:26.594865+0000, chain.objs.size()=1 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FHm0sMbvQRIjyY5QQkLCEdTc77pnw_n_0 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5226024694305473262', time=2024-09-22T10:59:26.641315+0000, chain.objs.size()=1 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZBlw4Z7dc_hIcoUDlqY3STf1ZxbhkE5_0 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3996344094762741759', time=2024-09-22T10:59:27.381762+0000, chain.objs.size()=1 2024-09-22T09:16:01.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0L2UeAAn6-tpRQ7fktLEGVS6svsk7zK_0 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15206668471612874500', time=2024-09-22T10:59:27.459255+0000, chain.objs.size()=1 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4l_QDLuoocfWFUZxaC7hKr3r961oH10_0 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4103420715788850390', time=2024-09-22T10:59:27.460399+0000, chain.objs.size()=1 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nM9M0nOPfyJaWbw7mA_NiX5Tt3li6bw_0 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6078446624252554015', time=2024-09-22T10:59:27.755960+0000, chain.objs.size()=1 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.810+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wJ10jI6kjqNGXThs9EzWxfpH3ym2dTS_0 2024-09-22T09:16:01.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.417221299367937937', time=2024-09-22T10:59:27.778491+0000, chain.objs.size()=1 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sUloM9ewdYpc1D4-gbevAXf0zochzMQ_0 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12312548754309062760', time=2024-09-22T10:59:28.142077+0000, chain.objs.size()=1 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ju4OETAMVZtxq3-IagQQpcRG-cd9t3W_0 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4908154741716098345', time=2024-09-22T10:59:28.200489+0000, chain.objs.size()=1 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f97pnSd0i818LNFf-bW0stFVvLAKjuu_0 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9362917818899658190', time=2024-09-22T10:59:28.337950+0000, chain.objs.size()=1 2024-09-22T09:16:01.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hsENusMlGnHqK5pkCVReMBrTMOx-fBm_0 2024-09-22T09:16:01.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10582117937620951110', time=2024-09-22T10:59:28.426917+0000, chain.objs.size()=1 2024-09-22T09:16:01.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OVC_dmXOa2L3AX9XVbPjPHJsg5wue-p_0 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11785389323921232880', time=2024-09-22T10:59:28.870052+0000, chain.objs.size()=1 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FvhamexeN74y6g7VY0wNpuJ2S3zB2EU_0 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12476270372747494155', time=2024-09-22T10:59:29.517290+0000, chain.objs.size()=1 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5mhNQ0TENtKs5zsGDIydEfq2pfKat0g_0 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13750426975847345952', time=2024-09-22T10:59:30.455405+0000, chain.objs.size()=1 2024-09-22T09:16:01.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.813+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.265jtfk3AdzbIb_iKybQ5Y1PnIi_-ul_0 2024-09-22T09:16:01.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.816+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1975557204370793536', time=2024-09-22T10:59:30.489405+0000, chain.objs.size()=1 2024-09-22T09:16:01.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.816+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rChJx5cwA16INRkgx0CDPUKBzsWJQlY_0 2024-09-22T09:16:01.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.816+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10203731353542307571', time=2024-09-22T10:59:31.412761+0000, chain.objs.size()=1 2024-09-22T09:16:01.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.816+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2ttAcferOHlIXAluaV8BrDL0QUjRMW7_0 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9146610726235450152', time=2024-09-22T10:59:41.142377+0000, chain.objs.size()=1 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.341__shadow_.IOxA72Dg2tB4055m3qPX9WfTJRDTu-J_0 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15190265223196717146', time=2024-09-22T10:59:58.636788+0000, chain.objs.size()=1 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.376__shadow_.7xyiK689eHkn-hNVXo7R2gF_7XfhwSJ_0 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2695480059327516220', time=2024-09-22T11:00:18.489039+0000, chain.objs.size()=1 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.410__shadow_.D7GMnxXu7uLXSJpuYMeAQv3HrDcGUEQ_0 2024-09-22T09:16:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11557255456631527901', time=2024-09-22T11:00:30.126761+0000, chain.objs.size()=1 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.818+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.434__shadow_.-vENxXW3eSCQtERUHz-O4zbPRRUqYxP_0 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8855013448809706421', time=2024-09-22T11:00:57.777394+0000, chain.objs.size()=1 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.482__shadow_.uT3Sd7k5Fj1GeZG3o_p9ThCnQe9atEV_0 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13572705376749843951', time=2024-09-22T11:01:27.387934+0000, chain.objs.size()=1 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.513__shadow_.NME0njpILUmx7IflbTgOPMtL-K0wE2t_0 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3239870906648750151', time=2024-09-22T11:05:04.176050+0000, chain.objs.size()=1 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:5dIoc12ltB2D3m02zT3HreuuVMpnIWk_.B8IbEIMOqK9oB817sq_CjILFYfG9U68_0 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7959786386623064671', time=2024-09-22T11:10:13.185732+0000, chain.objs.size()=6 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.1 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.2 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.3 2024-09-22T09:16:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.820+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.4 2024-09-22T09:16:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.823+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.5 2024-09-22T09:16:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.824+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.662__multipart_baz.2~WcD4mxebe4dG3hXaptYi2X-YvoyvCfc.6 2024-09-22T09:16:01.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.831+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/51577 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12246304412691221356', time=2024-09-22T11:10:17.281072+0000, chain.objs.size()=1 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667__shadow_.ziIKqc_EGWx8buK6aTUbDfxYSKSwCxv_0 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8661006767515784', time=2024-09-22T11:10:19.997770+0000, chain.objs.size()=1 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.673__shadow_.plqDTjgbDnl0MXRgAsSHwggDg5H3khz_0 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13012200701796037541', time=2024-09-22T11:12:49.789636+0000, chain.objs.size()=1 2024-09-22T09:16:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.834+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.765__shadow_.UAHRbDhklyx2L82nnwLNk8tYjQ0hVQd_0 2024-09-22T09:16:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.840+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54826' 2024-09-22T09:16:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7483759253411873198', time=2024-09-22T10:54:19.418839+0000, chain.objs.size()=1 2024-09-22T09:16:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.167__shadow_.Lu0g0da1GX0qS3CPKwqJrtWo0aAuVCj_0 2024-09-22T09:16:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8835891711782435102', time=2024-09-22T10:54:50.938923+0000, chain.objs.size()=1 2024-09-22T09:16:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.205__shadow_.s9cC4WTOxnqv-OM0G4UxM5W-dFdlsni_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14178763396108128909', time=2024-09-22T10:56:16.908852+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.242__shadow_.TOjiVrNcGL0TBMg7KqM7uBrWEvq1Sf3_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9756530602101101653', time=2024-09-22T10:56:18.453126+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.244__shadow_.l_Q11otRwGavncjvNkZdSVPUzd5-aag_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15895492391100098085', time=2024-09-22T10:56:24.241711+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.253__shadow_.Ze4uJ-_9QwcU4Wgu78_fFKII7riLwJX_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15485806267092122552', time=2024-09-22T10:56:27.327317+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.258__shadow_.LjWLLT_0EHRYf_frG0EV5AZf_iVUBQa_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15413676560894952277', time=2024-09-22T10:56:29.090761+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.261__shadow_.0QIp3mB5auuhNNquSf-jXicPJJC-HCW_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8424885622325938183', time=2024-09-22T10:57:06.014146+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.185cSKdVjs2vfOXij-7IMuZTaoWwrzO_0 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17910638128516732144', time=2024-09-22T10:57:06.297682+0000, chain.objs.size()=1 2024-09-22T09:16:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BD0cOT0rJPs7IOJUqtk2-Ifaoy26WaY_0 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18253202027754132626', time=2024-09-22T10:57:06.493807+0000, chain.objs.size()=1 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.imMwMtgbbYoXIlAAOzULigGaVi3Jkxr_0 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2567594897650716165', time=2024-09-22T10:57:07.861645+0000, chain.objs.size()=1 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mGG3rcUvO4Ai1zfi7p6Le3REFmBIGRx_0 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4670886090403920822', time=2024-09-22T10:57:08.117179+0000, chain.objs.size()=1 2024-09-22T09:16:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.842+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wE9Nwy0AJiRuYiFkZzA0F4SfHcUEhfk_0 2024-09-22T09:16:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6615897475964424910', time=2024-09-22T10:57:09.120442+0000, chain.objs.size()=1 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Je0xTk-wnjynsOQrLR-skNCS3e3hHo6_0 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10224533597721670799', time=2024-09-22T10:57:09.298941+0000, chain.objs.size()=1 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jAPxzT7ToFfSQSgpO-WyIwN1-XRz_jF_0 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13590470413185844866', time=2024-09-22T10:57:09.299669+0000, chain.objs.size()=1 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-3En5vk0oLhnqG9MquvxEqZL7QXaLYi_0 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4217480269548396145', time=2024-09-22T10:57:09.526285+0000, chain.objs.size()=1 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.q20OBnFbzzjsQZPTtaWgGREQA7NVRDf_0 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13156053094134486483', time=2024-09-22T10:57:09.837242+0000, chain.objs.size()=1 2024-09-22T09:16:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4jIkvbzgWTmVTKmoxdUn0l0pC1wsrob_0 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17059288363940884301', time=2024-09-22T10:57:10.455610+0000, chain.objs.size()=1 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2yqhA0m8eB5oF81VbChVb5D9IdfEqi__0 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.576265474986927025', time=2024-09-22T10:57:10.676444+0000, chain.objs.size()=1 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9Yzrpv2b6igot8kXVTrcmUf859T6Xvu_0 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18388231337170876968', time=2024-09-22T10:57:10.763798+0000, chain.objs.size()=1 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.APyeKEdEs0pXlq4Q2-eA_N-tGX_w9vp_0 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3160164962735472465', time=2024-09-22T10:57:10.995239+0000, chain.objs.size()=1 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Q8Dwe8hquN7NJMBj8GhqJWLOH8tnj_6_0 2024-09-22T09:16:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4719692019667177152', time=2024-09-22T10:57:11.040085+0000, chain.objs.size()=1 2024-09-22T09:16:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.m7qn4TPEjm2Vk2fjAiLnT4lwj0IuWqq_0 2024-09-22T09:16:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17042460947677734940', time=2024-09-22T10:57:11.420524+0000, chain.objs.size()=1 2024-09-22T09:16:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ajyz7BF4ioMy021DU3S578tO4QTAGY6_0 2024-09-22T09:16:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.850+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15884880622838465348', time=2024-09-22T10:57:11.886244+0000, chain.objs.size()=1 2024-09-22T09:16:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.850+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xyDpDU0o8ybQ9mCEPZuVFWqZAlFk8ml_0 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6541103533460084809', time=2024-09-22T10:57:12.196642+0000, chain.objs.size()=1 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rDIfP9S1u1H9B6w0Fvn3PXPy1uUSwjj_0 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6087296482209906619', time=2024-09-22T10:57:12.347090+0000, chain.objs.size()=1 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yaRfkk_XEGBIOd616-AkwZbzBYG42JD_0 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17286441375431117477', time=2024-09-22T10:57:12.530873+0000, chain.objs.size()=1 2024-09-22T09:16:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.i37SGCBI2sQ2tGLpaPZz1Fmg0Ux3thJ_0 2024-09-22T09:16:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2209599612064716162', time=2024-09-22T10:57:12.783127+0000, chain.objs.size()=1 2024-09-22T09:16:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4TpGZ86JRj8ng7Dm66UCmsLMqEHIXMy_0 2024-09-22T09:16:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.438827569864455236', time=2024-09-22T10:57:13.217043+0000, chain.objs.size()=1 2024-09-22T09:16:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5Dn5cH5k6Qc9IT5d_73hbedLUU48kp9_0 2024-09-22T09:16:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2724695402822067300', time=2024-09-22T10:57:13.227596+0000, chain.objs.size()=1 2024-09-22T09:16:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pv-h5emUPNJQSuDjOxKQqxHpC3d-iv2_0 2024-09-22T09:16:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.853+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10262542113751633901', time=2024-09-22T10:57:13.866229+0000, chain.objs.size()=1 2024-09-22T09:16:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.853+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bHXmP9ZDptF58EsAMohoCd5zFnlN7sQ_0 2024-09-22T09:16:01.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2951442010589055685', time=2024-09-22T10:57:13.976329+0000, chain.objs.size()=1 2024-09-22T09:16:01.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2aS5k51nG5quZZTB1zVSovM5Z-3i1Yh_0 2024-09-22T09:16:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.855+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1695602675814227818', time=2024-09-22T10:57:14.253899+0000, chain.objs.size()=1 2024-09-22T09:16:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.855+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.P3SG_b28p8SNSOqiygnVt4rACiygQdk_0 2024-09-22T09:16:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.856+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5719387887852159376', time=2024-09-22T10:57:14.254640+0000, chain.objs.size()=1 2024-09-22T09:16:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.856+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mWNzug2iJFJ9M1pYLlUBbPP_YFaYR1z_0 2024-09-22T09:16:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.856+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.450384135245436647', time=2024-09-22T10:57:14.399018+0000, chain.objs.size()=1 2024-09-22T09:16:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.856+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2pvXAuprDlY7Ba3MXS3ApmASe9Os0E1_0 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9668551133517061591', time=2024-09-22T10:57:14.767447+0000, chain.objs.size()=1 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZZk6roSwDlhDUhyVlpByAZkpJEa688j_0 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2282357189411865018', time=2024-09-22T10:57:14.788753+0000, chain.objs.size()=1 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Z80ZFi4WX01sDNvW3JSeFMRIkUQWAGQ_0 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17855255910763351023', time=2024-09-22T10:57:14.804961+0000, chain.objs.size()=1 2024-09-22T09:16:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zFV-kj5UyTpDXTTBpCzqUZzjCkzfM6c_0 2024-09-22T09:16:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1519610680024191018', time=2024-09-22T10:57:14.937318+0000, chain.objs.size()=1 2024-09-22T09:16:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2CPdiIOxEEBXoCv6Z9VcBzQYZNDssm__0 2024-09-22T09:16:01.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4154236557298701105', time=2024-09-22T10:57:15.167981+0000, chain.objs.size()=1 2024-09-22T09:16:01.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MYMOj78bDjuUnsWpA3ZEj7CFQ2Lr6BW_0 2024-09-22T09:16:01.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10498546559464552183', time=2024-09-22T10:57:15.609312+0000, chain.objs.size()=1 2024-09-22T09:16:01.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3FgfwS2S0R87RBS5-QaQDa-EJt-c5kF_0 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7149093628911028360', time=2024-09-22T10:57:15.622363+0000, chain.objs.size()=1 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.859+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rsiRAqdlFXhlzyPZO385OgcuvSxjm4o_0 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1101342072602763646', time=2024-09-22T10:57:15.871916+0000, chain.objs.size()=1 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VnOPqrSRrjwUYKPSBPQIJKN__2DUdAx_0 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3902061297881172730', time=2024-09-22T10:57:16.156274+0000, chain.objs.size()=1 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1fgziFXOlOb4y1FLaJNV1JFcJ52XG3G_0 2024-09-22T09:16:01.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.845525975277007841', time=2024-09-22T10:57:16.509608+0000, chain.objs.size()=1 2024-09-22T09:16:01.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6QgfiXv_0i3GVhgUHe1kE2N9iTpWF33_0 2024-09-22T09:16:01.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5698708925231318325', time=2024-09-22T10:57:16.539845+0000, chain.objs.size()=1 2024-09-22T09:16:01.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0FxK4owFWbMD0GE-jasWwQsuakh9kvB_0 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5414380876709420672', time=2024-09-22T10:57:16.686236+0000, chain.objs.size()=1 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wGb1Dn-CIzgFLeTyR8cs4ndIgmD-fRn_0 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10239759753894461663', time=2024-09-22T10:57:16.729550+0000, chain.objs.size()=1 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZZC3OpsCXbeMj2Y26Qcm6FHNK6mODPv_0 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5981480151889731410', time=2024-09-22T10:57:16.775132+0000, chain.objs.size()=1 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aodMQ_OupdvlshoQ2gR_JKr_MZ82BBG_0 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15682303748268906610', time=2024-09-22T10:57:16.913358+0000, chain.objs.size()=1 2024-09-22T09:16:01.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5gRHMzHAE7RQEcua-qvRAEX-2o6Ut8d_0 2024-09-22T09:16:01.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7741661767687878319', time=2024-09-22T10:57:18.187195+0000, chain.objs.size()=1 2024-09-22T09:16:01.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.265__shadow_.hWM9QDIH_hkocgSzizv15Bqx1aAKl7Q_0 2024-09-22T09:16:01.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.865+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17037086623781223285', time=2024-09-22T10:57:18.754716+0000, chain.objs.size()=1 2024-09-22T09:16:01.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.865+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.266__shadow_.-KDWOhfCIDHIIk3yudJ_2dyPI2CDXyL_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16372231324073989091', time=2024-09-22T10:57:21.617339+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.271__shadow_.3qApibf5p8ZD8yJFK7eaqVh1BA7nxFf_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16298594392536296283', time=2024-09-22T10:57:30.069313+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.285__shadow_.2pK-ux_Xr_3viCP-an4UgQEetF_QQdl_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14173336398320506070', time=2024-09-22T10:57:32.039304+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.288__shadow_.Bp-GAHHuD4s2cLRczeCEmpOhcpyJK2j_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14200705653788037129', time=2024-09-22T10:57:36.336876+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.uifTbO69EwAI9dgxR8CRtGf4PLRSJxW_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10258288916089183103', time=2024-09-22T10:57:43.604033+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.302__shadow_.RW5oc37qSEMfeCcS2OWdFBVkAYfafRC_0 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3219500123227934124', time=2024-09-22T10:57:55.071290+0000, chain.objs.size()=1 2024-09-22T09:16:01.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.320__shadow:VDar-3FL8EyvOv8BMwvc1gSsuHjSpSf_.QKMzAQDSeAjwFOkYya-UZcbjf8sxyj7_0 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10314101409180861369', time=2024-09-22T10:57:55.181583+0000, chain.objs.size()=1 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.320__shadow:JtHUOfu8zRZ61xjiU-r8zYzKau8WJip_.jltKQ7JEjAcpzQ5lw3dHoP-19e2zuKi_0 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8520539158009238877', time=2024-09-22T10:57:56.220038+0000, chain.objs.size()=1 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.322__shadow_.YG3PLAT585IPYvhXQbt2KatyeTbTBdy_0 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1685728750053288145', time=2024-09-22T10:58:34.396411+0000, chain.objs.size()=1 2024-09-22T09:16:01.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.866+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uA0s4eaB8Hur8svaFwnLglk6QGCK9Ed_0 2024-09-22T09:16:01.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.870+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15803167678689190739', time=2024-09-22T10:58:34.919343+0000, chain.objs.size()=1 2024-09-22T09:16:01.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.870+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.T9gXm1ET-TqiN_-0gI2A9yQDv67xXGc_0 2024-09-22T09:16:01.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13101293849082550650', time=2024-09-22T10:58:35.068634+0000, chain.objs.size()=1 2024-09-22T09:16:01.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xiyawTOvDMvIkzCXJ486nh6mrYjnQg4_0 2024-09-22T09:16:01.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17345698515084621193', time=2024-09-22T10:58:35.147357+0000, chain.objs.size()=1 2024-09-22T09:16:01.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vEYS4p4zDsPawBn6F04OXTNJifXFDvX_0 2024-09-22T09:16:01.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10033875818822083473', time=2024-09-22T10:58:35.923643+0000, chain.objs.size()=1 2024-09-22T09:16:01.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.871+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ko8PqL4T3k5Zg60OdZ1JpMe9P0y9v7W_0 2024-09-22T09:16:01.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.164521596717248367', time=2024-09-22T10:58:35.994120+0000, chain.objs.size()=1 2024-09-22T09:16:01.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ppk-GKGMRlRRlDzEuFV44kdwaCqMSJu_0 2024-09-22T09:16:01.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9759078658633747373', time=2024-09-22T10:58:36.062118+0000, chain.objs.size()=1 2024-09-22T09:16:01.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VN7n67L52GphPazWRvQY5GYb1sWeZxE_0 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5035453337266632821', time=2024-09-22T10:58:36.135330+0000, chain.objs.size()=1 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YIA50CewedyNblJRNklFffwei4uTtF8_0 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8526169047344677056', time=2024-09-22T10:58:36.253838+0000, chain.objs.size()=1 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OwnGe9opjRJp0XzH8PAzcBId49UMaWq_0 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2436480226007472200', time=2024-09-22T10:58:36.425959+0000, chain.objs.size()=1 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1z9cljL2TUUOech0oz-UV5ka-Us9Q62_0 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3682156171287783265', time=2024-09-22T10:58:37.610497+0000, chain.objs.size()=1 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Jz36cWSa2XdtNiIzz6O-j5ghewkx7El_0 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10256377851140939855', time=2024-09-22T10:58:37.639075+0000, chain.objs.size()=1 2024-09-22T09:16:01.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.J-jcuxXDFresWZHSAX8pJNaHd0Z-aA1_0 2024-09-22T09:16:01.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.874+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3802278267004049009', time=2024-09-22T10:58:38.012866+0000, chain.objs.size()=1 2024-09-22T09:16:01.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.874+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KAStVg5EKZHRdwSA6T31hQn9gPRb98v_0 2024-09-22T09:16:01.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.876+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7563290781633342324', time=2024-09-22T10:58:38.472074+0000, chain.objs.size()=1 2024-09-22T09:16:01.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.876+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.z_UMPo6C7h6rF8AOm4t0iax1LEXo37Z_0 2024-09-22T09:16:01.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.876+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15124231446145826457', time=2024-09-22T10:58:39.435006+0000, chain.objs.size()=1 2024-09-22T09:16:01.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.876+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NFxu59TqruGIQ_yKekP5V4fba3l4qku_0 2024-09-22T09:16:01.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16270269334009578119', time=2024-09-22T10:58:39.650831+0000, chain.objs.size()=1 2024-09-22T09:16:01.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.M6ntKo6t06HLNLbNC-UgoP2-zvu6szB_0 2024-09-22T09:16:01.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4906192467472052859', time=2024-09-22T10:58:39.906381+0000, chain.objs.size()=1 2024-09-22T09:16:01.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1gVeSkGStqp2SQWnt1_Xn2qC_8zrvCK_0 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16761219546654628566', time=2024-09-22T10:58:40.289479+0000, chain.objs.size()=1 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UlEcnublo1KWk_vDkpapZLvg79GKf6P_0 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14434528844635700709', time=2024-09-22T10:58:40.388374+0000, chain.objs.size()=1 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fHUXi-ajcFjhljyUppKle68oZvf0rbd_0 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11678508877061505799', time=2024-09-22T10:58:40.431607+0000, chain.objs.size()=1 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6_Z70Nz2rRFY7cPJqyxCwbutW2l9bkk_0 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4496438731559781461', time=2024-09-22T10:58:40.533726+0000, chain.objs.size()=1 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZaV6ygPkXW72Eqx6PTtT8w4AOXY6pKj_0 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5965198771976781353', time=2024-09-22T10:58:40.592111+0000, chain.objs.size()=1 2024-09-22T09:16:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Dp0qOGYk8t76FIZLUY_Gra8-rh0z6gi_0 2024-09-22T09:16:01.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12948897976233894061', time=2024-09-22T10:58:41.959307+0000, chain.objs.size()=1 2024-09-22T09:16:01.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.880+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.e2dU4yVX0lESquRtvo9gKF9VcwcCEgv_0 2024-09-22T09:16:01.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17673264071439820022', time=2024-09-22T10:58:43.099181+0000, chain.objs.size()=1 2024-09-22T09:16:01.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.b-cUfexqq9OGICZ5-lh1lTsiYm3G2Cl_0 2024-09-22T09:16:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.882+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12608126247729640129', time=2024-09-22T10:58:43.123011+0000, chain.objs.size()=1 2024-09-22T09:16:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.882+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.A7y-9Ble5kDBwZOuh5JMjid_HctiQgI_0 2024-09-22T09:16:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.883+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2786399718026936608', time=2024-09-22T10:58:43.123780+0000, chain.objs.size()=1 2024-09-22T09:16:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.883+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gJHWIcK6Pm2ERRsJbGdBxZNLRRz7nhr_0 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12425901144759387009', time=2024-09-22T10:58:43.222004+0000, chain.objs.size()=1 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oYXrVHtgc6-jRFrVJbl68IZK_mHqYxT_0 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1395690648151542276', time=2024-09-22T10:58:43.347986+0000, chain.objs.size()=1 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4sQ3p-Jc43QVyYuuKMosdPXzxk997jO_0 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14453501841486579536', time=2024-09-22T10:58:43.475466+0000, chain.objs.size()=1 2024-09-22T09:16:01.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dxe5fxywcWLmYbPkObAHyUWbcbnhade_0 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7301229140952246876', time=2024-09-22T10:58:43.562367+0000, chain.objs.size()=1 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8HfP0Esrx1pSyQOQIeo5YaApTLBkMAv_0 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1436088672903189755', time=2024-09-22T10:58:43.922820+0000, chain.objs.size()=1 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cHQBLCHYkWNoobhC7fhqUYk03rBwaOd_0 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10672578918141099781', time=2024-09-22T10:58:44.551602+0000, chain.objs.size()=1 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6EXrZx14DRkGpSFgEHfkQyR42zKJB3D_0 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16337514378626077952', time=2024-09-22T10:58:44.793539+0000, chain.objs.size()=1 2024-09-22T09:16:01.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W_M58HfJYLNeApyWhLgCAFiMGln-XKI_0 2024-09-22T09:16:01.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.94065061810622553', time=2024-09-22T10:58:44.990091+0000, chain.objs.size()=1 2024-09-22T09:16:01.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4SiabIyrJxxtbHvB_3k0ADZeMaNmaz9_0 2024-09-22T09:16:01.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15864607743963301591', time=2024-09-22T10:58:45.083492+0000, chain.objs.size()=1 2024-09-22T09:16:01.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TSPaWm26FxUOA9sa_XU5z7ITiJVQwmo_0 2024-09-22T09:16:01.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16398953666505008012', time=2024-09-22T10:59:22.128226+0000, chain.objs.size()=1 2024-09-22T09:16:01.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xjB6-fGDfWvmVFDf0b_qi2bXO4DxqkT_0 2024-09-22T09:16:01.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10042788416005187278', time=2024-09-22T10:59:22.129008+0000, chain.objs.size()=1 2024-09-22T09:16:01.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.888+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.z8WSSR0D4Va8SgrGzx12YVip6G3oPJG_0 2024-09-22T09:16:01.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.890+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7681914209798390740', time=2024-09-22T10:59:22.253671+0000, chain.objs.size()=1 2024-09-22T09:16:01.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lxLWup49DZaOBwPpEaO1_7Q6ANpsDoZ_0 2024-09-22T09:16:01.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12826560521197679522', time=2024-09-22T10:59:22.488293+0000, chain.objs.size()=1 2024-09-22T09:16:01.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Uqe8TnJVO-ZfkkNPZp_gP-0xv0NFBpq_0 2024-09-22T09:16:01.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13381709491083918593', time=2024-09-22T10:59:22.724370+0000, chain.objs.size()=1 2024-09-22T09:16:01.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jKR8dJE2fssfNSInDh-Wp-q3UwmHabE_0 2024-09-22T09:16:01.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/54826 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1643820920813057274', time=2024-09-22T10:59:24.536012+0000, chain.objs.size()=1 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rijysJzCA5yEBixgXjzUqfL3GC82PHE_0 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9494088873167295670', time=2024-09-22T10:59:25.201876+0000, chain.objs.size()=1 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f6Tq32JTaNZP6Tk6rpQqDSJJwoxBIvX_0 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7325345062083308443', time=2024-09-22T10:59:25.247926+0000, chain.objs.size()=1 2024-09-22T09:16:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.a2QqoXkb8mV4wa2NOPTEhfYIBTJGv3r_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16478895781780637985', time=2024-09-22T10:59:25.382198+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KoutcA7O-JJkMHZ20M3LK8VLjMgR_zP_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16218416488153428269', time=2024-09-22T10:59:25.632356+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jDi6jTgdGL5V22-PFkyaQXYU-GEPWOM_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7066901605328161728', time=2024-09-22T10:59:26.041985+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EWurdE6wwFS2IxBQctuppNT6Rev9-dt_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8653007863048190620', time=2024-09-22T10:59:27.307172+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NnWXg91VXsqxZPPIXJMrgGX1StVNbhC_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13244270464966210338', time=2024-09-22T10:59:27.603666+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0dBJ8GEueyUvMT79ITr9iXZiJc7jxEt_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14199319841680625857', time=2024-09-22T10:59:28.940812+0000, chain.objs.size()=1 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7ZwGAwiuqaDttllfEtwZc10wJXB0vkM_0 2024-09-22T09:16:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17779613196622418143', time=2024-09-22T10:59:29.003675+0000, chain.objs.size()=1 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YLYVVRXXbjFdZFpq-z1NEuH8g-lrPnk_0 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4381060775732060910', time=2024-09-22T10:59:29.848806+0000, chain.objs.size()=1 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.N6CmwYcz2BUgGzwKlp5WfxAyBcrjC89_0 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18266765155281018548', time=2024-09-22T10:59:29.910712+0000, chain.objs.size()=1 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.902+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VKeHwMjxOa_XsCFUuEBfwRQd1y5-sPw_0 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.905+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14759636191582206432', time=2024-09-22T10:59:30.002182+0000, chain.objs.size()=1 2024-09-22T09:16:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.905+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5hRXMXgWFelK5vdK9FD5iwWAWLJndT3_0 2024-09-22T09:16:01.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.906+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8521329551993517304', time=2024-09-22T10:59:31.029342+0000, chain.objs.size()=1 2024-09-22T09:16:01.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.906+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.R0-QHGQKiUh0kIz20mFHJuJcmgMGiRm_0 2024-09-22T09:16:01.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.907+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14337932955688566855', time=2024-09-22T10:59:31.476404+0000, chain.objs.size()=1 2024-09-22T09:16:01.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.907+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.POKQBmZjkxtz6bMRHq7mTCtclwTPhuw_0 2024-09-22T09:16:01.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3443392406537638129', time=2024-09-22T10:59:31.728961+0000, chain.objs.size()=1 2024-09-22T09:16:01.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Oo2VeThEmpxVqqk_1HB4OgjP3H20jEu_0 2024-09-22T09:16:01.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13873107240675907400', time=2024-09-22T10:59:31.729598+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Scr02Ka_KGLotWfWpPeVb3UBB543E6f_0 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11448262528608570249', time=2024-09-22T10:59:32.918001+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.agoo9vUtihFLOFNqEldNoIM17LeV_JW_0 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4127356137359320048', time=2024-09-22T10:59:40.688012+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.340__shadow_.slBAOV_b-dOBdm_TZjekX5PDQfgb-y3_0 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3582622121613180364', time=2024-09-22T11:00:07.112473+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.391__shadow_.X-fu1zBRJaq2iLFSn6rXjYBvS2k8Y3v_0 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8415820086603073077', time=2024-09-22T11:00:33.616634+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.440__shadow_.8HxfghsRri_FZzTn6gMtXYOXftTzTIU_0 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16864807009877005610', time=2024-09-22T11:00:51.979138+0000, chain.objs.size()=1 2024-09-22T09:16:01.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.467__shadow_.WWC598otShqKPciP_MReWM99sRYrIl9_0 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8167342700558320165', time=2024-09-22T11:00:59.849784+0000, chain.objs.size()=1 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.Rms19-5XSAehrICTCazdq8MV11PKtzJ_0 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16106127170557402122', time=2024-09-22T11:01:00.583993+0000, chain.objs.size()=1 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.485__shadow_.77nk2tsBfEGK9KJ45LYDt15IoQOBNhf_0 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.911+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17057540837594655168', time=2024-09-22T11:04:16.108708+0000, chain.objs.size()=1 2024-09-22T09:16:01.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.911+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.559__shadow_.kfBtnLNAzrLezKGjGWD_B-tnRpv9HQ3_0 2024-09-22T09:16:01.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16025262386007107993', time=2024-09-22T11:04:40.330415+0000, chain.objs.size()=1 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.571__shadow:1gdYoFIuvfuz9AWHUKJnnDXRk8Ucynk_.vra_dtTuoVECZ2F5uiXZvdomwEi_Qi9_0 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3039896839135886368', time=2024-09-22T11:04:47.928634+0000, chain.objs.size()=1 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:Sn8Xp3.bzRQcAS1S.K0emwI9Os-dUa._.2HI5JQ_f63ANeL9x53spUVV_rlCYr3K_0 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14728536096462462713', time=2024-09-22T11:04:54.355724+0000, chain.objs.size()=1 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:iRBO1iHR10YY5JJiJdj5t5LAd74Muvc_.LEv_4sXX4PfBPiHw-Yt90EHHLxSHiHr_0 2024-09-22T09:16:01.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8856110531628695490', time=2024-09-22T11:05:15.721569+0000, chain.objs.size()=1 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:MVEfiFnxxULwjRAPXmaRXqKjEyNT.LS_.16NF_9kwFzphFnincVPrMPgILdl6SK0_0 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10060990799498460261', time=2024-09-22T11:05:31.363839+0000, chain.objs.size()=1 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:zGvY61yiMqbYmcM8Z6loyfc3ljNg.Lj_.dIrkZHXTgEHZlC5U2mhLuGBHfzJmpkB_0 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10762432772365645851', time=2024-09-22T11:05:33.184275+0000, chain.objs.size()=1 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.584__shadow:QSi5grt2ThXQLhZPFssfr6rC2k8xyGq_.ALBSkhLc9avNaXMXA-2goWd2fWh7bIb_0 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4858756205407802147', time=2024-09-22T11:09:26.990339+0000, chain.objs.size()=1 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.915+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.627__shadow_.AXQ54qHgyDRLarkV8U4Rm3gJxulbaJV_0 2024-09-22T09:16:01.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.915+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17559176398309342685', time=2024-09-22T11:09:50.275087+0000, chain.objs.size()=1 2024-09-22T09:16:01.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.915+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.654__shadow_.11ic2b95H85NP3kAXmdTt2CJmtASA9J_0 2024-09-22T09:16:01.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.917+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3025789575796702047', time=2024-09-22T11:10:43.008538+0000, chain.objs.size()=1 2024-09-22T09:16:01.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.917+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.715__shadow:JslNABcMUie2ZyfA2yqO19g..iIBJhO_.L-4FvH-ExFD-Cw-dDByQDINxyddAr2x_0 2024-09-22T09:16:01.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.917+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12201698912709284708', time=2024-09-22T11:12:46.518781+0000, chain.objs.size()=1 2024-09-22T09:16:01.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.917+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.763__shadow_.bD7dr88GorFmWRN8pGpQaj9cm5xu2LL_0 2024-09-22T09:16:01.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.922+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46093' 2024-09-22T09:16:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5662209709027332160', time=2024-09-22T10:56:15.297152+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239__shadow_.MGbVDTtfY_-MlvHrcaMKkRQzI3owo2S_0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7272283278699557760', time=2024-09-22T10:56:15.303446+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239__shadow_.eQWmeuXRq7iT68EJttI4qqKcuIx0Od__0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2518104190622977207', time=2024-09-22T10:56:21.826642+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.249__shadow_.9DUB7EvDayCdBBHmj52x7yalwMKq2wf_0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6983899626179407098', time=2024-09-22T10:57:06.369719+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nN_0Yu9f6YiwGJIlpOT7tAae9u9lV0u_0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2758862663316509488', time=2024-09-22T10:57:06.909501+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nvLL0ELHGp7krPyjhCI3tCs3HBMBoY4_0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6953883917855957506', time=2024-09-22T10:57:07.882156+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oEuPsSEQkpoc4GPioY0tlkUpXZKHtg2_0 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11976387404332621204', time=2024-09-22T10:57:07.890034+0000, chain.objs.size()=1 2024-09-22T09:16:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rR318HzxEtQIk_L2_eIGZdj9gxXOvN5_0 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14213202723434978473', time=2024-09-22T10:57:07.944421+0000, chain.objs.size()=1 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VD69q4SzYSY62rxJ05Hwwu279b4maY9_0 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2302098125982285704', time=2024-09-22T10:57:08.060796+0000, chain.objs.size()=1 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k13o2J6-V5OmFaismDp0Lm-MvuoAXfv_0 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7831577100555376067', time=2024-09-22T10:57:08.087128+0000, chain.objs.size()=1 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QEbEJphBUzLEqMnZig-WQNJEt4s0j9O_0 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14318066048889073642', time=2024-09-22T10:57:08.087708+0000, chain.objs.size()=1 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8ynZJ4SpusIJckjQ8_eH3n8-bNXijk5_0 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15241943780063618775', time=2024-09-22T10:57:08.316974+0000, chain.objs.size()=1 2024-09-22T09:16:01.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Nls7ocZ5eKuEK2wCRkT5QdAOnU_Inuf_0 2024-09-22T09:16:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7109566729128188937', time=2024-09-22T10:57:09.356127+0000, chain.objs.size()=1 2024-09-22T09:16:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mg-uYjZEXU5tqNO6gHEBpcjp0sRlALS_0 2024-09-22T09:16:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17096237329017275415', time=2024-09-22T10:57:09.424481+0000, chain.objs.size()=1 2024-09-22T09:16:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.c7lyzQSwEuqgl6k7XtQU86RCNiXT-tH_0 2024-09-22T09:16:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.937+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4414678316913010093', time=2024-09-22T10:57:09.717249+0000, chain.objs.size()=1 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.937+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0Osf3g4pTq34RRO4gUc7z38kiCfDCbU_0 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.937+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5412033894939190248', time=2024-09-22T10:57:10.641953+0000, chain.objs.size()=1 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.937+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SuLyq8QtT6xe4KUTIpf9cAnmVF-EES1_0 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14185833349854922499', time=2024-09-22T10:57:10.881856+0000, chain.objs.size()=1 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rZMFTCr2L_H0sDA2JEaZetIq7fGPIR1_0 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2222617557946566268', time=2024-09-22T10:57:11.310359+0000, chain.objs.size()=1 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Wa5R_zJYl9_8n3WZ_WmUtOUF4b5nSM1_0 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11626669298463137777', time=2024-09-22T10:57:12.543485+0000, chain.objs.size()=1 2024-09-22T09:16:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FHibouXwR1CwRYNZILWmDBtHX1hU76u_0 2024-09-22T09:16:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13369420771930960921', time=2024-09-22T10:57:12.591779+0000, chain.objs.size()=1 2024-09-22T09:16:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wVRCU3O6ec7_v03xBo1QZwexlvukXbl_0 2024-09-22T09:16:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8122397412317173980', time=2024-09-22T10:57:12.595136+0000, chain.objs.size()=1 2024-09-22T09:16:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3F8BPlC4zxt_QPScDDsnlarOi7XT_F0_0 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4141288488934107972', time=2024-09-22T10:57:12.866026+0000, chain.objs.size()=1 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qMg9pWd5lixRpK5M8KTjRFz1Mk8zz6b_0 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14186185039561625756', time=2024-09-22T10:57:13.361303+0000, chain.objs.size()=1 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WUatRgXrb7KWv-RY1gxg9LzCDFWm9sP_0 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10615946481458926614', time=2024-09-22T10:57:13.371542+0000, chain.objs.size()=1 2024-09-22T09:16:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0w2rz-zVNqvTPKmG6LjuhKBa_Ju6_HT_0 2024-09-22T09:16:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12285581691316404965', time=2024-09-22T10:57:13.482837+0000, chain.objs.size()=1 2024-09-22T09:16:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.941+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vFG8L3zx6l4AFMsniiXDSCPb0P5fiw9_0 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14382054282365853770', time=2024-09-22T10:57:13.591982+0000, chain.objs.size()=1 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.p1_iGE4th8TDneh5ojLOv6kRsaoxxTt_0 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2427087344643039045', time=2024-09-22T10:57:14.055266+0000, chain.objs.size()=1 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6htHtgmmHbLxb5IJIXSS360FRMT5zdY_0 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2091137308711189495', time=2024-09-22T10:57:14.117111+0000, chain.objs.size()=1 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IsDFDWjeTtel1X-0_NaZkvU3HK4wXwP_0 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18192201993912876898', time=2024-09-22T10:57:15.135037+0000, chain.objs.size()=1 2024-09-22T09:16:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.N-LQWJxn04CgnQcgkbGxK2hc2J-CfNB_0 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7733898927214874767', time=2024-09-22T10:57:15.615106+0000, chain.objs.size()=1 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.eKPAyVxI09s0yKNSh4Kyrdc5rmyBFE__0 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4858882575071958932', time=2024-09-22T10:57:15.695427+0000, chain.objs.size()=1 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PViWcmECVDtQQzUxxs6PV754SfutI-k_0 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6375861495438330843', time=2024-09-22T10:57:15.739941+0000, chain.objs.size()=1 2024-09-22T09:16:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.944+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mQqfBISsFg9IOBPAfrz5lQ6EBHkK380_0 2024-09-22T09:16:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16950070594767981196', time=2024-09-22T10:57:16.753875+0000, chain.objs.size()=1 2024-09-22T09:16:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AD8Wo_K_B24RVicxhPtOlOstd3RMJmZ_0 2024-09-22T09:16:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2374481209315420896', time=2024-09-22T10:57:17.589711+0000, chain.objs.size()=1 2024-09-22T09:16:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.264__shadow_.Wx-9YIt_4tzIFqWsfXWixO82gBWtdLU_0 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4665133366190071496', time=2024-09-22T10:57:19.315867+0000, chain.objs.size()=1 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.267__shadow_.e-nrsKAUAGy5aVUvih2YCsfEcHSGJ5o_0 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9551887559363064936', time=2024-09-22T10:57:23.914343+0000, chain.objs.size()=1 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.275__shadow_.8OJVJH7u2ld8uumuIQWwdiTG6gz2d9-_0 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8472135502825873025', time=2024-09-22T10:57:36.424231+0000, chain.objs.size()=1 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.Z1yjws5QU3eMEB8302pxlqWr6NhhRdq_0 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9954885709824839701', time=2024-09-22T10:57:38.328866+0000, chain.objs.size()=1 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.7Q4iVNMI5Yvu4-EiOH6pMRl4NruBJ4H_0 2024-09-22T09:16:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1938772986939171576', time=2024-09-22T10:57:44.210362+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.303__shadow_.WErAZw8X9MU2pl79wBIv65XI8P8-UpR_0 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11818415862239963780', time=2024-09-22T10:57:45.405736+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.305__shadow_.-_BytGmDhU28xicEmw500A54LQ5EINT_0 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11259708701000430984', time=2024-09-22T10:58:34.789819+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AMrolhduiDxfsoUHUDU6aCT1eHdF-XR_0 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17953994281455060664', time=2024-09-22T10:58:34.917303+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Unf1uJ_DTF2mrYAEneXy0_E99BVydv9_0 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.950+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6362667546861854216', time=2024-09-22T10:58:35.249086+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.950+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Urk7w5e-JMeVvyVipmAMuINLJfJTMKh_0 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.951+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9256161574876147623', time=2024-09-22T10:58:35.440520+0000, chain.objs.size()=1 2024-09-22T09:16:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.951+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zYtWiBuc_-HDwT4kHTCWtuO9-346nJZ_0 2024-09-22T09:16:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16060457569068433579', time=2024-09-22T10:58:35.947040+0000, chain.objs.size()=1 2024-09-22T09:16:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IWIPG-MSpVQc-BGiK1tokvWXsb7QUAO_0 2024-09-22T09:16:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4853927836256489388', time=2024-09-22T10:58:36.118861+0000, chain.objs.size()=1 2024-09-22T09:16:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LMv5OcKjCTh2G3h96UlmWWBUpxCzJ9H_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2141544075007215081', time=2024-09-22T10:58:36.928800+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FyrtqyoW_gaTxy33XprmeheogiayfAj_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13465358733311759200', time=2024-09-22T10:58:37.482563+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9x07yGv4KbvVvB6vEG5VdAYlH7Z4UBX_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4741157667539014299', time=2024-09-22T10:58:38.048154+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.957+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hiCyVXhHVOD5R8h9romzaLXre4lMjg-_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8445707906979528807', time=2024-09-22T10:58:38.284903+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1Oewts1gT3HVImIY2j5Trf_KUP79Rs4_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13815027090185731623', time=2024-09-22T10:58:39.210431+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XFNf9RGXjHCJgS6yz48_uHdJ0A11OCe_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9018955778754728956', time=2024-09-22T10:58:39.295817+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._8zsALH6NxY-qq2kw12OeZZPZJDA09p_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16826043250150195591', time=2024-09-22T10:58:39.348858+0000, chain.objs.size()=1 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uiAQBFYZzOWDoKElBu92KKi0Jyyu9F0_0 2024-09-22T09:16:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8352108034569568273', time=2024-09-22T10:58:39.578394+0000, chain.objs.size()=1 2024-09-22T09:16:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h0UFh71HS2qXhDfjLg-UK1Qo4bdcW8f_0 2024-09-22T09:16:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6583204493858572135', time=2024-09-22T10:58:39.579486+0000, chain.objs.size()=1 2024-09-22T09:16:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.eMJ4gX8lWPDHLuzaDtV2rnGmJHgPnio_0 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.960+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15302742255954840476', time=2024-09-22T10:58:39.687124+0000, chain.objs.size()=1 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.961+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DVLXcU0aaCp0IwfleHiJktP_lbMhuQs_0 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.961+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17784024130340642244', time=2024-09-22T10:58:39.736988+0000, chain.objs.size()=1 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.961+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.giP4YNWK7gqKSmeYxMIvn8ZTjx3ADts_0 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.961+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16432833232806246343', time=2024-09-22T10:58:40.398449+0000, chain.objs.size()=1 2024-09-22T09:16:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.961+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2K0bjZ2oN9BdEZyR8Lvt3COHmFyAyqu_0 2024-09-22T09:16:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.962+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10768466335951236252', time=2024-09-22T10:58:40.618255+0000, chain.objs.size()=1 2024-09-22T09:16:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.962+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jpDQbG6ahF9CZ-wZhqWR9K5IJwvUitP_0 2024-09-22T09:16:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.962+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1709920130055267226', time=2024-09-22T10:58:40.738853+0000, chain.objs.size()=1 2024-09-22T09:16:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.962+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pDHZ_tMIvN4idOnlgEGzPqMlyupu6OL_0 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1895781866127877608', time=2024-09-22T10:58:40.939946+0000, chain.objs.size()=1 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Af90TUrYN9DsvgTDi-6-zLh1j7DI1Bk_0 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12602457359785975470', time=2024-09-22T10:58:41.167081+0000, chain.objs.size()=1 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.F3IkEUyLgbj5ELW-esCenWSmAf2HC8C_0 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5493435361327744025', time=2024-09-22T10:58:41.281903+0000, chain.objs.size()=1 2024-09-22T09:16:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.964+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Fqfem8joOnhHKuC0P5UrCrfq_IiDP9D_0 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7887668747230956609', time=2024-09-22T10:58:41.728551+0000, chain.objs.size()=1 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kq82bCZV-KcxoUjuYvhdcYh52uyhBUe_0 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3941463672702744495', time=2024-09-22T10:58:41.957078+0000, chain.objs.size()=1 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UCslHnGDec_cIP-5xPIxzo0Q2syqEea_0 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10819965009590175983', time=2024-09-22T10:58:42.400896+0000, chain.objs.size()=1 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.A3uHfCZGE1HBKOzgyuEVTnEYH4wbDEO_0 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16235496366717349569', time=2024-09-22T10:58:42.567545+0000, chain.objs.size()=1 2024-09-22T09:16:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-LgQ-Zo3JmRMrLkj4vriK8YeEbEuZxr_0 2024-09-22T09:16:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14184197804919815051', time=2024-09-22T10:58:42.573088+0000, chain.objs.size()=1 2024-09-22T09:16:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qoAF7K1HofH9krPVjtDXS1D4s-vSDj4_0 2024-09-22T09:16:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.966+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9016541790675364026', time=2024-09-22T10:58:43.009624+0000, chain.objs.size()=1 2024-09-22T09:16:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.966+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LZGCSHe-nMo-45VHNppz2zRe56m6g31_0 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.532998836309980904', time=2024-09-22T10:58:43.014118+0000, chain.objs.size()=1 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mddPNQHUsNq9BiRknsHBStG82LbW_Kt_0 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16531572108160562439', time=2024-09-22T10:58:43.101663+0000, chain.objs.size()=1 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oKC8-yLHYJFErBXicHNoGkOvUXwu1ZR_0 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1437785163901153343', time=2024-09-22T10:58:43.357873+0000, chain.objs.size()=1 2024-09-22T09:16:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6uyOuUw82_WhhrGg3VbOdwZFh1EAOGv_0 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4667775635715107585', time=2024-09-22T10:58:43.623589+0000, chain.objs.size()=1 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jL2AOKPRFAVaMlgjXxwVRk6z2Xbp_jh_0 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10642246234455769677', time=2024-09-22T10:58:43.796952+0000, chain.objs.size()=1 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qHwVNWS3tGf175yl2ajxs8I5BpX1-iF_0 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.835518041192783256', time=2024-09-22T10:58:44.540229+0000, chain.objs.size()=1 2024-09-22T09:16:01.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yW-2_N5l7XUvYnsQyXA9qPopr4hGbZL_0 2024-09-22T09:16:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15489325848534754984', time=2024-09-22T10:58:44.876755+0000, chain.objs.size()=1 2024-09-22T09:16:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.969+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rX3jkiiHIB6nqnRay-VTDxwezlSlNxm_0 2024-09-22T09:16:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.971+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1490045293955767326', time=2024-09-22T10:58:44.877583+0000, chain.objs.size()=1 2024-09-22T09:16:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.971+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oY8jlMcYqbgEwVf5Vnzb82RCWN7cUQA_0 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10341437230213822865', time=2024-09-22T10:59:22.000533+0000, chain.objs.size()=1 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bW4-P_MKc6_IpKgobopMKvZ-qk5oVrJ_0 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12894070011167462228', time=2024-09-22T10:59:22.164043+0000, chain.objs.size()=1 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZWg-L9-a4vwKvaZkJxUPDDFXSugmsOL_0 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17820027031272400608', time=2024-09-22T10:59:22.561627+0000, chain.objs.size()=1 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JhHBByghP1Y3uxBGqaxst_a3XuQ42JU_0 2024-09-22T09:16:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13977782045655235511', time=2024-09-22T10:59:22.884747+0000, chain.objs.size()=1 2024-09-22T09:16:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.i9zIjtAzOGVnD6CqdegAgQp-WOylzjW_0 2024-09-22T09:16:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.973+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13429671435489091881', time=2024-09-22T10:59:22.932250+0000, chain.objs.size()=1 2024-09-22T09:16:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.973+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.M5t4icBRkqwPmTLWp_SngOhvjb__-x9_0 2024-09-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.974+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17487050420172958818', time=2024-09-22T10:59:23.011386+0000, chain.objs.size()=1 2024-09-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.974+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5r-A0AmCrHRRdxf5if0juyAEI9Il_c3_0 2024-09-22T09:16:01.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.445261264324484021', time=2024-09-22T10:59:23.034827+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KEmU2JDe29vGMOXHkt_PCOckR6d7W08_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10259004162590109701', time=2024-09-22T10:59:23.994047+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eGbUDV3aUv8juslvwp_dp4LcyvxFNfz_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16427365778257589437', time=2024-09-22T10:59:24.034039+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.u-VWqrmMSfhyyyKDW5rY5i_JHr3Xu-O_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3099046603766740084', time=2024-09-22T10:59:24.213704+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AuB7OFUBoFeR2Su9w_nUjykWuVLRgsG_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12247613176777379894', time=2024-09-22T10:59:24.245759+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vAbwH0pg8MlyiEDEfTvk1I3lXXmbTYL_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5468940795064293145', time=2024-09-22T10:59:25.334948+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6kho2huH1Fo_VN0a0h-0aeh5igDybTk_0 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2561529413618375566', time=2024-09-22T10:59:25.335969+0000, chain.objs.size()=1 2024-09-22T09:16:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.975+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eNUcYEk3PfvB97tKv_XUD9Nv_2cvXVH_0 2024-09-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.976+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11214080666530230709', time=2024-09-22T10:59:26.005638+0000, chain.objs.size()=1 2024-09-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.976+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.n-LjK8sYHDufG9Cvf825-lu4UcZOryw_0 2024-09-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.976+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7354323126105307100', time=2024-09-22T10:59:26.475070+0000, chain.objs.size()=1 2024-09-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.976+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.j6Av0xFYQRBuGTNV2ypLN7F7KJLuxT0_0 2024-09-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.978+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9103173275372455605', time=2024-09-22T10:59:26.573062+0000, chain.objs.size()=1 2024-09-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.978+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.S5phxAnCiqSW4Gl5osrGarerZxvRq0S_0 2024-09-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.979+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7462268286509678375', time=2024-09-22T10:59:26.705302+0000, chain.objs.size()=1 2024-09-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.979+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tlIBq78BQmOwga8uOeGlCp5xE50t4pQ_0 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.979+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10958646330360021520', time=2024-09-22T10:59:26.920848+0000, chain.objs.size()=1 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.979+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ARg8OkRAg5tjT_1f3Hkgc3HoiGxzNPG_0 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13621633771521450318', time=2024-09-22T10:59:27.275766+0000, chain.objs.size()=1 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.axsHjdJLafv1Tp2jFfsXX3FjAkUD9GH_0 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14953538671866442190', time=2024-09-22T10:59:27.563531+0000, chain.objs.size()=1 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.S1ACzCI6nsax43GEeL0Qr6T6y1ctVKi_0 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13632551582220140538', time=2024-09-22T10:59:27.743161+0000, chain.objs.size()=1 2024-09-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.980+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sl_YPhi1YbYouQSGAn-UUR21xCAHmp3_0 2024-09-22T09:16:01.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.981+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7151026486693868652', time=2024-09-22T10:59:28.871237+0000, chain.objs.size()=1 2024-09-22T09:16:01.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.981+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eiaSYYmDbqOasZdP_KbbgMqP_9V4hrI_0 2024-09-22T09:16:01.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.981+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13202411117696223201', time=2024-09-22T10:59:28.968326+0000, chain.objs.size()=1 2024-09-22T09:16:01.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.981+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.J-q-DxHxoMXM6KZeHpKolyyXOrdpis6_0 2024-09-22T09:16:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.985+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46093 2024-09-22T09:16:01.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-22T09:16:01.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12226469759201031750', time=2024-09-22T10:59:29.172741+0000, chain.objs.size()=1 2024-09-22T09:16:01.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._NMyQL3-e9jioVGLHZuiIK01sOZLsmG_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7429510761277710685', time=2024-09-22T10:59:29.518468+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4xQGBmbw1IXimTEWrPuk47SyIwrQwGj_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13068224161037217621', time=2024-09-22T10:59:29.932378+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zyjrpHU1FnKMHhg7kBN5dPkT0w3JxK7_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16608155298649932557', time=2024-09-22T10:59:30.455044+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HEB_m6xBz7Ax5OOFVr5NNr3RH-ESiOP_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9440032644601206600', time=2024-09-22T10:59:31.509585+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MpZmK9rPWWfX-NYaL9_4Gp-_LiL0mSg_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9535672354676590880', time=2024-09-22T10:59:31.563142+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mb9TcbJeKi8XGIvJUYw6zMKfeUkPSJ5_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11059088278801189649', time=2024-09-22T10:59:31.773900+0000, chain.objs.size()=1 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vq2hSYHlWTQGDyTew1TDgS5QVdTqN5C_0 2024-09-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12664421062980577642', time=2024-09-22T10:59:32.154972+0000, chain.objs.size()=1 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.M0Ih0Gjjy9iABiFJuiz-za9mdfO3-A8_0 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9281170770295689488', time=2024-09-22T10:59:32.887847+0000, chain.objs.size()=1 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bgzcBn3QK41IT2W5GpNKHNzufeJ-pYn_0 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9021599727625102485', time=2024-09-22T10:59:38.714144+0000, chain.objs.size()=1 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.988+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.336__shadow_.7CWU5CdPsKL4_NG-XNdY8Z-WqRVmv93_0 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.989+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1899075957875444587', time=2024-09-22T10:59:59.813471+0000, chain.objs.size()=1 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.989+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.378__shadow_.oYp2R3EhB7qAIKVpP8V0InKChHE2cza_0 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.989+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9690642752000976414', time=2024-09-22T11:00:29.603405+0000, chain.objs.size()=1 2024-09-22T09:16:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.989+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.433__shadow_.8slgzTHHZ69Z81TkLKBaMp6P-3cXyOM_0 2024-09-22T09:16:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1903897944655394224', time=2024-09-22T11:00:57.779655+0000, chain.objs.size()=1 2024-09-22T09:16:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.482__shadow_.iUIGK5zcAm_SXk5ybfV2bi1nj2PFihR_0 2024-09-22T09:16:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7080284744399563555', time=2024-09-22T11:01:08.893437+0000, chain.objs.size()=1 2024-09-22T09:16:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.496__shadow_.QRIb58LATU_05MUcYPOeWcn0I2sLh_Q_0 2024-09-22T09:16:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4816919838540145757', time=2024-09-22T11:01:24.996944+0000, chain.objs.size()=1 2024-09-22T09:16:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.512__multipart_mymultipart.2~8a4yBgJANGyWeKLgvVx3YUzM7Gb17XA.1 2024-09-22T09:16:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13930943209627041199', time=2024-09-22T11:01:31.962306+0000, chain.objs.size()=1 2024-09-22T09:16:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.519__multipart_mymultipart.2~y2nQTKcqIHHrKnf2KVpbsjRiAD00m6E.1 2024-09-22T09:16:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5529204107400092275', time=2024-09-22T11:01:34.992765+0000, chain.objs.size()=1 2024-09-22T09:16:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.992+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.518__shadow_.gfMQSxiTW49pEiDlyvCIFIv79fHJuZA_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1543320599014575699', time=2024-09-22T11:04:09.632254+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.557__shadow_.dljneyXyvHSrTOs1GPaTOp95RsaI2xN_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12439965732969569314', time=2024-09-22T11:04:46.537820+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:P8KeKEtpTjfgGrVV6GPlkoJH-F2waX5_.ZQK4klNJfsgdMPaSL_rixVglX3b1YqD_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14169440368638430938', time=2024-09-22T11:05:07.661142+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:irdqH6JKFNAQLxp60uvKRFne4oGH8YW_.nhuxGtif2yiXgUFJq8ZsOcxvNwrpRIl_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15707714479028166315', time=2024-09-22T11:05:15.406732+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:vIVgUy5250tGyWvM57WzrW48FUI.hgs_.CwyrvIsVCvX7mOwDgtA4S8nUjhxm1-L_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9305453453426945123', time=2024-09-22T11:05:37.531843+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:oVtYmHvK4WDBB3F9-gYitqYnDx9Tf-s_.kYlJcvCMpXawe0BMO-EX5ygn4tugnVH_0 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13042443340787356549', time=2024-09-22T11:08:53.743242+0000, chain.objs.size()=1 2024-09-22T09:16:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.993+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.620__shadow_.SfrWZ9thH2Np3il1ZaAloXOFDMb1tQ6_0 2024-09-22T09:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5089343160317603021', time=2024-09-22T11:09:32.783340+0000, chain.objs.size()=1 2024-09-22T09:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.637__shadow_.CXrfNFMr7kHq99CIdcw9zNMsMj4IXah_0 2024-09-22T09:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15223310947284511954', time=2024-09-22T11:10:14.262193+0000, chain.objs.size()=1 2024-09-22T09:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.664__shadow_.OfLdwGYyEbg_lbDhAgUQ6u_Pfigy59h_0 2024-09-22T09:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12671034428066023478', time=2024-09-22T11:10:29.730686+0000, chain.objs.size()=1 2024-09-22T09:16:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.996+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.693__shadow:A2YPfpn.wnzo20Rdp7-55xdOj02MJkT_.TnlT07i5UKwHTcHoeY5woiMv0FUs-BC_0 2024-09-22T09:16:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11413618529456046614', time=2024-09-22T11:10:30.743141+0000, chain.objs.size()=1 2024-09-22T09:16:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.695__shadow:eNFy-gYdyex6FFNhMtrdMC2M0gXNtgg_.j2S7zvvHmKell0Sggd3S-LQDD0tA513_0 2024-09-22T09:16:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.242070831695465947', time=2024-09-22T11:10:37.043731+0000, chain.objs.size()=1 2024-09-22T09:16:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.705__shadow:yn40-yopDMBJfvEHlOSgSiJcnfzhL7c_.2Ztqb8MCnBRlKbG_HhEsnapX_qI0PWM_0 2024-09-22T09:16:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.999+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2021045404348996716', time=2024-09-22T11:13:26.477209+0000, chain.objs.size()=1 2024-09-22T09:16:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:01.999+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.778__shadow_.3tco2Y0B2ef8ERtHss2iLbagHM3Em52_0 2024-09-22T09:16:02.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.003+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.006+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:02.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.009+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.010+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43477' 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13042489065367001825', time=2024-09-22T10:53:48.705852+0000, chain.objs.size()=1 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.148__shadow_.wDdTfII3uIgNl4r7uF4PDDOgU430Yd-_0 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.785148501817110425', time=2024-09-22T10:54:32.257964+0000, chain.objs.size()=1 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.179__shadow_.HVoUEqy0cakGAElyTw8mfHmGHRWmOPL_0 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8741922003286943461', time=2024-09-22T10:54:46.088481+0000, chain.objs.size()=1 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.200__shadow_.KH71GTXRVYVZH0jc7kMkSSftpb7vYqh_0 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9018287459433701314', time=2024-09-22T10:56:10.364234+0000, chain.objs.size()=1 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.232__shadow_.6T9qMunW8KyvNSUqb2QtF5mESdH7u_6_0 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2359577730118230065', time=2024-09-22T10:56:20.568644+0000, chain.objs.size()=1 2024-09-22T09:16:02.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.247__shadow_.1xiBg55ErvDS3WYFYDFNlP4SQgokPtR_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10802815985806668989', time=2024-09-22T10:57:06.368034+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TX6KApOnF8kofRckDt78tPmGtGkW3mE_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7961457754013245418', time=2024-09-22T10:57:06.570291+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.eS_lI4agGZgJqMBRLvFvsU219_BVuZQ_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1087923976518987885', time=2024-09-22T10:57:07.526566+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8vNGb6rcpPTlEQXxOLd3z9gSndSi2N5_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16076148818004349271', time=2024-09-22T10:57:07.527829+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5TlGIkzZT3O8a_Sd9aFekARU2sJhqLE_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16223135637579185095', time=2024-09-22T10:57:08.220207+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jY48_0FT6t2MRNs5HLfwjsU37ev9s0p_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17027464226158358496', time=2024-09-22T10:57:08.363523+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vURPRsUfSqxtQuUHJ0vRaifwMiuBvjS_0 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11364952565682315012', time=2024-09-22T10:57:08.505133+0000, chain.objs.size()=1 2024-09-22T09:16:02.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.011+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._fhENq0MbmqHFiGZ_djKOYOVVlyFEXN_0 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2113276887322721167', time=2024-09-22T10:57:09.167580+0000, chain.objs.size()=1 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JfHunTw5Cx7RY3TJB_3GcDkvmNTaKmA_0 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15797307461340166498', time=2024-09-22T10:57:09.839435+0000, chain.objs.size()=1 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Lk-cOfHBzUJ47KRbyzI-T-M8l970hqV_0 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16495757839373594689', time=2024-09-22T10:57:09.883801+0000, chain.objs.size()=1 2024-09-22T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oZw3GDQzZPxpY_zr5JZj6xX6MLQ7oSI_0 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.475921787576486364', time=2024-09-22T10:57:09.979175+0000, chain.objs.size()=1 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.69bfmQYoR6BKIJloIv_vDmgZS4WAlKG_0 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12365858642715166245', time=2024-09-22T10:57:10.696672+0000, chain.objs.size()=1 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-kmis5XZiknP1vt43iuk61JQ3dIkTnH_0 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7254736207117051792', time=2024-09-22T10:57:11.008971+0000, chain.objs.size()=1 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DUbI-_dYL4TbT4Vo3KBAhm0J-O9CewQ_0 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1230806370820272198', time=2024-09-22T10:57:11.078512+0000, chain.objs.size()=1 2024-09-22T09:16:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.as4dLkbFbd17i5dCjs7mKUgchVVBVGq_0 2024-09-22T09:16:02.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14694967700829380435', time=2024-09-22T10:57:11.252921+0000, chain.objs.size()=1 2024-09-22T09:16:02.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1AfO_Ag8BqSOLxRG_cw83wDyYmfwna4_0 2024-09-22T09:16:02.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10761531651110493485', time=2024-09-22T10:57:12.052455+0000, chain.objs.size()=1 2024-09-22T09:16:02.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bd1zoopGAeKIECwhOmF4dhY4mE2rzsj_0 2024-09-22T09:16:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.019+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9041378958423601067', time=2024-09-22T10:57:12.122773+0000, chain.objs.size()=1 2024-09-22T09:16:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.019+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qP3mjv9Y-s6CXSfVcIVLwpSsFniXXeU_0 2024-09-22T09:16:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.019+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.196519216028885677', time=2024-09-22T10:57:12.463384+0000, chain.objs.size()=1 2024-09-22T09:16:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.019+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kJqZ8JA-vEljbaBQS7CMhR_DMOqOoJ3_0 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3691831917116901480', time=2024-09-22T10:57:12.531382+0000, chain.objs.size()=1 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DuBFdHR-3b52MxOUs0pZgPpMCBX6QUT_0 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2061809517797901623', time=2024-09-22T10:57:13.371591+0000, chain.objs.size()=1 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EBZPcQii3jQE99aAin7YVlCPU-pSIqx_0 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3729216833375270212', time=2024-09-22T10:57:13.511317+0000, chain.objs.size()=1 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.P5tsQdw2LUC7nwF7AoUt80ah942krcn_0 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13853808360631269017', time=2024-09-22T10:57:13.583281+0000, chain.objs.size()=1 2024-09-22T09:16:02.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wVFhY7HMI96S7U38XB1voVXYNzOYvh7_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10495613801848222884', time=2024-09-22T10:57:13.910414+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RXlzq2hv-HuLGtgw5cUIHrZl7losRNo_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7579483581447590231', time=2024-09-22T10:57:14.399214+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.py0gpKy6D3M7vPEPlOcLF357k_KULmW_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5614512712490564553', time=2024-09-22T10:57:14.951600+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.npoFrQqQFrZwQi4nDFhaAgcWXMZ59dd_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.202979870209601424', time=2024-09-22T10:57:14.987550+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EVSqfpyv9rprgewPWxGHSto0zjNhpdZ_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9444449501125680075', time=2024-09-22T10:57:15.181910+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.H_8M2iuGlqaADaawcXWQePZcB6EkHps_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14394272484046453087', time=2024-09-22T10:57:15.365252+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.X8WSaHy0zBoIHMyekyuz2jDbzFGHx1n_0 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13255274439825609889', time=2024-09-22T10:57:15.443578+0000, chain.objs.size()=1 2024-09-22T09:16:02.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.024+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.HdEtZxlfRXWN2Jr3CZob9F-FawyeUoM_0 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.030+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3498827753452226470', time=2024-09-22T10:57:15.696436+0000, chain.objs.size()=1 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.abIEWhzzad6X54LECIAlSwUK30F6eyx_0 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2499339990946142664', time=2024-09-22T10:57:15.824335+0000, chain.objs.size()=1 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.sBPFBdBW0-TXM9zaB-YPyuk3oI052oC_0 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16701925871575917961', time=2024-09-22T10:57:16.280192+0000, chain.objs.size()=1 2024-09-22T09:16:02.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YyXzH4BIWYVJRzQsKkqubz_TX-9t1S7_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.932817638120909739', time=2024-09-22T10:57:16.653093+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3Jf58tNpMBxt8GO0q9h32yMtNeq10VY_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18215749737964051925', time=2024-09-22T10:57:16.799431+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ap9EGVR4Wbm_igqL8h2jELNIjmVtFC3_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9172249308940290416', time=2024-09-22T10:57:17.011905+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.S6Pm2jZOyqtE7SNVfxCcLydCZIjzhIG_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17865522992317240930', time=2024-09-22T10:57:21.039166+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.270__shadow_.3CfXhfMlnB0BbaLxuQHxV3GrPZXZ6N5_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7204521382264014893', time=2024-09-22T10:57:36.339567+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.oPkAvVjNFfoVXrN4WO7izSrw7mpNRnb_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10146092808602835774', time=2024-09-22T10:57:36.441221+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.eWH-LEGM4V96UWeJvoNZWp750sbWN0N_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17142209075229996052', time=2024-09-22T10:57:38.240477+0000, chain.objs.size()=1 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.c9Qbm7J8LorSGklHKr3B6BvJPRFwkAC_0 2024-09-22T09:16:02.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1097583886679782484', time=2024-09-22T10:57:38.241089+0000, chain.objs.size()=1 2024-09-22T09:16:02.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.bOWggsFMKiSgh_L7WMPrktbg3d2GVGC_0 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10837985978687680885', time=2024-09-22T10:58:34.419646+0000, chain.objs.size()=1 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.s6fcXrPCabCVgpWo0_tnRvmmky-FQ_P_0 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5282807640704412193', time=2024-09-22T10:58:35.070419+0000, chain.objs.size()=1 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RvYleDeZj6mfinhN_HDw2Um3k0IG8bC_0 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9594580886286524588', time=2024-09-22T10:58:35.178033+0000, chain.objs.size()=1 2024-09-22T09:16:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.036+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ic8K22v-iEwA4weCLlcap7Nne9-s5Of_0 2024-09-22T09:16:02.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13811462681818643269', time=2024-09-22T10:58:35.224456+0000, chain.objs.size()=1 2024-09-22T09:16:02.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cF4-OSRM4RsadEy25yiT7vmCWnElc6o_0 2024-09-22T09:16:02.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.918333969492291778', time=2024-09-22T10:58:35.283604+0000, chain.objs.size()=1 2024-09-22T09:16:02.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jSU1dJjJNwRWo7f0mskdm22i8PHTEA4_0 2024-09-22T09:16:02.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8876626769550210919', time=2024-09-22T10:58:35.397155+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AlJNmeK5wuoPPrEjetlx1Vs7x7Ol5hj_0 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.407256536485336817', time=2024-09-22T10:58:35.947019+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2gSPffq16wun5i3NeIS_9ORDy8ZQNQy_0 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17033029387682625996', time=2024-09-22T10:58:36.345868+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-hdj84mhRN0SD-MelgGa_8n0YDtx3o4_0 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13839358523724787618', time=2024-09-22T10:58:36.990482+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jDjyR5uapPGDxY6LJ8TVZxX2tKH6oIU_0 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17569107971572442690', time=2024-09-22T10:58:37.575828+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DrZPz5CIxMcXZfB9E1I56qhYEpN845t_0 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8598923931726257850', time=2024-09-22T10:58:38.133867+0000, chain.objs.size()=1 2024-09-22T09:16:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.038+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z43ga652Vg3-_r0qBo1fatG2HZGqn_B_0 2024-09-22T09:16:02.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.040+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7755371606003195036', time=2024-09-22T10:58:38.876345+0000, chain.objs.size()=1 2024-09-22T09:16:02.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.040+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CiMv-GF3f7y3OXHZrDrSj-U3dkvw2KU_0 2024-09-22T09:16:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.041+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3955683115023108983', time=2024-09-22T10:58:38.921097+0000, chain.objs.size()=1 2024-09-22T09:16:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7-JCIZWvFja9AmOMi_mETFBDRQJmP9H_0 2024-09-22T09:16:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.041+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16660247159159034466', time=2024-09-22T10:58:39.188396+0000, chain.objs.size()=1 2024-09-22T09:16:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qaRiUCPEpbjBX93LYbweHQTadjzLKsf_0 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11404033721681111137', time=2024-09-22T10:58:39.209128+0000, chain.objs.size()=1 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Nd6KuLx-nMYqykaeuRqLOk_KiaZM_KF_0 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8322815621578743123', time=2024-09-22T10:58:39.297807+0000, chain.objs.size()=1 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I5p6K-O-J8MbXkDKNxWWo-aGkzTWND9_0 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.531772068086135618', time=2024-09-22T10:58:39.432745+0000, chain.objs.size()=1 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.f5368t-qpiUwTKc9jsdUhNgUGTOf22V_0 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.043+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5011168783662482623', time=2024-09-22T10:58:40.304974+0000, chain.objs.size()=1 2024-09-22T09:16:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.044+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iSRMwuNt3SSfm_JQW5jF4DF07piNfLA_0 2024-09-22T09:16:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8835508279871536052', time=2024-09-22T10:58:40.306279+0000, chain.objs.size()=1 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8JfH6CNluVTouDbjSiPj5AMdDk58mt8_0 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11941028738504293281', time=2024-09-22T10:58:40.430109+0000, chain.objs.size()=1 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.blxEt6H0AetqXTIzB7GbPMTNPHvjTZl_0 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1190594549390419796', time=2024-09-22T10:58:40.535978+0000, chain.objs.size()=1 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QHNvtWVi68jXPKjYsid8uv7sJpO_Xeu_0 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17425936218765103445', time=2024-09-22T10:58:40.609037+0000, chain.objs.size()=1 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.maodzuWt75zLvbGyCsj2hujqcdp00H0_0 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15752745424619881311', time=2024-09-22T10:58:40.655975+0000, chain.objs.size()=1 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zuWnIfh9a0v0TU4QkEFwMlRnA4R_che_0 2024-09-22T09:16:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.046+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3219679808885837540', time=2024-09-22T10:58:40.657883+0000, chain.objs.size()=1 2024-09-22T09:16:02.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.046+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vCUVxBUjYF2akHSnkME2QjOLPUR9l5Y_0 2024-09-22T09:16:02.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.046+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17391946790635690540', time=2024-09-22T10:58:40.799750+0000, chain.objs.size()=1 2024-09-22T09:16:02.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.046+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7dVcspHSVojAeVbq0t4N4Swy013cj4W_0 2024-09-22T09:16:02.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15801161681335922173', time=2024-09-22T10:58:40.802747+0000, chain.objs.size()=1 2024-09-22T09:16:02.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RPkLqhiD0cWvoVqEKXInk6GSxKgfsl5_0 2024-09-22T09:16:02.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14197114474680284871', time=2024-09-22T10:58:41.267401+0000, chain.objs.size()=1 2024-09-22T09:16:02.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0UMrSY-d-figHQvKHN1__LI1W33T2eB_0 2024-09-22T09:16:02.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2316824530882123967', time=2024-09-22T10:58:41.639002+0000, chain.objs.size()=1 2024-09-22T09:16:02.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gZBDNY5Yh6Iv12iYj2ZrxJIWIOyQRf0_0 2024-09-22T09:16:02.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17591452239189668863', time=2024-09-22T10:58:43.014042+0000, chain.objs.size()=1 2024-09-22T09:16:02.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.048+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.l69hXPNfcG8jQ78WSxyEDGscn1RfrxX_0 2024-09-22T09:16:02.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.050+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8492115320904184072', time=2024-09-22T10:58:43.068761+0000, chain.objs.size()=1 2024-09-22T09:16:02.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.050+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-Y42jE4WOs6-mUwYrAbsf2t2W02dEFo_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17368766760939615862', time=2024-09-22T10:58:43.898510+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.65ZDPlsJlLL9KNQrfi646t9VZoxkuoJ_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17874146591774365907', time=2024-09-22T10:58:44.264240+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JCvYmfZOhtelXJwwrbJM-2ejZAnnXuN_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15546928412104136766', time=2024-09-22T10:58:44.541489+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qY-wGdrmHxJfECETXFAMwse_gogXqsb_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8733183149628006427', time=2024-09-22T10:58:45.006039+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bmbszNHk1OghCth98oBOyPZs6Kz5kpQ_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13500481848405382559', time=2024-09-22T10:59:22.666963+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ndPEnUxJ2USu9OADkAn0E66MK1cvQuA_0 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17547881334058539890', time=2024-09-22T10:59:23.012028+0000, chain.objs.size()=1 2024-09-22T09:16:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.051+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.t7DyPBzcvXfK39Xrak0tE4H9JxBEHUT_0 2024-09-22T09:16:02.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7011037975955713432', time=2024-09-22T10:59:23.852820+0000, chain.objs.size()=1 2024-09-22T09:16:02.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BVzfU44KZt7Y6Nj5cVy-HQtv880ob1D_0 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3943407744732950353', time=2024-09-22T10:59:24.554008+0000, chain.objs.size()=1 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WcKFeHQweCqiYGBh7B15hv1gjUa7k0C_0 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9594404041771720491', time=2024-09-22T10:59:25.022468+0000, chain.objs.size()=1 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ggRoE8Hp4gY4f-5YSR-mK4dk9eXLUtV_0 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11418432102329221397', time=2024-09-22T10:59:25.153062+0000, chain.objs.size()=1 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.92Vr64C3mCb4HV6A_fJaqVpwXtuXpwD_0 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8723216335882472692', time=2024-09-22T10:59:25.590596+0000, chain.objs.size()=1 2024-09-22T09:16:02.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.053+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.t7AfCSwwOg7Hhr4C7TVAtHtxmBPOjFW_0 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8050138806700313286', time=2024-09-22T10:59:25.669722+0000, chain.objs.size()=1 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9LI2yNZvMGro3utbesiWThMjsBBOKDr_0 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3620973580580501654', time=2024-09-22T10:59:25.820020+0000, chain.objs.size()=1 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OKsgBSXOQPmnBfr4eT3jSHof5ufAjFi_0 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14723154492539415388', time=2024-09-22T10:59:26.730366+0000, chain.objs.size()=1 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WYHNSYw2fhl_l9HWmMKznfnJEUNJoNU_0 2024-09-22T09:16:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14492180598850458909', time=2024-09-22T10:59:27.672874+0000, chain.objs.size()=1 2024-09-22T09:16:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.056+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ueYSIGdk-WrM6iAWnuweNv9rq-n1Q2L_0 2024-09-22T09:16:02.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14846257138494591946', time=2024-09-22T10:59:28.170793+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZKlPGkneCOV2JIYzFl5QFpqFXRPDWq5_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5394704601377639816', time=2024-09-22T10:59:28.798910+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ENPvayvt4UduR_1Zu1TlIjfm8yLp98M_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18141862036355927336', time=2024-09-22T10:59:29.518884+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rhTDTtaA_Uo7aV6nO3nJatbGDv8VXJs_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8766068975127054955', time=2024-09-22T10:59:29.634996+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nyojvKkgpdxTsK_0mjdYQYteElYxgM9_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8164069392320137320', time=2024-09-22T10:59:29.776498+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sxZJJlH8_yDQ2fLZP6Cr2w8KOG-9uy0_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11631070289254264488', time=2024-09-22T10:59:29.847145+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bxrhzqNHmEYb_595_-67jjz8O2Wc7Mx_0 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16486669190103353944', time=2024-09-22T10:59:30.035679+0000, chain.objs.size()=1 2024-09-22T09:16:02.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.058+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jZM4ndfiN6fYgvcKYXAiHFyATQgA5Tg_0 2024-09-22T09:16:02.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.060+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10341832484114732486', time=2024-09-22T10:59:31.279156+0000, chain.objs.size()=1 2024-09-22T09:16:02.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.060+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.E6n8kzb4N1MRTNruv_XHg2wKa0QlkzZ_0 2024-09-22T09:16:02.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.060+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13267296173132231983', time=2024-09-22T10:59:31.708145+0000, chain.objs.size()=1 2024-09-22T09:16:02.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.060+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eXNk3e9wjSTxchwedjRA3yqQCzlXgQR_0 2024-09-22T09:16:02.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.061+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11410521187404982589', time=2024-09-22T10:59:31.876588+0000, chain.objs.size()=1 2024-09-22T09:16:02.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.061+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YzGjHEw4XdfQmXEwflPh5h6hgEtivZY_0 2024-09-22T09:16:02.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.066+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43477 2024-09-22T09:16:02.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-22T09:16:02.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7761534322413562922', time=2024-09-22T10:59:32.325651+0000, chain.objs.size()=1 2024-09-22T09:16:02.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gWHJOowwNJ5cQxV3B8KOaIOqrJyBeZ3_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4303919325319896206', time=2024-09-22T10:59:32.338859+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.92PS05sUecUSSfgfN6DKUPJJ9LPESNF_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17458500350843776220', time=2024-09-22T10:59:32.432608+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f74-VO8PKnvOe3SOHAkbTOBB-TWcK5q_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17580043267219838042', time=2024-09-22T10:59:32.697363+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nqPNXBWf1SNY1oWJl4PeLPNabxCjHy-_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3760759210508343799', time=2024-09-22T10:59:32.725832+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.s0v4AJ-Q2Lpk6T_nM8h1RDc60G4vA_3_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14773309436489820835', time=2024-09-22T10:59:32.886253+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tMsz_wZm4U-TcojOi1D4sre116Lesrk_0 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.754192654302794716', time=2024-09-22T11:00:01.150581+0000, chain.objs.size()=1 2024-09-22T09:16:02.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.380__shadow_.nevj1xS86NazNt235sW1kjmQaDxMBbc_0 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4854297607917023711', time=2024-09-22T11:00:17.519890+0000, chain.objs.size()=1 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.408__shadow_.iHXtSSUvW1RabmAZDJeSo-bOHw_j1v1_0 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17077599821129682413', time=2024-09-22T11:00:28.464467+0000, chain.objs.size()=1 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.431__shadow_.TJ8ASvDzMkALz9e8b3fH-ldsItRFP7n_0 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10622624795548072982', time=2024-09-22T11:00:34.237117+0000, chain.objs.size()=1 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.441__shadow_.ZszotEHge-2wX1YgdnsJlW62WEGxjTL_0 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18322867041238742188', time=2024-09-22T11:00:59.863526+0000, chain.objs.size()=1 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.rxhIKXpA5DUKa0PQoKEnsQZwJID7pXq_0 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2705914033879127828', time=2024-09-22T11:01:09.589656+0000, chain.objs.size()=1 2024-09-22T09:16:02.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.070+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.497__shadow_.7YW_rHmFRdDR-uIs74ihEsTK8jcbyUP_0 2024-09-22T09:16:02.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8474583464362404415', time=2024-09-22T11:01:27.640934+0000, chain.objs.size()=1 2024-09-22T09:16:02.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.514__multipart_mymultipart.2~CkBaoaSX-kL2aCp0wrD_tNoTaFFaShT.1 2024-09-22T09:16:02.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3441354531687628425', time=2024-09-22T11:01:33.291255+0000, chain.objs.size()=1 2024-09-22T09:16:02.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.519__multipart_mymultipart.2~ejg27ogfvUUVSsbsSAFh2qmviWiEDo9.1 2024-09-22T09:16:02.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4407807118628142559', time=2024-09-22T11:03:07.105079+0000, chain.objs.size()=1 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.525__shadow_.lBmUWhA1O-nsdpPCde2TRjTfmAmsf8n_0 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.075+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~TR7BJHz8hYo5wKLcZGLEFYP5XjzNoVe', time=2024-09-22T11:03:19.301953+0000, chain.objs.size()=1 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.076+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.532__multipart_mymultipart2.2~TR7BJHz8hYo5wKLcZGLEFYP5XjzNoVe.1 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.076+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2211661255449739670', time=2024-09-22T11:03:59.630458+0000, chain.objs.size()=1 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.076+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.552__shadow_.hDB5x_kwbbiS2ydS0_1hskx8YUjddF4_0 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.076+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1595374489568168115', time=2024-09-22T11:04:09.307800+0000, chain.objs.size()=1 2024-09-22T09:16:02.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.076+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.557__shadow_._ky-TJEFAehGCcyfKMqKKS2uGa8HLnF_0 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14584342182831938663', time=2024-09-22T11:04:26.451780+0000, chain.objs.size()=1 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.566__shadow_.MuRyc-NgB_fVu9g_W3PO6qKPGp0iaOA_0 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4628325030180861893', time=2024-09-22T11:04:36.749700+0000, chain.objs.size()=1 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:ttLpnSFTV5tCgBjksDL.wSs4DbMAkFL_.lSOsjrHAo2JUgIq5RJ_3mNSfiJBUeSD_0 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15365881354867451268', time=2024-09-22T11:04:50.039700+0000, chain.objs.size()=1 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:mmoHFgMes9F.y8sagfNuXBWnmPq-RwG_.6dXRuvbpXCtn8QoqCHrqcxjyq8sncdG_0 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2962587512170792489', time=2024-09-22T11:05:00.956433+0000, chain.objs.size()=1 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:XejB-C9RMN4fVourblKdOtogsxpemqA_.KVQvvR2jNr1JYELibyjZgkxTdsJielo_0 2024-09-22T09:16:02.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4754471966335894758', time=2024-09-22T11:05:37.027632+0000, chain.objs.size()=1 2024-09-22T09:16:02.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:M8qvki8Rfp9HwLyrkW8VrWCNgw4saPj_.eViwK9F4dUEyFjIOE80I_bB40F52R_4_0 2024-09-22T09:16:02.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.081+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11977669889455719575', time=2024-09-22T11:09:32.244754+0000, chain.objs.size()=1 2024-09-22T09:16:02.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.081+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.636__shadow_.d1NM7k1tNEu9WD5Mgr36hl2R8DeasN9_0 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6716185605390629202', time=2024-09-22T11:09:46.545473+0000, chain.objs.size()=1 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.650__shadow_.CVmp2wQ9B4VzrdTmTjkl9D3jf-mGnhX_0 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~a-Wp61eCjfx_stm78Es2GjSzFFBEBwF', time=2024-09-22T11:11:24.825040+0000, chain.objs.size()=1 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.743__multipart_mymultipart.2~a-Wp61eCjfx_stm78Es2GjSzFFBEBwF.1 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2811773131670841338', time=2024-09-22T11:11:27.994649+0000, chain.objs.size()=3 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.744__multipart_mymultipart3.2~qtz6s2yJMHKR3I0LNm7wyoUttnmLFC4.1 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.744__multipart_mymultipart3.2~qtz6s2yJMHKR3I0LNm7wyoUttnmLFC4.2 2024-09-22T09:16:02.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.744__multipart_mymultipart3.2~qtz6s2yJMHKR3I0LNm7wyoUttnmLFC4.3 2024-09-22T09:16:02.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.085+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1257204389142860441', time=2024-09-22T11:12:20.870716+0000, chain.objs.size()=1 2024-09-22T09:16:02.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.085+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.758__shadow_.izWgFtHfShmxDt_of1IavXwuwpAnYj0_0 2024-09-22T09:16:02.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.085+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10036923001705049971', time=2024-09-22T11:12:48.261915+0000, chain.objs.size()=1 2024-09-22T09:16:02.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.085+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.764__shadow_.lV8isMRVXZ5ga2W0u1G2rj5iMws9k4n_0 2024-09-22T09:16:02.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.092+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.101+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:02.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.103+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43335' 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_0bbxofdOHtNX43NiT54Mmx85JrRtGMc', time=2024-09-22T10:54:16.425253+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.164__shadow_.qmZvnhMUWPGhW3rfUP18MSsJQDvYWia_0 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4725994551242038056', time=2024-09-22T10:54:21.521317+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.171__shadow_.2jB7YdSQSEw4pp6JxZsRB-twoC3T_qM_0 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13512296367245794230', time=2024-09-22T10:56:09.730485+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.231__shadow_.7awN9R6yXZUdR8ZP8m8PiEwTZkKKm13_0 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6396541748706944147', time=2024-09-22T10:56:11.616937+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.234__shadow_.VNqPhPSppGwNp9xbgUvhy8JAEiQ26m5_0 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.818569739981634072', time=2024-09-22T10:56:17.545371+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.243__shadow_.-eydGnBHPUitdl8RooFph9JzLAiZGiW_0 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10098138062619197748', time=2024-09-22T10:57:06.683935+0000, chain.objs.size()=1 2024-09-22T09:16:02.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cE078QsoEPYSXJnW75jak3w-O_dYC8f_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8893402753177510930', time=2024-09-22T10:57:06.985611+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aVud6qNzwD5vycEL_1zOaG30P_aBNEK_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17655330011685648030', time=2024-09-22T10:57:06.986589+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4ifBs5i8D_5ib6vMBQ8GSvgrlpcFWJg_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2338827399614817659', time=2024-09-22T10:57:06.988647+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oA7D2SaZVkBqEFlpVPb3FJJ6DHYi6qY_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11247178280671454550', time=2024-09-22T10:57:07.513433+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3d5GHHRDAnpQapT8RsMGqLctioIvRoI_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7908751987549593981', time=2024-09-22T10:57:07.819215+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fyAk6ghrpZL5w8PswGwTFdDtGVyI23t_0 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7414804658847155084', time=2024-09-22T10:57:08.400377+0000, chain.objs.size()=1 2024-09-22T09:16:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.104+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Zv8kDSZynqob5Cs7pBesHWUetDDVkjj_0 2024-09-22T09:16:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.106+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17312506286368422272', time=2024-09-22T10:57:08.426636+0000, chain.objs.size()=1 2024-09-22T09:16:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.106+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GjDxw9pD1Wek6x3TnANmFju9XpGPskj_0 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10725580721837198174', time=2024-09-22T10:57:09.161094+0000, chain.objs.size()=1 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.d1vk4H_3VNgN00QHv1zZFSR0HxoXUt6_0 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6175243910087187921', time=2024-09-22T10:57:09.256751+0000, chain.objs.size()=1 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PlIAoIwUGoET005ueyi7u2HH3EGWXWk_0 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10032509175303715679', time=2024-09-22T10:57:09.395001+0000, chain.objs.size()=1 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7V5Z0CWopG-QxFUt5CmlCFz-KCZBCVZ_0 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10676367678028047110', time=2024-09-22T10:57:09.430465+0000, chain.objs.size()=1 2024-09-22T09:16:02.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.v0gKeo6yGHaPvy_KevKeSttSzASX_60_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1076809955146391608', time=2024-09-22T10:57:09.431176+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TRQiODrFFEZcxonBtbhW_6ccGm9uCrz_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16403160422322662232', time=2024-09-22T10:57:09.912257+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dFO73HM89cs789OP-Be8seNithEE27I_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7970275332891288979', time=2024-09-22T10:57:10.642858+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oPK9z1AZkg_b_vdehWSBAcNkNlY_M72_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11731116595096957809', time=2024-09-22T10:57:10.797946+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.o_lsjwk5wgYC_c87O0ZtzN0wCTPNXuf_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.612229003645380087', time=2024-09-22T10:57:11.038007+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FQqcVB3DiK2AOKoN4avuHsAiQ0KZXpM_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6066234081235665159', time=2024-09-22T10:57:11.225167+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BuNuvPnAGWNly85RuQNjNVP1YQdAP2Q_0 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2161201804525083829', time=2024-09-22T10:57:11.274690+0000, chain.objs.size()=1 2024-09-22T09:16:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.110+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1MhCv3y6YGIdhDLWwEErpspc4qiDbXd_0 2024-09-22T09:16:02.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.115+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11297106059876424398', time=2024-09-22T10:57:12.039487+0000, chain.objs.size()=1 2024-09-22T09:16:02.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.115+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.r4cBn_vQY5RrnW-Z5wAJwzRxKag_0NW_0 2024-09-22T09:16:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11256675968648012723', time=2024-09-22T10:57:12.294211+0000, chain.objs.size()=1 2024-09-22T09:16:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gIFNl5WfxLKItepFy1oZWp3rNmsPbBk_0 2024-09-22T09:16:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15714319696496893469', time=2024-09-22T10:57:12.346043+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wfQHu7wxISLmD7jFbR_2l4tVv8EHl5j_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8131005940616102997', time=2024-09-22T10:57:12.494869+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Cy8bst2P4fXLfTFU6-p0Wo7ymoydrF4_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10338631007619202038', time=2024-09-22T10:57:12.744590+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dhl1gKfuXMJ6epEysj5e82np3gDiX7F_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9220968994585354266', time=2024-09-22T10:57:13.571837+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zYAA09DubL2RuHCqvQlWhdzdTxf0xfR_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10891308142206373718', time=2024-09-22T10:57:14.390149+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3BPtXJapqeSjMbXWeeXhKCU4iOu67Rk_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10508314207575556533', time=2024-09-22T10:57:14.883702+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.q4gxBibqXkJPoKHJnZkcYHpA3SEcTRx_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13685647306848567692', time=2024-09-22T10:57:14.999719+0000, chain.objs.size()=1 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g4FdHL4aIztAxFMAUMunFuMFayQVyNQ_0 2024-09-22T09:16:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7815035969725133395', time=2024-09-22T10:57:15.081225+0000, chain.objs.size()=1 2024-09-22T09:16:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TUn2hqVG5urrfi7lAz8xbGikCUXypX2_0 2024-09-22T09:16:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17220399826576070575', time=2024-09-22T10:57:15.194013+0000, chain.objs.size()=1 2024-09-22T09:16:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KBGxrn_kiT23JqWA8PKDNbXKioYiAfi_0 2024-09-22T09:16:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18130338559661925749', time=2024-09-22T10:57:16.162240+0000, chain.objs.size()=1 2024-09-22T09:16:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zfGv164q1fv_6XEMG8uspKIwoRvfeFI_0 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.122+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14921716404556810948', time=2024-09-22T10:57:16.569960+0000, chain.objs.size()=1 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.122+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.sLDftjJlHy0FaBLPjpW7vX-uHqFqeZM_0 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9428604643629844940', time=2024-09-22T10:57:16.709634+0000, chain.objs.size()=1 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nYwIzUJqTcf_s42KQqjNfk01c3v-GeZ_0 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3953473478791867433', time=2024-09-22T10:57:32.047460+0000, chain.objs.size()=1 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.288__shadow_.E-FlekAfTQqfv9xUkdnZ8kxHLnrsbTI_0 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17080273835006397942', time=2024-09-22T10:57:36.313379+0000, chain.objs.size()=1 2024-09-22T09:16:02.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.123+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.9R1sZjJrEKGNH13mH1zX6hoYNj-qC75_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10466774073362921934', time=2024-09-22T10:57:38.231533+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.O4JGjw54wOlA1SL2_BxcUTZp1VFcuH4_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5131976453865915864', time=2024-09-22T10:57:41.003197+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.298__shadow_.7SXU3scZow3rsDBQYBZzAh7FDafD8TH_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15803877745419024701', time=2024-09-22T10:57:44.207611+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.303__shadow_.cnl_Zijcrk_stYlX-Ci2UFXRl_5QY32_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14751339226944016367', time=2024-09-22T10:57:46.858317+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.307__shadow_.P2H2eU9YkGEcV8n_ezLNLG4QSGeKE8j_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2580166964455977628', time=2024-09-22T10:58:34.411043+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2rNHZdo2golIottpAr6b9DzydST5P6p_0 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12212771442225628572', time=2024-09-22T10:58:34.598013+0000, chain.objs.size()=1 2024-09-22T09:16:02.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WeFM-qVrPWIAZcb81tdT6cId1Ga69LE_0 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6288454112385001781', time=2024-09-22T10:58:34.831356+0000, chain.objs.size()=1 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.125+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Hnkwxt4kJ6H4DzPj275uh6KMfdfRYBk_0 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7691341988045185145', time=2024-09-22T10:58:34.936531+0000, chain.objs.size()=1 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.E4DVTmDVwmUiR4ngT5cBcwkNQ2skKrM_0 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12250007498047596250', time=2024-09-22T10:58:35.007009+0000, chain.objs.size()=1 2024-09-22T09:16:02.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YO9pyf1MxuI-FNAjeVid3AeM9S2qgog_0 2024-09-22T09:16:02.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7951768463898753326', time=2024-09-22T10:58:36.649109+0000, chain.objs.size()=1 2024-09-22T09:16:02.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GLByGwYDV8eTKtcS-ZVjWvjp4XeFcmv_0 2024-09-22T09:16:02.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7757962541677402613', time=2024-09-22T10:58:36.801315+0000, chain.objs.size()=1 2024-09-22T09:16:02.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.127+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3G46GDJ32QVd31FQmNTxaYY5XHoc-e5_0 2024-09-22T09:16:02.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7522456062664560489', time=2024-09-22T10:58:37.503217+0000, chain.objs.size()=1 2024-09-22T09:16:02.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-hgjxCCrXMxq7_W977BDU2IlYnYIOir_0 2024-09-22T09:16:02.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10012852908233672230', time=2024-09-22T10:58:37.596412+0000, chain.objs.size()=1 2024-09-22T09:16:02.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BMBgz3ke8a-WKU0-RgEuh2t_ci3aqF5_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14825800064210556667', time=2024-09-22T10:58:37.693466+0000, chain.objs.size()=1 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ekQdRNJzyfyx883zsJAFw69O_9kOoB1_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14108674027943987929', time=2024-09-22T10:58:39.043243+0000, chain.objs.size()=1 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NPxFzu1FIXIEO4Er3iZGUfDAlmL_JF2_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6641219489184970279', time=2024-09-22T10:58:39.197016+0000, chain.objs.size()=1 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qkymJkHjS2-sfQY1EBXJ4n7vvl6L4R9_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2193879657490245219', time=2024-09-22T10:58:39.366370+0000, chain.objs.size()=1 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jTPPSilBTwZKy4NAXQiScOKR5xNQg5b_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8625257649590282367', time=2024-09-22T10:58:39.871521+0000, chain.objs.size()=1 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RyDfH9roobH6XVen-MAK2i4HH2DJobC_0 2024-09-22T09:16:02.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8595119187993438842', time=2024-09-22T10:58:40.582155+0000, chain.objs.size()=1 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SZZEisBBEY8PsCDBZvFmO31bgDqHez2_0 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16078973086045276657', time=2024-09-22T10:58:40.875839+0000, chain.objs.size()=1 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WK8obw8NGRHsqNdue9rxZ3pdAfpgkI9_0 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.131+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2309214364806342803', time=2024-09-22T10:58:40.938112+0000, chain.objs.size()=1 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.131+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.r7K5KzrxeaeDcEdzbUMgdssldCyv-Jv_0 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.131+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11741465721905671387', time=2024-09-22T10:58:41.610921+0000, chain.objs.size()=1 2024-09-22T09:16:02.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.131+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.m_EdswxyRnLdeNEN5H0wHJBjC37d0Lf_0 2024-09-22T09:16:02.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.134+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6252085109871000077', time=2024-09-22T10:58:42.445259+0000, chain.objs.size()=1 2024-09-22T09:16:02.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.134+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TgrNPBM0rScGlkMX6o4EuiNKhKfguOq_0 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11792279594157606701', time=2024-09-22T10:58:42.972158+0000, chain.objs.size()=1 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZeGRTUQoiBcTFUoetHzJx9PJ3oU5C-d_0 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2186150214944303529', time=2024-09-22T10:58:43.102312+0000, chain.objs.size()=1 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QIrV0UUaz-ELYZzhPa9alVoE4TphxpD_0 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17827001178581484509', time=2024-09-22T10:58:43.199493+0000, chain.objs.size()=1 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lfRTDH74RxuAt2L9_Dud-KSFZDy3n6z_0 2024-09-22T09:16:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7489320182212747835', time=2024-09-22T10:58:43.681071+0000, chain.objs.size()=1 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6KvPXy22yun6oTjCM8YJToKiGynsXvj_0 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14219120684923683431', time=2024-09-22T10:58:43.978696+0000, chain.objs.size()=1 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zKIcAshd4KeIW_4cwFtJmsSBZWwr94f_0 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3423478767980770377', time=2024-09-22T10:58:44.435860+0000, chain.objs.size()=1 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4um4ouC7pgjPwQMBUgF7y9uk8tr91T4_0 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17966274442818713131', time=2024-09-22T10:58:44.820563+0000, chain.objs.size()=1 2024-09-22T09:16:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.EPGr6fDjXCWqyinnl0h3eFu6xt7U5cu_0 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5860611529180940670', time=2024-09-22T10:59:22.008433+0000, chain.objs.size()=1 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.w1lyF8kcgJd-ibzKnCj_8l2cFG9uh0B_0 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5513168169608950106', time=2024-09-22T10:59:22.056076+0000, chain.objs.size()=1 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.o_1SiSNrNWnw34XeTxkQPZxjP4ZWaCd_0 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.356631489653232887', time=2024-09-22T10:59:22.728174+0000, chain.objs.size()=1 2024-09-22T09:16:02.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.138+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PTOXHUPr-6ooOH2rKJdTLnn6IW-fYr0_0 2024-09-22T09:16:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3384234432012552594', time=2024-09-22T10:59:22.752419+0000, chain.objs.size()=1 2024-09-22T09:16:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Z42LUV7RcZXbN0tf14KcB5yxr2wFraN_0 2024-09-22T09:16:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2297279124227965737', time=2024-09-22T10:59:23.062761+0000, chain.objs.size()=1 2024-09-22T09:16:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.H4PXJ_17i7d9COxCwTX2JfuErIrtQ5T_0 2024-09-22T09:16:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12137615018824808889', time=2024-09-22T10:59:23.800302+0000, chain.objs.size()=1 2024-09-22T09:16:02.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.r0eayMmUhkS6ZJaFAYp2LUPjAri05lh_0 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5149911200820216010', time=2024-09-22T10:59:25.071110+0000, chain.objs.size()=1 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HkHp7UR6cF9NHKSMHyxOvlhLJ60h5mE_0 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3492548099199691375', time=2024-09-22T10:59:25.280978+0000, chain.objs.size()=1 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.143+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RZaTFug4PtgDLeF1phOkzArW8KQfl3X_0 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.144+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8736787145018462189', time=2024-09-22T10:59:25.287718+0000, chain.objs.size()=1 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.144+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8hZU9hpqU3VNpqBBtbbm2S-slxwFdVv_0 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.144+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5573288512102090761', time=2024-09-22T10:59:25.416464+0000, chain.objs.size()=1 2024-09-22T09:16:02.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.144+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EAwrlt9xrpoTGtdPYuVoiEluCO_4QA4_0 2024-09-22T09:16:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14462033321764255819', time=2024-09-22T10:59:26.025453+0000, chain.objs.size()=1 2024-09-22T09:16:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cYphctvL_ljX5HTtFnDeCi-jXjBwZ-d_0 2024-09-22T09:16:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13154292510985486304', time=2024-09-22T10:59:26.423839+0000, chain.objs.size()=1 2024-09-22T09:16:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5gZh9j6KLiZLOqSvOkeJEfeQqr0o9R0_0 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7250548617740957403', time=2024-09-22T10:59:26.548665+0000, chain.objs.size()=1 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lADHH7S87FVRSU5epYENKItYTR4Q0XY_0 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6119380587807287598', time=2024-09-22T10:59:26.916463+0000, chain.objs.size()=1 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EYGfVFe5VZ5_3aNvemdEpeA88Nvbvpv_0 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3812928144808703878', time=2024-09-22T10:59:27.319322+0000, chain.objs.size()=1 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IMf0xGFEhDwyk-5wpaFnGpQFS9nZMl5_0 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9645449749582576679', time=2024-09-22T10:59:27.608288+0000, chain.objs.size()=1 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jOEAsNbNqNG4aeZjl31g2wXxwi0sFnL_0 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8684820842418362637', time=2024-09-22T10:59:27.739150+0000, chain.objs.size()=1 2024-09-22T09:16:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yx8jw5F_2n3mfAykDX5rtOg5akrk9pD_0 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15540559666647808513', time=2024-09-22T10:59:28.533282+0000, chain.objs.size()=1 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SO-dMedGjzLsuvcYufmG4uSC8ReWw6x_0 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14721070517297197939', time=2024-09-22T10:59:29.133051+0000, chain.objs.size()=1 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MwKXPO1A0O3QgMWUvkN76cWXCUlUNG2_0 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10765148881546241086', time=2024-09-22T10:59:29.511989+0000, chain.objs.size()=1 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QAFYYQglboE0kg-ZOE_FVfPcxqvYv0i_0 2024-09-22T09:16:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6081603643193706457', time=2024-09-22T10:59:29.848512+0000, chain.objs.size()=1 2024-09-22T09:16:02.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.149+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.midNEFTdr4RWbzvS1VB3OJWoErL_PNj_0 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4015814871481157333', time=2024-09-22T10:59:29.958772+0000, chain.objs.size()=1 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Q5wXchHzLBce6Mrz2id7ffbgUUHZ6vW_0 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5375376468081830667', time=2024-09-22T10:59:31.003856+0000, chain.objs.size()=1 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.03Bss3fNocRS2wFVaHCFu3gYfFMFgFY_0 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12905534852509095103', time=2024-09-22T10:59:31.077548+0000, chain.objs.size()=1 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EksHBR6-718cTy3ycuvfg-V3WyeCEKL_0 2024-09-22T09:16:02.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7630722343106686566', time=2024-09-22T10:59:31.603064+0000, chain.objs.size()=1 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XDhanaJ3q9e-tRLu-fbuZBdpV0ky4ik_0 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12430675414079270986', time=2024-09-22T10:59:31.776126+0000, chain.objs.size()=1 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.buLl2Z80qBH-lauZebuJ_Rv9hR5DIOp_0 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1897587366396335929', time=2024-09-22T10:59:31.821527+0000, chain.objs.size()=1 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4-_xCA7LlLn2ofVP96RdpdTdmmRMN-M_0 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5598496510228585454', time=2024-09-22T10:59:32.444358+0000, chain.objs.size()=1 2024-09-22T09:16:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.152+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q9oKc14MaiAuz0ner0C-nTcXdjzbyNZ_0 2024-09-22T09:16:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.154+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16729391844021350781', time=2024-09-22T10:59:32.724998+0000, chain.objs.size()=1 2024-09-22T09:16:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.154+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tKhDVwMLYz9igywBQqGKkzmXJZyO93H_0 2024-09-22T09:16:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.155+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8522911018572217306', time=2024-09-22T10:59:32.841396+0000, chain.objs.size()=1 2024-09-22T09:16:02.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.155+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.j8siSIq-raJYWr5ERMysbgGpO35IU_p_0 2024-09-22T09:16:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.159+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43335 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15103198594777801471', time=2024-09-22T10:59:32.931439+0000, chain.objs.size()=1 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QeqWnyUrmquIF4fDJFpzbvo6zLK8s_e_0 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14971319198223210594', time=2024-09-22T10:59:32.945728+0000, chain.objs.size()=1 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0Wyw13OlKiokoU8hA1a3zWLTB44eYzL_0 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8359825476882978599', time=2024-09-22T10:59:32.946292+0000, chain.objs.size()=1 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rq0Uwgtmk-gg5qKwipA17FO8Lq_qnkE_0 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13239162845593491724', time=2024-09-22T10:59:32.974703+0000, chain.objs.size()=1 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lYB9jtx01nHx4gDfK69OPjV4zowQR8p_0 2024-09-22T09:16:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16690778110823687795', time=2024-09-22T11:00:46.365804+0000, chain.objs.size()=1 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.460__shadow_.K1CN5nc4PG-KfxTooOqp2cx_KiFPH6D_0 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17365851638597006599', time=2024-09-22T11:00:59.826958+0000, chain.objs.size()=1 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.b_DYMklHoO-f9envlsbPLxvp1hvhobk_0 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14723246613866347729', time=2024-09-22T11:01:14.306913+0000, chain.objs.size()=1 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13897405849670522483', time=2024-09-22T11:01:43.957229+0000, chain.objs.size()=6 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.1 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.2 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.3 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.4 2024-09-22T09:16:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.164+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.5 2024-09-22T09:16:02.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.168+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.520__multipart_mymultipart.2~51jyJp9qslTvP9AAUc4b6JFMXIL8Aqs.6 2024-09-22T09:16:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10016975456263546608', time=2024-09-22T11:04:08.644179+0000, chain.objs.size()=1 2024-09-22T09:16:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.556__shadow_.lnj1exMVZDEb98Y13I4uHKImhoRhZFy_0 2024-09-22T09:16:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13543057956164115659', time=2024-09-22T11:04:09.873286+0000, chain.objs.size()=1 2024-09-22T09:16:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.557__shadow_.hoQu0TS3JkpJ9GSvZlVvdbBQ__cWXMM_0 2024-09-22T09:16:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1922313959346248000', time=2024-09-22T11:04:20.064834+0000, chain.objs.size()=1 2024-09-22T09:16:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.170+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.563__shadow_.pCfgHuN2WzEjoDoWl9KmiUMOMRCtG2I_0 2024-09-22T09:16:02.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17232085033676704851', time=2024-09-22T11:04:40.656651+0000, chain.objs.size()=1 2024-09-22T09:16:02.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.571__shadow:uoFjSN9gSw6vTfy7rnZSp0tlb1HZKRh_.oIDeTIQes5vgMoEppqWJS23VwSbV92F_0 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5774843472811033595', time=2024-09-22T11:04:43.212308+0000, chain.objs.size()=1 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.574__shadow_.Bout536n0GFB-0gbIZf7fqK2AIt36Tz_0 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6227438588622978564', time=2024-09-22T11:04:44.316057+0000, chain.objs.size()=1 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow_.W0NoVLHnf5z2MD_5GMY-jTCyBqBerHi_0 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9314147072136323359', time=2024-09-22T11:04:44.371756+0000, chain.objs.size()=1 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow_.IV3SWrRvNOvYgZtrYDrubPrIYjwJMue_0 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12847898714917631119', time=2024-09-22T11:04:58.432628+0000, chain.objs.size()=1 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.173+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:w4QHOqSF31YPbSfhvJCw-W5fU4zes-N_.1hYuccv91BStIuUCRo-rcmdBBBSuq81_0 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6229144603785451207', time=2024-09-22T11:05:31.377004+0000, chain.objs.size()=1 2024-09-22T09:16:02.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:.PA7uEl9I7Dcp42sG9DGp6-08knnBD2_.II5O5xYROMCCfwCLzPxMP5i3zVCc5mi_0 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18308947274016608844', time=2024-09-22T11:08:53.173047+0000, chain.objs.size()=1 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.619__shadow_.xO6X0IfW5cSDZyQrdIAHeeQS4qm27MT_0 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.175+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5764853934215689408', time=2024-09-22T11:09:27.527307+0000, chain.objs.size()=1 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.175+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.628__shadow_.NzGbPIZDMNKGnwBCrpazu9BtHnUSFOZ_0 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.175+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16708777761684195766', time=2024-09-22T11:09:35.054952+0000, chain.objs.size()=1 2024-09-22T09:16:02.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.175+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.641__shadow_.Ykp9JmufUfTL3Ur1T5GILiP8eX7r4B__0 2024-09-22T09:16:02.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2969241220199765189', time=2024-09-22T11:09:36.763880+0000, chain.objs.size()=1 2024-09-22T09:16:02.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.643__shadow_.4AX7FoWjQy5yY5f8mjXIELgX4ORUegW_0 2024-09-22T09:16:02.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.905513975907231918', time=2024-09-22T11:10:17.037648+0000, chain.objs.size()=1 2024-09-22T09:16:02.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667__shadow_.ziIKqc_EGWx8buK6aTUbDfxYSKSwCxv_0 2024-09-22T09:16:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.178+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1426433156528338800', time=2024-09-22T11:10:39.529803+0000, chain.objs.size()=1 2024-09-22T09:16:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.178+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.709__shadow:1frB2MkyKrn8bEEYWAAen.OckZS9VJ6_.0lzssEdDC5VLvr6Z9WfQuBpnbCU4PB6_0 2024-09-22T09:16:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.184+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.192+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.192+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41603' 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_SWn8bXf5MTwab-xHXLg-qaIFVObD3j-', time=2024-09-22T10:54:16.399852+0000, chain.objs.size()=1 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.164__shadow_.Ll1TlTmvvzsXPPesEw7I_O6idE_mAI7_0 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4311878464514307582', time=2024-09-22T10:56:21.826969+0000, chain.objs.size()=1 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.249__shadow_.c_kRk61qi3RnvTUtH63ip9C82UEPR7r_0 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4459870702998779817', time=2024-09-22T10:57:06.212233+0000, chain.objs.size()=1 2024-09-22T09:16:02.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mRwaKwykADWuLYIuHVqCGAUMS0zCE73_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13371205151532463987', time=2024-09-22T10:57:06.226857+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.G5oywkHPoH6rdYx-v_FajKCAUJHvt4P_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12229657665641199691', time=2024-09-22T10:57:06.525815+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.feK5U9M83NvHazk13kX_d0QdYksfWP6_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9262652268293216740', time=2024-09-22T10:57:06.591458+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AzfI7V9seUsn9veqLD1Hl7htoT3TfkK_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14962521406414324169', time=2024-09-22T10:57:06.727350+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u6UsSKU3KZGcP52gJuTvu2bnPOUYkKh_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14519152197364090246', time=2024-09-22T10:57:08.191991+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x6qeIkLvViNK1lXunxuO8Hrb8jzuKi2_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13496698635512105329', time=2024-09-22T10:57:09.168951+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.f_0DZVOu6BdJ4oe99TJ3D-DbI1YpUwa_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9088791638785377386', time=2024-09-22T10:57:09.613755+0000, chain.objs.size()=1 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JtySUubINRMJNTCO39c3WjMJlZVeydW_0 2024-09-22T09:16:02.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1532114651737571498', time=2024-09-22T10:57:09.939331+0000, chain.objs.size()=1 2024-09-22T09:16:02.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lSDYS-UtAvocDIXdc8RVbwuWkMlngC-_0 2024-09-22T09:16:02.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.980187873136232513', time=2024-09-22T10:57:10.742958+0000, chain.objs.size()=1 2024-09-22T09:16:02.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.193+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.X4n17ui5qE-ZzJ4_MxU-3EsfsDey8GK_0 2024-09-22T09:16:02.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.196+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7013505187686305514', time=2024-09-22T10:57:10.912230+0000, chain.objs.size()=1 2024-09-22T09:16:02.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.196+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mrOdUfsBXtHmhMgetzGcuo7wPcJXgj5_0 2024-09-22T09:16:02.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.197+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9455194034307818631', time=2024-09-22T10:57:11.388890+0000, chain.objs.size()=1 2024-09-22T09:16:02.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.OpGVrlDoCH_YldZl_IY46Xt4lxHN_EE_0 2024-09-22T09:16:02.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.197+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2926677529288651335', time=2024-09-22T10:57:12.191135+0000, chain.objs.size()=1 2024-09-22T09:16:02.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bNFQ7nnkudeHDn6r6XjWKjls-hVJRdJ_0 2024-09-22T09:16:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15244666009620521866', time=2024-09-22T10:57:12.303593+0000, chain.objs.size()=1 2024-09-22T09:16:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LJslAeOvkXxmQY4WwJ81N6R1h66dxTv_0 2024-09-22T09:16:02.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13945664484148297245', time=2024-09-22T10:57:12.501619+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aBKbuLO2i4_JMxMLf5_5uMV71QrafMK_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8407714887312851359', time=2024-09-22T10:57:12.794909+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.HqFft4UgXD65gHbWYHYAA9KyTkjXOCQ_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4155139778809296505', time=2024-09-22T10:57:13.289867+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7SCvS9FOQVmVEaMvSK48-TNJN4CMXqt_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1832071057497118285', time=2024-09-22T10:57:13.390806+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.c4Vj_D19KNZgH_Fw9tqJtQhHto_tsQl_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7266625212010675768', time=2024-09-22T10:57:13.976635+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fJyf8GFHPpBjXWlUfnbZTVTK7XdzRSe_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1965228839596476368', time=2024-09-22T10:57:14.060052+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B6SjYBrkyL-F27n9oprdsXT8wTfk5ay_0 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14217186841438135212', time=2024-09-22T10:57:14.361235+0000, chain.objs.size()=1 2024-09-22T09:16:02.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XNHWMzu7qy16EQNy2dCQJrl5FbI6jmB_0 2024-09-22T09:16:02.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.201+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.98704259794514189', time=2024-09-22T10:57:14.437873+0000, chain.objs.size()=1 2024-09-22T09:16:02.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.201+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vIOOdT5uqwaNQpKZVYAmUDyfs_TQvNH_0 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.204+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10983065605257590220', time=2024-09-22T10:57:14.817869+0000, chain.objs.size()=1 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.204+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bGKqKgJIIOFb9JqCWSE_HMuw-wn3Umt_0 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.204+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.314713835598429541', time=2024-09-22T10:57:15.059802+0000, chain.objs.size()=1 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.204+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hYGhMfPZEc6Z_dFmzJHtaM8wTWnGoTa_0 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1869343592909281074', time=2024-09-22T10:57:16.424756+0000, chain.objs.size()=1 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9U-psEHGcVtHohjE5CueaYFIxoDy80B_0 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.328181762282733520', time=2024-09-22T10:57:16.464481+0000, chain.objs.size()=1 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fVPe2ggPFL1zD6hFDnmEhpkceUXYS4V_0 2024-09-22T09:16:02.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14453691618249128405', time=2024-09-22T10:57:22.228859+0000, chain.objs.size()=1 2024-09-22T09:16:02.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.205+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.272__shadow_.-lgX23bbA_meqO5XGCRNtrx84CUPVaX_0 2024-09-22T09:16:02.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.206+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13041810781643889069', time=2024-09-22T10:57:25.128210+0000, chain.objs.size()=1 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.206+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.277__shadow_.J8xl5pSTNu0aSxKvF_bRKDlwDmOQeaJ_0 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2617054313449354460', time=2024-09-22T10:57:28.190133+0000, chain.objs.size()=1 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.282__shadow_.efwLUzOP0712X9x6zcNiJaHKD8Y2Nqz_0 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6346943471234013966', time=2024-09-22T10:57:30.066656+0000, chain.objs.size()=1 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.285__shadow_._aEPTrabAZ8zSOjmImjQKAwJ74dm7hj_0 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8832559134679249910', time=2024-09-22T10:57:30.742939+0000, chain.objs.size()=1 2024-09-22T09:16:02.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.286__shadow_.4-KEXgHnsTMRedA1C9Wiu01bNXVDr56_0 2024-09-22T09:16:02.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3493068719882046230', time=2024-09-22T10:57:36.319778+0000, chain.objs.size()=1 2024-09-22T09:16:02.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.UgXr6F5E7ZaxHxYHLTgk5QoKsAS8mSz_0 2024-09-22T09:16:02.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7206683556587744690', time=2024-09-22T10:57:38.228845+0000, chain.objs.size()=1 2024-09-22T09:16:02.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.4zP7bmZNKB_YqGka8RsWzi-IldTNH5b_0 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15389095624310765384', time=2024-09-22T10:57:38.229522+0000, chain.objs.size()=1 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.mjBzER4xKv1mBYL8IVBSeoFciOMSYpF_0 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11289698834740968993', time=2024-09-22T10:57:38.230053+0000, chain.objs.size()=1 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.9cfryvFewLIgg3Nmg-hKM_p4P93c4_s_0 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10649454107124173092', time=2024-09-22T10:58:34.467132+0000, chain.objs.size()=1 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7MVhzs-umNWfGX5CVRm2K0ZUfbjpKcq_0 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14705892916109649405', time=2024-09-22T10:58:34.754879+0000, chain.objs.size()=1 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9P_SbsvS3E3-bUgZS0wK8aOCwl45ikg_0 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13470843361421538747', time=2024-09-22T10:58:34.832808+0000, chain.objs.size()=1 2024-09-22T09:16:02.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.209+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Du7FIxoKTzMQmA1PeD4Z06mu5rMxiE6_0 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1011989674766546665', time=2024-09-22T10:58:34.833524+0000, chain.objs.size()=1 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ottl7_RT02RdcePP_3I9K7KaqPVswcB_0 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17072752682824410434', time=2024-09-22T10:58:35.214670+0000, chain.objs.size()=1 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pWPAqh0vOW7SY7fGRPHnuSHZoO6XL4w_0 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7797245693716308371', time=2024-09-22T10:58:35.318115+0000, chain.objs.size()=1 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GuXBR9EX4wanbS40LKHGS7bp3ytcuZ8_0 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1075641553837358409', time=2024-09-22T10:58:35.318812+0000, chain.objs.size()=1 2024-09-22T09:16:02.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._jRLV_Bz7rg-LELKyb4RGwIp7mk8pVR_0 2024-09-22T09:16:02.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4687194324810035644', time=2024-09-22T10:58:36.010116+0000, chain.objs.size()=1 2024-09-22T09:16:02.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vfObfKE1PgyP3fNxOhulwsO-XybrdAG_0 2024-09-22T09:16:02.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6090280406172029096', time=2024-09-22T10:58:37.486788+0000, chain.objs.size()=1 2024-09-22T09:16:02.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wb_6yOxLS4_WQ7rNqqt3jrWV6OSC8sW_0 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4034576586499950949', time=2024-09-22T10:58:37.761878+0000, chain.objs.size()=1 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5SBmzknXlBRuq8Q2T9FhQMpsPbLyIu8_0 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523684018734514752', time=2024-09-22T10:58:38.088754+0000, chain.objs.size()=1 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.63JjpKG-Jk4uzT9ctR1ZwyFaJYeTo51_0 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17667205268281388706', time=2024-09-22T10:58:38.280786+0000, chain.objs.size()=1 2024-09-22T09:16:02.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.f29AuWV_xcHTMEUHKhfIgurAtX1hwsY_0 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11706839834771951548', time=2024-09-22T10:58:38.461076+0000, chain.objs.size()=1 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CG8eN3jEkSe2YValDQnQ33KMYrmNAAu_0 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11978890346175750300', time=2024-09-22T10:58:38.875326+0000, chain.objs.size()=1 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.215+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ROmbN77JW2keQsy0fnxsMRDEdtmlF1D_0 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.216+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11897749813977255547', time=2024-09-22T10:58:39.343748+0000, chain.objs.size()=1 2024-09-22T09:16:02.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.216+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lWdh_zsnbvLnEbxGampZi344VbwTA3G_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14376982556315706598', time=2024-09-22T10:58:39.344482+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bjbCSp-5GjlsB3DHRVUAf5o6Udhgn1d_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15594288586079837235', time=2024-09-22T10:58:39.406610+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QbM8vRxxdyCM5NIct3U_gvzvnJBL6cJ_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10344492771168552439', time=2024-09-22T10:58:39.586084+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lMK1GcqfADNg-c_IjQMyGue08jaN4s6_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1678244047396489406', time=2024-09-22T10:58:39.656265+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Q5r8p0LJL8PAG4NIgHcMb1YbsV6dppY_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17667388295449996990', time=2024-09-22T10:58:39.716130+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vU7GZgCbvNftU0uYHefDacgUubzTjIU_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8878389893192230191', time=2024-09-22T10:58:39.756424+0000, chain.objs.size()=1 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pCmNZ0ir8gtw_3dkmEcLGQGqfC7xiXQ_0 2024-09-22T09:16:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8154489770758795838', time=2024-09-22T10:58:39.790177+0000, chain.objs.size()=1 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CPy25rH2oS_bOgHHwmTF5athFuevdSK_0 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17990596715120819821', time=2024-09-22T10:58:40.429520+0000, chain.objs.size()=1 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oxi4HnN4VTIX0wA5KxaSrgGreQIaxT7_0 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6774164984422031147', time=2024-09-22T10:58:40.797043+0000, chain.objs.size()=1 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TIZi6Xb77MVjil2aTFRuKl4i3yhFNlD_0 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17844531100225372819', time=2024-09-22T10:58:40.910329+0000, chain.objs.size()=1 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.219+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JTTwtqv8h8qsT9OtSLSkt_3Z8wSoZsL_0 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.221+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15894005614258872212', time=2024-09-22T10:58:41.619247+0000, chain.objs.size()=1 2024-09-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.221+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4tsM7KiScXNGUbxJhzDnzSOqGrceliE_0 2024-09-22T09:16:02.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.223+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4325262600025919601', time=2024-09-22T10:58:42.042044+0000, chain.objs.size()=1 2024-09-22T09:16:02.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.223+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8X40ahAQszW666GwXbv2cqfGOkJvYcx_0 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14829571725698897210', time=2024-09-22T10:58:42.214210+0000, chain.objs.size()=1 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mSConCERPE9yXO-GiYlNHMybXWEBh8g_0 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14409014874939646676', time=2024-09-22T10:58:42.634272+0000, chain.objs.size()=1 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.g-oBdYNfsvL4pgjwvl0LI8uDN6NsZv0_0 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4320035601103001911', time=2024-09-22T10:58:42.635787+0000, chain.objs.size()=1 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.E89EB4Fv4T6n4tPQS8ZiM24eqRV8idu_0 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14642718596042108960', time=2024-09-22T10:58:42.641980+0000, chain.objs.size()=1 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zAaI7qWC4EIqs8hjkEScA_3AMCkKsix_0 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17110226638746578258', time=2024-09-22T10:58:43.244459+0000, chain.objs.size()=1 2024-09-22T09:16:02.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.225+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZLjFQ6nZdrO-GhAmMPMmMFkwn-bZkDu_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8586289795715403328', time=2024-09-22T10:58:43.377500+0000, chain.objs.size()=1 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-crSOHbWGPC0fkaxDK_4qMJfZW7sgeP_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16139625849735761402', time=2024-09-22T10:58:43.461320+0000, chain.objs.size()=1 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.u3LvKXmD5Gj7hrzt_Cm1WnnmemCGz75_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.820353097372921510', time=2024-09-22T10:58:43.539443+0000, chain.objs.size()=1 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.m1yzWOnyCUuZcOt978vtlIqIa_xZerI_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6818616463523978182', time=2024-09-22T10:58:43.639138+0000, chain.objs.size()=1 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YprISVV6_8Hk0My8emeXszbm_Hnp0KY_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14871895190766820319', time=2024-09-22T10:58:43.944667+0000, chain.objs.size()=1 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.INb79CsjQrKzLWG0AppsKfYJgqehmvi_0 2024-09-22T09:16:02.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4325843580503506927', time=2024-09-22T10:58:44.266441+0000, chain.objs.size()=1 2024-09-22T09:16:02.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.228+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yoNtmoqzIGWHNonO1jt8SA6BdGzl8V8_0 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14250601448121259995', time=2024-09-22T10:58:44.413510+0000, chain.objs.size()=1 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Vdmq96c7EWTkQ31NJARNSyeFoMr7Xcp_0 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4357822557363694938', time=2024-09-22T10:59:22.793229+0000, chain.objs.size()=1 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FjHE3Kc1FWul7COvHcQ4-Dce4QPOKCg_0 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1544802172462187147', time=2024-09-22T10:59:23.674375+0000, chain.objs.size()=1 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xjRa7du385EJishg56ZxNxO3R7IkgD3_0 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2686676636772458835', time=2024-09-22T10:59:23.849635+0000, chain.objs.size()=1 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Q3QQtm8Njrf4hK8a7WA4-1kM0yPz_4N_0 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8457344535472415770', time=2024-09-22T10:59:23.946762+0000, chain.objs.size()=1 2024-09-22T09:16:02.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.231+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uKmaCJIAE2YYsirmV0_fzQ9b4lPxZg0_0 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12351395564320891648', time=2024-09-22T10:59:24.278239+0000, chain.objs.size()=1 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tJqqA63QeJQgdPa6hUAxU0EXFC5mJ8a_0 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13377424800327341356', time=2024-09-22T10:59:24.498424+0000, chain.objs.size()=1 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pLnHRKgRCKgEx4XVHIQSnSPWjvfntQ4_0 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13818525469356408392', time=2024-09-22T10:59:25.024471+0000, chain.objs.size()=1 2024-09-22T09:16:02.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.232+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zp6oH0YRUXlTxPi4IkrUgWb6WmLOZ_C_0 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9292620602756656346', time=2024-09-22T10:59:25.190280+0000, chain.objs.size()=1 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EXwPz7K0st9zgG6VGLjj27mFHlhTG0-_0 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12771076887735405476', time=2024-09-22T10:59:25.555730+0000, chain.objs.size()=1 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.s5_97n95umdtZ9UWaB2BT76dCCjItQz_0 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16317960315397576873', time=2024-09-22T10:59:25.632771+0000, chain.objs.size()=1 2024-09-22T09:16:02.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.b9fJCkjw6wbLYfjDjqubxmF8bAGXghJ_0 2024-09-22T09:16:02.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.236+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1510966539725233096', time=2024-09-22T10:59:26.465390+0000, chain.objs.size()=1 2024-09-22T09:16:02.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.236+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tgXvkpAjUliVw56V6SVyTFsVlBsR0OY_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.405474602886832912', time=2024-09-22T10:59:26.466030+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FG3UzN-or1tUtMAjdMclv8ZqxMDoyQY_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8069715605516093470', time=2024-09-22T10:59:26.535266+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8T5ED6jvgVOzcOqs243Rn5lmQVmRYh5_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9855046712938410347', time=2024-09-22T10:59:26.714776+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.R62UOEuEWKoD_Dw1BlHvSjQH08bpSCj_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14653205824309954062', time=2024-09-22T10:59:26.796262+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Zro4JQ-qpJqBXd4tuClqIMjCa_4Dxh7_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8931879271833712675', time=2024-09-22T10:59:27.325946+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zYYvi3Cnyg0ymlZnaleyJWdvkhNODvT_0 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8382235232526535813', time=2024-09-22T10:59:27.570736+0000, chain.objs.size()=1 2024-09-22T09:16:02.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ijWmEGwxc9W4PEaFNMsqDJ75BpsmCIY_0 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.176518511361151946', time=2024-09-22T10:59:27.788359+0000, chain.objs.size()=1 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Fdf6D7HBmR4f6hDwUck_MFvdKmxly7y_0 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2424236473366483089', time=2024-09-22T10:59:28.541924+0000, chain.objs.size()=1 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2yVMM7yp47ye4HKNdetT9Q3Ptsrnavt_0 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12063045030552743958', time=2024-09-22T10:59:28.715689+0000, chain.objs.size()=1 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.diZfcCWGSMhmBwEhBhX2amvndZxbQpb_0 2024-09-22T09:16:02.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7544131471938162123', time=2024-09-22T10:59:28.851291+0000, chain.objs.size()=1 2024-09-22T09:16:02.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8PlaScHdU_ewLbr8COFa8nFtMK0lAOe_0 2024-09-22T09:16:02.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.240+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15678699147283323102', time=2024-09-22T10:59:29.108109+0000, chain.objs.size()=1 2024-09-22T09:16:02.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.240+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f2DCGgULWyYlILSfcLdYSgQVh7-xQvq_0 2024-09-22T09:16:02.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.244+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.690936067787900747', time=2024-09-22T10:59:29.529405+0000, chain.objs.size()=1 2024-09-22T09:16:02.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.244+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6ARYTZ_jmFom1bEahgXiqRVnDz5Pnme_0 2024-09-22T09:16:02.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.244+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2123297732179669188', time=2024-09-22T10:59:29.636768+0000, chain.objs.size()=1 2024-09-22T09:16:02.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.244+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8mjlE5scgcbE0h8dIbQyLrYM534Hvk__0 2024-09-22T09:16:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.247+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/41603 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2360692510488452307', time=2024-09-22T10:59:29.725331+0000, chain.objs.size()=1 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hddY1sSYBuYfmiXcmImRHYptmObLmBV_0 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2113447937881319876', time=2024-09-22T10:59:29.846623+0000, chain.objs.size()=1 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uCMYhhiwdLZ_F3MSeDpdL6fyrBRnN2o_0 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5746218844413606484', time=2024-09-22T10:59:29.911028+0000, chain.objs.size()=1 2024-09-22T09:16:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.y67wkKwsK3qADpnRilga5l2chSTV175_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4031724278545608742', time=2024-09-22T10:59:29.985479+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4tOV2-6K4Vz7QvhvOLoD6YDU9QN2r-r_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7317293801561964726', time=2024-09-22T10:59:30.140090+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8jGgC6Czac_vp8CBd8P9geNK3DXXueM_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527412300713704695', time=2024-09-22T10:59:31.511181+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UMXtFmKT5whxupirpB4i9PfM-_En662_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10515010678781049822', time=2024-09-22T10:59:31.580856+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QXPMJ9z2NTmArt8m2vTsRiaPdg9wn0y_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16708255712914039666', time=2024-09-22T10:59:31.644488+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ppJvdx0Wv4ZiZniYEj6avlZMKwcoAox_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7353949499681476448', time=2024-09-22T10:59:31.867213+0000, chain.objs.size()=1 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x_oQ2RRomsMkb92RnBDbuf-82bN8C4Q_0 2024-09-22T09:16:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11040020987352903239', time=2024-09-22T10:59:32.482592+0000, chain.objs.size()=1 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.v-PMdF7Z57U9tyfpXLw-7ckmozP7O23_0 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4623413024476906596', time=2024-09-22T10:59:32.970760+0000, chain.objs.size()=1 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.B0rL3yyekLpAjuxtn0DzUbhyY79dclV_0 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9354505700992160553', time=2024-09-22T10:59:55.528273+0000, chain.objs.size()=1 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.254+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.372__shadow_.rSZW3siCNeMcJpfNDz1SE3Nrq2qzdhL_0 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.256+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6422242540204923721', time=2024-09-22T11:00:40.171659+0000, chain.objs.size()=1 2024-09-22T09:16:02.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.256+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.451__shadow_.kQ6fISyrlpZqMFNvfFhUOq2zpAqfX2X_0 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.259+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9755669321274353343', time=2024-09-22T11:00:50.283726+0000, chain.objs.size()=1 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.259+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.465__shadow_.P-50X9Skqnoz6S9B8M1uYhVXNBAgomG_0 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4534759633743157014', time=2024-09-22T11:00:59.839153+0000, chain.objs.size()=1 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.a4bdaX5bSm6bY73kIil8yTXkGX6T8i0_0 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12822274191898239840', time=2024-09-22T11:01:05.335577+0000, chain.objs.size()=1 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.489__shadow_.btCXQRGfYNaisun3o4gI0mJW-Odp6SN_0 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9787254135163895469', time=2024-09-22T11:01:10.790170+0000, chain.objs.size()=1 2024-09-22T09:16:02.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.499__shadow_.noDeVW3fAE4w2RNCxppJvRdgfxAVFwt_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16582435476002938497', time=2024-09-22T11:03:59.428899+0000, chain.objs.size()=1 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.552__shadow_.L6pjijgQ7txzxJTVNJO-6D2MY1qKHxp_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9222039858571312658', time=2024-09-22T11:04:05.387175+0000, chain.objs.size()=1 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.555__shadow_.HsE_mfVV8uVVkx5-POHzm7v31-chB5k_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.922897738670272242', time=2024-09-22T11:04:18.569047+0000, chain.objs.size()=1 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.561__shadow_.77vPAjOtUPWC5S5VC4kafpkxVzJZAE3_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4723734483110158254', time=2024-09-22T11:04:31.242112+0000, chain.objs.size()=1 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:27O3NxHmtYHJLW2N8A8I1sQWWqRKGhq_.nkvb9OyVWJqlyh31Bl9jLRXpZccSGlk_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15878997626952136136', time=2024-09-22T11:04:40.607142+0000, chain.objs.size()=1 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.571__shadow:IflqpfG4Bh0tk3-WxZqH-f079.1tijH_.BUvc7_V8pbXFBdQvrgvJr5eIxyEWyvf_0 2024-09-22T09:16:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7408256292157920199', time=2024-09-22T11:04:41.285210+0000, chain.objs.size()=1 2024-09-22T09:16:02.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.572__shadow_.Y9zQXRlL7g8u4HRA8Zz3zERQDtmGYc3_0 2024-09-22T09:16:02.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11931497128610579520', time=2024-09-22T11:04:54.041809+0000, chain.objs.size()=1 2024-09-22T09:16:02.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:KVcr1wGSh2o5ZN-JVtoCiveDNsLpT5x_.drN2uha0FFfuc3UkG4bNLZ8u9pgIVqD_0 2024-09-22T09:16:02.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17230141777696671133', time=2024-09-22T11:05:03.665029+0000, chain.objs.size()=1 2024-09-22T09:16:02.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:kJyPD74b445dnG5JIIhllaWHX69Zy5d_.RoDB6OoC-95uABjnDV8JYHkz3WIfrun_0 2024-09-22T09:16:02.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15801737376814894666', time=2024-09-22T11:05:09.823287+0000, chain.objs.size()=1 2024-09-22T09:16:02.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:q0syYOcrg2sAnkDSdV4VpzADVRpcfn-_.lf2dvAZLXtYksDF9pBq-t3s3kPCgc05_0 2024-09-22T09:16:02.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18259611302986527154', time=2024-09-22T11:06:43.210303+0000, chain.objs.size()=6 2024-09-22T09:16:02.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.265+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.1 2024-09-22T09:16:02.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.2 2024-09-22T09:16:02.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.3 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.4 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.5 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.615__multipart_multipart_enc.2~5KJrbWDWRpSkPSsLo4bew6heRFpZU5h.6 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13034700957403685081', time=2024-09-22T11:10:14.265146+0000, chain.objs.size()=1 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.664__shadow_.25kZdWMh55S9MEL_FKAM5Clwj2ZS9Di_0 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7004675670853243726', time=2024-09-22T11:10:17.283495+0000, chain.objs.size()=1 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667__shadow_.PARyhh7hjaY2Rum5MQj9FS9HZHFS_6i_0 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3206404903837283719', time=2024-09-22T11:10:18.170124+0000, chain.objs.size()=1 2024-09-22T09:16:02.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.669__shadow_.DjnyQhzm0Ph0R0PtJR1Xex_7KkZXKIG_0 2024-09-22T09:16:02.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.274+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.279+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.280+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.281+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45489' 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5879377966553247239', time=2024-09-22T10:54:05.851493+0000, chain.objs.size()=2 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.oQskJMBNdAMGRUQp7N1E_ORMwUZIUCX_0 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.oQskJMBNdAMGRUQp7N1E_ORMwUZIUCX_1 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_LeIXzzR_C-3hFFfipsEXmQ_UnNJMSI2', time=2024-09-22T10:54:08.103212+0000, chain.objs.size()=2 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.WDHjq76_Qv1F3W15kzC5FJl6zksXXFY_0 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.WDHjq76_Qv1F3W15kzC5FJl6zksXXFY_1 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.736086313472281252', time=2024-09-22T10:56:22.417489+0000, chain.objs.size()=1 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.250__shadow_.XZkfgDgYod-qCR6-x37Dc1GYXMuuzKF_0 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1449745199519777553', time=2024-09-22T10:56:24.884352+0000, chain.objs.size()=1 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.254__shadow_.RnetPGApOu8efTXu1LANhpK2UC6Iro-_0 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17644836680221515502', time=2024-09-22T10:56:26.154159+0000, chain.objs.size()=1 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.256__shadow_.m6odl7rOqDlqq-_3Mn6ytyW3ZSAv15a_0 2024-09-22T09:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8718525131880110755', time=2024-09-22T10:56:27.880960+0000, chain.objs.size()=1 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.259__shadow_.0qASfGmpDjJ0cebtAC_Lz2QE4rH0lWY_0 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11999011523471396878', time=2024-09-22T10:57:05.946273+0000, chain.objs.size()=1 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KK6DvyjFB-U1Za4B7iAK3JArBVacVdP_0 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10697624412760798705', time=2024-09-22T10:57:06.087651+0000, chain.objs.size()=1 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dYUP3SMHNlZghsz6TboAugj7nVFUBmx_0 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14507117931244807638', time=2024-09-22T10:57:06.394634+0000, chain.objs.size()=1 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9nAoiN_lQvNkGAukUZP5gku5InaUOwl_0 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2902331774069091090', time=2024-09-22T10:57:06.848206+0000, chain.objs.size()=1 2024-09-22T09:16:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.282+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0NLXlANg5d424g849-lF5O_4P-tNGqg_0 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2013534345419138308', time=2024-09-22T10:57:06.902031+0000, chain.objs.size()=1 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.b1FT3_Z0zWvJGJTHla1GGcqR9NMioZx_0 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.802493452804463680', time=2024-09-22T10:57:07.512998+0000, chain.objs.size()=1 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3kjKPsXPj7PrNWPZVhV6XVyubZlDHq1_0 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.770663368593183518', time=2024-09-22T10:57:08.181563+0000, chain.objs.size()=1 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9VKz5Cijp1yl5nBnt2JlBVR8R2J5Pt3_0 2024-09-22T09:16:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9712156209675415506', time=2024-09-22T10:57:08.502227+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4bmwnpG5xdGyyXqvPvhlyx2TcfRFFCV_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3461726766818767486', time=2024-09-22T10:57:09.026935+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.n5hT2oKVQZL_pPkiqTcjN05spam6JWW_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12486061289025923566', time=2024-09-22T10:57:09.725889+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8giPjm3DkxmzB012klzk0izVGbGCgGn_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.847478244316442800', time=2024-09-22T10:57:10.022968+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MwW8z_cXObbAmwCQsqhNfZ6mIxWmslG_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2242575072085172457', time=2024-09-22T10:57:10.592033+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.sssFzHFUWtNsncsAX9oeQeo2x38ik5W_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9584338994912948371', time=2024-09-22T10:57:10.700423+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.drQjHu24mtKYUm3r_X8VSuQKZd05w0l_0 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13204085835187093822', time=2024-09-22T10:57:10.865735+0000, chain.objs.size()=1 2024-09-22T09:16:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AuUOATq1tA9vHv2lP3Dwpc54anl1bYJ_0 2024-09-22T09:16:02.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10571129613744869829', time=2024-09-22T10:57:11.049874+0000, chain.objs.size()=1 2024-09-22T09:16:02.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.288+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aU5OAdBJ5Do2wRGGpd7JGOr-Rsu6xVV_0 2024-09-22T09:16:02.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6782201777232823003', time=2024-09-22T10:57:11.050589+0000, chain.objs.size()=1 2024-09-22T09:16:02.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tVWlUHt3ptJJs4OzRPIqq6BCbnrYnA3_0 2024-09-22T09:16:02.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18074904260727558472', time=2024-09-22T10:57:12.574994+0000, chain.objs.size()=1 2024-09-22T09:16:02.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fngm2jMStYTFzP8kircCEU8fPaWMNGv_0 2024-09-22T09:16:02.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14009999060055652660', time=2024-09-22T10:57:13.581229+0000, chain.objs.size()=1 2024-09-22T09:16:02.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-dpya5X0qA9EQAeDfvL9mgCfE0mO-91_0 2024-09-22T09:16:02.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10034512677261474665', time=2024-09-22T10:57:14.246690+0000, chain.objs.size()=1 2024-09-22T09:16:02.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9RX5wHLAzYKYn6MtARTvt9ES8J1Zemo_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7429464581427969373', time=2024-09-22T10:57:14.281442+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MkLHFHdvaZzWgPyyej_97UJgfjHa-DZ_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9658652449223399281', time=2024-09-22T10:57:15.303111+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.F8dLbqkIJIwHlD9J6E-rlKgRbCOIcKt_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6092638801907167215', time=2024-09-22T10:57:15.536218+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7w-RCh7G42w0g8LkxvR93tdBmsUsUeu_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16839804652098906097', time=2024-09-22T10:57:15.572130+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4V6dWXgKij7I9BW8taQad9uebcvDNUc_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18004820589882119301', time=2024-09-22T10:57:16.553065+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cr0idQsjtFeglAr4BOMOUhb8mLQvfmP_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3128008486372808580', time=2024-09-22T10:57:16.848634+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ADfPeBvO62PI6L8wQX4cKw5LsHPZIT1_0 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15938963594227695627', time=2024-09-22T10:57:16.973584+0000, chain.objs.size()=1 2024-09-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.293+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pQwvPQkfGNfFikWvnNfDk7BJL-l1Bfg_0 2024-09-22T09:16:02.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.296+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4297982884589776377', time=2024-09-22T10:57:24.521773+0000, chain.objs.size()=1 2024-09-22T09:16:02.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.296+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.276__shadow_.4oI0xnd3Dp5zXTvOF6MaKKkMMStCyaP_0 2024-09-22T09:16:02.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.296+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9230129278028222539', time=2024-09-22T10:57:25.778917+0000, chain.objs.size()=1 2024-09-22T09:16:02.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.296+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.278__shadow_.Wq4Egr8RP8Ke-x8stF_zdyT_wYe-0bb_0 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5536559605692136269', time=2024-09-22T10:57:26.388675+0000, chain.objs.size()=1 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.279__shadow_.V2xZPZ7yuz9o_BLnXpBKJxyASG5eFZn_0 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13566372619106107072', time=2024-09-22T10:57:33.897261+0000, chain.objs.size()=1 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.291__shadow_.86a7DSdCjBZGRzjsPPQ8xGF3XgL1wo__0 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9518721787852446975', time=2024-09-22T10:57:39.788286+0000, chain.objs.size()=1 2024-09-22T09:16:02.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.296__shadow_.VgpjBNX9INRYqq5uqMtdrdvvqp-b_rd_0 2024-09-22T09:16:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10700462405477138020', time=2024-09-22T10:57:42.959283+0000, chain.objs.size()=1 2024-09-22T09:16:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.301__shadow_.JNOEiHn6MAPojA2FV5Qmt_73Cbn9CTT_0 2024-09-22T09:16:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16124830282436333821', time=2024-09-22T10:57:46.017014+0000, chain.objs.size()=1 2024-09-22T09:16:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.306__shadow_.WtCLrG_ZIBRTCWrzhHV6P0qZ8hM2v1D_0 2024-09-22T09:16:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7039637354042797363', time=2024-09-22T10:57:55.169919+0000, chain.objs.size()=1 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.320__shadow:Mpu1dQ9VTdTJuKAw238C2OFAJTKMkJm_.eh4MXd9LKQlKxZT9cuBX-FV4mn4UabQ_0 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7350935467763002911', time=2024-09-22T10:58:34.752948+0000, chain.objs.size()=1 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LAH79GjqIt7lAypy6payP568IcYiEwB_0 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14341069234070344223', time=2024-09-22T10:58:34.872284+0000, chain.objs.size()=1 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.P-k2nPFfHuw5kTJ4qiJsIggnrlW2W4b_0 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4435180606819066481', time=2024-09-22T10:58:35.068789+0000, chain.objs.size()=1 2024-09-22T09:16:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.299+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Q_dpgkYdUE7gobvG3RvDZ7zE3eQDh5Y_0 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14827303460557788307', time=2024-09-22T10:58:35.366200+0000, chain.objs.size()=1 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JgbOcu0pGcfZvbbERTy-t6UbV_DhzZ1_0 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12594032298893264408', time=2024-09-22T10:58:35.970855+0000, chain.objs.size()=1 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kL9i9xjOXvOcACBEjUl3vZ6psFJFlUr_0 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14924810121627093503', time=2024-09-22T10:58:36.316557+0000, chain.objs.size()=1 2024-09-22T09:16:02.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fZ-9Y8RgVZQ_4w0VFFE8WdoIEROn6oo_0 2024-09-22T09:16:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.303+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10409541421041587114', time=2024-09-22T10:58:36.444069+0000, chain.objs.size()=1 2024-09-22T09:16:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.303+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7RT_3P9Y5-HxPdboEl2_XTtxsCOjrg8_0 2024-09-22T09:16:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.303+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16826103629272932139', time=2024-09-22T10:58:36.498457+0000, chain.objs.size()=1 2024-09-22T09:16:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.303+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.enjBoMkScPhzq_6BXzneVMlM0qBaVm1_0 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18185696390400162602', time=2024-09-22T10:58:36.588698+0000, chain.objs.size()=1 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.909j-kzo7T1cJp-ihNugNnNOwGNqJCq_0 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10442829733223070967', time=2024-09-22T10:58:36.630389+0000, chain.objs.size()=1 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.J2D2GsQasnWzjLJ8Kjin4K7Wu8yD9ui_0 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2956080697467839507', time=2024-09-22T10:58:36.916554+0000, chain.objs.size()=1 2024-09-22T09:16:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NJzEFsHJIyVMRuoQtolA3JZCZeOVrKz_0 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15217408067691471609', time=2024-09-22T10:58:37.445514+0000, chain.objs.size()=1 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.304+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gGDB-uvl3-dh_4vNOaX96Gme6OTfSde_0 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.318871276215681069', time=2024-09-22T10:58:37.737992+0000, chain.objs.size()=1 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AQ5I4hOwrIzIO-ez7vwIGkpjlS1YbN4_0 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10866680619894859896', time=2024-09-22T10:58:37.913018+0000, chain.objs.size()=1 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CPDufyOLBSHMaHiihZdwtF8Eez12Zwj_0 2024-09-22T09:16:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10177017251070526811', time=2024-09-22T10:58:37.913732+0000, chain.objs.size()=1 2024-09-22T09:16:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9Kn2o5AEHNsfY7c9qo_ZRFTXyffCDYe_0 2024-09-22T09:16:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14405102730414172232', time=2024-09-22T10:58:37.915777+0000, chain.objs.size()=1 2024-09-22T09:16:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.305+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cMaeOIjo453mMLW5HvHDBDqAdUCjybd_0 2024-09-22T09:16:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10652190218124004375', time=2024-09-22T10:58:37.919302+0000, chain.objs.size()=1 2024-09-22T09:16:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.s80Q_yIg0GvO1PDmeAxi0H7IGTsWgy6_0 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.892567400055436814', time=2024-09-22T10:58:38.091001+0000, chain.objs.size()=1 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OcdhR5D3CbYqQktmXqVNkgduebyeb2f_0 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14386624796842757107', time=2024-09-22T10:58:39.283546+0000, chain.objs.size()=1 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.st8Y4tnO7MWESCPOaxcwaA1n_BtAPi3_0 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.308+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15850505561610189068', time=2024-09-22T10:58:39.810727+0000, chain.objs.size()=1 2024-09-22T09:16:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.308+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ke7PRvhMOtBg1h-BrFL9t2Cu8ODy7W__0 2024-09-22T09:16:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7353096789529036061', time=2024-09-22T10:58:39.869430+0000, chain.objs.size()=1 2024-09-22T09:16:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ss-gcJW7qZ44HvfUO0G9nwVsSv4AJ89_0 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14734399262329608923', time=2024-09-22T10:58:40.505398+0000, chain.objs.size()=1 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZX7MuBqiXVq0yDefx7T6bNfqZJqZqHr_0 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8107224589318150177', time=2024-09-22T10:58:40.967608+0000, chain.objs.size()=1 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1VRVzxocobdnqvgzz3pIU6eEq3xDTbO_0 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3415602655448872887', time=2024-09-22T10:58:41.074262+0000, chain.objs.size()=1 2024-09-22T09:16:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Iwj0Eyzk-YeEEK543fRQ6smK7o0R8o8_0 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15823674392446197113', time=2024-09-22T10:58:41.188899+0000, chain.objs.size()=1 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oALl5AqwsnPIeXFXd-JLKzxmmbOdCaf_0 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6397554046060548323', time=2024-09-22T10:58:41.769313+0000, chain.objs.size()=1 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6zAUOX2jjJaxhTMd63jOYvQhTcPrBkO_0 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18330670613352820985', time=2024-09-22T10:58:43.223520+0000, chain.objs.size()=1 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.310+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4B2eAFdgZDTJ7MIfkUZ4GfdpkKLXVEK_0 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.311+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6858199047993563895', time=2024-09-22T10:58:43.227405+0000, chain.objs.size()=1 2024-09-22T09:16:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.311+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.E_3uHFmMtbtbM5N0g8ArPCWqDa6RNpM_0 2024-09-22T09:16:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10405285554036090043', time=2024-09-22T10:58:43.544419+0000, chain.objs.size()=1 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KsXeB-ZeIJPtgiZVerVZrMYgEkd0xOT_0 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5141007977476606356', time=2024-09-22T10:58:43.683744+0000, chain.objs.size()=1 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hgCIxN017SgoRcDaFJpvh5--5dLJMfe_0 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16930263661213638914', time=2024-09-22T10:58:43.723886+0000, chain.objs.size()=1 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BQZq1dsjSbXczuiSfARmSbmEsP6mvkc_0 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15909212644792628658', time=2024-09-22T10:58:43.798460+0000, chain.objs.size()=1 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PEsD0GcmaJTOownibCnVjazjkCIiF-f_0 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15398164325449298212', time=2024-09-22T10:58:43.856796+0000, chain.objs.size()=1 2024-09-22T09:16:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.313+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oDsI9EEBOvvamgbwgsmaPZA-mJ0brDR_0 2024-09-22T09:16:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9988684349719007180', time=2024-09-22T10:58:44.321451+0000, chain.objs.size()=1 2024-09-22T09:16:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RRiiCbpkB1dgp2E8b5dODlChR3SPvI-_0 2024-09-22T09:16:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11571644740467736059', time=2024-09-22T10:59:22.313384+0000, chain.objs.size()=1 2024-09-22T09:16:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ya7oPb_uKGzZABvaEt2UOeiIhhlGgtw_0 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14271024383590577127', time=2024-09-22T10:59:22.453377+0000, chain.objs.size()=1 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2MLBlWxa8CCxkZaZMqaLLQfTT2ER3Oi_0 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5663144481614566230', time=2024-09-22T10:59:22.487739+0000, chain.objs.size()=1 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qGaFRCPPcBqoEy1yQb0NzSbryGKOtMT_0 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17166681112066194509', time=2024-09-22T10:59:22.489046+0000, chain.objs.size()=1 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JOglF-OIC8xZ1elkthq-gk8Xd6I9eQq_0 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3074581715959549664', time=2024-09-22T10:59:22.623549+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x0Pb2O8PqAbRWzUKnqZg_sFD-0aa59o_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.845608271789367707', time=2024-09-22T10:59:22.624798+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Y11PgLd0H7_w7T4K1J05fXshEJ8eiSK_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8622878296398223421', time=2024-09-22T10:59:22.909040+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1JkuTwejESJsoTTZLbo9QV58jPHDGvA_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4563495371666521892', time=2024-09-22T10:59:23.012946+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MeopKqUJNi4s7TEp8rUQ_bu9Kp2IQyT_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15765941778396865298', time=2024-09-22T10:59:23.705048+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pFe1WQKToTOSVRzTPvvq_rKxSMRwAoH_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7286233733703164474', time=2024-09-22T10:59:23.747078+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OazQQauS1O_3Vcx1AUh9PqEuuXY9A2V_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7386866564869597961', time=2024-09-22T10:59:23.962087+0000, chain.objs.size()=1 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Na7h5itlnpAKlyaJXKz0G9EWocmwd_-_0 2024-09-22T09:16:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.51631086369388064', time=2024-09-22T10:59:24.349618+0000, chain.objs.size()=1 2024-09-22T09:16:02.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OfF9SDm262SYb0U_TPWqkYqoZma7nT0_0 2024-09-22T09:16:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.325+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11526384746772688183', time=2024-09-22T10:59:24.451484+0000, chain.objs.size()=1 2024-09-22T09:16:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.325+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kYN9lP-9he8NPU2Hc2S_CeIuIyKOaru_0 2024-09-22T09:16:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.326+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16322581577457685053', time=2024-09-22T10:59:24.592725+0000, chain.objs.size()=1 2024-09-22T09:16:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.326+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lXdW-735oJ3SKUWwy6Mrl9rdCpJMNIr_0 2024-09-22T09:16:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.326+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8418150225527250622', time=2024-09-22T10:59:25.514424+0000, chain.objs.size()=1 2024-09-22T09:16:02.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.326+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1IXbZ2_kE0l0TdOl3GWLiMoXwPQ26zr_0 2024-09-22T09:16:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17772082133725840040', time=2024-09-22T10:59:25.723406+0000, chain.objs.size()=1 2024-09-22T09:16:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1YujhqAEVOrnzf9Wb4OvgOU17aooBTI_0 2024-09-22T09:16:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10848256058152203180', time=2024-09-22T10:59:25.835391+0000, chain.objs.size()=1 2024-09-22T09:16:02.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4uaPDnq_2bO0npypWVviusdWPztOr2l_0 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9436276642686169333', time=2024-09-22T10:59:26.588073+0000, chain.objs.size()=1 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SRUSq9ImeM-gjg_qPIz30YpyhysCJIz_0 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5579989123688440628', time=2024-09-22T10:59:27.546691+0000, chain.objs.size()=1 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.d22vfcLairw2b3r20rdj1v6XaUJZq79_0 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1424593442282646477', time=2024-09-22T10:59:27.752669+0000, chain.objs.size()=1 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YNQcMZ9Q55G-BFj333t51ZwD8WcIuRN_0 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11005257896415241230', time=2024-09-22T10:59:27.753386+0000, chain.objs.size()=1 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NCBVnvl2W6EDaBzHsI98enrkrex31Xt_0 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4450088984464807411', time=2024-09-22T10:59:28.160333+0000, chain.objs.size()=1 2024-09-22T09:16:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.328+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eypN_4HN8wu17LvpNISSaImso0NXunO_0 2024-09-22T09:16:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.329+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13663823582603663260', time=2024-09-22T10:59:28.190574+0000, chain.objs.size()=1 2024-09-22T09:16:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.329+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZSde_MfJ3lVvpaDhYr-7QW-pEEcx61V_0 2024-09-22T09:16:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4946093311508789978', time=2024-09-22T10:59:29.514827+0000, chain.objs.size()=1 2024-09-22T09:16:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.LSicXPqvy_cFV-F7-A5pI--qbTO-SPh_0 2024-09-22T09:16:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1532902588981331693', time=2024-09-22T10:59:29.665054+0000, chain.objs.size()=1 2024-09-22T09:16:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G_BF99LaC5Fc6WacKMSicsFIWdhnXa2_0 2024-09-22T09:16:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17028838057360742481', time=2024-09-22T10:59:29.762083+0000, chain.objs.size()=1 2024-09-22T09:16:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.331+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.29KYd3hJc3rIoR02-jLhUofPppXjHK5_0 2024-09-22T09:16:02.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.338+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/45489 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6041679550317048354', time=2024-09-22T10:59:29.910526+0000, chain.objs.size()=1 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Cij97TwHveu7x-mEXNR192LEQhzKMaE_0 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.632142637907230127', time=2024-09-22T10:59:30.125426+0000, chain.objs.size()=1 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QyaeedIg_MNlSuQMzHeyDgJCgIRC-se_0 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4613086972560577309', time=2024-09-22T10:59:30.528229+0000, chain.objs.size()=1 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZlXQaaSznyNn1H6RL9LwygMBy-gJvRG_0 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1395424446142872043', time=2024-09-22T10:59:30.925612+0000, chain.objs.size()=1 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Wtc66BqNN2HxfK1wIMlO244P-GFrjcy_0 2024-09-22T09:16:02.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12936855985555482012', time=2024-09-22T10:59:30.944427+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lIb2cvGpTQuFLWMKLkAUDyLOb39gkdx_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11659786403318489852', time=2024-09-22T10:59:31.223278+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ILpRW5mtUHljT_AxvqsuAdreXQb-jCA_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8568944621387986155', time=2024-09-22T10:59:31.225985+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ma3Is_DiNAtbwv6ebyRYxCPLOYlsthR_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13026936203507777906', time=2024-09-22T10:59:31.277686+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.adkNfiI2WevcRxODJKfUnTCKdnsj2K1_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3861765691721129727', time=2024-09-22T10:59:31.377726+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Sl3o0aZUZWj87NPSBpzy1PHW7__rib6_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5642177442545440688', time=2024-09-22T10:59:32.288447+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2Bj62mRrtQVg9v7aU8cXOl5v_kTjFG-_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3032964778540697167', time=2024-09-22T10:59:32.776236+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XRYsAIGKqkX2nmzyLAAKEAfZ5E0_8Qj_0 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1107616128321617770', time=2024-09-22T10:59:32.876671+0000, chain.objs.size()=1 2024-09-22T09:16:02.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pFN9MMQb68tVzn2Mmq8QqCxB-BGwvVE_0 2024-09-22T09:16:02.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.349+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7451637091958964606', time=2024-09-22T10:59:37.640950+0000, chain.objs.size()=1 2024-09-22T09:16:02.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.349+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.334__shadow_.S9NjUgKYcWp-S1YonmltEQNFKK73_tB_0 2024-09-22T09:16:02.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.349+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12474346429239034266', time=2024-09-22T10:59:43.316856+0000, chain.objs.size()=1 2024-09-22T09:16:02.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.349+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.345__shadow_.pTMHXdIu94IJAhU0CWKlwWs6ib_uC_Q_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17710752136439947250', time=2024-09-22T11:00:29.076251+0000, chain.objs.size()=1 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.432__shadow_.-sc2WNb6xlVDYQ4T_Y49U-vMW3HYc6c_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8993375391164647733', time=2024-09-22T11:00:52.377986+0000, chain.objs.size()=1 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.467__shadow_.tCQAMzobY63ZZwz73Tg71Vsaf3Ne3dn_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1984171820833523614', time=2024-09-22T11:00:59.841577+0000, chain.objs.size()=1 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.iby6C3v_SWl_8dTYCvMV8w58GbluVhn_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5320691752033116199', time=2024-09-22T11:01:00.582359+0000, chain.objs.size()=1 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.485__shadow_.nnuoZc00BaJKTlN89tqf9R3zKy6EIXU_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16415268315494975945', time=2024-09-22T11:01:04.695434+0000, chain.objs.size()=1 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.488__shadow_.r_3AcEkeFEJj1B1ARyjAjPy8O2TAVAt_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4319518397093867779', time=2024-09-22T11:01:56.702763+0000, chain.objs.size()=3 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:AsecWkfGZBud9-4EWtA2Wzn0JFVCSD._.BmKdj6T55gbrsjOslntrKwVaoXgt8js_0 2024-09-22T09:16:02.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:AsecWkfGZBud9-4EWtA2Wzn0JFVCSD._.BmKdj6T55gbrsjOslntrKwVaoXgt8js_1 2024-09-22T09:16:02.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.352+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:AsecWkfGZBud9-4EWtA2Wzn0JFVCSD._.BmKdj6T55gbrsjOslntrKwVaoXgt8js_2 2024-09-22T09:16:02.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.352+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.41798933787260147', time=2024-09-22T11:01:56.720494+0000, chain.objs.size()=1 2024-09-22T09:16:02.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.352+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:5YjVN-BRYl2R.PtxGD-Lpigfr2TNpG5_.KIRYQPr9exJsXP9zbCd002k6rM45Q9A_0 2024-09-22T09:16:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.355+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8853510361702556819', time=2024-09-22T11:02:43.339206+0000, chain.objs.size()=6 2024-09-22T09:16:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.355+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.1 2024-09-22T09:16:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.355+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.WDMnIkx4ZKW2WMdo8uQWubk3lGNaitMs.2 2024-09-22T09:16:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.355+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.-hUGq_mHxOjb_-LwMG8vctc_MnJY6tKq.3 2024-09-22T09:16:02.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.4 2024-09-22T09:16:02.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.5 2024-09-22T09:16:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.358+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.6 2024-09-22T09:16:02.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9655602274885881', time=2024-09-22T11:04:34.926793+0000, chain.objs.size()=1 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:5D-v47snXfP73uTxgVl9EC5VTBpkPPC_.wiOrSpuuVfMpKlHJGQ1fy3Sh2tMKUQt_0 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1565974076632061142', time=2024-09-22T11:04:58.944516+0000, chain.objs.size()=1 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:SBP7hBVKXGgsBvKuU.a3lE261ccT8yL_.ALxNcOJ0tLxqaxmP5RIuKjyC5gi6AcE_0 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14229286767383768295', time=2024-09-22T11:05:13.510660+0000, chain.objs.size()=1 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:ZM.rpp1UBVBSwg9q8lLOvT1VxvY.1.n_.d-eoS1KuE3XBqm0y8kSEQwcWmzojg7C_0 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9185832869933986633', time=2024-09-22T11:05:37.455074+0000, chain.objs.size()=1 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:pBsqXXMFaLAwQ8laQkta2cVq47mkrBQ_.4uUk-J3w7d50i44lF8oRnbKk7JHxR22_0 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6172558366280523429', time=2024-09-22T11:08:53.030284+0000, chain.objs.size()=1 2024-09-22T09:16:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.619__shadow_.w3_YNHVTeUUdcTp8nMtzHXOel8JkiDG_0 2024-09-22T09:16:02.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7837066141778586529', time=2024-09-22T11:09:13.795287+0000, chain.objs.size()=6 2024-09-22T09:16:02.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.1 2024-09-22T09:16:02.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.363+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.2 2024-09-22T09:16:02.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.365+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.3 2024-09-22T09:16:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.366+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.4 2024-09-22T09:16:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.366+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.5 2024-09-22T09:16:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.366+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.624__multipart_multipart_enc.2~Y2rIumBopmVnidhcqItOBehVtZTD2ze.6 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6683333167081123465', time=2024-09-22T11:09:45.072840+0000, chain.objs.size()=1 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.649__shadow_.jbGBYMNp8ioAw39rTm-IBHq0725kRc5_0 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12263885251570850296', time=2024-09-22T11:10:29.103585+0000, chain.objs.size()=1 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.692__shadow_.nHu2cFcc9ADPahVHO68MdRDxgAhf4QT_0 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13693099663853543345', time=2024-09-22T11:10:41.827087+0000, chain.objs.size()=1 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.713__shadow:6aU5IsrYa76FQZRxbshOq10Om4Mqhem_.6MxViJdlGbadUJ0Ta9bkkzLIiCVfZzc_0 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9684797376027582856', time=2024-09-22T11:11:05.358192+0000, chain.objs.size()=1 2024-09-22T09:16:02.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.720__shadow_.rlS3V072AL7gdGPq_m2gyFJL0XmuEFe_0 2024-09-22T09:16:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16240380426997909977', time=2024-09-22T11:11:23.062767+0000, chain.objs.size()=1 2024-09-22T09:16:02.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.369+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.741__shadow_.kyfCF0OlsVjNqAahgONkmgf1GG9zA1a_0 2024-09-22T09:16:02.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.374+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.376+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:02.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43399' 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_J_pg-49ujXdZkCT96XLmZmZ-_YozOfe', time=2024-09-22T10:54:14.468156+0000, chain.objs.size()=2 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.G0PMsLaE01qbPrUFN0vWCAOgRhpJ-uL_0 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.G0PMsLaE01qbPrUFN0vWCAOgRhpJ-uL_1 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9044839479308791899', time=2024-09-22T10:54:50.247964+0000, chain.objs.size()=1 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.204__shadow_.AB54-iY3-mFSKhiDs3DJeUZ98dD8vCo_0 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5334043503237896978', time=2024-09-22T10:56:18.459344+0000, chain.objs.size()=1 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.244__shadow_.XDST1AJiIFnCvn9UIXRLGrxOkhPuyD1_0 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2062440356793506250', time=2024-09-22T10:56:19.361062+0000, chain.objs.size()=1 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.245__shadow_.vfxX2lkk4mqfLX-C0NkyAc7lVwLyM3d_0 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3412228275101869597', time=2024-09-22T10:56:21.826702+0000, chain.objs.size()=1 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.249__shadow_.FDnkevs68qARib44OEEsn2XhvIVKW2f_0 2024-09-22T09:16:02.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15026573856597167162', time=2024-09-22T10:56:23.635404+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.252__shadow_.t0sTw5zXhVrIPfJhArezYItrUcxCRuF_0 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16088964819386083810', time=2024-09-22T10:56:24.249058+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.253__shadow_.dViba8VeDtumwI8ZnNg_IJy3piDKLW7_0 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.327531999513120251', time=2024-09-22T10:57:06.300272+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.d_AJPstgDkkpxDS76kMQyJ_XMfDu-Ah_0 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1545211827501134586', time=2024-09-22T10:57:06.749575+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.00gxHtcKSEeCiUl2BEY0TVRhK9Bro4n_0 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13772950072269811600', time=2024-09-22T10:57:06.948562+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6LMQHgWxHZ2Ith7vzOCf5_Pj7LMRZn1_0 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4979713607932820360', time=2024-09-22T10:57:07.510445+0000, chain.objs.size()=1 2024-09-22T09:16:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YjEY_0ntMD68Rxjadl0Ct2KPXyiIrS2_0 2024-09-22T09:16:02.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.382+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5699812665301711694', time=2024-09-22T10:57:07.731039+0000, chain.objs.size()=1 2024-09-22T09:16:02.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.382+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yHyTdhYfASm7A0-bjIZ7R6jMbd0gx7g_0 2024-09-22T09:16:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15435773552425000506', time=2024-09-22T10:57:07.802110+0000, chain.objs.size()=1 2024-09-22T09:16:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7xbBoe_TDpMIC4wOmM3a45vasiy8ozO_0 2024-09-22T09:16:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10336845988062547172', time=2024-09-22T10:57:07.984679+0000, chain.objs.size()=1 2024-09-22T09:16:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UrISG_eLdGUoad2g_NuuHIOpENnytEA_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10967981824069849156', time=2024-09-22T10:57:08.090961+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.e3-0AUNTCDDaLeHf40qYI0FssEuXvqt_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1280793910667848130', time=2024-09-22T10:57:08.169994+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.z4WEjc92zV_gouOHXC1ZenrpgFh4P7t_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16982572135798434027', time=2024-09-22T10:57:08.560438+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tp7B0Xw0T0mOLRld8pw47QW74fJwpvs_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2974074253722045058', time=2024-09-22T10:57:09.003132+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TmZ_-mOYNcZYfa-kYJIdvv_fVmI7oBA_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9892886596495284818', time=2024-09-22T10:57:09.166325+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uGcDAKP76LxWCFQa__w3cnqhPXgbsdF_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3333715729402898030', time=2024-09-22T10:57:09.358570+0000, chain.objs.size()=1 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KLxkHsnIbvsH8WC7JoDt4QTmbq8kptB_0 2024-09-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4784901564569168299', time=2024-09-22T10:57:09.695750+0000, chain.objs.size()=1 2024-09-22T09:16:02.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.spX-8f3QNcAj9aCka7PoqUwpFte0njt_0 2024-09-22T09:16:02.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3158752884550003744', time=2024-09-22T10:57:09.827316+0000, chain.objs.size()=1 2024-09-22T09:16:02.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4SUgzgUnGD5bvVqq2A2EMP4lK9Dn8wf_0 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9781156324807219055', time=2024-09-22T10:57:10.575948+0000, chain.objs.size()=1 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.l2vJE2pjGajRSNTwcwlgIYXeBSzbZFr_0 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3052457180588674451', time=2024-09-22T10:57:10.749890+0000, chain.objs.size()=1 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZR3lWDmusTFyBIxrBotjVAWSxfHOZPZ_0 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6030086193958306147', time=2024-09-22T10:57:11.032477+0000, chain.objs.size()=1 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.387+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SudqQADB5AfJg0lpg8yMM8UUjvWksUk_0 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.388+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18224800062941208432', time=2024-09-22T10:57:11.145511+0000, chain.objs.size()=1 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.388+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rZj5GxhRccGrr8ua_vBKP-DqyF2cHnl_0 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.388+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3756170367115090913', time=2024-09-22T10:57:11.452624+0000, chain.objs.size()=1 2024-09-22T09:16:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.389+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jZL28aFHvYlC66bPJCyQvkudfbdYyO0_0 2024-09-22T09:16:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.389+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.989844942153910987', time=2024-09-22T10:57:12.295711+0000, chain.objs.size()=1 2024-09-22T09:16:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.390+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.o30HjZxQ367I4mIFTTDXIjm2iIZVPNp_0 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.390+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.98074305569096198', time=2024-09-22T10:57:12.657260+0000, chain.objs.size()=1 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.390+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UdFHte7m4y9PK6L2b-XzKd0hyQSmIG8_0 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17109056349784630066', time=2024-09-22T10:57:12.726293+0000, chain.objs.size()=1 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rG-NB-ITXMT80KSeu8zcm7_v1YsZnQk_0 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.310734897366365438', time=2024-09-22T10:57:13.360473+0000, chain.objs.size()=1 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7FuTuEFEuv-fEDVnI1m32jHsUSofmeC_0 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10680830613469740606', time=2024-09-22T10:57:13.371346+0000, chain.objs.size()=1 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lix-VP5UdOcQ8ohc4TLcyVsYQLRL6jS_0 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16968633223609778994', time=2024-09-22T10:57:13.639763+0000, chain.objs.size()=1 2024-09-22T09:16:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.391+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lBe4S13Csmm9fbRNlqDQFPpP5UTsTy-_0 2024-09-22T09:16:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10474182520426135096', time=2024-09-22T10:57:13.912208+0000, chain.objs.size()=1 2024-09-22T09:16:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nz67W_KvSh15OpU3uT_L076VRNJxF2a_0 2024-09-22T09:16:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4487577491850027957', time=2024-09-22T10:57:14.140799+0000, chain.objs.size()=1 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TUhItSSi8aTDIRXfmo0SdZRidesWGJe_0 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5960333966185299349', time=2024-09-22T10:57:15.195742+0000, chain.objs.size()=1 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AXd1YNdXq9C94t6G7zjijMvTW46O812_0 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5389534354449193557', time=2024-09-22T10:57:15.461262+0000, chain.objs.size()=1 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UffR_8Ul8H2ePtw5GCxJSAZ7i4Q53Cp_0 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.393+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.506960792750843592', time=2024-09-22T10:57:15.678081+0000, chain.objs.size()=1 2024-09-22T09:16:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.393+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.14hDIIwJtPZO_4fPOkDMV4gCe_lGstD_0 2024-09-22T09:16:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.394+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2259221574320159286', time=2024-09-22T10:57:16.554535+0000, chain.objs.size()=1 2024-09-22T09:16:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.394+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u-iTYQOnesjW2Dn9U2Np7oTkLU6ncSv_0 2024-09-22T09:16:02.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5962360858717975605', time=2024-09-22T10:57:16.921188+0000, chain.objs.size()=1 2024-09-22T09:16:02.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bsGyb6i5QNQWmZRizARE-OsLyS_hPLp_0 2024-09-22T09:16:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10919972385544657320', time=2024-09-22T10:57:38.226034+0000, chain.objs.size()=1 2024-09-22T09:16:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.xE_VgLncoJnyN0LihoRNoEiUMER6KZK_0 2024-09-22T09:16:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11813929856200903705', time=2024-09-22T10:57:38.320114+0000, chain.objs.size()=1 2024-09-22T09:16:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.395+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.BSGXyfY55HWFobK2WLhGxT-pETTKrrp_0 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.171330435883944881', time=2024-09-22T10:57:46.011517+0000, chain.objs.size()=1 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.306__shadow_.IUDHa8v8D4K1O8EgJLtrWRPdpGw7EJs_0 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15417810653887261983', time=2024-09-22T10:58:35.032395+0000, chain.objs.size()=1 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vMTc2WJAjMsZ62BaCGJc7jgnIpcj4tN_0 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7856122543252075776', time=2024-09-22T10:58:35.070656+0000, chain.objs.size()=1 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Go27eeZFaQa1eXaqkNmthHeaE8GWETI_0 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.826652169324552631', time=2024-09-22T10:58:35.298974+0000, chain.objs.size()=1 2024-09-22T09:16:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rooERvNsBeNKaTmqN_Hbmz-hF4w_rgn_0 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5918445460154144572', time=2024-09-22T10:58:35.353596+0000, chain.objs.size()=1 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.llHgt_Um8aEnlpzRD5lDrqFoU1S4a5s_0 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6053679767816648647', time=2024-09-22T10:58:35.423233+0000, chain.objs.size()=1 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ITdDURYCJqTz9HpnvU2mqZHiX7GTzwp_0 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14359978984885381747', time=2024-09-22T10:58:36.295634+0000, chain.objs.size()=1 2024-09-22T09:16:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tJKWRSCUTocgLdF-ESiiNdqAGSsSc93_0 2024-09-22T09:16:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2086728713620941905', time=2024-09-22T10:58:36.465563+0000, chain.objs.size()=1 2024-09-22T09:16:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.399+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zekGqYC7W8d_TzQG62q31M5CI7kN977_0 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17184452163650964277', time=2024-09-22T10:58:36.869087+0000, chain.objs.size()=1 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HRqM0PyuzM7N-EB4OGkMW8rLcxMCzk2_0 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17387424354398945773', time=2024-09-22T10:58:37.514409+0000, chain.objs.size()=1 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I3Ur8-euwSYmisHXo98N-FJaeC9PVIR_0 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10322072473445288254', time=2024-09-22T10:58:38.116947+0000, chain.objs.size()=1 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MRF5_wLW7d9lFizgBgv0j343brgIN5h_0 2024-09-22T09:16:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12833980755890879201', time=2024-09-22T10:58:38.265699+0000, chain.objs.size()=1 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Nq0xUbAipahv3HlMvnhUtsC9Zecmf0D_0 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15984840257710359236', time=2024-09-22T10:58:38.925605+0000, chain.objs.size()=1 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gQFTJ8br_pt0Md6kLD5YKNsuOrYhwHo_0 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.494390882036036941', time=2024-09-22T10:58:39.023941+0000, chain.objs.size()=1 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ltYkcKi20Gln749MltYEIRyrfXJkl9u_0 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11509908502668632906', time=2024-09-22T10:58:39.810599+0000, chain.objs.size()=1 2024-09-22T09:16:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.401+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.C0axXnLun1jQtQFfnDLMVf5qmaVmntj_0 2024-09-22T09:16:02.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16291032212358137404', time=2024-09-22T10:58:39.904373+0000, chain.objs.size()=1 2024-09-22T09:16:02.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vU9DELrBj8sLi__kvR8bJui-Ps8z6Pr_0 2024-09-22T09:16:02.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16553748376817350422', time=2024-09-22T10:58:39.904976+0000, chain.objs.size()=1 2024-09-22T09:16:02.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lLb7zStQCWbSQar4bpT9H3Fpb4Ot_BJ_0 2024-09-22T09:16:02.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4087181418294794127', time=2024-09-22T10:58:40.292507+0000, chain.objs.size()=1 2024-09-22T09:16:02.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yfqVa_wU7MvSqlablCP6MB9ZJAeUN65_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18128700186468721700', time=2024-09-22T10:58:40.548013+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._nHmjRslsJO9NdsKRpHVxW5yYaOg6YH_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15704295009761651837', time=2024-09-22T10:58:40.859411+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t2J6Z5aXdp3aNPAHzz3dOJ9zMC-UWI0_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7558287133495055705', time=2024-09-22T10:58:41.086511+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qzWPnHgaHkKW0BmfA3Xxt3C4wkN-XBL_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8002840351887632037', time=2024-09-22T10:58:41.280736+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hwmMBPChc6I32flVrvsXk1WKp1_QTlE_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7815331231709933624', time=2024-09-22T10:58:41.293928+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.R7Ij51WPHUeDsvSeYIi4B3zYjuyOynZ_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14006924636129439857', time=2024-09-22T10:58:41.629826+0000, chain.objs.size()=1 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.spa4ZZk4sXconZ4a6HkDlbXnXdW8zaM_0 2024-09-22T09:16:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17102474471350826116', time=2024-09-22T10:58:41.895020+0000, chain.objs.size()=1 2024-09-22T09:16:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XmWF_OCsg9WierNC-5qRkGBoq1kGvf5_0 2024-09-22T09:16:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12308754769553513282', time=2024-09-22T10:58:42.155640+0000, chain.objs.size()=1 2024-09-22T09:16:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.407+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lSB80-395VdSU9c1DULb7GyL2bcRNDY_0 2024-09-22T09:16:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.411+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8661133852290297831', time=2024-09-22T10:58:42.579085+0000, chain.objs.size()=1 2024-09-22T09:16:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.411+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bEcII7dudmAu2TdjZpUYP2fBqzQjdsT_0 2024-09-22T09:16:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.411+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15709459851431457895', time=2024-09-22T10:58:42.657648+0000, chain.objs.size()=1 2024-09-22T09:16:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.411+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.c82-IPiB_sksZiIx5MSOjzjJju1sATs_0 2024-09-22T09:16:02.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.414+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12869475682770450427', time=2024-09-22T10:58:43.158802+0000, chain.objs.size()=1 2024-09-22T09:16:02.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.414+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kjp1LV0apt0-8P2dl8V9Nme4F7VIXjC_0 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13469031216786678844', time=2024-09-22T10:58:43.868523+0000, chain.objs.size()=1 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uIKGu-STAa4r3nRaT9XYOypbMeMoJz-_0 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16486134849040604872', time=2024-09-22T10:58:44.459626+0000, chain.objs.size()=1 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.46BXLTWnVpoM3-9KZ1-Sx2Vu5z__lFN_0 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5913872010044121984', time=2024-09-22T10:58:44.949051+0000, chain.objs.size()=1 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.aO56jwEk0Cz3WMTSi9LN8xZuD1cHGVL_0 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.433184484138733372', time=2024-09-22T10:58:44.949771+0000, chain.objs.size()=1 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5N2fELs34tMsNKT4P9NpBbaA2UhyeCK_0 2024-09-22T09:16:02.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9025886099874551227', time=2024-09-22T10:58:44.977393+0000, chain.objs.size()=1 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iUz3Ft_Xo9lJxvImVq93lptqqH5xJYo_0 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12725730826517202266', time=2024-09-22T10:58:45.082689+0000, chain.objs.size()=1 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iRVjREeXnvaxYAaKoAzFn8_GdLPattZ_0 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.79433344500774772', time=2024-09-22T10:59:22.134825+0000, chain.objs.size()=1 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kXAHMKqdcAUNgs8s-RJ-QBWER9yfgBO_0 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18135333091660806189', time=2024-09-22T10:59:22.196430+0000, chain.objs.size()=1 2024-09-22T09:16:02.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.415+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mSYrI3OnMm0jx-nGIajUvhkePj7vFN8_0 2024-09-22T09:16:02.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.418+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4805746509647538979', time=2024-09-22T10:59:22.253526+0000, chain.objs.size()=1 2024-09-22T09:16:02.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.418+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nf1umsbsE2XUocK-Tb4yqzL9k_EoXin_0 2024-09-22T09:16:02.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.418+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1577619284389241034', time=2024-09-22T10:59:22.487290+0000, chain.objs.size()=1 2024-09-22T09:16:02.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.418+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UHu4jZYXzyqEVc1vDgei0Zngn7GbKEh_0 2024-09-22T09:16:02.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13477912735343210027', time=2024-09-22T10:59:23.548330+0000, chain.objs.size()=1 2024-09-22T09:16:02.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q9Vp0U71xCrycDvajzEsSwUpe8k5aEp_0 2024-09-22T09:16:02.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2801441159095746324', time=2024-09-22T10:59:23.555492+0000, chain.objs.size()=1 2024-09-22T09:16:02.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2_X5NGufYja1lyXOzjNqUu-l8jxf0tl_0 2024-09-22T09:16:02.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.34944513923448708', time=2024-09-22T10:59:23.995899+0000, chain.objs.size()=1 2024-09-22T09:16:02.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.419+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bmH3yz8cQGFyQ1ORg3toxfQIU2XV33L_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6274901879127930734', time=2024-09-22T10:59:25.771614+0000, chain.objs.size()=1 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xW9y33uAVUPpHE6_uKE8j_N-U_DnfOt_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7553146640185385761', time=2024-09-22T10:59:25.851423+0000, chain.objs.size()=1 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.879iSpwmRCGsiFi0twss-kxZ3Y2JBWu_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2734150033414542823', time=2024-09-22T10:59:25.932024+0000, chain.objs.size()=1 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pg5F0QtBW9iO6gSvA3aTgEDa5xRRWL-_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11960310432102806305', time=2024-09-22T10:59:26.002338+0000, chain.objs.size()=1 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HZYydZJ8b9G5TiFxt437-m1aX6RirHJ_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18039941486607774711', time=2024-09-22T10:59:26.042930+0000, chain.objs.size()=1 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.knIpNO_TgZTEdkC3CUsP7ljhfbB6xdW_0 2024-09-22T09:16:02.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3484718084912517983', time=2024-09-22T10:59:26.911532+0000, chain.objs.size()=1 2024-09-22T09:16:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.420+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.V31G0n7NCZzygckOqlcnMvUzOf-Bt9p_0 2024-09-22T09:16:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.421+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7760141932512264111', time=2024-09-22T10:59:28.295008+0000, chain.objs.size()=1 2024-09-22T09:16:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.421+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.b8R5AEpkJzupXx83QX_cNhwv9aQXWwT_0 2024-09-22T09:16:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4600561779247686670', time=2024-09-22T10:59:28.450461+0000, chain.objs.size()=1 2024-09-22T09:16:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2jbYj-liAjuOqlcgtYRCd5FCOW1LG6x_0 2024-09-22T09:16:02.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4271430284889563482', time=2024-09-22T10:59:29.159308+0000, chain.objs.size()=1 2024-09-22T09:16:02.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.425+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oBAKQNg3AwRdYom5yC3C9sFjdJPD0qJ_0 2024-09-22T09:16:02.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9323177292214238880', time=2024-09-22T10:59:29.488690+0000, chain.objs.size()=1 2024-09-22T09:16:02.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4-DhAZetW_cyMKOJH56zvTSO6YbMrPx_0 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6740370514973743394', time=2024-09-22T10:59:29.517533+0000, chain.objs.size()=1 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lr2VWSJfXCyk9ibPklpbJqy9W_aGLXx_0 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3563446282606996616', time=2024-09-22T10:59:29.908345+0000, chain.objs.size()=1 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.i9lwdrNe9iTzqcsix3ZZtwpH7dL7dvo_0 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14921131083980808109', time=2024-09-22T10:59:29.974613+0000, chain.objs.size()=1 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kgeW5xGr66X-HVeElqzYyVPPACHdWxv_0 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.924256404224457141', time=2024-09-22T10:59:30.010794+0000, chain.objs.size()=1 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.426+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.A34989_MeE1grVEtC4DXd4CVIwCbpmb_0 2024-09-22T09:16:02.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6435647738400978764', time=2024-09-22T10:59:30.146000+0000, chain.objs.size()=1 2024-09-22T09:16:02.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5ANanaCNgCqDMxM62K8prxnxXd_WqRe_0 2024-09-22T09:16:02.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13567517084375091133', time=2024-09-22T10:59:30.267369+0000, chain.objs.size()=1 2024-09-22T09:16:02.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jPRr_lhyRb_eHwa6OFSME8ObEs_r_Sx_0 2024-09-22T09:16:02.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.434+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43399 2024-09-22T09:16:02.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-22T09:16:02.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12141461048253836822', time=2024-09-22T10:59:30.926966+0000, chain.objs.size()=1 2024-09-22T09:16:02.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yuF2lGvC-1l1A9UyYYfBarnZJCUDAI5_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1105150400513838711', time=2024-09-22T10:59:31.190504+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NnPu6ZsXJXJtJ5gaitACuqcrfHXBzTw_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14444586617910438518', time=2024-09-22T10:59:31.314027+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.R-6JAQPJovgLGhGh8aicXTJ0JZ5k2zx_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7867656635040816542', time=2024-09-22T10:59:31.472254+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.K0b7J5HAjunvqutBcbgHP0S5mc69xYA_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7860580384822694756', time=2024-09-22T10:59:31.473136+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WwctEr62i_6StVwVEUnMD_haMK8dNsa_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5104079501702037315', time=2024-09-22T10:59:31.572260+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.llSfD9dDwF_-8R0Q7UpLAuXiWyj2LOe_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4222494644451445499', time=2024-09-22T10:59:31.733052+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bwd_9h-vcWgCU3JpE7kr6RZrL8KR7vB_0 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10854137767685777851', time=2024-09-22T10:59:32.635601+0000, chain.objs.size()=1 2024-09-22T09:16:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HsCmXnESCdBzkb7p3vF26Kic0w8J4Yl_0 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1133011128640076056', time=2024-09-22T10:59:32.651240+0000, chain.objs.size()=1 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nNEIyiKgMz253RE8gv9ds35rS3vCjZQ_0 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12758939148601795969', time=2024-09-22T10:59:38.169401+0000, chain.objs.size()=1 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.335__shadow_.GQP8K7Qu0v10fsg9YOyYEskYZt5c-8x_0 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.954576814944681544', time=2024-09-22T10:59:47.208970+0000, chain.objs.size()=1 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.354__shadow_.tAfBoBiapPcCXEHyoII_zJjoWDS4s5S_0 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10969406641227988267', time=2024-09-22T11:00:00.951799+0000, chain.objs.size()=1 2024-09-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.440+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.380__shadow_.HmDX-uOlnNPfYFQNIa0fAtfftkGJU0Y_0 2024-09-22T09:16:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.443+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4768493348984463156', time=2024-09-22T11:00:31.183675+0000, chain.objs.size()=1 2024-09-22T09:16:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.443+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.436__shadow_.SxhA5wer4RDYVbAH3lNIcu3EIeqW-T__0 2024-09-22T09:16:02.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16231210312297967871', time=2024-09-22T11:00:44.743297+0000, chain.objs.size()=1 2024-09-22T09:16:02.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.458__shadow_.LEZtN7w2K_dDLQriR_Upf7f5EeD6Pdn_0 2024-09-22T09:16:02.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12805871072332126472', time=2024-09-22T11:01:05.884877+0000, chain.objs.size()=1 2024-09-22T09:16:02.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.490__shadow_.jTQbv7dm_AWYrwaIwAn-kDfTo1X9oiO_0 2024-09-22T09:16:02.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4759335767097181564', time=2024-09-22T11:01:14.817817+0000, chain.objs.size()=1 2024-09-22T09:16:02.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.301259+0000, chain.objs.size()=1 2024-09-22T09:16:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.1 2024-09-22T09:16:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.305188+0000, chain.objs.size()=1 2024-09-22T09:16:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.2 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.308795+0000, chain.objs.size()=1 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.3 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.312726+0000, chain.objs.size()=1 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.4 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.316385+0000, chain.objs.size()=1 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.5 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3', time=2024-09-22T11:02:43.320283+0000, chain.objs.size()=1 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~FEuzxtW2MdriuqvoZGNu5hSmOq_R7y3.6 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.657953785158488465', time=2024-09-22T11:02:56.511617+0000, chain.objs.size()=2 2024-09-22T09:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~aX9JgAWr-7xi6tlqC6rWgvxlNI6BwJf.1 2024-09-22T09:16:02.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~aX9JgAWr-7xi6tlqC6rWgvxlNI6BwJf.2 2024-09-22T09:16:02.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.450+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14392943247838476100', time=2024-09-22T11:03:01.793397+0000, chain.objs.size()=2 2024-09-22T09:16:02.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.450+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~r3w06G98iSCPtc7tdZaB4MpG62CmdMj.1 2024-09-22T09:16:02.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.450+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~r3w06G98iSCPtc7tdZaB4MpG62CmdMj.2 2024-09-22T09:16:02.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.450+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2963252640306146973', time=2024-09-22T11:03:03.356488+0000, chain.objs.size()=2 2024-09-22T09:16:02.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.450+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~ggnTUaZ8fdpvKok-zIpWtDFOEgQGvEj.1 2024-09-22T09:16:02.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.453+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~ggnTUaZ8fdpvKok-zIpWtDFOEgQGvEj.2 2024-09-22T09:16:02.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.453+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9549671021065367444', time=2024-09-22T11:04:19.539549+0000, chain.objs.size()=1 2024-09-22T09:16:02.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.453+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.562__multipart_mymultipart.5ATseDxOTftjgZBbLWAvKj4tkgrTRP2P.1 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12114902549369896342', time=2024-09-22T11:04:35.302771+0000, chain.objs.size()=1 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:NY8Acli5nqGPtcIhHZfS8ZwQNnjXwDc_.FT2vGsB7pbC29hX3IkoTp-Cr13Ucy3-_0 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2714249784522999526', time=2024-09-22T11:04:38.961446+0000, chain.objs.size()=1 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:AIkisx0.QhJN9O.I5yUCi.5E3stMK4t_.1w1NMHji2yhTQR6ZaRAz8Z23e7Ae2WB_0 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.20447249469462804', time=2024-09-22T11:05:01.726998+0000, chain.objs.size()=1 2024-09-22T09:16:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:dKeyr5eTdrP4F3JqvI4cxfM8xw7e9Zu_.2emcdMvWRPEiXJiDDpV_QWyE3ssAzT-_0 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13724655237376900617', time=2024-09-22T11:05:05.554647+0000, chain.objs.size()=1 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:N08hwDX1xSq4SmyBy8waWmMnGjrw4U1_.o9mMhfZ2h9QzmZB-cV2umS-M3t1IFTP_0 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12084962935577498352', time=2024-09-22T11:05:29.511906+0000, chain.objs.size()=1 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:-IA5D0tsK4bMncYtL6lO-ycYab4ZDZa_.JGtYJEDhf44mLHi6Tr2pT1B4mVIrjEF_0 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1037253589509836572', time=2024-09-22T11:05:35.142072+0000, chain.objs.size()=1 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.586__shadow:2BfUl3g8zuPmh9qJ.pTB-.TIc6V467o_.kFRwB7pgAuDhwZsEI2alcg8qwt8v5eZ_0 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12859846827613723467', time=2024-09-22T11:05:37.422464+0000, chain.objs.size()=1 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:p7-ArQTyFvpHWHW5uN196S5AIdlusAd_.VseEAjm7k4KMXr8b44KGeTrjSvelJtx_0 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16667793357638805313', time=2024-09-22T11:06:50.367398+0000, chain.objs.size()=6 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.1 2024-09-22T09:16:02.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.2 2024-09-22T09:16:02.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.459+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.3 2024-09-22T09:16:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.459+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.4 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.5 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.616__multipart_multipart_enc.2~wtf315EHoF-keM7Jj4XdltP6zwrFLN0.6 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.460+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11626360483602978665', time=2024-09-22T11:09:34.308864+0000, chain.objs.size()=1 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.640__shadow_.muPqpSh6VlMJN4Kc-ASo4mkPhLBV-b4_0 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18211016850977880452', time=2024-09-22T11:09:43.627814+0000, chain.objs.size()=1 2024-09-22T09:16:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.648__shadow_.QHNqgzfyc4lsPWUZ2u3akSjaDo0Edhk_0 2024-09-22T09:16:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.462+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16408222821778342025', time=2024-09-22T11:09:49.681090+0000, chain.objs.size()=1 2024-09-22T09:16:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.462+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.653__shadow_.Cu6nyp6j-qOgAuTg7TKu0QXK7yiW3nO_0 2024-09-22T09:16:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.462+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.938211515009045959', time=2024-09-22T11:13:08.078110+0000, chain.objs.size()=1 2024-09-22T09:16:02.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.462+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.772__shadow_.mlEaShXX49JcWyfQV3I-LDhl4WF6rJH_0 2024-09-22T09:16:02.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.467+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.470+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:02.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.471+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47169' 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9299432564389011522', time=2024-09-22T10:54:03.001419+0000, chain.objs.size()=3 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-LUKEWARM.2~8T38ehcoHN5uktZhCqFwVlFB29Zu0x_.1 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-LUKEWARM.2~8T38ehcoHN5uktZhCqFwVlFB29Zu0x_.2 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-LUKEWARM.2~8T38ehcoHN5uktZhCqFwVlFB29Zu0x_.3 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1977221124229386473', time=2024-09-22T10:54:03.029438+0000, chain.objs.size()=3 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-STANDARD.2~1kiCLP5gk9l4BBepzt9-4tFHFGXCOft.1 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-STANDARD.2~1kiCLP5gk9l4BBepzt9-4tFHFGXCOft.2 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-STANDARD.2~1kiCLP5gk9l4BBepzt9-4tFHFGXCOft.3 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13870382773423532283', time=2024-09-22T10:54:31.757513+0000, chain.objs.size()=1 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.472+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.178__shadow_.igXK1uyjNHu1yV8Cq_9g6-b6TEInkr5_0 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17262825534140577820', time=2024-09-22T10:54:34.115856+0000, chain.objs.size()=1 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.183__shadow_.R2_lqezWHMIxIx3KJFjO8U0fe493Pht_0 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16291738065692082580', time=2024-09-22T10:56:10.357476+0000, chain.objs.size()=1 2024-09-22T09:16:02.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.232__shadow_.2vsPxbak5zX0MA4YiiFB-lIN_QVjWEU_0 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7711951919263964511', time=2024-09-22T10:56:11.623420+0000, chain.objs.size()=1 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.234__shadow_.3Bl5wvgN8W-Iw1WltdvPg61rJxh8I29_0 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12289807244205507488', time=2024-09-22T10:56:19.350541+0000, chain.objs.size()=1 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.245__shadow_.SYogqAgtB_Tj_ArsIv4PdjkazEII0xJ_0 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4094592764483618839', time=2024-09-22T10:56:23.032484+0000, chain.objs.size()=1 2024-09-22T09:16:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.473+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.251__shadow_.ETyQEGOPiek_PTyU1z_xTgYVf7q4rwg_0 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2464289858655414510', time=2024-09-22T10:56:24.240798+0000, chain.objs.size()=1 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.253__shadow_.vys7ZIYzxA43Ee4lb1h_jFgK5omSAIg_0 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12816616859654529580', time=2024-09-22T10:57:06.461169+0000, chain.objs.size()=1 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._9fPA_1FrIsF0V3kqZErTGWCsB4xe1X_0 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16896297005179029621', time=2024-09-22T10:57:06.531740+0000, chain.objs.size()=1 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fxBNE8yi3HdP2GQ59VDIH33Lp-XaXBE_0 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12387315625422675537', time=2024-09-22T10:57:06.646547+0000, chain.objs.size()=1 2024-09-22T09:16:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B_GMnFFmz71_Pz6lKAWKH82S-dqU9jq_0 2024-09-22T09:16:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15948889014901997787', time=2024-09-22T10:57:07.730932+0000, chain.objs.size()=1 2024-09-22T09:16:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tHM_vod5NR63w68W4sCX_snHcKUkQFX_0 2024-09-22T09:16:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6441982723002685404', time=2024-09-22T10:57:07.793221+0000, chain.objs.size()=1 2024-09-22T09:16:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.OjlOITclf3lPrclrC7cdafBtZMB7KWq_0 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2621895030728271969', time=2024-09-22T10:57:07.887129+0000, chain.objs.size()=1 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0xNiUpt-I193beK8aPuvs6LgkiMmX4E_0 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3022877296744692556', time=2024-09-22T10:57:08.015986+0000, chain.objs.size()=1 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PjcwG-ph38oRm0qdGubvOU6CE2pn0zJ_0 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14011531348873978962', time=2024-09-22T10:57:08.019025+0000, chain.objs.size()=1 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.M_tXxPfTlPWBVFzLb_6Vxxf98NcLjdf_0 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5783118726219643830', time=2024-09-22T10:57:08.047979+0000, chain.objs.size()=1 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cwbvT03zrfcuCIFAQuPCUAwFGzcYiju_0 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6567032363736184353', time=2024-09-22T10:57:08.362248+0000, chain.objs.size()=1 2024-09-22T09:16:02.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zH9JuS4Q83Auo6FKhh8k3wySZelk0QB_0 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3921992427829230167', time=2024-09-22T10:57:08.365149+0000, chain.objs.size()=1 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.D4LYarYygVMNDKr_wgDumjBGbmQeUln_0 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.659293698738717768', time=2024-09-22T10:57:08.459334+0000, chain.objs.size()=1 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Sz0XYRTwjBGJnBb1FpnsjYCU6P2Bt1T_0 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11308897619789493046', time=2024-09-22T10:57:08.461953+0000, chain.objs.size()=1 2024-09-22T09:16:02.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0-oZsAjdH_O8_IK15-Jsv-gowA449XA_0 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15331379756469982869', time=2024-09-22T10:57:08.528084+0000, chain.objs.size()=1 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tvf7Hsfz9zLVVqvJnjefRmYWQ3LGBTo_0 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2634365041869488707', time=2024-09-22T10:57:09.032345+0000, chain.objs.size()=1 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.480+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jFOku_TpqoevfV7GyM8AOtDH-GZGdfp_0 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17597781066907593558', time=2024-09-22T10:57:09.033002+0000, chain.objs.size()=1 2024-09-22T09:16:02.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EWgMiihORXzbGr7Dh892vBwaYK9glrm_0 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.256548206000239359', time=2024-09-22T10:57:10.479771+0000, chain.objs.size()=1 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.n6mjFdYV5kYA8wkmIDiKipw_meh9dEk_0 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3010321810790428706', time=2024-09-22T10:57:10.843926+0000, chain.objs.size()=1 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Vp9aMxbCTgXqqcmDInEPNyun5tThqzc_0 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5452436307034280012', time=2024-09-22T10:57:11.400727+0000, chain.objs.size()=1 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g0dkdCuAdiloWHiybtaS_Jr62pjwh0w_0 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5824026619118877993', time=2024-09-22T10:57:12.123358+0000, chain.objs.size()=1 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ec5UEJcn0_0JZhkTs8JwRYKC5tzEHIW_0 2024-09-22T09:16:02.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17012753648336858843', time=2024-09-22T10:57:12.410262+0000, chain.objs.size()=1 2024-09-22T09:16:02.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hGdrDmFUtRgLqv63cPt8D8_hbmiap2m_0 2024-09-22T09:16:02.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.484+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9073808912526453143', time=2024-09-22T10:57:12.585536+0000, chain.objs.size()=1 2024-09-22T09:16:02.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oURdCnNXyFEj2_ec2JX6rOuZ5sm_Z0G_0 2024-09-22T09:16:02.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.484+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14792507542928201740', time=2024-09-22T10:57:12.864189+0000, chain.objs.size()=1 2024-09-22T09:16:02.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bv8l10mUJJbCF3-C01h18ELFjiiiwMX_0 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1740857732405734247', time=2024-09-22T10:57:13.259970+0000, chain.objs.size()=1 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EnuV_G8tqrIfV2e_0P9RDsKo4HPC28V_0 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3085438425975351128', time=2024-09-22T10:57:13.875795+0000, chain.objs.size()=1 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AKMcFr_6uDZ6ExzUFZFZ11ysYFEggWc_0 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4367631446073415506', time=2024-09-22T10:57:14.012775+0000, chain.objs.size()=1 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2f7C3koN8GGASFhf7LalDryIUTkKK8B_0 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12477391359394042373', time=2024-09-22T10:57:14.438549+0000, chain.objs.size()=1 2024-09-22T09:16:02.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.487+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J9_XgdIu7DYQ0sFftCBTmlw0p3aqrQb_0 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6372902630658994423', time=2024-09-22T10:57:14.454267+0000, chain.objs.size()=1 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.T6Y3mIsYiQpdcVWFPFhOk_tWgEOzxhO_0 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4343279413710031142', time=2024-09-22T10:57:15.184290+0000, chain.objs.size()=1 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8SUypm6yobk5I_IY_foJuQH38sHqs8U_0 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13787400806831482353', time=2024-09-22T10:57:15.265957+0000, chain.objs.size()=1 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.488+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BTSzmf3Ow9GnHlVoLaFtp9s_b-t0jcI_0 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3974551642419450719', time=2024-09-22T10:57:16.161317+0000, chain.objs.size()=1 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iVjuMUOAmHSnWP9DfVuF5hRphTTukkq_0 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16142170188945139785', time=2024-09-22T10:57:16.698580+0000, chain.objs.size()=1 2024-09-22T09:16:02.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4sMnE59Vn6ycNTuTtQJ2B8ikHHdcU_K_0 2024-09-22T09:16:02.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.152978914926695601', time=2024-09-22T10:57:16.863666+0000, chain.objs.size()=1 2024-09-22T09:16:02.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.sbe8MEJbW8ileVtvM5f_hbj4ZEGealG_0 2024-09-22T09:16:02.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3074286778247317838', time=2024-09-22T10:57:26.387363+0000, chain.objs.size()=1 2024-09-22T09:16:02.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.489+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.279__shadow_.6du5avIN5_UisZqpxo4PZJyQ1qdKqMr_0 2024-09-22T09:16:02.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17373563128039161209', time=2024-09-22T10:57:28.201542+0000, chain.objs.size()=1 2024-09-22T09:16:02.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.282__shadow_.pDjwVoLt30JGEcwOyTegDM8vj7TtGTh_0 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10228745958515507349', time=2024-09-22T10:57:36.424181+0000, chain.objs.size()=1 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.5S-MatHzmyD8LnPpFGYbcz1u52Ba7wz_0 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16202404258767270414', time=2024-09-22T10:57:36.440716+0000, chain.objs.size()=1 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.8Nd12M9OAjOGlbDps2m7aEgRpeXDinr_0 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5952815571393876687', time=2024-09-22T10:57:36.442963+0000, chain.objs.size()=1 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.Z_AksOBwTMjzz-AW1KaCIHJOS1f_V11_0 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4690519258959108609', time=2024-09-22T10:57:40.397099+0000, chain.objs.size()=1 2024-09-22T09:16:02.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.297__shadow_.cFYIbgrvtBa_WsuNb-M7sII8bA9tqhA_0 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14089783776433063645', time=2024-09-22T10:57:41.664793+0000, chain.objs.size()=1 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.299__shadow_.-dXY5iM5KKwLK1CrXXT2xr-h41b284c_0 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18390767498698513521', time=2024-09-22T10:58:34.520526+0000, chain.objs.size()=1 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0O8zIGhZg38hKm1snnfR8FEHnxufslb_0 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8567106401802625926', time=2024-09-22T10:58:34.579633+0000, chain.objs.size()=1 2024-09-22T09:16:02.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.492+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6pygwUTGCpiNkJaA6mFDkkMfLopgqkQ_0 2024-09-22T09:16:02.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.146352016293394959', time=2024-09-22T10:58:34.675620+0000, chain.objs.size()=1 2024-09-22T09:16:02.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wCmltS2BcL8Pt9ucARBRpN9ScjvpCvE_0 2024-09-22T09:16:02.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5187557568816252939', time=2024-09-22T10:58:34.789865+0000, chain.objs.size()=1 2024-09-22T09:16:02.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Pg2lUHnuZq3EvkMvf4D2QF4U0zVVbGH_0 2024-09-22T09:16:02.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6910805846898805215', time=2024-09-22T10:58:34.869369+0000, chain.objs.size()=1 2024-09-22T09:16:02.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vNaN-6dosmSE6EG7pmHUGIgT5A2t5Po_0 2024-09-22T09:16:02.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10485815940553328471', time=2024-09-22T10:58:34.913955+0000, chain.objs.size()=1 2024-09-22T09:16:02.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9ltXMzKdIyQC82hl-jd_pVjHYqfQiqt_0 2024-09-22T09:16:02.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.497+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10932639522194973093', time=2024-09-22T10:58:36.843772+0000, chain.objs.size()=1 2024-09-22T09:16:02.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.497+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lVA5zGsyO7HaIDvMfVgKbJwfp2E271K_0 2024-09-22T09:16:02.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7613998193697820616', time=2024-09-22T10:58:39.580159+0000, chain.objs.size()=1 2024-09-22T09:16:02.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.p7Bed61lMdH8fs7rv0DdmwL_FMKKagP_0 2024-09-22T09:16:02.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2487183338776043586', time=2024-09-22T10:58:40.534567+0000, chain.objs.size()=1 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BVGHUyXHhE_7TLCiafFkh5felI31bxb_0 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17435704090216171713', time=2024-09-22T10:58:40.644781+0000, chain.objs.size()=1 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rQEVq7OKsCn9ihZNHBL92QOyNPB4YcC_0 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1656254463101597972', time=2024-09-22T10:58:40.729185+0000, chain.objs.size()=1 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.upy-dPbtRqPy9O8n8CnnQvsUJsODuos_0 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18322452758336335340', time=2024-09-22T10:58:41.127564+0000, chain.objs.size()=1 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._XXBG7_7Dxll054YYiZANCYETP9DjdA_0 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11623839350283512206', time=2024-09-22T10:58:41.167057+0000, chain.objs.size()=1 2024-09-22T09:16:02.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.498+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dH4BdeXmntVvdcbhMJ_LFuyfwyMnzv8_0 2024-09-22T09:16:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.501+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9573952215978792344', time=2024-09-22T10:58:41.268123+0000, chain.objs.size()=1 2024-09-22T09:16:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.501+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3lSsM9YEY6a3NOLno7EfaTGseVFEQqp_0 2024-09-22T09:16:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13143823671764020241', time=2024-09-22T10:58:41.637214+0000, chain.objs.size()=1 2024-09-22T09:16:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8xf9tWjxA-108QzAoqqVKdiwtLFWxjY_0 2024-09-22T09:16:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1647294857133577997', time=2024-09-22T10:58:41.638518+0000, chain.objs.size()=1 2024-09-22T09:16:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2z4niY9yh_1ThUTsPQEFkhi-bnlTgXs_0 2024-09-22T09:16:02.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14716674203762041056', time=2024-09-22T10:58:41.803674+0000, chain.objs.size()=1 2024-09-22T09:16:02.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.g8kIFKWDl1asgsImgVOXzFZx3Nvjq11_0 2024-09-22T09:16:02.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6635694666309211931', time=2024-09-22T10:58:41.804454+0000, chain.objs.size()=1 2024-09-22T09:16:02.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.502+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9h1IhHroWVnnJ4H39aE7bai91eBcnHB_0 2024-09-22T09:16:02.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2377745583951719261', time=2024-09-22T10:58:42.066650+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OWaig4MTEZQ1Gsp6BjKMT14bsNJgp3n_0 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10467142127023077051', time=2024-09-22T10:58:42.254773+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qu50-dfMTVz_GPL8S-z4pDkGrBSVfz-_0 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3343363473973609578', time=2024-09-22T10:58:42.646793+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LKD5QvAFLib2GPm4TDnta8LTHG2kvrU_0 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6585342676307224210', time=2024-09-22T10:58:42.653527+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ylmofMhaCd_ZRqsDJdFueON9Rz3U7h4_0 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3398990541138656753', time=2024-09-22T10:58:43.370301+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mAI8dBPGWgQOqT9ss-Ntmiu-5h3NeA8_0 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17934921236853060667', time=2024-09-22T10:58:43.416079+0000, chain.objs.size()=1 2024-09-22T09:16:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.503+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PjpkokljNEPDUrDQY8cuyaWNqOn1Vcw_0 2024-09-22T09:16:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6260782055058596816', time=2024-09-22T10:58:43.544256+0000, chain.objs.size()=1 2024-09-22T09:16:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.E8ZdI7-AgMv4Vl_ZcYOY9lYsGVCl120_0 2024-09-22T09:16:02.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.508+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5532359642418431694', time=2024-09-22T10:58:44.588594+0000, chain.objs.size()=1 2024-09-22T09:16:02.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.508+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.P-Wdlq2AZQ5bCy5ui2067ksT6uMexRz_0 2024-09-22T09:16:02.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2243333841977780006', time=2024-09-22T10:58:45.059593+0000, chain.objs.size()=1 2024-09-22T09:16:02.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UcS32NALoTuK8BsNcb9YJeXmMwkQh_a_0 2024-09-22T09:16:02.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11229948472215889796', time=2024-09-22T10:59:22.129499+0000, chain.objs.size()=1 2024-09-22T09:16:02.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Bk-fmL7aTiAwNExWv6yjBmfVNSsfIJ1_0 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2943704340968878552', time=2024-09-22T10:59:22.197684+0000, chain.objs.size()=1 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EsesVWNSiSJwqphLXfKMna8p3ia39Sq_0 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4971008135020924758', time=2024-09-22T10:59:22.198339+0000, chain.objs.size()=1 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GYfr31vFfw9u6_qtbzrHfX0mdCkU-YP_0 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14602259593015098546', time=2024-09-22T10:59:22.461412+0000, chain.objs.size()=1 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yAFcHILJ8796UB4BnyfoZKTTAifyA20_0 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13184860350265437620', time=2024-09-22T10:59:22.776875+0000, chain.objs.size()=1 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0ad28wWd8R0cX_zSzUd4NFnjL-jw1IH_0 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2650191546826452504', time=2024-09-22T10:59:23.698797+0000, chain.objs.size()=1 2024-09-22T09:16:02.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0vUPH8uoV_D2qQs5tXfz9icpqQybHMV_0 2024-09-22T09:16:02.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8110236383541151688', time=2024-09-22T10:59:24.187649+0000, chain.objs.size()=1 2024-09-22T09:16:02.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q_BCgY-mtuyd3a5OaFdTRD5wREa_NQV_0 2024-09-22T09:16:02.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4470670115555011594', time=2024-09-22T10:59:24.233217+0000, chain.objs.size()=1 2024-09-22T09:16:02.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UTUHilIRf92DFr64uabJ6rEHOnU8Pr3_0 2024-09-22T09:16:02.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7069853095590942546', time=2024-09-22T10:59:24.552654+0000, chain.objs.size()=1 2024-09-22T09:16:02.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G8_oaQxPxWK_-LJeljF0Rk_QtMCGG3T_0 2024-09-22T09:16:02.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16332117059294715573', time=2024-09-22T10:59:24.555113+0000, chain.objs.size()=1 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7BQXVK3YWuqmVD4ETKqu9d8PFwy8HOv_0 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17175664948281825683', time=2024-09-22T10:59:25.217675+0000, chain.objs.size()=1 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FwLRXQpIuBgG4Hri-OHMWAsr7QNVtl5_0 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16345588565862257897', time=2024-09-22T10:59:25.420085+0000, chain.objs.size()=1 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qMKc9ERfy8rzQGyTgYK-F4u0yWPCcdY_0 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11595452241878705060', time=2024-09-22T10:59:25.457040+0000, chain.objs.size()=1 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.514+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZXs8VUnhROipx6kqAbRRok2N457ok8z_0 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2502511383107827035', time=2024-09-22T10:59:25.589089+0000, chain.objs.size()=1 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IRHRcbzbzJlczZwSHig8ALKE9RDndHx_0 2024-09-22T09:16:02.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15632874180579064562', time=2024-09-22T10:59:25.820703+0000, chain.objs.size()=1 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8sszUIVyroNSnm93j1WJNR4WZxXuWAf_0 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8796388488192090004', time=2024-09-22T10:59:26.412840+0000, chain.objs.size()=1 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uLegBGF_LzpVHhSQFRn9v_FAh6iCD94_0 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2339759221536446113', time=2024-09-22T10:59:26.848889+0000, chain.objs.size()=1 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.515+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.M2A-tBsjru0fjUxL1z33yVRwYeuW76p_0 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8902688085571757392', time=2024-09-22T10:59:26.920831+0000, chain.objs.size()=1 2024-09-22T09:16:02.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.61JVqtDijgUi36dHm4jru7xCEdaF7wR_0 2024-09-22T09:16:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.517+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17144313849014117612', time=2024-09-22T10:59:27.547227+0000, chain.objs.size()=1 2024-09-22T09:16:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.517+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.axKHOQW0oAPtZU0nqrA9xMWe7LB1kyX_0 2024-09-22T09:16:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.517+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5640967929487735257', time=2024-09-22T10:59:27.791265+0000, chain.objs.size()=1 2024-09-22T09:16:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.517+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0nqLA1ddyj__1tp8WL42OpUmfDPAr91_0 2024-09-22T09:16:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9986689525810578767', time=2024-09-22T10:59:28.300206+0000, chain.objs.size()=1 2024-09-22T09:16:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h-t4Cwfb7NCL1el0nwTy5uwVMoOs7Et_0 2024-09-22T09:16:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8817262544786601552', time=2024-09-22T10:59:28.355213+0000, chain.objs.size()=1 2024-09-22T09:16:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6Km910NFdpjOUERJmM7WC0w-UW11azn_0 2024-09-22T09:16:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11413202934430846177', time=2024-09-22T10:59:28.797000+0000, chain.objs.size()=1 2024-09-22T09:16:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-6Ow_XCkvczVs2HqqIUHJDIgtI130fX_0 2024-09-22T09:16:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9487396795747746025', time=2024-09-22T10:59:28.834669+0000, chain.objs.size()=1 2024-09-22T09:16:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.523+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DyjOTHD9Zdplw0pMKiUVPHyMN6hW1Ap_0 2024-09-22T09:16:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.528+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47169 2024-09-22T09:16:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-22T09:16:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18082557484187422286', time=2024-09-22T10:59:29.001385+0000, chain.objs.size()=1 2024-09-22T09:16:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5VQCENC0FLHAoI0nTSr2tGxXBI0C4vN_0 2024-09-22T09:16:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10575349123567714416', time=2024-09-22T10:59:29.844354+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IEsO4TvDFSGp7_-rhARvcQHCc8PO6xr_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.623648459712422454', time=2024-09-22T10:59:30.341295+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-xduzM-JipgokRhWa5VGr1VuekV1Q-H_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6149460858584356182', time=2024-09-22T10:59:31.344634+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sM4eL81tYV6-JBUzDBAcsGT2Fgol7w5_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1679849108562666519', time=2024-09-22T10:59:31.611634+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6ByAxpj2SnU07pQA7K6TRVGbSSpqVUk_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.714959932017026757', time=2024-09-22T10:59:31.707047+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jeX3x6k7T57598mjwYbx0HKGxcK7INW_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18037489610177917502', time=2024-09-22T10:59:32.156967+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ArNi5-DSo_WH8qAJoOCB_0vGCHgvHWo_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10053679657828289788', time=2024-09-22T10:59:32.384760+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lHbnULXRt4IT28-uZCt7UPJ0fuRV8fr_0 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1271545248991353902', time=2024-09-22T10:59:32.521980+0000, chain.objs.size()=1 2024-09-22T09:16:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1x1Hydt-OTcPohBPvT4a_vLwSfex3P6_0 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5312276522397478971', time=2024-09-22T10:59:32.677189+0000, chain.objs.size()=1 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GU7zArLiS3C_2JMFET5TgWJlFumOBa4_0 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12499413695218342510', time=2024-09-22T10:59:32.766951+0000, chain.objs.size()=1 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lYd8kIccDeuINUypNhz514L1Y2Umppk_0 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13113504339089023244', time=2024-09-22T10:59:32.771347+0000, chain.objs.size()=1 2024-09-22T09:16:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7u0pvk_m62uDbpPDLBCve85vBP_oN88_0 2024-09-22T09:16:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18076712445371599849', time=2024-09-22T10:59:32.828268+0000, chain.objs.size()=1 2024-09-22T09:16:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kcBeI2H_0izENaFwhMbfTJD0_mt-g2D_0 2024-09-22T09:16:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15133381621304045652', time=2024-09-22T10:59:32.887946+0000, chain.objs.size()=1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oE7t91f_wW2CmOk2LuD001rkVJlPsqv_0 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783261654231475658', time=2024-09-22T10:59:33.913823+0000, chain.objs.size()=1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.538+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.327__shadow_.chK1ofcgxbzhUl26VgsW4joCFA0v8tB_0 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10840496589254927644', time=2024-09-22T10:59:35.334404+0000, chain.objs.size()=1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.330__shadow_.1Yd9cDE9BMhjzjY4Jkoz-Tt7OZGvh5h_0 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1536070678287319350', time=2024-09-22T11:00:00.518288+0000, chain.objs.size()=1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.379__shadow_.az13liNuOtxrmH99jUZStm24L-MAP9F_0 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3109724343242288981', time=2024-09-22T11:01:05.332560+0000, chain.objs.size()=1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.489__shadow_.btCXQRGfYNaisun3o4gI0mJW-Odp6SN_0 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9396018317134007216', time=2024-09-22T11:03:38.253376+0000, chain.objs.size()=4 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.536__multipart_mymultipart.2~pQQqVHT-xHbTjXMhj1_07XWvG_l3Hov.1 2024-09-22T09:16:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.536__multipart_mymultipart.2~pQQqVHT-xHbTjXMhj1_07XWvG_l3Hov.2 2024-09-22T09:16:02.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.536__multipart_mymultipart.CHBaRyfUDLTGWnGPSqn4eOjx_8mCnuWL.3 2024-09-22T09:16:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.536__multipart_mymultipart.2~pQQqVHT-xHbTjXMhj1_07XWvG_l3Hov.4 2024-09-22T09:16:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3793347061729519959', time=2024-09-22T11:03:58.075396+0000, chain.objs.size()=1 2024-09-22T09:16:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.551__shadow_.IqZ4Kz_M6IbhVM95hm-8HoUSq6iDmOA_0 2024-09-22T09:16:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14971908102977469490', time=2024-09-22T11:04:08.370966+0000, chain.objs.size()=1 2024-09-22T09:16:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.556__shadow_.wyFRlZ9n4PnDuc0-wIm8S06Pt7SPEX1_0 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15758274445859042080', time=2024-09-22T11:04:46.035103+0000, chain.objs.size()=1 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:H7QvFCZfrg6hC5DyvpdCbtOes.uQYbJ_.VE0ziTqNohD0fTCYr0-9p_PA0tTSew2_0 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12060548846893523647', time=2024-09-22T11:05:08.296819+0000, chain.objs.size()=1 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:3pl1jyNq2oRdYV.trOG.60GLxb.8pLc_.bH6PYlH5XZIZPc45CyD1IEaGDU5-TY6_0 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1148584993053713509', time=2024-09-22T11:05:31.413342+0000, chain.objs.size()=1 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:.PA7uEl9I7Dcp42sG9DGp6-08knnBD2_.II5O5xYROMCCfwCLzPxMP5i3zVCc5mi_0 2024-09-22T09:16:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6418624461506497185', time=2024-09-22T11:05:33.161171+0000, chain.objs.size()=1 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.584__shadow:mkiCRzsu2rS4cdZFvZEMP7SLmy-4-qH_.vNUWBDUY3_OVQY6YqTNeKfZc_EIOuf3_0 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1061300019673722706', time=2024-09-22T11:05:44.494057+0000, chain.objs.size()=1 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.603__shadow_.JIgRC0V59ZQSXe2ARtc3MvO8bXuwSx5_0 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12977862818095603597', time=2024-09-22T11:05:47.436739+0000, chain.objs.size()=1 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.608__shadow_.184S5wmjakBrvsxPu0SgCYLueXsLzJy_0 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2217180400334300286', time=2024-09-22T11:11:24.715789+0000, chain.objs.size()=1 2024-09-22T09:16:02.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.545+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.743__multipart_mymultipart3.2~uYQwGbAgvShtrCnlKK4CWYtAl1F2gyh.1 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18277643681753922039', time=2024-09-22T11:11:38.346663+0000, chain.objs.size()=1 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.748__shadow_.K-EhwaQeU47QHV7_a4fd5l_isaXSsYI_0 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13514375819852074467', time=2024-09-22T11:14:02.068262+0000, chain.objs.size()=5 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.780__shadow_.3vblF39Ws16C91HSubKqMbjXCVH7JUe_0 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.780__shadow_.3vblF39Ws16C91HSubKqMbjXCVH7JUe_1 2024-09-22T09:16:02.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.547+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.780__shadow_.3vblF39Ws16C91HSubKqMbjXCVH7JUe_2 2024-09-22T09:16:02.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.550+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.780__shadow_.3vblF39Ws16C91HSubKqMbjXCVH7JUe_3 2024-09-22T09:16:02.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.550+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.780__shadow_.3vblF39Ws16C91HSubKqMbjXCVH7JUe_4 2024-09-22T09:16:02.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.555+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.561+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.562+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43178' 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_WpCScfTDUhKma7-gocNKaZyG9_AJzy8', time=2024-09-22T10:54:08.128550+0000, chain.objs.size()=2 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.yEGQ1q48s9hWDJPT5PRfDvHQ5_xEw7Y_0 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.yEGQ1q48s9hWDJPT5PRfDvHQ5_xEw7Y_1 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8596885240826076006', time=2024-09-22T10:56:12.241430+0000, chain.objs.size()=1 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.235__shadow_.FUSRuT2Sl4d4OEDsoiOzduM72SAC7IL_0 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15507448521106213513', time=2024-09-22T10:56:22.420508+0000, chain.objs.size()=1 2024-09-22T09:16:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.250__shadow_.XBtLQDdBX9dSTkha1dgE5X24TyOlwTp_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17391983182178367078', time=2024-09-22T10:56:26.160137+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.256__shadow_.2ZU7CugO_QTLddHgI4mVuHikmcg8IEs_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10928926139573926064', time=2024-09-22T10:56:29.102787+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.261__shadow_.pLTjBBoVyZwGM-QVQlHjM3wEky9a5y8_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11090368027366346795', time=2024-09-22T10:57:06.394088+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.va9fdkcnavRPpQjkPWu1a-DdAHrbVAz_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7929928678497977713', time=2024-09-22T10:57:07.512542+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SqaCKvlCyybDWlG2MwIWjkENvtDbCxW_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16308826845645381565', time=2024-09-22T10:57:07.669936+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Xl0XqK3UcmBIvqzTYj-okXAICWHV4Mm_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6565702206250513029', time=2024-09-22T10:57:07.670545+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ny0kI6EUvoaWWaD--xy7TXjMWiBLaeE_0 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1029783674541140385', time=2024-09-22T10:57:08.013854+0000, chain.objs.size()=1 2024-09-22T09:16:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rMcxnzkomw8wleoBkRkdk1BI-Wws1cB_0 2024-09-22T09:16:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7339073948727660076', time=2024-09-22T10:57:08.169270+0000, chain.objs.size()=1 2024-09-22T09:16:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.563+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qrWPRJeUCBSnOICqb4nQB48TYlRkffB_0 2024-09-22T09:16:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6446291592466879774', time=2024-09-22T10:57:08.297921+0000, chain.objs.size()=1 2024-09-22T09:16:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.voknkC_SRg3XFiFcbr8raLZpMyUgDh-_0 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7092864864331523768', time=2024-09-22T10:57:08.314914+0000, chain.objs.size()=1 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LnDmAnMzAL7Mo0lWNfqWyLEAR4t1jo8_0 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4078965947003794506', time=2024-09-22T10:57:08.526211+0000, chain.objs.size()=1 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BOJLnxvgawt3IWop-HA9OTEek15I7Gi_0 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13309419342980404235', time=2024-09-22T10:57:09.006574+0000, chain.objs.size()=1 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kmbvP4js-GJD5QMbVvZGo_DYdwwHWNt_0 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16075997722019959838', time=2024-09-22T10:57:10.569639+0000, chain.objs.size()=1 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5ZipRvsRQzS_ZijDB3114FdcwFyBleU_0 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17006756800566513383', time=2024-09-22T10:57:10.738672+0000, chain.objs.size()=1 2024-09-22T09:16:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.567+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZCINcbzJjM6yA03MacgVNyxvpb1W0Cf_0 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.568+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16049693716972219835', time=2024-09-22T10:57:11.146937+0000, chain.objs.size()=1 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.568+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oVqxp8dBtWoDWPPnJyK3sZMWe_8HIS9_0 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14242269930200781160', time=2024-09-22T10:57:11.961293+0000, chain.objs.size()=1 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tXFxLcQ9MH0LLTcTf_qbaBNMzH3LF2S_0 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1462544557773001342', time=2024-09-22T10:57:12.253790+0000, chain.objs.size()=1 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XYiIUm6S3eC27IeWAT0UIZ3MAUjxjK__0 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6148121417454226539', time=2024-09-22T10:57:12.631626+0000, chain.objs.size()=1 2024-09-22T09:16:02.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dLDIEmkN5w2wstRa_gISngsc50kcWjN_0 2024-09-22T09:16:02.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12437980824070749208', time=2024-09-22T10:57:12.877037+0000, chain.objs.size()=1 2024-09-22T09:16:02.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3KX8fD0CH7T9AXLTMHsyay6XfBk2zWb_0 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10446007119058502855', time=2024-09-22T10:57:13.263795+0000, chain.objs.size()=1 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J36IjpPDK7VuvX1l-nvIJN6viKJFVXs_0 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15991799812753865002', time=2024-09-22T10:57:13.264495+0000, chain.objs.size()=1 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kwpUBV-gEAu36VSqwV34UOb2F-oDIFG_0 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1453957182353517569', time=2024-09-22T10:57:14.213570+0000, chain.objs.size()=1 2024-09-22T09:16:02.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CAEBPEpHyH_YwEckzJoUjLO_d_KLyN8_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8790193610814954796', time=2024-09-22T10:57:14.330051+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2IZ21ZXswAzQKiOlOYpYvDhRTjKqXdS_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16773715527518823433', time=2024-09-22T10:57:14.908261+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QGn5L8meWLPBt--e7mOZDWGdny_SLRn_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7430018228519790915', time=2024-09-22T10:57:14.951852+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.n2rOIB1ogieRay9b-vTgQoFd-5E1kd1_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10588982506571903427', time=2024-09-22T10:57:15.080401+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.w4bL1etgkQmBGn8tMMlYRUoeysxwuT5_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16622152195498335849', time=2024-09-22T10:57:15.325466+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lSmJDsZ7IjVJIwvYzEGmPXJhjK3wsxM_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9546824562902242403', time=2024-09-22T10:57:15.485697+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Fc1-X2vNVoiJkxZ1nC6Klo6uZ6gBYwN_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3122782997142709349', time=2024-09-22T10:57:15.546589+0000, chain.objs.size()=1 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AH7OcNtXdl8365HPhN1qlfTqFJzdqDu_0 2024-09-22T09:16:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10043220147348774751', time=2024-09-22T10:57:16.263006+0000, chain.objs.size()=1 2024-09-22T09:16:02.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dO07_fyhdil1WPJcS3uhWsvY_kuVatf_0 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15657893699033283998', time=2024-09-22T10:57:16.645993+0000, chain.objs.size()=1 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.NRCeNbVd51plWZ_IB7ZsTzqUKT2oIpU_0 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1942038177625642081', time=2024-09-22T10:57:16.996101+0000, chain.objs.size()=1 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.S_jMsZIvEgsvHNRwcSjPt0ZgxYsqa_l_0 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10425413725740712042', time=2024-09-22T10:57:23.913562+0000, chain.objs.size()=1 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.275__shadow_.ktQtuibXDLJb3nVxFd9iPlKIjCfZfqJ_0 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6548381784013333940', time=2024-09-22T10:57:26.381307+0000, chain.objs.size()=1 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.279__shadow_.gxE90EpRU-kRVHvVBMO8zSv0AGU5q-r_0 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9516627504608038320', time=2024-09-22T10:57:36.372671+0000, chain.objs.size()=1 2024-09-22T09:16:02.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.578+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.D3PQ-5_qs7bxZSdXaM1gotuS6Vj8jQZ_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1789303749183052783', time=2024-09-22T10:57:38.295918+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.Q_R9fTPGZNXmmSsEPDbJqwnhQNSkFRq_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1749202577714024400', time=2024-09-22T10:57:41.003768+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.298__shadow_.t5fEKKNtO2oOGKvR8k9C2tAvih_8CA6_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17832667884664688920', time=2024-09-22T10:57:42.958306+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.301__shadow_.RY3i6IvyjhfM5WwI6qB0UjgbPZEmIry_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15827572921818799537', time=2024-09-22T10:58:34.597280+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.81v_DcsI1wBQoNNOxBfZt-SEQTorg2w_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13703941160976152563', time=2024-09-22T10:58:34.959133+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ySS78xVmjvKgMbmRuB-oZw47IlOTV7S_0 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13390731651592634005', time=2024-09-22T10:58:35.006227+0000, chain.objs.size()=1 2024-09-22T09:16:02.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NOHphh2ZdlxxfonKZQ7XbsrMBnc-vEI_0 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4389086072972927857', time=2024-09-22T10:58:35.065172+0000, chain.objs.size()=1 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yzrFQJsTD4HzYWBhX7GPUTsXf4NApO8_0 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16090020678786377091', time=2024-09-22T10:58:35.280734+0000, chain.objs.size()=1 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OFttn3gKeuWvjnXASrEElsnYH4GmIpn_0 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11679893336243631681', time=2024-09-22T10:58:35.951555+0000, chain.objs.size()=1 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jelBTofpVWvhcHDKNswosNPPgisoHsn_0 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2559668142763136029', time=2024-09-22T10:58:36.098982+0000, chain.objs.size()=1 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gjRBFJDB1znq53q74cxZ45PAT--XidE_0 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14983290911949281412', time=2024-09-22T10:58:36.174694+0000, chain.objs.size()=1 2024-09-22T09:16:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rZ6YcNnGe0zpPutx3EIJUOVzM0Nx0J6_0 2024-09-22T09:16:02.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7664994180430688495', time=2024-09-22T10:58:36.834725+0000, chain.objs.size()=1 2024-09-22T09:16:02.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nKmC_Iyip7IimsmNP68QEvGs2nGmgxb_0 2024-09-22T09:16:02.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16235841654725202433', time=2024-09-22T10:58:36.895761+0000, chain.objs.size()=1 2024-09-22T09:16:02.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.C5YYoR6YbQ_jpbVyo-CyylSyZVbOYBG_0 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11708565664921120828', time=2024-09-22T10:58:36.977156+0000, chain.objs.size()=1 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BirUf6CgMoDwQvh0WOmzWj_2mEUBT5x_0 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9708694958640070654', time=2024-09-22T10:58:37.595637+0000, chain.objs.size()=1 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.abpFrv5XpGpHsTHZl0sjAjKrur0RWm__0 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3007280282276154957', time=2024-09-22T10:58:37.843846+0000, chain.objs.size()=1 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9v33IRx4l3hyZlMJGslYqRgyHiaiUsv_0 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1016567759182530021', time=2024-09-22T10:58:38.168456+0000, chain.objs.size()=1 2024-09-22T09:16:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hYpA3PuTiQ4D_elCDVC61iQ7EyXNziG_0 2024-09-22T09:16:02.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.589+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13771833919646799891', time=2024-09-22T10:58:38.374972+0000, chain.objs.size()=1 2024-09-22T09:16:02.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.589+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.s1nBP_ar78za4W6zvSar5LW_6hzDND8_0 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14217170011477085051', time=2024-09-22T10:58:38.452634+0000, chain.objs.size()=1 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FL_en-3JrWlN3rh9b1mRyZw_82LLdoP_0 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7475403425786249597', time=2024-09-22T10:58:38.999745+0000, chain.objs.size()=1 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I_5j8uwM1GQCFGbQm4mcaTdSUKVvlNg_0 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8710793964891288500', time=2024-09-22T10:58:39.018131+0000, chain.objs.size()=1 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZZnawQS39Ryqf95Ee1XapxH-CUyonh4_0 2024-09-22T09:16:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14461898463030808325', time=2024-09-22T10:58:39.068514+0000, chain.objs.size()=1 2024-09-22T09:16:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SMm-7ilefFGpTj-PERNHMx4SFUoFedg_0 2024-09-22T09:16:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3817148234456670775', time=2024-09-22T10:58:39.318129+0000, chain.objs.size()=1 2024-09-22T09:16:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qdfsmLy7fgXstxdV1gSQtFs-H0QXp7m_0 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4546795259230226371', time=2024-09-22T10:58:39.390366+0000, chain.objs.size()=1 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wmtJEYmVb-ciP5OIKyE8uSZKfoBXjIm_0 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3570969539339444870', time=2024-09-22T10:58:39.391454+0000, chain.objs.size()=1 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jm4rBPQlXmDO-LPpYYcjhKb3Vv3_wvL_0 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15330198646253252010', time=2024-09-22T10:58:40.255853+0000, chain.objs.size()=1 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GYeoI51plbWWXfLQnTykH4nkydk9Nyr_0 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9972998813134279662', time=2024-09-22T10:58:40.773589+0000, chain.objs.size()=1 2024-09-22T09:16:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ep3E8yssrd-ryvn6d_BF985K_hoFcZ8_0 2024-09-22T09:16:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5637953186746611777', time=2024-09-22T10:58:41.034121+0000, chain.objs.size()=1 2024-09-22T09:16:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ywhMq8XOGMU_9s8Iobxxu2OP6yDZBNe_0 2024-09-22T09:16:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13747153038391530378', time=2024-09-22T10:58:42.031351+0000, chain.objs.size()=1 2024-09-22T09:16:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-gUkvQok1PsouzF-II2BRmUh0ylghQg_0 2024-09-22T09:16:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8287089786860446719', time=2024-09-22T10:58:42.198917+0000, chain.objs.size()=1 2024-09-22T09:16:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jCfyOtEKSD3d4kdPy9LDALXUurhVELU_0 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13092055890548314174', time=2024-09-22T10:58:42.551868+0000, chain.objs.size()=1 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6yNygr3k3rNdugdaVNkr6Q78df0d2yK_0 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1807569702984735472', time=2024-09-22T10:58:42.666201+0000, chain.objs.size()=1 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iHtdylNhrWhuXW4wBBCoqW6MiaQudjy_0 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17014867972055494894', time=2024-09-22T10:58:42.678934+0000, chain.objs.size()=1 2024-09-22T09:16:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yN4OIl6mUWtqF3EW-sxDu8Qq7fAI8wF_0 2024-09-22T09:16:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17733868494895090931', time=2024-09-22T10:58:43.153118+0000, chain.objs.size()=1 2024-09-22T09:16:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pi4fEqA7u5bmLe_Le8X7vdGf21-7VV0_0 2024-09-22T09:16:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13148104028864700130', time=2024-09-22T10:58:43.387748+0000, chain.objs.size()=1 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8IonUK4tdCYR30wzMoXHWMAuHdOA8Iw_0 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8777072254196290928', time=2024-09-22T10:58:43.418233+0000, chain.objs.size()=1 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Aj-bmLR22ouvP_EN0rQk5VtQf3AMVBD_0 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3825005292217031990', time=2024-09-22T10:58:43.532145+0000, chain.objs.size()=1 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3kkeZVEs1T6u8wozNVGWONm2HrnjYVA_0 2024-09-22T09:16:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8304124864269917533', time=2024-09-22T10:58:43.833432+0000, chain.objs.size()=1 2024-09-22T09:16:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.G9WZN74aDS-bX3qYsPl-elaX2gDLUA7_0 2024-09-22T09:16:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9150444027429293154', time=2024-09-22T10:58:44.670459+0000, chain.objs.size()=1 2024-09-22T09:16:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.EHAy4hOpQ58wE-LDkikuY3OfjeQyjg7_0 2024-09-22T09:16:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2929062264116828693', time=2024-09-22T10:58:44.732592+0000, chain.objs.size()=1 2024-09-22T09:16:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.598+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4SA54zXFJahpk4rh6lM6-FhSb62Bgw4_0 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17691123683795771057', time=2024-09-22T10:59:22.009167+0000, chain.objs.size()=1 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iYimtr-hhy-8yTQeW-P72IHpo3ydhGA_0 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11511920721330713813', time=2024-09-22T10:59:23.575706+0000, chain.objs.size()=1 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HfZMf8XR-SpduywuKlVdWsOZOwZjFww_0 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2541011839951578371', time=2024-09-22T10:59:23.933645+0000, chain.objs.size()=1 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lmJlBUSFgdhkThAvjfdAGFsMmANbfw4_0 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3231470234918667004', time=2024-09-22T10:59:24.089467+0000, chain.objs.size()=1 2024-09-22T09:16:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.599+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nNx_ZZOPmeaxKSr02xa1aXy83cAi8Tz_0 2024-09-22T09:16:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.601+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3283721057706317685', time=2024-09-22T10:59:24.207485+0000, chain.objs.size()=1 2024-09-22T09:16:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.601+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RHAVhjPbIGaox9wki4aa4NG8D_rVWj-_0 2024-09-22T09:16:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18081998687389514450', time=2024-09-22T10:59:24.313883+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.D8HLQyRVl1mssdT8ctw9iwXPDJNSFcn_0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2400415693960213189', time=2024-09-22T10:59:24.442845+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fJaOb8FwZOZek71Qh_12Zs9iqlFqy7p_0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3930554116995778801', time=2024-09-22T10:59:25.042013+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0qVDa6FTT700_DTCImz5tYOPsSOLiO3_0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14220731954513670167', time=2024-09-22T10:59:25.143181+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h3h4ZnBjZlp9eOlhOMWReLS5bsNxOsp_0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16677853362166513789', time=2024-09-22T10:59:25.452789+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cP5tGgF4o_9lTy1H0JluGoce_VMg2E__0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17101848837896319561', time=2024-09-22T10:59:25.591936+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yLzU9EJAqLtrPGCxGx8FFE8G-Hj_hXg_0 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9319652651260522374', time=2024-09-22T10:59:25.650585+0000, chain.objs.size()=1 2024-09-22T09:16:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.605+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZlV8UaRrM2bP3zy4-YHboUP_evQ9Y4z_0 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4584886170557570177', time=2024-09-22T10:59:25.907471+0000, chain.objs.size()=1 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f2ObXp1yLilrnNf5zeycmk0ep53K31F_0 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16729694038137613294', time=2024-09-22T10:59:26.423052+0000, chain.objs.size()=1 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7sbNIwdk8kVk34NPm4SbU9Z8BQqTSqS_0 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17115396750382479172', time=2024-09-22T10:59:26.518990+0000, chain.objs.size()=1 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GbY03sPI6aGgvtMd0ginP1F7QydLEBt_0 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6063649691142838326', time=2024-09-22T10:59:26.847936+0000, chain.objs.size()=1 2024-09-22T09:16:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.606+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KSiDq3TSdkGJzwPOYhNkmGk124OwMqu_0 2024-09-22T09:16:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2191515439881379017', time=2024-09-22T10:59:26.936475+0000, chain.objs.size()=1 2024-09-22T09:16:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.U46Ru1F8J02hpM7-tv5ifFoVux9LPFH_0 2024-09-22T09:16:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13478300835920093899', time=2024-09-22T10:59:27.283198+0000, chain.objs.size()=1 2024-09-22T09:16:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kVOq30tge0wL8n2xKegQ8aWqS9wu-gH_0 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9752632454983563057', time=2024-09-22T10:59:27.457188+0000, chain.objs.size()=1 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ySMClvD3fMHb2LBADsnFl0EUymjlmLg_0 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12997496201400819878', time=2024-09-22T10:59:28.489470+0000, chain.objs.size()=1 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0kCajTJs56o0B2WUI95TIdvSKA1i8i2_0 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8190810368612586922', time=2024-09-22T10:59:28.630779+0000, chain.objs.size()=1 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.610+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JxWvDKPCuYa-0MoWjI0MDjHXVLyGi97_0 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6877593938488455002', time=2024-09-22T10:59:28.793864+0000, chain.objs.size()=1 2024-09-22T09:16:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.b3f8uCkTllb29pveNPRPHX7A0L6ikv1_0 2024-09-22T09:16:02.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.614+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43178 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8925405457770220944', time=2024-09-22T10:59:29.664630+0000, chain.objs.size()=1 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fVlm3sgqJ6jYGb85uURBHbbxtLG-uZc_0 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1705964943178213303', time=2024-09-22T10:59:29.695237+0000, chain.objs.size()=1 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1VGIaPLkk6b1HmzIf7noGF_kwQVVSXd_0 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11047884558482155209', time=2024-09-22T10:59:30.180224+0000, chain.objs.size()=1 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.J8lmE6J_54w5fl00LlIZRv18I_7JMYT_0 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1533201480241897492', time=2024-09-22T10:59:30.416380+0000, chain.objs.size()=1 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wgC9Z3NeIBufIZyf6o33hONB7EkWkuS_0 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15455678371197507787', time=2024-09-22T10:59:30.535761+0000, chain.objs.size()=1 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yiXuVKI8MElLAXxM9QeFwngBIvmdggs_0 2024-09-22T09:16:02.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6610412287357027130', time=2024-09-22T10:59:30.899351+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gjtoW4s-lpAufGQ5kgYGv3qsm6tydvn_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16172012611162002289', time=2024-09-22T10:59:30.946859+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NGjGMo8jhtJJgKfzJuDFr5lwtqUGwtC_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.228738360749752202', time=2024-09-22T10:59:31.646160+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qj3P6ZwecgMHEftsocyc58Biiv2suA7_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15349759529943191817', time=2024-09-22T10:59:32.277268+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rDQDYsui98rxYCWujk4FiBNI5sGrhZ0_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9551782555180898242', time=2024-09-22T10:59:32.531759+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._5ii-bMVUSzANm-_SWrpkJK5ke9RXR2_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1241181690692011017', time=2024-09-22T10:59:32.657836+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hMEb2Ca4Ow_dCrMow8aUrs55_WLCK2r_0 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14855922580616536667', time=2024-09-22T10:59:32.933723+0000, chain.objs.size()=1 2024-09-22T09:16:02.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.619+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.b8cCGDi0oNt2LA53Z_CLyXQxSUMSedb_0 2024-09-22T09:16:02.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.622+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13781530206317751051', time=2024-09-22T11:00:07.111621+0000, chain.objs.size()=1 2024-09-22T09:16:02.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.391__shadow_.zjtLHGr-J3p1BJI2B3RUpbV2v5FZ6qS_0 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15396481692271757833', time=2024-09-22T11:00:30.562706+0000, chain.objs.size()=1 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.435__shadow_.RQ50KY3uaADDcaSFzkk_ITtUyyTyLc1_0 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4979491522025956106', time=2024-09-22T11:00:43.080409+0000, chain.objs.size()=1 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.456__shadow_.7OULbH9uzvaIcF3OcKTlw0PzWxjry6J_0 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11492613588441834551', time=2024-09-22T11:00:43.930730+0000, chain.objs.size()=1 2024-09-22T09:16:02.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.457__shadow_.AArgoPsVuYORmRxNWr3vV-N25wv8qku_0 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7639087415721760332', time=2024-09-22T11:00:48.033867+0000, chain.objs.size()=1 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.623+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.462__shadow_.9rkjGTBvPF8bdcTY_n2mqmG91XE3Mq8_0 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5920705122408438757', time=2024-09-22T11:00:51.482723+0000, chain.objs.size()=1 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.466__shadow_.90p4y5nzkc9jUSMcJ0jzmgicwoQEek6_0 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10978248151851080060', time=2024-09-22T11:01:23.949278+0000, chain.objs.size()=6 2024-09-22T09:16:02.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:02.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:02.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:02.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.624+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:02.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.625+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:02.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.628+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:02.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.628+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3439432084986984277', time=2024-09-22T11:01:29.145380+0000, chain.objs.size()=1 2024-09-22T09:16:02.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.628+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.516__shadow_.lQHv0RDCWmx0iiB1nP_PCl0FEIHbRae_0 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8379312100007236860', time=2024-09-22T11:01:53.691592+0000, chain.objs.size()=3 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~rfu-fHXrhFj8kCDT3JFzE5FufNO3sw7.1 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~rfu-fHXrhFj8kCDT3JFzE5FufNO3sw7.2 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~rfu-fHXrhFj8kCDT3JFzE5FufNO3sw7.3 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT', time=2024-09-22T11:02:20.574791+0000, chain.objs.size()=1 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.3 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4', time=2024-09-22T11:02:30.096573+0000, chain.objs.size()=1 2024-09-22T09:16:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.2 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4', time=2024-09-22T11:02:30.100052+0000, chain.objs.size()=1 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~YaF3gpHyQMoLcjLg5geU1Z4H0ESFqZ4.3 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5450533177100210599', time=2024-09-22T11:04:12.416288+0000, chain.objs.size()=1 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.558__shadow_.A3i2_y2ds0-dedqUGEbitNx73dcRz2d_0 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1500189497681237026', time=2024-09-22T11:04:38.581269+0000, chain.objs.size()=1 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:vzHOEGsh-fPu.82cjnK6oS-fBj-jIVd_.9NSfzhPPNHAnXn8MAxz4c6xgFtIv3GN_0 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16468056243178441903', time=2024-09-22T11:05:05.306719+0000, chain.objs.size()=1 2024-09-22T09:16:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.631+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:Q8lGwntwFhjP3pLrk0J6NVnVpeAqwbm_.bnxTS1fvwp0khhnrGtCDu4_fWWe_KmV_0 2024-09-22T09:16:02.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.634+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14754760210198350210', time=2024-09-22T11:05:08.871899+0000, chain.objs.size()=1 2024-09-22T09:16:02.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.634+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:9YN53.6QhgdKJ4aPA4m26BYpW4MoSv7_.rXp4MzOfyA0Gull14SCNH4xfYr8JEy4_0 2024-09-22T09:16:02.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.634+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.137180716173202797', time=2024-09-22T11:10:15.178928+0000, chain.objs.size()=1 2024-09-22T09:16:02.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.634+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.665__shadow_.GyyMecauUDRCgljmz5MyMBYVtigAA-4_0 2024-09-22T09:16:02.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.636+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2704908672951986842', time=2024-09-22T11:11:38.899067+0000, chain.objs.size()=1 2024-09-22T09:16:02.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.636+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.749__shadow_.kIO7ez_BHkyA476CdRp2IB9XpO000y1_0 2024-09-22T09:16:02.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.642+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.644+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:02.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.645+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.646+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51409' 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3478395600910948256', time=2024-09-22T10:53:50.158390+0000, chain.objs.size()=1 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.152__shadow_.N_vaaQhFHkrEV9R4xbBQ6hv1ZOXYCc__0 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3247666644681176404', time=2024-09-22T10:54:02.975935+0000, chain.objs.size()=3 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-FROZEN.2~iHBdHKD7P6jEheDRoHauc115Xulij9Q.1 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-FROZEN.2~iHBdHKD7P6jEheDRoHauc115Xulij9Q.2 2024-09-22T09:16:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.160__multipart_mymultipart-FROZEN.2~iHBdHKD7P6jEheDRoHauc115Xulij9Q.3 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_iVKwFW8LEq1VcM5oCGzwgCA15ReoPtZ', time=2024-09-22T10:54:14.154875+0000, chain.objs.size()=2 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.GfjyCVL_9SgRAw6S6p1DwjqdYzFSPE4_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.GfjyCVL_9SgRAw6S6p1DwjqdYzFSPE4_1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13320807999595949676', time=2024-09-22T10:54:36.738713+0000, chain.objs.size()=1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.189__shadow_.Uv7ucZzYL69q8TwBZx44lF-7LYBSWS4_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14061616254244593461', time=2024-09-22T10:56:19.957531+0000, chain.objs.size()=1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.246__shadow_.mmq97PuRBSxn-o5fa6Nio1HzvDh1fWD_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17924078846370279807', time=2024-09-22T10:56:27.889030+0000, chain.objs.size()=1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.259__shadow_.wzDekpM9mB5Bnjdf9hXOm0znj6gAFgN_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17502517377719045025', time=2024-09-22T10:57:06.031355+0000, chain.objs.size()=1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DzE8Y0htVXwuTAiuZPZQwP_hczkvqy4_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11630107508966122392', time=2024-09-22T10:57:06.165548+0000, chain.objs.size()=1 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Z5E8FfTgkVJp2opzAXxsrTwIrnhN5XQ_0 2024-09-22T09:16:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2733500051599900154', time=2024-09-22T10:57:06.212213+0000, chain.objs.size()=1 2024-09-22T09:16:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.647+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1OJwl0CofMiSyAmWh_NhkNz9OI8yxpG_0 2024-09-22T09:16:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.992521597456200512', time=2024-09-22T10:57:06.364477+0000, chain.objs.size()=1 2024-09-22T09:16:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nusfzp7I0DGxe-Vcqm3O5NKMoDVrE4r_0 2024-09-22T09:16:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.890611933387827338', time=2024-09-22T10:57:06.495375+0000, chain.objs.size()=1 2024-09-22T09:16:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wm9Mu5-hnpnGQoz4S_FBeJZ2imDsg4__0 2024-09-22T09:16:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11427416430322456308', time=2024-09-22T10:57:07.653493+0000, chain.objs.size()=1 2024-09-22T09:16:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.07uQUTHvg_4DFm6vHnMSgS2XFH33KvM_0 2024-09-22T09:16:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7082477088957157549', time=2024-09-22T10:57:07.700073+0000, chain.objs.size()=1 2024-09-22T09:16:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uAUEGnfgXgvYOI_3wUW-mb0H0MCGqyv_0 2024-09-22T09:16:02.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6954413396977680986', time=2024-09-22T10:57:08.314389+0000, chain.objs.size()=1 2024-09-22T09:16:02.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.d8kMySeulNJ_n27OxZlMpuzIz94UI1f_0 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7975603410365528473', time=2024-09-22T10:57:08.992357+0000, chain.objs.size()=1 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ggSUEP-zZ_rfKGSB99vBHIDyt8vgXVm_0 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9895920664592984845', time=2024-09-22T10:57:09.558789+0000, chain.objs.size()=1 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.thOirgB6iwyBNirfMe8TyWaVqGSc-RL_0 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14418430981521495832', time=2024-09-22T10:57:09.735034+0000, chain.objs.size()=1 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.653+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jTNIKvLH-Fqps13j1egeksmc5nA0JbD_0 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7331491483260238965', time=2024-09-22T10:57:11.311326+0000, chain.objs.size()=1 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nlEXafhszM-jo1dgmkH5Ptp_qxhORLW_0 2024-09-22T09:16:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14219613583522690509', time=2024-09-22T10:57:11.896872+0000, chain.objs.size()=1 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x3U3SolEldHIjisNpcCGQMl-9ScDX_e_0 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4056190244398026568', time=2024-09-22T10:57:12.303586+0000, chain.objs.size()=1 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3icWNsz87a1IgngEUA0UWEnIXDMwL7h_0 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17501119539609096953', time=2024-09-22T10:57:12.353557+0000, chain.objs.size()=1 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iCkXSRHDly7XIeOFjU39OyJ-hF5sENr_0 2024-09-22T09:16:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.426605010905436782', time=2024-09-22T10:57:13.289924+0000, chain.objs.size()=1 2024-09-22T09:16:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3c8gKyWPdf1oB9DuLnfO8wxZZwHCuvg_0 2024-09-22T09:16:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16686933490154957030', time=2024-09-22T10:57:13.869539+0000, chain.objs.size()=1 2024-09-22T09:16:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.655+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DzyieYx73uEgN7Z_ECP5shGpQM-sarN_0 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16674985553553885022', time=2024-09-22T10:57:14.252031+0000, chain.objs.size()=1 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cayuNnOx8vly4PSSpouiaaIMby2JfZH_0 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10020257751791125258', time=2024-09-22T10:57:15.620503+0000, chain.objs.size()=1 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.beEY7jG_wqJIpP_lfgCg3pp5oWmnCwX_0 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6532764123475441199', time=2024-09-22T10:57:15.764387+0000, chain.objs.size()=1 2024-09-22T09:16:02.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.657+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5-VsnNZYpLJucKCtsn9m8CGqMKYDpL9_0 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17542439849232861113', time=2024-09-22T10:57:16.116061+0000, chain.objs.size()=1 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1S91V4NGGqXJpGwBriBXebUG5JfsM6v_0 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14951849935492614385', time=2024-09-22T10:57:16.156733+0000, chain.objs.size()=1 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wnH45cTZi-h2kpzW0LKPQr5jER0Vv9s_0 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.267467043204162919', time=2024-09-22T10:57:16.555746+0000, chain.objs.size()=1 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YLBIbnSZlh9KqcQnfKARRukyXiQ7S27_0 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5532846339036130508', time=2024-09-22T10:57:16.620144+0000, chain.objs.size()=1 2024-09-22T09:16:02.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ft6oeG8VP93ag85COhvSL9g7kbK2E0H_0 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1900978746356925167', time=2024-09-22T10:57:16.620807+0000, chain.objs.size()=1 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yBtKPmtN_dW2MhhK2Ntlv9dHT3EwQAr_0 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14082696144462540959', time=2024-09-22T10:57:17.010693+0000, chain.objs.size()=1 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YWH-bi2BBHDGzuGLrqZcHJ26N89xbTT_0 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8833302919313696425', time=2024-09-22T10:57:19.902301+0000, chain.objs.size()=1 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.268__shadow_.tur7nZyD255P7em8hKZHLF7KnBZjqPz_0 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4941945455186076995', time=2024-09-22T10:57:25.128303+0000, chain.objs.size()=1 2024-09-22T09:16:02.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.661+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.277__shadow_.cN2qlukB7D0I-9_w31GUN7iNa5ycRqZ_0 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14289988060289489934', time=2024-09-22T10:57:31.429265+0000, chain.objs.size()=1 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.287__shadow_.6d0fRbXiCzRtZj0W8dS_AbZa2jchYUs_0 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.855892400201870334', time=2024-09-22T10:57:38.228842+0000, chain.objs.size()=1 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.hFA1mcFsXVReol84XZDpCtEfVrgc60X_0 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12099726481497671250', time=2024-09-22T10:57:40.996309+0000, chain.objs.size()=1 2024-09-22T09:16:02.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.662+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.298__shadow_.PumUOayVglOoNVfTcEOCrw97rQyq7vs_0 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.925225697881473186', time=2024-09-22T10:58:34.402840+0000, chain.objs.size()=1 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4vGmxU6X2P7iaLjSQYtrkMg66zoFlUc_0 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3443913014334990266', time=2024-09-22T10:58:35.174873+0000, chain.objs.size()=1 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.i4Kg7iVP0dJ688Ji7cWTXcBOVwM_K2y_0 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17821359426453543958', time=2024-09-22T10:58:35.380910+0000, chain.objs.size()=1 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WnRr1GiXP2jeJXe_QehrhYZ7ECVWzjP_0 2024-09-22T09:16:02.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12685670607881829399', time=2024-09-22T10:58:36.117275+0000, chain.objs.size()=1 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XMdn5u_BZPcUo3RvEqtwKRUKNVeTwW8_0 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17089570817590601929', time=2024-09-22T10:58:36.388393+0000, chain.objs.size()=1 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7YNbZiC12_7hB0iLSe0bBqMf2LEnhw3_0 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3520641238414954192', time=2024-09-22T10:58:36.610259+0000, chain.objs.size()=1 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3_-N8CcWuIx-jnuYyQV1uFP7mnqezJk_0 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17095268529285346754', time=2024-09-22T10:58:38.378671+0000, chain.objs.size()=1 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pOymrWb-MrJ-ZCD1rd1k-aaRrQkSg6c_0 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11660217286399398390', time=2024-09-22T10:58:38.401548+0000, chain.objs.size()=1 2024-09-22T09:16:02.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Scq9QaEc_2R4CRM4QCbKwpytTAuSruu_0 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16428100854777699037', time=2024-09-22T10:58:39.138718+0000, chain.objs.size()=1 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DJxFgVRuwSaYfrff9kT1U1riy84k2CN_0 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3646683142470331280', time=2024-09-22T10:58:39.842370+0000, chain.objs.size()=1 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-5CTsI6ZabL8kDUZNl508r_X1fnCdEx_0 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5172301850152242883', time=2024-09-22T10:58:40.706148+0000, chain.objs.size()=1 2024-09-22T09:16:02.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RZBjZqmn1XTXNXJ5XNq4cas1Eqe-C6p_0 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13567786327244402814', time=2024-09-22T10:58:40.797703+0000, chain.objs.size()=1 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8NgD8f01q3LRvF6Ogl-15Hj82sVyCEl_0 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5730159541817535675', time=2024-09-22T10:58:41.071308+0000, chain.objs.size()=1 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SHQFyNZIsJklY7diMiWnNs_HGkr_dfK_0 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5248453936368140998', time=2024-09-22T10:58:41.247116+0000, chain.objs.size()=1 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PyrxFSq09tIHtfObV-E2TFHk1nRUCWN_0 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13491206327940705854', time=2024-09-22T10:58:41.248404+0000, chain.objs.size()=1 2024-09-22T09:16:02.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.674+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DlFZZGaXHqx62nIGYjLnCzoltqBNkr2_0 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8769124921959370146', time=2024-09-22T10:58:41.267864+0000, chain.objs.size()=1 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ute6p4r_gQ_cHXe7mo20tmS6R-IO_Ml_0 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5746136410461217626', time=2024-09-22T10:58:41.894204+0000, chain.objs.size()=1 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7mDv49xjd6NSQ3FGSpgDMqqL4cqiqWk_0 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8637373795606836959', time=2024-09-22T10:58:41.982428+0000, chain.objs.size()=1 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ihBmUkMlsjv1-YxM18LBLzw5wA4hWx8_0 2024-09-22T09:16:02.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1801642294641520961', time=2024-09-22T10:58:42.312252+0000, chain.objs.size()=1 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dI8LLVeenvE0X3ec38p0TBOiuPBMOy7_0 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11354311215601959006', time=2024-09-22T10:58:42.634886+0000, chain.objs.size()=1 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Q00qkMOz5XTQucN7aYn9uuRASPVJ20J_0 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5662817769485631816', time=2024-09-22T10:58:42.975163+0000, chain.objs.size()=1 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.769CCcqzqY2qBkffaHLrf0Svm9NwQFK_0 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12783894579199996526', time=2024-09-22T10:58:42.975927+0000, chain.objs.size()=1 2024-09-22T09:16:02.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.676+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3K2fklB7wNT8D5RFLEGvmi7f7Ln3O9O_0 2024-09-22T09:16:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.679+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15516130006438049105', time=2024-09-22T10:58:43.656541+0000, chain.objs.size()=1 2024-09-22T09:16:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.679+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fwshCRfnLE_41xlXTJeIAoyCDctnUlE_0 2024-09-22T09:16:02.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17499910986484094013', time=2024-09-22T10:58:43.784960+0000, chain.objs.size()=1 2024-09-22T09:16:02.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CACiCfhGNOd_Mvgrs1hF_auZ4zolQP5_0 2024-09-22T09:16:02.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5118560707147635685', time=2024-09-22T10:58:43.853485+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BNATgOW3xz7qnJEXPvs_e_hiqjMdA9u_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17041038114809997595', time=2024-09-22T10:58:43.999143+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.P7TxdX0_Ppevy8dbvuuO7K1YSGkrCBj_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9111557035536471377', time=2024-09-22T10:58:44.001400+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.34hjC7BTIegRN1Xby-fMLEsiqkr59Zk_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.352709041420584949', time=2024-09-22T10:58:44.266440+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Bp9RYcb4MOMvXeH_LB6drYqron7itLB_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11805297847132004780', time=2024-09-22T10:58:44.412755+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zCw535KEL5IQXB0GO3Hmmucw-AL2YnR_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17838253715880816545', time=2024-09-22T10:59:22.955565+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZFB0iGKGx4X74ZfRXhzsIm8DReD1eui_0 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2949315811192914544', time=2024-09-22T10:59:24.278275+0000, chain.objs.size()=1 2024-09-22T09:16:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.J8omRaTzFWiFIaQ0DL1WULfVlDf_Kjo_0 2024-09-22T09:16:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8963400573397340520', time=2024-09-22T10:59:24.567436+0000, chain.objs.size()=1 2024-09-22T09:16:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KnaLK01vAtdkPzIPkK7nKn2KD8Yx_2Z_0 2024-09-22T09:16:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2515556915780479573', time=2024-09-22T10:59:25.148289+0000, chain.objs.size()=1 2024-09-22T09:16:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hdIplk0yiOEikyUhG0_96zkBUZInI23_0 2024-09-22T09:16:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.685+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16187317086676314063', time=2024-09-22T10:59:26.761150+0000, chain.objs.size()=1 2024-09-22T09:16:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.685+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WA1BqOTSu9Kk0TKs16inf6zN7cVBCKq_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8323782370447739169', time=2024-09-22T10:59:27.408054+0000, chain.objs.size()=1 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3sTLi7OC3A6Pax-t96HAsiUUiMg9hdJ_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8043569574896677053', time=2024-09-22T10:59:28.282520+0000, chain.objs.size()=1 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iiha6rzCQfnNu67HZTjeKYWf0ZrqIkL_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2183107215392219475', time=2024-09-22T10:59:28.408154+0000, chain.objs.size()=1 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._a7rxCXbCX6AjsACYy9n7FiiHrW9Pni_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18172834696651289582', time=2024-09-22T10:59:28.558341+0000, chain.objs.size()=1 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1GiMEnvw-mcpDqQpzzrlXVY68Mnar5b_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17741743677559292272', time=2024-09-22T10:59:28.832911+0000, chain.objs.size()=1 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xUHsQxq4wzEzVxSmyxur5xbk21cpD_k_0 2024-09-22T09:16:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5861612133394578261', time=2024-09-22T10:59:28.889004+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.80nYZlpZKwIe7E2XjjMho0UW9HL8hBq_0 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12947550494862068386', time=2024-09-22T10:59:29.074679+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5A6TM7Flo-rET2E_nvWs81ATUnMYhy-_0 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2845847706045715240', time=2024-09-22T10:59:29.640781+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XaAjiblVqcAi-3UFb_6EjIUzcc7hzqu_0 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1409919142186316159', time=2024-09-22T10:59:29.662874+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.duzr1XrcScKbMfhHxZbQVG0jj8j8WE6_0 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6083593276593523163', time=2024-09-22T10:59:30.225044+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GjwRwx4Bpa8c5IPqHU1Q-pidaVvXC_S_0 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14474776333900593794', time=2024-09-22T10:59:30.290554+0000, chain.objs.size()=1 2024-09-22T09:16:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.688+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tSxqS3rSiPQ5Ch8pQbfNpvKS4Pxaqvx_0 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15808854663619172829', time=2024-09-22T10:59:30.363626+0000, chain.objs.size()=1 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ULOTuAnsAzqeetGFgfHhTVd15DkMzwo_0 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1673853396820043890', time=2024-09-22T10:59:30.849130+0000, chain.objs.size()=1 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q5bZU4uXMLf1jueYhUq7H4dISxHUwaX_0 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7590246933176215232', time=2024-09-22T10:59:31.031649+0000, chain.objs.size()=1 2024-09-22T09:16:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7-JAWYOpcWIU2VD4IRMRM8LX2LuE9r9_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13671810458913942390', time=2024-09-22T10:59:31.228531+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HDjIwRNWIkwXg9O9GYz5s4Ftnv2x8b0_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7772878532212232622', time=2024-09-22T10:59:31.443599+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dYJie4PDZoSbW8MkdM4ioJsGpb4YsnO_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14848542701751849764', time=2024-09-22T10:59:31.732011+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CSAWcmY5XT2jP3aL-QFuGrce-ho27Or_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1675693250653248852', time=2024-09-22T10:59:31.883633+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dMH9-Hh2ROm6zNmWkyduCjVkh2e75w1_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.518843114623057832', time=2024-09-22T10:59:32.309696+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kPXmwzQni7BQ3wQbWggagpGlwQc82rc_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7402353691739955550', time=2024-09-22T10:59:32.519497+0000, chain.objs.size()=1 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._0ofO2x0FMCtjir0-qIWk6Gt4SlBND2_0 2024-09-22T09:16:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7177766077848526069', time=2024-09-22T10:59:32.592079+0000, chain.objs.size()=1 2024-09-22T09:16:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AaszCX5kJj-lPSnGfesqeMplOJlVhF2_0 2024-09-22T09:16:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.694+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17062985030418388372', time=2024-09-22T10:59:32.970732+0000, chain.objs.size()=1 2024-09-22T09:16:02.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.694+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xT27a5C9XUnDWErOV9O-04VLovOEb8N_0 2024-09-22T09:16:02.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.696+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12189266920916087882', time=2024-09-22T10:59:36.899037+0000, chain.objs.size()=1 2024-09-22T09:16:02.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.696+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.333__shadow_.OQpfiq9lExfRuN_TxjMak9v4ts5dJwm_0 2024-09-22T09:16:02.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.698+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15857516036036919111', time=2024-09-22T10:59:41.842648+0000, chain.objs.size()=1 2024-09-22T09:16:02.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.698+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.342__shadow_.nGXSnElLj2NWl0B0KQl3Pccq3wtYKzk_0 2024-09-22T09:16:02.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14991547144946379426', time=2024-09-22T10:59:42.848635+0000, chain.objs.size()=1 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.344__shadow_.BkeYB1PS4N125MBmMDwH7a3q7z51V4K_0 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16166769261170635457', time=2024-09-22T10:59:54.470825+0000, chain.objs.size()=1 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.370__shadow_.9vazNTH_bg5iKdmQYNAi2CulRN9K7bg_0 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18256356789672308965', time=2024-09-22T10:59:55.041280+0000, chain.objs.size()=1 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.371__shadow_.CitBQfyjp5chrRv0VxJ1k8m4D_fxzus_0 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12966121327155596644', time=2024-09-22T11:00:52.373671+0000, chain.objs.size()=1 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.467__shadow_.GgHDNHEc5P-ZSPWSeUwh5BfdKyhtGQu_0 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4288104558600408507', time=2024-09-22T11:01:00.595369+0000, chain.objs.size()=1 2024-09-22T09:16:02.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.701+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.485__shadow_.6z1Wiw5y1hWWlsmAJAz4mvI4U6TIbj5_0 2024-09-22T09:16:02.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.707+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/51409 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17235804888864100416', time=2024-09-22T11:01:10.537310+0000, chain.objs.size()=1 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.498__shadow_.wQkTFEo4Srx67QCYyUW774QW3hQn9GX_0 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8306766111584737994', time=2024-09-22T11:01:23.426960+0000, chain.objs.size()=6 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:02.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17135454136177186191', time=2024-09-22T11:01:23.954700+0000, chain.objs.size()=6 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:02.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.713+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:02.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12015636464801835587', time=2024-09-22T11:01:56.994991+0000, chain.objs.size()=3 2024-09-22T09:16:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~ruYYPhPaTWTsWjNZFqmwpQBzbEaaVnh.1 2024-09-22T09:16:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~ruYYPhPaTWTsWjNZFqmwpQBzbEaaVnh.2 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~ruYYPhPaTWTsWjNZFqmwpQBzbEaaVnh.3 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~pQQqVHT-xHbTjXMhj1_07XWvG_l3Hov', time=2024-09-22T11:03:24.142486+0000, chain.objs.size()=1 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.536__multipart_mymultipart.2~pQQqVHT-xHbTjXMhj1_07XWvG_l3Hov.3 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12562400613658835104', time=2024-09-22T11:04:11.736672+0000, chain.objs.size()=1 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.558__shadow_.sw4-7ma0hAZLoG8FG5aLzSEVGVBZqi0_0 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6007505931073764833', time=2024-09-22T11:04:37.130141+0000, chain.objs.size()=1 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:lO8-JOniRAQVG3c5tGcajsPTUbugUgb_.vgbyH-JZwv6qPjznGBxVz54GxOZUCM4_0 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1491479710440931347', time=2024-09-22T11:04:59.383561+0000, chain.objs.size()=1 2024-09-22T09:16:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:-YgpCVneBLEEbDMoHujXoODickuVagq_.AYwY92oniS1nLc-0lCtqnA3H3Aupurv_0 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16768700199125572947', time=2024-09-22T11:05:03.090494+0000, chain.objs.size()=1 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:yBTIHPPKtKSLTwn14GQwTnpbP6pLXPP_.DV_OGCMM4HvqKYOS5_n_6SEKZwQwDnf_0 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18152557466940208047', time=2024-09-22T11:05:10.512194+0000, chain.objs.size()=1 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:Nb5WaMrmD.7Ua5glkQtHCXhS-QxE1Gu_.wYAslxQ9oC_XUFIjyWMfYmi7gnnJA7S_0 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2867419953692555660', time=2024-09-22T11:06:16.678125+0000, chain.objs.size()=6 2024-09-22T09:16:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.1 2024-09-22T09:16:02.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.724+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.2 2024-09-22T09:16:02.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.724+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.3 2024-09-22T09:16:02.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.724+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.4 2024-09-22T09:16:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.5 2024-09-22T09:16:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.614__multipart_multipart_enc.2~wKD2W2zefldNAcyly4VjDdUnpb_VaMc.6 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_', time=2024-09-22T11:09:20.200589+0000, chain.objs.size()=6 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.1 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.2 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.3 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.4 2024-09-22T09:16:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.5 2024-09-22T09:16:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.625__multipart_multipart_enc.2~emBQCNqCUpsPdL--ic0yNlMmR8pNRX_.6 2024-09-22T09:16:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3746674457268907824', time=2024-09-22T11:09:35.308680+0000, chain.objs.size()=1 2024-09-22T09:16:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.642__shadow_.efdOU9OeQO_x8-Malkw6ZfaDD5J1E9U_0 2024-09-22T09:16:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1180546119890152990', time=2024-09-22T11:10:28.505053+0000, chain.objs.size()=1 2024-09-22T09:16:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.691__shadow:fGlvMfxcD5FmiIkaUXOsVeBDOblPNPW_.85orif-_mM_U8bMhFDEqKmma_6MuHuk_0 2024-09-22T09:16:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.746+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.746+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44144' 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1532498274776027671', time=2024-09-22T10:56:12.245699+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.235__shadow_.8cj4mwm40RcB4euEiu8e6gNXUUOU1ds_0 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11392326902135917869', time=2024-09-22T10:56:19.362102+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.245__shadow_.DvVZHLadaDwOk2KYvj6qkJFC4PX9Me2_0 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16547294306873006767', time=2024-09-22T10:56:27.322116+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.258__shadow_.gUffWm8l5P8H8Qq_pWQc-GWocBY8RXx_0 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1387539202439048397', time=2024-09-22T10:57:06.058817+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.omkdZXJwHd_C_4w14MUQJFDaMJtRpT9_0 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12164300712013113718', time=2024-09-22T10:57:06.647968+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tCNffpBFDAdAQRmYAhGedhNa4UXP7S0_0 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2963088191163940786', time=2024-09-22T10:57:06.981834+0000, chain.objs.size()=1 2024-09-22T09:16:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vuEBS6AOER4xaS3zGBA3q950_zTmLx0_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15103126464532586107', time=2024-09-22T10:57:07.010411+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RWyU3TvR4z6PY5AB1Gm9ZDid7ii6gjI_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9989397448719463972', time=2024-09-22T10:57:07.504936+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CjpMSLMZTJNY4Xc-w92LJq3iwxWzIhT_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14943555217139881352', time=2024-09-22T10:57:07.546886+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.092mpezXGSsAcjMiGsSQ7bbGcz4rvAv_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5059051455235933869', time=2024-09-22T10:57:07.675127+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MNc2F-ZYcPuYMWKmQGNkuNWphvu9jh0_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4377574184191370658', time=2024-09-22T10:57:08.178550+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2aZEQUa_pq8begogeC5zAXmZHTq02td_0 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11816192217863267311', time=2024-09-22T10:57:09.035910+0000, chain.objs.size()=1 2024-09-22T09:16:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.747+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0kWQF0ER-FpXkR6G71ckHaYRNpfbObs_0 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2038367765779084864', time=2024-09-22T10:57:09.553755+0000, chain.objs.size()=1 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9dWaM5sJ1XdvBnyjXMYpTHCv2OGhFn-_0 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9125646571259416183', time=2024-09-22T10:57:09.763259+0000, chain.objs.size()=1 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._OIJUQyR5GxHBJ0hugyH6u9bYUqfc_2_0 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1808037394223425236', time=2024-09-22T10:57:09.814124+0000, chain.objs.size()=1 2024-09-22T09:16:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.751+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nZr0jTY8Ip_Uy1ThQfSvygBODXRum7K_0 2024-09-22T09:16:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2221028461298756757', time=2024-09-22T10:57:09.962153+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ujc1zIskKYt2kqDxhR5PJRVWXRLQVwh_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3220344468866093270', time=2024-09-22T10:57:10.480253+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.js8R70i1JyDHZhQdDlDztXMh3lyFCSu_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17484330323084005556', time=2024-09-22T10:57:10.534142+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nQoXXQG4vRV8h8dLYq0apkEX-X1YIJI_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9352685808175666226', time=2024-09-22T10:57:10.794903+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Wy9JxgljJgC-v2ORtuQlxwxENZauZf4_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13747695756853546603', time=2024-09-22T10:57:10.911930+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iF5P4YddSXX_cd4Q5b_A83d0mETD1dT_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12342498798511144165', time=2024-09-22T10:57:11.069143+0000, chain.objs.size()=1 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FSEqWd2iDvj-XgNrUbnNj80cJDOZWKw_0 2024-09-22T09:16:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7100475505004905045', time=2024-09-22T10:57:11.848942+0000, chain.objs.size()=1 2024-09-22T09:16:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.y012Gt6XdBK9cP8dspKxA03OL5UMFJM_0 2024-09-22T09:16:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14198478998615705554', time=2024-09-22T10:57:11.885666+0000, chain.objs.size()=1 2024-09-22T09:16:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UbeZzWMNRArpRVqbEbUq1klN3CyCT1w_0 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14325005395953299872', time=2024-09-22T10:57:12.022556+0000, chain.objs.size()=1 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.OZbzCxaGX-rhp3AX4TY6NewEGt8CZvz_0 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11953157750196061796', time=2024-09-22T10:57:13.425348+0000, chain.objs.size()=1 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tByuqErQn53_A5RyxRif7-dxuSW6CBr_0 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3791587505085753120', time=2024-09-22T10:57:13.704704+0000, chain.objs.size()=1 2024-09-22T09:16:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ClRsS-eWxUQfyeWhgFqOpqJBW2I4LmO_0 2024-09-22T09:16:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.756+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16740964459820717914', time=2024-09-22T10:57:14.176586+0000, chain.objs.size()=1 2024-09-22T09:16:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.756+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MIcRf3BI1l3De66yhtk46zYkaZ6I5RY_0 2024-09-22T09:16:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15161878387524484337', time=2024-09-22T10:57:14.772272+0000, chain.objs.size()=1 2024-09-22T09:16:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9HRFSgvGUO3Mw55bN8rCJndN_xxqNLA_0 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11452678992140460825', time=2024-09-22T10:57:14.940391+0000, chain.objs.size()=1 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kGDlDPbUydHgZyDl14JqlFqgfGGWW_V_0 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7947626199667219955', time=2024-09-22T10:57:14.941091+0000, chain.objs.size()=1 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B5tSUSxvWShOvZznB9Dn-qxX6Fjmia4_0 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4254086517174959830', time=2024-09-22T10:57:15.552743+0000, chain.objs.size()=1 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.A5jL3J6oTzBcDqS6fCWIBxd7JoizPZk_0 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3136805077728924972', time=2024-09-22T10:57:15.646915+0000, chain.objs.size()=1 2024-09-22T09:16:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.759+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.b66PyWoFAK30LPXNH6XvptxY1gW0x95_0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1143842815980599164', time=2024-09-22T10:57:15.831204+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cAJ4aaVEFzBqEuW1fXtEygAWRSn-hIc_0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15968999867015483147', time=2024-09-22T10:57:15.852513+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.upauYNrSCpSJ22JBvyzUWzPLhU_rUx4_0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13427543640500114161', time=2024-09-22T10:57:16.511194+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Hu4axqVUHKf2HpPUoSyNjWRDFtH9Ub__0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6507800652635544610', time=2024-09-22T10:57:16.799288+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.knYB3qVhq_ID-2aGoVUliS3AmuNKivN_0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16442253823369024557', time=2024-09-22T10:57:16.799975+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2zBCVdtntNkZ6FyIgWuPe9L8KZX2oYI_0 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6400806751179385086', time=2024-09-22T10:57:16.968166+0000, chain.objs.size()=1 2024-09-22T09:16:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.760+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lZ2iT3KXvmmlOcRYx5HppnRg41jXEeH_0 2024-09-22T09:16:02.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5797110260759415981', time=2024-09-22T10:57:20.464673+0000, chain.objs.size()=1 2024-09-22T09:16:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.269__shadow_.5aWnN8xebZtWMUl0lRzQCgRaBMh1ix7_0 2024-09-22T09:16:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10580580005171451130', time=2024-09-22T10:57:21.611730+0000, chain.objs.size()=1 2024-09-22T09:16:02.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.271__shadow_.zG8sbusNyiT3QYAgNgxbCj2epq7MUm6_0 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15682712058972553665', time=2024-09-22T10:57:33.256154+0000, chain.objs.size()=1 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.290__shadow_.iFB98jr_VGWqC8jSTjfbRPIfCwOd_wB_0 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7405986156543916733', time=2024-09-22T10:57:45.402506+0000, chain.objs.size()=1 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.305__shadow_.0kdPtUkNfz0oVF_7XVDO1kfNScgLZk__0 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12235165482460870732', time=2024-09-22T10:58:34.424754+0000, chain.objs.size()=1 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.E_Ztyi-AckL44uKkl4T4OKEUDcbIbTb_0 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12755227836171185632', time=2024-09-22T10:58:34.572788+0000, chain.objs.size()=1 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.764+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.C2-ICIrZcqEptU2aVTgbcdKxwhtc7Bz_0 2024-09-22T09:16:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16916078074237915971', time=2024-09-22T10:58:34.722105+0000, chain.objs.size()=1 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KiPV0sFh3v5Y1PJZUPvRiAN5speGkaL_0 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1944821870793010485', time=2024-09-22T10:58:35.421305+0000, chain.objs.size()=1 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OpZOOq64bBqlzwcIq82lrjgbBqvyqjU_0 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6091909255200724090', time=2024-09-22T10:58:36.193250+0000, chain.objs.size()=1 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gjRggEyoCX7roeYR6J6hyU5rbTMYgao_0 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8371072647578678588', time=2024-09-22T10:58:36.328404+0000, chain.objs.size()=1 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bAww4Pql2U8Qi_gVONO5OtuLXcbhkpt_0 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16838750824234041354', time=2024-09-22T10:58:36.579268+0000, chain.objs.size()=1 2024-09-22T09:16:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.765+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tJoQQhyGoNWzEkz7oZ4EAiUziQvJt--_0 2024-09-22T09:16:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12787308456375331392', time=2024-09-22T10:58:36.608384+0000, chain.objs.size()=1 2024-09-22T09:16:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h-MUEneaIOKmvne7UwDqc0z3wNiSZEb_0 2024-09-22T09:16:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4199687218968985845', time=2024-09-22T10:58:36.916301+0000, chain.objs.size()=1 2024-09-22T09:16:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.769+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5RuJDfhkcIX1aLegS_x661aXyRrFKYf_0 2024-09-22T09:16:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17904985653919029764', time=2024-09-22T10:58:36.979845+0000, chain.objs.size()=1 2024-09-22T09:16:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hc6MrFi4N1s9ITSY3SA8Z9yUxKQp5w5_0 2024-09-22T09:16:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4455431548977102843', time=2024-09-22T10:58:37.489587+0000, chain.objs.size()=1 2024-09-22T09:16:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ir8RZEmzoPGqP2lFOQpep2TNfGLTv2J_0 2024-09-22T09:16:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1735056846199225490', time=2024-09-22T10:58:37.783367+0000, chain.objs.size()=1 2024-09-22T09:16:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.770+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.V0RV_gknyhJ4VT5VXkvetWIIvUM0dvs_0 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.292239708628810458', time=2024-09-22T10:58:37.785339+0000, chain.objs.size()=1 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Pog-SmS1Fuywdz9f-AwfKNIN1FfYGvh_0 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10445032325652826677', time=2024-09-22T10:58:38.402302+0000, chain.objs.size()=1 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lQe9ZoBo9eFnJlT7qLwsp2jeQYN8XD5_0 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18106164166388529898', time=2024-09-22T10:58:38.928829+0000, chain.objs.size()=1 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FPvYv5uY57M7SyAOG1ukUCbiS03O6MN_0 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3490033855061678140', time=2024-09-22T10:58:39.289350+0000, chain.objs.size()=1 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.b7XVVcAHWvPit7erzpigJgqx1-APMY4_0 2024-09-22T09:16:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4764236848466315644', time=2024-09-22T10:58:39.529577+0000, chain.objs.size()=1 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ByE5eZ5E6n8NdFiBE-PusB7Wvbja5vs_0 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7373382540521915100', time=2024-09-22T10:58:39.770871+0000, chain.objs.size()=1 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Idjg0jDvYIWozct9OLixZlpqc4saPwo_0 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15210081262152996954', time=2024-09-22T10:58:39.809852+0000, chain.objs.size()=1 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.v9kQIy2_F4bEhupeQCS5D74NKHBUqlg_0 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9079670349655751494', time=2024-09-22T10:58:40.249270+0000, chain.objs.size()=1 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t9vMoeO4D-_HzZuKC8Tyu2v_03b8l1G_0 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14872732898481079242', time=2024-09-22T10:58:40.297708+0000, chain.objs.size()=1 2024-09-22T09:16:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Nfkys-MfH-4iblW9VHqVh4JTqM04-nM_0 2024-09-22T09:16:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3360975642737347335', time=2024-09-22T10:58:40.666665+0000, chain.objs.size()=1 2024-09-22T09:16:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.G6je07-GHFVyNrPOUDIVOSGDea4srSr_0 2024-09-22T09:16:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5398167267615783195', time=2024-09-22T10:58:40.908739+0000, chain.objs.size()=1 2024-09-22T09:16:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.773+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.j0qbYSKcGpKVylnORW_wi2lypOisSHn_0 2024-09-22T09:16:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5560994920270588426', time=2024-09-22T10:58:41.127731+0000, chain.objs.size()=1 2024-09-22T09:16:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ioAQB0fUptWmBk6qfi2Crv2pJdb4B72_0 2024-09-22T09:16:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8233663278442243069', time=2024-09-22T10:58:41.271319+0000, chain.objs.size()=1 2024-09-22T09:16:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2dPMoOcq2NZiJMma90BpfvE-auVsefI_0 2024-09-22T09:16:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17029617243540156701', time=2024-09-22T10:58:41.633223+0000, chain.objs.size()=1 2024-09-22T09:16:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.777+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ps6cYnmhmDVfPl3DskQdSLK_tcAnnwb_0 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13400425118595507182', time=2024-09-22T10:58:42.070235+0000, chain.objs.size()=1 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5nDJEJ0Ybw2yta-sOnnb-DaT1EuPqL5_0 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6322617988418730041', time=2024-09-22T10:58:42.605794+0000, chain.objs.size()=1 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UjZ8kBLAPy_kxjVaisroDQNoLNVtYOX_0 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16911599410502904703', time=2024-09-22T10:58:43.575444+0000, chain.objs.size()=1 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h19rEc4hxnv0MaPd96mu5CKiUNJtBjP_0 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12086996764536654604', time=2024-09-22T10:58:43.853296+0000, chain.objs.size()=1 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N17c23Mg9IKPng34HHCNfBZJ5qPEsqF_0 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3737905918711208971', time=2024-09-22T10:58:44.507084+0000, chain.objs.size()=1 2024-09-22T09:16:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tD5-Iq-pBW5wNi_Nwz048UC9T0M8jCU_0 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1275833569023696709', time=2024-09-22T10:58:44.535366+0000, chain.objs.size()=1 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.juEdofFV3MkQipW81Z7bMH0ZUFLKYf6_0 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14977926466554870363', time=2024-09-22T10:58:44.687931+0000, chain.objs.size()=1 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tHBXiunZNKbOa-iDR-BN5wbWb_ZQSyl_0 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10841424590773233405', time=2024-09-22T10:58:44.729711+0000, chain.objs.size()=1 2024-09-22T09:16:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.EKNNl14094qQJDxCM6sckFcyvszE35s_0 2024-09-22T09:16:02.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8818270136966713205', time=2024-09-22T10:59:22.178315+0000, chain.objs.size()=1 2024-09-22T09:16:02.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CPFUHagOAUh7_aD3vR5h1_w1pO3OTKM_0 2024-09-22T09:16:02.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.707294366872059552', time=2024-09-22T10:59:23.045480+0000, chain.objs.size()=1 2024-09-22T09:16:02.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RuiC3w-UYOrVyTkKC6wJ-sSjCe68EPd_0 2024-09-22T09:16:02.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5563936566391292692', time=2024-09-22T10:59:23.048150+0000, chain.objs.size()=1 2024-09-22T09:16:02.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.781+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oEmNito5lZg5yoWPu1pNUzdyMLB8dkU_0 2024-09-22T09:16:02.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17847380410269082638', time=2024-09-22T10:59:23.670610+0000, chain.objs.size()=1 2024-09-22T09:16:02.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kBZ12JhmpimKbI1_Df3I5_bPAT4uLN1_0 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2342030753025744029', time=2024-09-22T10:59:23.851625+0000, chain.objs.size()=1 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Eli4ppPCIaQPwqzGt8tvWyoKvY03_T8_0 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12128756858630704987', time=2024-09-22T10:59:23.852304+0000, chain.objs.size()=1 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TWVyhgjzDhwE5MWY97pFarHz8IunOz0_0 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10194527974060365301', time=2024-09-22T10:59:24.356993+0000, chain.objs.size()=1 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._C6RjEKNknsro54a5NWfPu4phoDd7FL_0 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6178984572406472603', time=2024-09-22T10:59:25.291802+0000, chain.objs.size()=1 2024-09-22T09:16:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1OPcWFf3ILCyoDMRs_kIuhpzpr_nfxn_0 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2865635569796034882', time=2024-09-22T10:59:25.465051+0000, chain.objs.size()=1 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YXuF3-XfYROBkTDxfsQ5mtNJ4ZgDrD__0 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12348302158638174778', time=2024-09-22T10:59:25.584958+0000, chain.objs.size()=1 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vtz94i_YXvrbu4iWApD4mr6Vnnx_B_t_0 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9728970180438228634', time=2024-09-22T10:59:25.906994+0000, chain.objs.size()=1 2024-09-22T09:16:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ES0frxGTNXtB6ZHEoK2WmgcyDWlpU4p_0 2024-09-22T09:16:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1965355370323167128', time=2024-09-22T10:59:25.907582+0000, chain.objs.size()=1 2024-09-22T09:16:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QmzkZBXB1TBFylwOku_QHlKz8x0q72W_0 2024-09-22T09:16:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8253754777281629187', time=2024-09-22T10:59:26.860549+0000, chain.objs.size()=1 2024-09-22T09:16:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._k_vbzOgiqFXXB4OsgKsY9tIOxcpzaG_0 2024-09-22T09:16:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7906856635862182140', time=2024-09-22T10:59:27.359964+0000, chain.objs.size()=1 2024-09-22T09:16:02.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.787+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.L_djD6RXfijFXlLBv1ADTRFgBSNXtUd_0 2024-09-22T09:16:02.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6025259439727334044', time=2024-09-22T10:59:27.730263+0000, chain.objs.size()=1 2024-09-22T09:16:02.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fxNW6-SjbpwOmY3Cafge3abjFIgPUJ6_0 2024-09-22T09:16:02.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15363063956680473029', time=2024-09-22T10:59:28.428188+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.24Loy2M0TDvuZv51lQAn6K_4dGVGzxP_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2144044585879831381', time=2024-09-22T10:59:29.166925+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nIJGbOWNXOslPVB3cRlxADbvFUpnbpK_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.994649119712603895', time=2024-09-22T10:59:30.321957+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.aUffB8l8Gvaq0C03j4C7GYQ94M8Cb0h_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7198675009850411143', time=2024-09-22T10:59:30.455890+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.D5GEMtKRZmblG6pojZNgvwjmIMnphyS_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6637224257866952459', time=2024-09-22T10:59:30.535510+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EsEFFVKOKSi_56eB_u7itnRKQDi9h03_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7602728738389919846', time=2024-09-22T10:59:30.938782+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VG-KvydJNm5pD-Xap-hohMtrjkxBGGN_0 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5140269883718360291', time=2024-09-22T10:59:31.123826+0000, chain.objs.size()=1 2024-09-22T09:16:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.790+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OsI17VVFrLodNuLMUg06w5z0Fsh5_Ds_0 2024-09-22T09:16:02.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16829389616353789496', time=2024-09-22T10:59:31.159358+0000, chain.objs.size()=1 2024-09-22T09:16:02.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MKlf4Oh3XIzTzW6NLbOICFktzG9RlEx_0 2024-09-22T09:16:02.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2637797561496272872', time=2024-09-22T10:59:31.512055+0000, chain.objs.size()=1 2024-09-22T09:16:02.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-z5qRmF2kMVeb0P-tQV5ygcCwt3-5nP_0 2024-09-22T09:16:02.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44144 2024-09-22T09:16:02.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2493622904502310873', time=2024-09-22T10:59:31.849975+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.g1cenhWRGDeHh6x7QlLTZHDo9LcFCdO_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2694006682889133873', time=2024-09-22T10:59:32.136514+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vMEetGcFzJ0z4L4P5siCWBoKbTFCSSD_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9962024619811179121', time=2024-09-22T10:59:32.156320+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RhHV6VjckikbE0D-S-MD9w79Tjk9qUr_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16378002293451687105', time=2024-09-22T10:59:32.322450+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eOfcnj-NYl0bwCNHEHrhtDWaEZlZa1B_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2094834391803781448', time=2024-09-22T10:59:42.370028+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.343__shadow_.pLIeh8ieWF2aRjb0QWGry2NFHUkIK4V_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14198640610909813328', time=2024-09-22T11:00:35.478426+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.443__shadow_.sAE336ByGLmsBy6hE05zKlDMb5ORl21_0 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15570814262921649825', time=2024-09-22T11:00:45.562417+0000, chain.objs.size()=1 2024-09-22T09:16:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.459__shadow_.RGeSLTsClFMK7Wh7jFuRp_M4Cm4CU0Y_0 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2616761325667533958', time=2024-09-22T11:00:46.369206+0000, chain.objs.size()=1 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.460__shadow_.BwKVO1u8XUm2LByczyGKJZKmFtPHZJr_0 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13383206417012285344', time=2024-09-22T11:01:07.966325+0000, chain.objs.size()=1 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.494__shadow_.vDnGYc3i0awxrMxA1rCgBGPsZ93OXKV_0 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2589400653759313540', time=2024-09-22T11:01:34.993720+0000, chain.objs.size()=1 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.518__shadow_.0oJOE2o0e3USumTGpVCMI64BtIXzBiM_0 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13413188471856119167', time=2024-09-22T11:04:17.865909+0000, chain.objs.size()=1 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.560__shadow_.JdaiSjyjifiBDiOWQXnlk9qdnigfrGc_0 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17662440347030959832', time=2024-09-22T11:04:48.878952+0000, chain.objs.size()=1 2024-09-22T09:16:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.806+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.576__shadow_.v7HO8OYIkMvPmgU_5zxDdoqH6s21gGJ_0 2024-09-22T09:16:02.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16269372849207920586', time=2024-09-22T11:05:09.379474+0000, chain.objs.size()=1 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:IkOjfCkEAptUqQOm63bWvGqyBXScrQ3_.InggFoR3fHzxc6lHQTxq84_nzO4-s1g_0 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6268118268796556064', time=2024-09-22T11:05:15.030876+0000, chain.objs.size()=1 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:U8KadrIjA0kjPrYSGCXi5A96yThExpD_.7siRNsoda-hOVvZbUfMuny9gxdUhCIy_0 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.79542396721278565', time=2024-09-22T11:05:37.376954+0000, chain.objs.size()=1 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:dZ6IToy4FQG5dFUE4ozoKUyE-VCQhSX_.DxogXqeq3wajofmYE_3oagTdQb_r5RC_0 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14591622733358172957', time=2024-09-22T11:09:48.601475+0000, chain.objs.size()=1 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.651__shadow_.dbQYaJhhTMbcHACOrOOeUKTdgePQPJ4_0 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1057242568825096923', time=2024-09-22T11:10:41.411543+0000, chain.objs.size()=1 2024-09-22T09:16:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.712__multipart_file1.2~PJeDkFV9QNPWGHAmHHrZp960zgp1wgt.1 2024-09-22T09:16:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10171803031922804924', time=2024-09-22T11:11:04.713625+0000, chain.objs.size()=1 2024-09-22T09:16:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.719__shadow_.h6urBhKcd1_zQNn9fxZeYUOaSblqXyp_0 2024-09-22T09:16:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4705802783459000915', time=2024-09-22T11:12:21.433266+0000, chain.objs.size()=1 2024-09-22T09:16:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.811+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.759__shadow_.iBaX0IGuD6s7xKLl6GJSiku5zunlH9s_0 2024-09-22T09:16:02.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.815+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:02.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.820+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.820+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53521' 2024-09-22T09:16:02.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8629334715708062658', time=2024-09-22T10:54:34.579762+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.184__shadow_.XDaNFZTjxa8jvhzUWR0nRPYyLyBX-kk_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1472167672661017433', time=2024-09-22T10:54:46.913035+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.201__shadow_.6OjxfCkRvnRt9_2fGTGXrDnxyFpv3qB_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14040008162667692018', time=2024-09-22T10:56:12.855610+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.236__shadow_.khvfcnTTMH7FilF3gTN4Kz9qubWrd-y_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16990744738685390862', time=2024-09-22T10:56:16.908508+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.242__shadow_.Ba14n9wxRsAjTq0oUcc4wEY_0llxVNb_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16193621089288985272', time=2024-09-22T10:56:24.892700+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.254__shadow_.ehBpGOY9oaJh9assvJSO1ozH9D65Jxg_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1370975050403949565', time=2024-09-22T10:56:29.716009+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.262__shadow_.zan9-kMXsn19ULs05iMkOoexSQMIF_G_0 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1028707615751602992', time=2024-09-22T10:57:05.905403+0000, chain.objs.size()=1 2024-09-22T09:16:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.L3Z4eOvt6SvNfL7OxzwsFtq7hg0rZq8_0 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3335024575094073782', time=2024-09-22T10:57:05.989479+0000, chain.objs.size()=1 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Wl8rFtjaNOCl59Clma8yXoHlArU12Wl_0 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11267948415424044522', time=2024-09-22T10:57:06.160798+0000, chain.objs.size()=1 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uurus_NPnU0rv1-t5FuON1E1svkMgDl_0 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13491564505246294430', time=2024-09-22T10:57:06.427440+0000, chain.objs.size()=1 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.V5ZZgEHvjMchuRofsWMpnmF33iDt-3v_0 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9559192080289338810', time=2024-09-22T10:57:06.964445+0000, chain.objs.size()=1 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9OqjsxwqQggO09F0KFNGaJDNlhZaqJB_0 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14050575909317538708', time=2024-09-22T10:57:07.638914+0000, chain.objs.size()=1 2024-09-22T09:16:02.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.821+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1IaEqQQwmhjvy4rL1NcDuyJc2upKE2C_0 2024-09-22T09:16:02.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.826+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6309711261585357611', time=2024-09-22T10:57:07.946316+0000, chain.objs.size()=1 2024-09-22T09:16:02.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.826+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fjHoQZxP498lobAb3RMV5am4cm4_-D__0 2024-09-22T09:16:02.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.826+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1377398153391744154', time=2024-09-22T10:57:08.463109+0000, chain.objs.size()=1 2024-09-22T09:16:02.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.826+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k1_o9zYCRJAaieAO4eHeTzUN-vGCSc4_0 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16053104589794420954', time=2024-09-22T10:57:09.486360+0000, chain.objs.size()=1 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AZ4fDrD9Z0ps09Y3Lm_rYzsS-nikIJP_0 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7722255626438097139', time=2024-09-22T10:57:09.685185+0000, chain.objs.size()=1 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.eUZB2V5Dgw7Jayp2YNBTKuUilheYa0J_0 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16479926388723104439', time=2024-09-22T10:57:09.840111+0000, chain.objs.size()=1 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Hiu7ab7lImiVJ_5b5Wtiyfi3qPsUrqT_0 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6343300105717736549', time=2024-09-22T10:57:10.837208+0000, chain.objs.size()=1 2024-09-22T09:16:02.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Vqi0we6N9CJ3KHI-ZShYZn_VBDpay9R_0 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6973859943448485361', time=2024-09-22T10:57:11.038032+0000, chain.objs.size()=1 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B1zvd3X5LqNZ6JSBxMN5os41yz_oVfx_0 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16731014658573772845', time=2024-09-22T10:57:11.286002+0000, chain.objs.size()=1 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.827+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6Y9ySg7NIspMAyaqg--TIdDJlDruL4H_0 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3769047228659663472', time=2024-09-22T10:57:11.458764+0000, chain.objs.size()=1 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uZXqW_LcS62DSwQDusnNf5fdADAENhi_0 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.355367524574041188', time=2024-09-22T10:57:12.377391+0000, chain.objs.size()=1 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.L673n-KcRX8aHHQrbi8pBhxdMEvDQs2_0 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1057409113927728432', time=2024-09-22T10:57:12.448707+0000, chain.objs.size()=1 2024-09-22T09:16:02.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nND6gGy9hU-ZYBVCe3DBI7rO66U1nw3_0 2024-09-22T09:16:02.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5729197107276949706', time=2024-09-22T10:57:12.575921+0000, chain.objs.size()=1 2024-09-22T09:16:02.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Za9kHaLW4bM6tzdtvGg3QO5eGTDv7H0_0 2024-09-22T09:16:02.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3443592476269841421', time=2024-09-22T10:57:12.744523+0000, chain.objs.size()=1 2024-09-22T09:16:02.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bvwecLuRf70DKbwyISpr8ZrNIgGtA5T_0 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14263069021849462578', time=2024-09-22T10:57:12.868701+0000, chain.objs.size()=1 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XkPZY5NqUgXI7pQKSPsUgI5UZRW7o3A_0 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1404619907790660908', time=2024-09-22T10:57:13.510181+0000, chain.objs.size()=1 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6E-S3vVeIgRUwlxCxuFLA3OCiOjgHgi_0 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13855335085275904790', time=2024-09-22T10:57:13.633141+0000, chain.objs.size()=1 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nMHRYVTZXzTKlG4daLCA9nWqs5m9vBr_0 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13079486877488696877', time=2024-09-22T10:57:13.977588+0000, chain.objs.size()=1 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DN_5MxG2Vs0-Zm1VyiCKvWlxJCAEhGC_0 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18368240500267724772', time=2024-09-22T10:57:14.951866+0000, chain.objs.size()=1 2024-09-22T09:16:02.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.832+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tnl_FpWZ_sT0c6anSkLkrZMYAk8rMmJ_0 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7643959989022380837', time=2024-09-22T10:57:15.130600+0000, chain.objs.size()=1 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oi2_FJqPQ2706DnAdZCNEI-lJIcfqT2_0 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.289076668096387804', time=2024-09-22T10:57:15.163674+0000, chain.objs.size()=1 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MP7XpnwALGL5lE6qbiLWAtzpLwWNWYN_0 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1863108516471149353', time=2024-09-22T10:57:15.264645+0000, chain.objs.size()=1 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fkVe6SwgxExikjQ4qd_yST-AfSvZ7YC_0 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9207847893519244305', time=2024-09-22T10:57:15.302399+0000, chain.objs.size()=1 2024-09-22T09:16:02.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.835+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g1K9NeSbKcDYj0rwkpwBq43QxNolHoW_0 2024-09-22T09:16:02.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1125380359444948810', time=2024-09-22T10:57:15.403174+0000, chain.objs.size()=1 2024-09-22T09:16:02.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WwQf22cs62eoOtfgExo7c2ePAe-idmg_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7526047729254915578', time=2024-09-22T10:57:15.732950+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nwLBR7CAdEXovxBM9giBq_xhT-P3Hio_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17208339129021212443', time=2024-09-22T10:57:15.774795+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-c7a4ugY-eWjOZnZIH2Qlquug7oV0XP_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16615193379195002721', time=2024-09-22T10:57:15.828471+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x5MwmNQiFti19CAqMy5C9PObADbde_T_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4587646413019991821', time=2024-09-22T10:57:16.162240+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7H7FrcKPddQwtrMXk932aJSB9d4qu5x_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17959151662708293000', time=2024-09-22T10:57:16.162982+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WpVlfbH0TcmQ2fEQtYHcirAK6-dsMOn_0 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11734668054036331379', time=2024-09-22T10:57:16.646031+0000, chain.objs.size()=1 2024-09-22T09:16:02.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SQuCrKSD3w7hZsO-FQfTYRFUyMAbipX_0 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14363552024056807514', time=2024-09-22T10:57:16.689628+0000, chain.objs.size()=1 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.z7Mm0o7hgJj0dk1xZST2kJDgegVIIZw_0 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7249524955814955951', time=2024-09-22T10:57:16.996033+0000, chain.objs.size()=1 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qIOmf97otgO3AnKmnKHOcRD_wZQTZ7J_0 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6390134086247406628', time=2024-09-22T10:57:19.318379+0000, chain.objs.size()=1 2024-09-22T09:16:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.267__shadow_.geuskNxauFvix0nbbD42Pqtunu5CeAR_0 2024-09-22T09:16:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7652972743479112109', time=2024-09-22T10:57:20.471496+0000, chain.objs.size()=1 2024-09-22T09:16:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.841+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.269__shadow_.BC8UJvmmI_q3PLVYROJsxe765NbblOV_0 2024-09-22T09:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13623373399361013317', time=2024-09-22T10:57:31.420183+0000, chain.objs.size()=1 2024-09-22T09:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.287__shadow_._ifhDIHnGo693XptJk0bw1qv61s8qrt_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2278538600743625519', time=2024-09-22T10:57:33.246433+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.290__shadow_.jq0f36eZYvpvmpdoLS9T8Sl-ptQWAsb_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13184317195860829436', time=2024-09-22T10:57:36.305517+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.PJsjZlgpvrdgtpwbCR9f_bb5AO3UhUt_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12315159227942374925', time=2024-09-22T10:57:38.231574+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.l1PmcorErzHZNVTTwBIABew2XAIgxtI_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11534969394866579840', time=2024-09-22T10:57:38.338570+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.eaXqAYom-UTUwA0AFyd521FVn7yqVkg_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8140554986065994665', time=2024-09-22T10:57:45.410361+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.305__shadow_.ZUwssYEQ0CvREtqh7DcKsl2yUkGsZVQ_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18230175802040501808', time=2024-09-22T10:58:34.673083+0000, chain.objs.size()=1 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.68juN6GCeXPEcVCIvLj0yAXNiAAlTwu_0 2024-09-22T09:16:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5365440161727732250', time=2024-09-22T10:58:35.065185+0000, chain.objs.size()=1 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Qo_NyXOHvXzp6fhdxlffZliy9OgJRGd_0 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15009865111209050581', time=2024-09-22T10:58:35.144888+0000, chain.objs.size()=1 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Kk8VOQbWFhkUXg6U3-lptG5oXjiDQqR_0 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12582734369876840505', time=2024-09-22T10:58:36.013271+0000, chain.objs.size()=1 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mFxKHExsMMrNXHN6UAxuswGlGj--X-8_0 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7280837616972055775', time=2024-09-22T10:58:36.318590+0000, chain.objs.size()=1 2024-09-22T09:16:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.846+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nS6n1lbcsFJqR2CARryjjj1yct9K5eE_0 2024-09-22T09:16:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5963884003479373033', time=2024-09-22T10:58:36.649023+0000, chain.objs.size()=1 2024-09-22T09:16:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W_ij3R9brdj98viZ1ZMHS3lysL04N8__0 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12708637322062889875', time=2024-09-22T10:58:36.681031+0000, chain.objs.size()=1 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.T2KSenmEckzAYZ-UzTD1_dSeBVDlGj1_0 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5179068782995082749', time=2024-09-22T10:58:36.732293+0000, chain.objs.size()=1 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.k8tTt6qKlP63KeSbKx9vboqz7JOi_bj_0 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8819052550839308284', time=2024-09-22T10:58:37.503179+0000, chain.objs.size()=1 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iGqjnzoAw2OwW-PF9x11rsXtfbxRyrD_0 2024-09-22T09:16:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6534024622488901756', time=2024-09-22T10:58:38.488973+0000, chain.objs.size()=1 2024-09-22T09:16:02.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.852+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8zMdwCzeAWsg0fWNUC9nNdfvOmg5zYj_0 2024-09-22T09:16:02.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17447034923234519676', time=2024-09-22T10:58:38.887210+0000, chain.objs.size()=1 2024-09-22T09:16:02.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.s1SrhFHmJ-lgEhmHXR04__rR5Qza0OW_0 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1702382957519900338', time=2024-09-22T10:58:38.887967+0000, chain.objs.size()=1 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BXt6aTOSbDFUmetnkGjRcjBxKn_wMXA_0 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9427603831108680214', time=2024-09-22T10:58:38.917470+0000, chain.objs.size()=1 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cVnQhEg1BKCg4wJKai9im3kJPMi6Wfz_0 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6985284111131538416', time=2024-09-22T10:58:39.179476+0000, chain.objs.size()=1 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pkprvueDXBQWiSvdrdq-xZIQoqK0R79_0 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15240643026154149927', time=2024-09-22T10:58:39.318045+0000, chain.objs.size()=1 2024-09-22T09:16:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dQQ6bD2Vd_kIJ2SYIgMMEEsvMevr_FA_0 2024-09-22T09:16:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.855+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5684718305526739152', time=2024-09-22T10:58:39.626457+0000, chain.objs.size()=1 2024-09-22T09:16:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.855+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8aLOzCxz3CBWx6plnzQXI0lxdAo_DlU_0 2024-09-22T09:16:02.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11968957488707379401', time=2024-09-22T10:58:40.506151+0000, chain.objs.size()=1 2024-09-22T09:16:02.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7MFpIDaMzhCtuKZQ3Qx5z1K-1Umc7RZ_0 2024-09-22T09:16:02.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8107515906344618245', time=2024-09-22T10:58:40.962398+0000, chain.objs.size()=1 2024-09-22T09:16:02.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.izuTAyf8_8EuKcRR9hb6lh_XlpuFlUa_0 2024-09-22T09:16:02.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.198406499557112403', time=2024-09-22T10:58:41.731693+0000, chain.objs.size()=1 2024-09-22T09:16:02.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.857+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.llRxGB8IN9ibQdfk3TlHQdkqdEKDB1w_0 2024-09-22T09:16:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.842992113722356451', time=2024-09-22T10:58:41.772031+0000, chain.objs.size()=1 2024-09-22T09:16:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yKAe2JFXEIQBnxWdRsA5bmxD7lELrM3_0 2024-09-22T09:16:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16878800863717267001', time=2024-09-22T10:58:42.199005+0000, chain.objs.size()=1 2024-09-22T09:16:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4rjm1vU7udgsLG-jrU1iTTDO1-eOLXw_0 2024-09-22T09:16:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15228531119303489557', time=2024-09-22T10:58:42.444488+0000, chain.objs.size()=1 2024-09-22T09:16:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.X393jXDgLxeEUdTT98aWn2A6_b9FkKW_0 2024-09-22T09:16:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8997101839178450814', time=2024-09-22T10:58:42.551886+0000, chain.objs.size()=1 2024-09-22T09:16:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lTdN_pTc3TeKyL8ckqsVBNNxIyiYTu3_0 2024-09-22T09:16:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3115052502321545689', time=2024-09-22T10:58:43.775167+0000, chain.objs.size()=1 2024-09-22T09:16:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.F49djKKGLdCNW9vFi6h7DrK8MvwWl4z_0 2024-09-22T09:16:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10939968657771456059', time=2024-09-22T10:58:43.902153+0000, chain.objs.size()=1 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6nqCqzOJKJJTRxzD9baI_sUylzFxbSd_0 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3282011058930504727', time=2024-09-22T10:58:43.927082+0000, chain.objs.size()=1 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UPxGe4wk5Hs9r4zj09XD5zTJczkVmjB_0 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16658153268907208710', time=2024-09-22T10:58:43.946525+0000, chain.objs.size()=1 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.862+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wdwOj1UJLdM9c1xY3GuhE7ZtqvkQjoU_0 2024-09-22T09:16:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17531901488979213275', time=2024-09-22T10:58:44.411375+0000, chain.objs.size()=1 2024-09-22T09:16:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O7eXvZ1xjXpJ86fPp6gEZ-1OqGTNBT8_0 2024-09-22T09:16:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18049449963626608756', time=2024-09-22T10:58:44.540466+0000, chain.objs.size()=1 2024-09-22T09:16:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.H-dat7O_Fl7KAm1XFp8xILMRldr9Hhd_0 2024-09-22T09:16:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8302742511785736044', time=2024-09-22T10:58:44.587483+0000, chain.objs.size()=1 2024-09-22T09:16:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xfFKDnXC0vgtmWSxDUQpIh6NciaRDey_0 2024-09-22T09:16:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.865+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9871783884790023289', time=2024-09-22T10:58:44.651444+0000, chain.objs.size()=1 2024-09-22T09:16:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.865+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.t8i-XyEBZH0D8_-h-wIOifPfLYnkEe0_0 2024-09-22T09:16:02.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.867+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162551174856484199', time=2024-09-22T10:58:45.032162+0000, chain.objs.size()=1 2024-09-22T09:16:02.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.867+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6Wgf0NV8kEXwIbt0nDP2UyWD3MiSeUZ_0 2024-09-22T09:16:02.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.867+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9233358912549692723', time=2024-09-22T10:59:22.243684+0000, chain.objs.size()=1 2024-09-22T09:16:02.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.867+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.C7DyXxltVJg3mhDlK2KpNzYeG1YIzDK_0 2024-09-22T09:16:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12612414048066890116', time=2024-09-22T10:59:22.692447+0000, chain.objs.size()=1 2024-09-22T09:16:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KX3mGW9HDz70wMRxjjcN-_bKosB9iH4_0 2024-09-22T09:16:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13389918124733475862', time=2024-09-22T10:59:23.024587+0000, chain.objs.size()=1 2024-09-22T09:16:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.g_jhk7aE5qri5jhi_FcUG2PoHQKd81e_0 2024-09-22T09:16:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16045981101008834527', time=2024-09-22T10:59:23.025318+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x9eOcMBp_lvnT-OZQzip1E0Giy-aXiJ_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8422986536135238575', time=2024-09-22T10:59:23.592071+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zcPJVhJVACXwrz9sMbjnWcTva_hatZc_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2148445353330910980', time=2024-09-22T10:59:25.452903+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2tGtlN_INMAYIQpMKKN2Xq90jDH-hnx_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5433472469272816424', time=2024-09-22T10:59:25.540250+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YpRMRNd-WhErG60-b81SBokA2PTSslg_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12767037143027997872', time=2024-09-22T10:59:25.703665+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BbWW1hieWVxurkDmVvPMG1mo-COty2J_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15523190292137803289', time=2024-09-22T10:59:25.838831+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vNJg2mDGI3LhjmTFXk_Ha_QfYdFgHr0_0 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12136698031836326565', time=2024-09-22T10:59:25.839526+0000, chain.objs.size()=1 2024-09-22T09:16:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ne0wLIDRO4juvuTKTu94BxPS0EIfbaG_0 2024-09-22T09:16:02.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14932134955760169110', time=2024-09-22T10:59:25.869167+0000, chain.objs.size()=1 2024-09-22T09:16:02.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zk48TApAP9RG4mGQg5HnB983Y4EkF5O_0 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.876926033260043406', time=2024-09-22T10:59:26.658805+0000, chain.objs.size()=1 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Iuc6G9N_A2wwVpOwTN1oc7faPsMz7kW_0 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5096048444864955422', time=2024-09-22T10:59:26.712298+0000, chain.objs.size()=1 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.y2WPe_-cuADmgHbH457HXMuFbnKm0qR_0 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7945657822226887043', time=2024-09-22T10:59:26.792816+0000, chain.objs.size()=1 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QJErCY8KUhuBb9dAQVaqP5Jui4weTj2_0 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13782942677495802671', time=2024-09-22T10:59:27.247030+0000, chain.objs.size()=1 2024-09-22T09:16:02.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0N6R-6uD_Bk_W9U3BHd1UidyxOp7_8u_0 2024-09-22T09:16:02.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17095767163858063795', time=2024-09-22T10:59:27.426702+0000, chain.objs.size()=1 2024-09-22T09:16:02.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-t4C3CBV5R9N63_l5bd0QqC7f32hfP5_0 2024-09-22T09:16:02.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11053047336404025934', time=2024-09-22T10:59:27.649732+0000, chain.objs.size()=1 2024-09-22T09:16:02.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.873+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7oh58JCavDgn9Ut1YuDzct3XQS7coxN_0 2024-09-22T09:16:02.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.878+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/53521 2024-09-22T09:16:02.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9957048824753767912', time=2024-09-22T10:59:28.138523+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.v0My3vtGYEcbL-JgMA1bqXpf20fDCwa_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15268072388011860003', time=2024-09-22T10:59:28.434728+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ny-BCgpzVE0wvqGDsJVj9K-lISCPVuV_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.273115160523446162', time=2024-09-22T10:59:28.489486+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-X9KtLrU9VqTi0XPFIizkijKrrXO8Sv_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10590007590143204765', time=2024-09-22T10:59:28.793277+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._Wc9bBI6u_YUJ1cNjFrqdCpfoJjAMyL_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2878363820014258935', time=2024-09-22T10:59:29.132975+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.scVBeGzzZ8vnIXiABiIoisk_gGS1uG7_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11546550869105315598', time=2024-09-22T10:59:29.479579+0000, chain.objs.size()=1 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-XxTXr55g6hqDDmmfIYc-HFyQP3UJ_f_0 2024-09-22T09:16:02.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.868596609152506246', time=2024-09-22T10:59:29.512112+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QrZD51_FWD7v9Fq2W_v9kud-Kgu_80a_0 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9445665145297195627', time=2024-09-22T10:59:29.663821+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZPPR1DHcq4IPfor74dZ_UZXWgFutxlr_0 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12743075721669543743', time=2024-09-22T10:59:29.997771+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BPwUJ4Slfxwlb6LiMREyuuh8xucxGGg_0 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14380716924311163537', time=2024-09-22T10:59:30.273584+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5axyetGUwAbP__KAoajVYMUejx9jqSw_0 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10539584069048628067', time=2024-09-22T10:59:30.945681+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5oPPwqQI4uyylPU8NEoQxB1HSOA3-ax_0 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12223144399846869091', time=2024-09-22T10:59:31.372682+0000, chain.objs.size()=1 2024-09-22T09:16:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.881+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dXO67tN1rydZfHH8kutn4yN2pmbLNLs_0 2024-09-22T09:16:02.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.884+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14216740088328879004', time=2024-09-22T10:59:32.163934+0000, chain.objs.size()=1 2024-09-22T09:16:02.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.884+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.c_63DrHA9dMyachjxLA_dL3pUFQDs_T_0 2024-09-22T09:16:02.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1496850692826738134', time=2024-09-22T10:59:32.288837+0000, chain.objs.size()=1 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CiVXLrr0AFaAbWCB_mmPsg7J2r5H7_Q_0 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11238618468420301838', time=2024-09-22T10:59:32.354188+0000, chain.objs.size()=1 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0jnmuR1sFTT_Tf6YbUNkPVwsqDTYLLM_0 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2214194893664343948', time=2024-09-22T10:59:32.630423+0000, chain.objs.size()=1 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2RguH5w2yZk9yypcs-TyOoaTmF4iboS_0 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.886+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16031602032832298096', time=2024-09-22T10:59:32.778476+0000, chain.objs.size()=1 2024-09-22T09:16:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QKrdGbfz7OCzIulzdsmpYN0Gujpn48Y_0 2024-09-22T09:16:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.886+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13038974073132820648', time=2024-09-22T10:59:43.807124+0000, chain.objs.size()=1 2024-09-22T09:16:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.346__shadow_.TZTRtcoECGwiME7Of_ZVmsfF8vIMIh2_0 2024-09-22T09:16:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5636140277601573800', time=2024-09-22T11:00:18.003086+0000, chain.objs.size()=1 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.409__shadow_.BOwKVCfUqrtq_6LsqICk40_rY_IzVsQ_0 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11628218531060038249', time=2024-09-22T11:00:32.564462+0000, chain.objs.size()=1 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.438__shadow_.AIxAgk7XUx9WKX71EvOPfAAM60en7Yq_0 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9148484682375865560', time=2024-09-22T11:00:49.686305+0000, chain.objs.size()=1 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.464__shadow_.-zNqJeYlV0ex95831fIbe2gBzg89-oT_0 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17456739112707137876', time=2024-09-22T11:00:52.378622+0000, chain.objs.size()=1 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.467__shadow_.Nd-M_bzpQKurNLQwQA0i-N21ygJ5g07_0 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6533460995962475123', time=2024-09-22T11:00:59.843368+0000, chain.objs.size()=1 2024-09-22T09:16:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.1adEWtZqbo4-ehhn0Esy_TW-_xJr4BZ_0 2024-09-22T09:16:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.890+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12824940118288266177', time=2024-09-22T11:03:14.316243+0000, chain.objs.size()=2 2024-09-22T09:16:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.529__multipart_mymultipart.2~1SmudzIxoVmfmYyUZZaURryYPb9swxD.1 2024-09-22T09:16:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.529__multipart_mymultipart.2~1SmudzIxoVmfmYyUZZaURryYPb9swxD.2 2024-09-22T09:16:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.890+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8940196970588776455', time=2024-09-22T11:03:41.612476+0000, chain.objs.size()=1 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.538__shadow_.XBEb88dRjNcmB6EDCsgBTKMb5l9DaLN_0 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3457542246220803628', time=2024-09-22T11:04:35.861771+0000, chain.objs.size()=1 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:IdvOpkh4prqp7sXPW5Tt3E8st7rBJ7u_.p00_EQU4gtSr_ON0fPQktRtNzdf0AiK_0 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6698809528531710165', time=2024-09-22T11:04:37.688845+0000, chain.objs.size()=1 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:V36Ih65qhceeRoC1MFRywc8dqOtl5ay_.45U0xOPPXFwlax1klygrybNjHs4P9BD_0 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5756870240501098430', time=2024-09-22T11:04:56.518887+0000, chain.objs.size()=1 2024-09-22T09:16:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:DSPOBjGBt-WZDE9SZPfjW-MJbJqu3EW_.CwviQORawLAcSqEpH4f68QpX8UgtKv8_0 2024-09-22T09:16:02.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1862791891151842680', time=2024-09-22T11:05:14.081356+0000, chain.objs.size()=1 2024-09-22T09:16:02.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:ZVDamnaLYE0fMRWdC7LOaUM6heVVWCa_.-2zQqeO_EvprkM8DTNAbXalhvyU2ShH_0 2024-09-22T09:16:02.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14027926426050895845', time=2024-09-22T11:05:29.271096+0000, chain.objs.size()=1 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:-C2t0ZD7l8M8lbHdZsjN10UZmWlKlom_.TBvbkAa260jvFDj6CQgqyoI06mCkxt-_0 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1625317902288850656', time=2024-09-22T11:05:29.322011+0000, chain.objs.size()=1 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:zvToMM92nPzR0K6MqRx3hbbwDi16XjW_.FJuxxlJgTAqxr3EP_cXeAoWLsfzLgSM_0 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16664081512628099438', time=2024-09-22T11:05:29.348749+0000, chain.objs.size()=1 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:3J1LHb9BjSdGEVX-aGtPj7z.UPKPC1K_.wPvGj0ovfZf2cb0l3YHQedThuthUkQX_0 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14556519697393785148', time=2024-09-22T11:05:36.075771+0000, chain.objs.size()=1 2024-09-22T09:16:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.587__shadow:9Wqe7VsHP8RW15Anw.Cyy3daCJ1WDXK_.perL6hM47ykkgyAIsr8jm3PxbVOwRFR_0 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2390124813806286330', time=2024-09-22T11:05:48.006353+0000, chain.objs.size()=1 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.609__shadow_.TLNJmTLhMkIVHj-GYLwfMy2G5DhEQE__0 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8195705230820425920', time=2024-09-22T11:10:31.883694+0000, chain.objs.size()=1 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.697__shadow:AQ2kcp7rszQo9GFyyMq51EoEywSWTOe_.MoaFOgIrkuS-n89-YA2AVlZAHMMSLiR_0 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12373525354625375352', time=2024-09-22T11:10:37.697094+0000, chain.objs.size()=1 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.706__shadow:7klUetetZdNGxHW4XNCpFYoIwTAaqcF_.SAAkbzbDh9TjrVtDs0HPh7fr2weKSDE_0 2024-09-22T09:16:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~TK7T2HUMRWzO7iV5PH5ZcsByznDVg5f', time=2024-09-22T11:11:24.840665+0000, chain.objs.size()=1 2024-09-22T09:16:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.743__multipart_mymultipart2.2~TK7T2HUMRWzO7iV5PH5ZcsByznDVg5f.1 2024-09-22T09:16:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3643631829943976857', time=2024-09-22T11:11:51.965701+0000, chain.objs.size()=1 2024-09-22T09:16:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.896+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.751__shadow_.szdhGXbHhRqsgQjt9KD8Bu4DxxRfXIj_0 2024-09-22T09:16:02.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.904+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.907+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:02.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.909+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43840' 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16690484362826706931', time=2024-09-22T10:54:45.069303+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.198__shadow_.4VFPowgu5CyHzsn4Oc1eGsNa6idpIUw_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5570319966390712217', time=2024-09-22T10:56:25.562682+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.255__shadow_.5VOwgj_Z8MEoAgwQOnAP0YJHwI_ZZkx_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11422602423654173213', time=2024-09-22T10:57:06.029640+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QmKQYWMyIOe8-vSoTxMpBBt5c7ydYBj_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9996702970380965750', time=2024-09-22T10:57:06.716331+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TBZza62_NAApRnPvHpXq-cCsZPjkASF_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7066281521014825725', time=2024-09-22T10:57:06.869412+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._EPY-M1XTgjyCBfFg1Wso8E1vLj0Aak_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6953243017820730574', time=2024-09-22T10:57:08.163721+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jhTKxdYHciEbE683NFrpfZlHfnni2wP_0 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7157813307538420557', time=2024-09-22T10:57:08.314153+0000, chain.objs.size()=1 2024-09-22T09:16:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.m20daip283l9xL7kkM-swN2TOvQcLAC_0 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12472968502753286410', time=2024-09-22T10:57:08.470060+0000, chain.objs.size()=1 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1EPzs9tgPDM0-cHLpa8-vNL8nKqt7p9_0 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9868621368247711167', time=2024-09-22T10:57:09.295844+0000, chain.objs.size()=1 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.M52sNxAxP2-ZnCEEJFi-KmvRtveZE94_0 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15812884740279541027', time=2024-09-22T10:57:09.784573+0000, chain.objs.size()=1 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uIXPggeJfVuGzg6OR5YIZZmNhSHzI0q_0 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.241695942541352125', time=2024-09-22T10:57:09.814117+0000, chain.objs.size()=1 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fs3OU51rdPvz1IeJifwyYkmb_Vp1Ed6_0 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9988813163238679479', time=2024-09-22T10:57:09.934424+0000, chain.objs.size()=1 2024-09-22T09:16:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.910+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aX7ynUdtNVJpft37pBV5QwHqd8PQEDg_0 2024-09-22T09:16:02.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14801565590316987235', time=2024-09-22T10:57:10.642864+0000, chain.objs.size()=1 2024-09-22T09:16:02.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WbnLXP8R7nYptr5cslvVtooCqgm8so2_0 2024-09-22T09:16:02.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18056867131689161551', time=2024-09-22T10:57:12.811221+0000, chain.objs.size()=1 2024-09-22T09:16:02.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Soe5nlwG2I8mttOpIAa_OCLXQQdrCaX_0 2024-09-22T09:16:02.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1225009055907016780', time=2024-09-22T10:57:12.897965+0000, chain.objs.size()=1 2024-09-22T09:16:02.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oJeq7MFwy6ppc9Jf81uNzNA8EzrXHLN_0 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12565729580813775609', time=2024-09-22T10:57:14.021714+0000, chain.objs.size()=1 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5sPHI33Y_XZM1hYJHKXgJewmqHWTZz4_0 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5292450757411664332', time=2024-09-22T10:57:14.961405+0000, chain.objs.size()=1 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.h9yrVGN2YJ1Mhuoam6aVq5jIVrrXMs3_0 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12590397641491323906', time=2024-09-22T10:57:15.405460+0000, chain.objs.size()=1 2024-09-22T09:16:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.915+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6Kv4cfbTtdNDkEBMqlbdgvAbsV4NHt8_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15305840639543624206', time=2024-09-22T10:57:17.017014+0000, chain.objs.size()=1 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7vduqY76Xw0t_q44fYqn6YxTMYbv-fk_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4618148910303659707', time=2024-09-22T10:57:24.515962+0000, chain.objs.size()=1 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.276__shadow_.Yr_KmAsk-QDA8PwZDndAxxCZiowtLMo_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11105806283568878657', time=2024-09-22T10:57:30.737514+0000, chain.objs.size()=1 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.286__shadow_.dxHhmrknXeNlfUjHDnQj2coh05OyAH1_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6726991589298247159', time=2024-09-22T10:57:38.307042+0000, chain.objs.size()=1 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.62Pjb7vLN7xGdFOm91nIlh8uNIHT1_G_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15005862462424468099', time=2024-09-22T10:57:41.005044+0000, chain.objs.size()=1 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.298__shadow_.8_PuLDmVkP8CXiIFhMzoXm6-ht7UwX3_0 2024-09-22T09:16:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7240484698319923108', time=2024-09-22T10:57:41.671704+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.299__shadow_.h-dAP5KTZ3yZidOe7CJyhfmwDIwtuPi_0 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16756960490610941984', time=2024-09-22T10:57:41.672268+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.299__shadow_.n9HuhOo6Pt-PK4ZjoBkeUvZ0cBK8eBD_0 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17097969739107815881', time=2024-09-22T10:57:46.011845+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.306__shadow_.8CKp2hrf0cvlN0g5kNbj1XqrRTm6egG_0 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16357451476477877470', time=2024-09-22T10:58:34.695229+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pUMEizd3lPIY9eoxri_n1rWD4018ZqN_0 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5893625581932037828', time=2024-09-22T10:58:34.803002+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zA-c-dEtq-s8ChXla5kwV0qWG4YsNvX_0 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4994277328935824802', time=2024-09-22T10:58:35.008383+0000, chain.objs.size()=1 2024-09-22T09:16:02.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.919+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.sDDEGy4uPq2tfqmZLjOrlAq9Tx8p-or_0 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.923+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6754948972124856322', time=2024-09-22T10:58:35.174736+0000, chain.objs.size()=1 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.923+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5No-ggV_2TYjs8fbtOZ55ejRD9RJfVA_0 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15907586787232064693', time=2024-09-22T10:58:35.321605+0000, chain.objs.size()=1 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GmD1yiW0XOXRIpabxL0Y3eM060kp6nM_0 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5822965098907390604', time=2024-09-22T10:58:36.191210+0000, chain.objs.size()=1 2024-09-22T09:16:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kDTe37ynPJ2jBJLXp3Z5It1qxWrcUT9_0 2024-09-22T09:16:02.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9231176147991619562', time=2024-09-22T10:58:36.408308+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ClWk4dCY-whwbPB29g1s1xBtQYNWX3G_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10775982267559639323', time=2024-09-22T10:58:36.752073+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5R7Pmt1NSVff2yN7UuWbUGU5OI2E9p0_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8588403217483832313', time=2024-09-22T10:58:36.839526+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BB2dPOUeo4QWDB3lvhirLifI6qSjNd4_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17478401106545409619', time=2024-09-22T10:58:38.063395+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.43LyItmFOvZTjITE2SpAYf4lMpU2ysy_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10406405121184822022', time=2024-09-22T10:58:38.266507+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4jYjJG94Vz3pz0SD1_cQ6aPXXVe0xIH_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10508601049211080549', time=2024-09-22T10:58:38.380869+0000, chain.objs.size()=1 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.utNDlGKBYDxe-GRMKte4988n4uZYz7f_0 2024-09-22T09:16:02.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11873499575282860642', time=2024-09-22T10:58:38.482931+0000, chain.objs.size()=1 2024-09-22T09:16:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.70mUKraAYtybjyC1MVEyM2p1xbu4SGs_0 2024-09-22T09:16:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15900389924798483809', time=2024-09-22T10:58:38.491496+0000, chain.objs.size()=1 2024-09-22T09:16:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.926+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CF2sQt6lC-BcmNBn1RJsx9cx8-IUKtj_0 2024-09-22T09:16:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.929+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11154908604402173494', time=2024-09-22T10:58:38.875623+0000, chain.objs.size()=1 2024-09-22T09:16:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.929+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N_rIL-HwGwMaq8ptnMRM_MtpmBmKTTm_0 2024-09-22T09:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14548577869200525405', time=2024-09-22T10:58:38.947223+0000, chain.objs.size()=1 2024-09-22T09:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4CkoRc-oFxxRfzIz8EI2xiiCG9noEhM_0 2024-09-22T09:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3623995871785717429', time=2024-09-22T10:58:39.028009+0000, chain.objs.size()=1 2024-09-22T09:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z6JkD4mi61chafw6QpLBIXrwP3YQw-Z_0 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15331758657154926089', time=2024-09-22T10:58:39.090323+0000, chain.objs.size()=1 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.932+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HeV6wYAp0ihvQW2vwYsRIkdwaTgJ879_0 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10274349163585470038', time=2024-09-22T10:58:39.181073+0000, chain.objs.size()=1 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YSrVLuAP1viLdz2YPfiMf6972zAp0fe_0 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4661399328909684319', time=2024-09-22T10:58:39.261103+0000, chain.objs.size()=1 2024-09-22T09:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uxr82gKgNVT3Ktt7Vj-iWpe40iHZ_HR_0 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3596125076177356420', time=2024-09-22T10:58:39.382190+0000, chain.objs.size()=1 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lN6oqvHDoYQkzuPgDnsxQFNRgg8QOE3_0 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15313522070421938175', time=2024-09-22T10:58:39.679249+0000, chain.objs.size()=1 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.n8gz5Itf9nBIA8Af2ADctPV64yxswxO_0 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5456560916664589270', time=2024-09-22T10:58:39.738288+0000, chain.objs.size()=1 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pnpLqF0RQmrkBp6j73w2GUew3fiaDQe_0 2024-09-22T09:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5920477178120338719', time=2024-09-22T10:58:40.298952+0000, chain.objs.size()=1 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2YQ61OxsxqxNbtegig2uRrwkmwKMRxh_0 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5748726847915303301', time=2024-09-22T10:58:40.637017+0000, chain.objs.size()=1 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jOjrgiXvy70cd1VUXxOoIk3VrWntchU_0 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8579755772181694030', time=2024-09-22T10:58:40.795819+0000, chain.objs.size()=1 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ElSy9RcQUO8IJJjig2L_t-RwJE-KSQq_0 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.936+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15280280316050292168', time=2024-09-22T10:58:41.029529+0000, chain.objs.size()=1 2024-09-22T09:16:02.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.936+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bUfkgwTXO8JtZs0NeiALDu02hcy3i7b_0 2024-09-22T09:16:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5415784717083134879', time=2024-09-22T10:58:41.769504+0000, chain.objs.size()=1 2024-09-22T09:16:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.a5u20q6xA3z18FVYg472dda_M_8i6eE_0 2024-09-22T09:16:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.938+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17970123463715872093', time=2024-09-22T10:58:41.812539+0000, chain.objs.size()=1 2024-09-22T09:16:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.938+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iI9X5wBFnJXMBAtNV6QftsDNl-XE61I_0 2024-09-22T09:16:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8273436874487138126', time=2024-09-22T10:58:41.921900+0000, chain.objs.size()=1 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PlD4yp9jrz8jAVJbmuFJ8lrSwfO46Qc_0 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1562961279526348080', time=2024-09-22T10:58:42.015055+0000, chain.objs.size()=1 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.g7oATeqhqG_QyPawtPNSqlteeTHRSoJ_0 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15177506538602089983', time=2024-09-22T10:58:42.147778+0000, chain.objs.size()=1 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PSgDWb2LIyPZVvX0hRUImYASJHoANSH_0 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17522475512485298937', time=2024-09-22T10:58:42.449885+0000, chain.objs.size()=1 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.g_8rJlhljaWhAmE9L46bQ4CKuWTYhVX_0 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15479946930218267235', time=2024-09-22T10:58:42.669080+0000, chain.objs.size()=1 2024-09-22T09:16:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lZPqoOMxJlJ71y1W-Bzd8tk6ouKbWkP_0 2024-09-22T09:16:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8538435020172836552', time=2024-09-22T10:58:42.968034+0000, chain.objs.size()=1 2024-09-22T09:16:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N3C0FNZj_9wrOqv8eoL0EWbcwA6ZEbV_0 2024-09-22T09:16:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16252256278451259328', time=2024-09-22T10:58:42.969626+0000, chain.objs.size()=1 2024-09-22T09:16:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.b8EvNMlbqsPVMH6VPWSNHknIKpP72Dh_0 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10912978925763999590', time=2024-09-22T10:58:43.315846+0000, chain.objs.size()=1 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6ku1gDgwZcwMiwPWBk81zzwQ0iQYNSp_0 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10899609732560539545', time=2024-09-22T10:58:43.651006+0000, chain.objs.size()=1 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DUqPT0HQa--hH34FLRVt3888A1sjRC__0 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14347243946418225761', time=2024-09-22T10:58:43.699682+0000, chain.objs.size()=1 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kRpttwNqOapb0vzToPJ2uDLysU4zzzy_0 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2013736652846813626', time=2024-09-22T10:58:43.720265+0000, chain.objs.size()=1 2024-09-22T09:16:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DSchtm7Yn4Xapfml_4dwwtaJMMqS-5U_0 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16950169648226375821', time=2024-09-22T10:58:43.749251+0000, chain.objs.size()=1 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.S-SL6LxVtI6zduZ-CGYp2mt42IWf0RJ_0 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.748319251300989055', time=2024-09-22T10:58:44.265414+0000, chain.objs.size()=1 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.c8ZNCdrywK6OB2mPyaBv4skFRIkayc2_0 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.118935152888321343', time=2024-09-22T10:58:44.315494+0000, chain.objs.size()=1 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.P3Tc8cBtDoqYRWR5gMw8LmxZOqUINz-_0 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.933875217669065873', time=2024-09-22T10:58:44.506384+0000, chain.objs.size()=1 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.i5VS0inxw9NYEbdfv8u_MfY1Qi1aN1T_0 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13199563581487870754', time=2024-09-22T10:59:22.007016+0000, chain.objs.size()=1 2024-09-22T09:16:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.akFlBXd6USd6-cEY0Bi8NZY4kPJ8EYj_0 2024-09-22T09:16:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6350172072807749451', time=2024-09-22T10:59:22.026065+0000, chain.objs.size()=1 2024-09-22T09:16:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5esDGgxxbAgMBDqQT1xHcCK5yQkY4Pc_0 2024-09-22T09:16:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6363662312021743294', time=2024-09-22T10:59:22.535072+0000, chain.objs.size()=1 2024-09-22T09:16:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.W58XVn9haFTg9YA6bps-kRK2GdyS3VH_0 2024-09-22T09:16:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.235375215195152952', time=2024-09-22T10:59:22.585771+0000, chain.objs.size()=1 2024-09-22T09:16:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.948+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GwWuuo7C9YiWyoMCQPHTuAQ9jOzoCMI_0 2024-09-22T09:16:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5982418607440242375', time=2024-09-22T10:59:22.834344+0000, chain.objs.size()=1 2024-09-22T09:16:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YYigHdQQc6DcK5rjZbaGGcWOzIwxcxd_0 2024-09-22T09:16:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.949+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7367734234222608799', time=2024-09-22T10:59:23.696195+0000, chain.objs.size()=1 2024-09-22T09:16:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.949+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PZ340PxvHrw3MAGkacYgmwoprLuO7eq_0 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5504934824671680166', time=2024-09-22T10:59:23.739237+0000, chain.objs.size()=1 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XUUWnRQ6tMqHeHrmBrvAlDmEhVxI-6F_0 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15602112623873233122', time=2024-09-22T10:59:23.762749+0000, chain.objs.size()=1 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iUMSs99F3hIjPgonXqet01v51Frxlq5_0 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13780549217373267968', time=2024-09-22T10:59:23.971084+0000, chain.objs.size()=1 2024-09-22T09:16:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.950+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Wet8I8Tsry5d5mDDXbw2Q9lNW8EpptR_0 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14903101112561404231', time=2024-09-22T10:59:24.036347+0000, chain.objs.size()=1 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qYIQkfsV_KWEYl2QzP7od9htuyrahiO_0 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15106559729342010657', time=2024-09-22T10:59:24.220985+0000, chain.objs.size()=1 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cW7Apbcdudb1foJOdlC2HUa2jrFgpaX_0 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8370882626001094883', time=2024-09-22T10:59:24.548000+0000, chain.objs.size()=1 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.952+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bq5qpSNKooHoIPAdIOB3jaap87TNcdt_0 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.953+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2236963189541049489', time=2024-09-22T10:59:24.562946+0000, chain.objs.size()=1 2024-09-22T09:16:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.953+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hR-_CwVlBwUXGeEb8y7a9q0hqqhy-Hr_0 2024-09-22T09:16:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.953+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15648127105344985265', time=2024-09-22T10:59:25.020965+0000, chain.objs.size()=1 2024-09-22T09:16:02.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.953+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vMWOFU-hx4Ou1trUyRx_m5cglnY13BM_0 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14069848269879082994', time=2024-09-22T10:59:25.159456+0000, chain.objs.size()=1 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Itdov1jPQj6DLxyqJ3NuOIDbSkGLohp_0 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8146928786738389280', time=2024-09-22T10:59:25.328851+0000, chain.objs.size()=1 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.B5skm5uINI8GUWcT1UdymCr8Z_Dg9xB_0 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.955+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3027115189171414823', time=2024-09-22T10:59:25.451781+0000, chain.objs.size()=1 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.955+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WmjqUwMOcV8PfrkqbuBxFhblAiZDlXv_0 2024-09-22T09:16:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.955+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15792437389877556932', time=2024-09-22T10:59:25.627810+0000, chain.objs.size()=1 2024-09-22T09:16:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.955+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TL905UVjWu7bSI_E8E_s2LfBJtjQbr6_0 2024-09-22T09:16:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.956+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1783903045390976476', time=2024-09-22T10:59:25.905819+0000, chain.objs.size()=1 2024-09-22T09:16:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.956+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gKxtPSQdAIPJ2oD0us0qaiVNv7MU7P__0 2024-09-22T09:16:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.956+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6241468011513242994', time=2024-09-22T10:59:26.439168+0000, chain.objs.size()=1 2024-09-22T09:16:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.956+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rnb7lLSdcsprDDJ0wecNVbUsV5twKot_0 2024-09-22T09:16:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9632862154201539573', time=2024-09-22T10:59:26.467126+0000, chain.objs.size()=1 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JID5D7L1QBJehcbGFMjXiYXupObw8s0_0 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14184862162102490102', time=2024-09-22T10:59:26.610165+0000, chain.objs.size()=1 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pFB1nsjf5nTgaMWwz3I2Hy0qgsF4U8b_0 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8444304584153423773', time=2024-09-22T10:59:26.644952+0000, chain.objs.size()=1 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rrzgvDVnUur4J9hP1m5j8krIYrIIh8A_0 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16083453749103226474', time=2024-09-22T10:59:27.668455+0000, chain.objs.size()=1 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.__5ssk4gR4mlByiTSxiwDeu9mFdtFZz_0 2024-09-22T09:16:02.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12472162197938168512', time=2024-09-22T10:59:28.157340+0000, chain.objs.size()=1 2024-09-22T09:16:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Aqj1UI9asod2VEtvUBUytpQWUv7y3O8_0 2024-09-22T09:16:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12034417116479623757', time=2024-09-22T10:59:28.499093+0000, chain.objs.size()=1 2024-09-22T09:16:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4dMIQgp0g-C1DXMAQH2i0RUWeGDXcWt_0 2024-09-22T09:16:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4100025957810048583', time=2024-09-22T10:59:28.556830+0000, chain.objs.size()=1 2024-09-22T09:16:02.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IfMRRq0GW8AoZ58z4nJXJhv9FvE-MKx_0 2024-09-22T09:16:02.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.961+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9358517805221237594', time=2024-09-22T10:59:28.586807+0000, chain.objs.size()=1 2024-09-22T09:16:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.961+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7t-cxQ-hOar0xcTYt24BV1JaY2LAI8R_0 2024-09-22T09:16:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.961+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7439800320718842143', time=2024-09-22T10:59:28.641001+0000, chain.objs.size()=1 2024-09-22T09:16:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.961+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Sp0Blo5UTOwqKZgxpTlVLYDJFTxhHsQ_0 2024-09-22T09:16:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.962+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3514444926507516380', time=2024-09-22T10:59:28.919340+0000, chain.objs.size()=1 2024-09-22T09:16:02.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.962+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4rb0hrsURgYvfnMqNadz7Kr31k8GWrQ_0 2024-09-22T09:16:02.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43840 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16609140900425388684', time=2024-09-22T10:59:29.003225+0000, chain.objs.size()=1 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PS4A9fViz7_hkzbh0MRj5MFUlYSIb5X_0 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14490936493855456554', time=2024-09-22T10:59:29.157471+0000, chain.objs.size()=1 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3T9sOCvltmFDLhwAElk8B1PqoR_J9At_0 2024-09-22T09:16:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5353652591870505276', time=2024-09-22T10:59:29.640992+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SD9vWOeuZHak0p0ImVUdeSR3poYwQZQ_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15239641799165380966', time=2024-09-22T10:59:30.023684+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q_xWYppn_4yWzBIYEomO7iPqHxgr20L_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4641395207568729865', time=2024-09-22T10:59:30.074602+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.--VNQPpMjvp5mvbQaVnNBp9P8pJ-Rmp_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7515291949612904661', time=2024-09-22T10:59:30.178566+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.967+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.t7sKhXCtAa0SlVM8MqSFCYwofaV2X9D_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14237294822343498105', time=2024-09-22T10:59:30.209876+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UG8miYQpDHqptjVCEF5EEklhV-ZtwTq_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2751394678950737354', time=2024-09-22T10:59:30.421156+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UlfXwBxUDIw92TnOxADyPsJN-y2iNg6_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5594547059325224688', time=2024-09-22T10:59:31.159369+0000, chain.objs.size()=1 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.y2EFJi8lI6Jhs0UX4KeyxloZSRN8Syz_0 2024-09-22T09:16:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4266705592765137463', time=2024-09-22T10:59:31.648711+0000, chain.objs.size()=1 2024-09-22T09:16:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h4ZkYAalz3AlglqnQBeC8OT7ZJ2b1Jw_0 2024-09-22T09:16:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14996402810975950268', time=2024-09-22T10:59:31.849956+0000, chain.objs.size()=1 2024-09-22T09:16:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.99svc0wfhhbw96AlTvg2B6YMnPTcP1e_0 2024-09-22T09:16:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13358786493569579838', time=2024-09-22T10:59:32.158021+0000, chain.objs.size()=1 2024-09-22T09:16:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.968+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JoWOoUGaOFyTpRGRY5QnRo4Ap451hOf_0 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7028181850033134132', time=2024-09-22T11:00:02.097691+0000, chain.objs.size()=1 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.382__shadow_.5JT7aT-pYYBnNTtDC_ZRX4Uii1b0oAy_0 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6486720412375023273', time=2024-09-22T11:00:51.487457+0000, chain.objs.size()=1 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.466__shadow_.LFTgSqk_h4y9LOvFmaHQ3zJXPPV7tWn_0 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9047634592883569357', time=2024-09-22T11:00:59.823933+0000, chain.objs.size()=1 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.hB-0hhgk3SK34MBsbmrgd5E196DDMca_0 2024-09-22T09:16:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15160612691559910714', time=2024-09-22T11:00:59.844549+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.Mjyq3GapEHOcm82zputRtA-PPg3mNg0_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10284606046659708648', time=2024-09-22T11:04:16.824289+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.559__shadow_.605rwY1wYsuSRxN9tk9M1CdkAlqpj1k_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12912441834593994170', time=2024-09-22T11:04:17.665023+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.560__shadow_.F0O9VJpJCxAOtwYT-pQgYhWLpxYcXp2_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13468345399631960158', time=2024-09-22T11:04:33.095280+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:aLN7dpE3mEn.Wa.hSLDGo.DOhWUltek_.h9RNfh2nd6vT8jcv-veUaFAsMh9wiK6_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10961686630504036153', time=2024-09-22T11:05:06.186253+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:NEDF9MF7H4HMLiK8WNuCU.Va5ye28.B_.ayEcolt0C1_whTfBtY0mApptAytYySI_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13763493614168534', time=2024-09-22T11:05:15.968828+0000, chain.objs.size()=1 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:HbdJvwKl9FnhRPgsByFjn.h4u3fudu-_.0T3cVT_ddHYjJCM8mGBy_9GAGJb3dGm_0 2024-09-22T09:16:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15378046539056866921', time=2024-09-22T11:05:29.289359+0000, chain.objs.size()=1 2024-09-22T09:16:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:HX6SDW3.g.Vg04Qi0H0hEpPbWSLFSLL_.J27WrhlbN38MCkwjvXUWyt1Uz2rHb89_0 2024-09-22T09:16:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16580848136010499540', time=2024-09-22T11:05:29.389533+0000, chain.objs.size()=1 2024-09-22T09:16:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.972+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:Q1QZ5a2hJ.hUZeEHjVojLThZFz5uDAZ_.X6GTvFYrOzCfxJAHc0yboWkUsOUMqtX_0 2024-09-22T09:16:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4147306897609018358', time=2024-09-22T11:05:35.204427+0000, chain.objs.size()=1 2024-09-22T09:16:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.586__shadow:tD5cIr8lYrIbaIvRRKcfQttFudRzk-d_.FQ93gfZ9-ZLo9VkMpxDIUsSA6J6HpIY_0 2024-09-22T09:16:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12026307970083569425', time=2024-09-22T11:10:16.055101+0000, chain.objs.size()=1 2024-09-22T09:16:02.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.666__shadow_.bPFH2oUBE5oHJ7ATaXaiX_9Qo7Bdw2j_0 2024-09-22T09:16:02.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.90495937532522605', time=2024-09-22T11:10:40.043780+0000, chain.objs.size()=1 2024-09-22T09:16:02.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.976+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.710__shadow_.0nVY5MSVb9roqQq5aIEi7FXcDsrfJ6h_0 2024-09-22T09:16:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.978+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17374011749473828333', time=2024-09-22T11:12:24.818159+0000, chain.objs.size()=1 2024-09-22T09:16:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.978+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.760__shadow_.Fh3PqCAyPkoR0TPO8GvxFXJu1uvnG7b_0 2024-09-22T09:16:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.978+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8182217441904448950', time=2024-09-22T11:12:55.505988+0000, chain.objs.size()=1 2024-09-22T09:16:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.978+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.767__shadow_.z0CScW79LV2oMc2ZZ3H0vF7hzWttimm_0 2024-09-22T09:16:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.981+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.983+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.985+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.985+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:02.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49821' 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6695779781204921574', time=2024-09-22T10:54:33.653282+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.182__shadow_.ztvi8GGcUtfCmwD6gHCbaZKBvvqjfSs_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5096645684068472411', time=2024-09-22T10:56:12.851136+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.236__shadow_.ej8LYSxL9Vi0Pi7h5mzIC9QDAHrNJBv_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4881466222417214174', time=2024-09-22T10:56:13.511485+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.237__shadow_.kLo_WuL-3KhSEOzA0o1MnRwNBTjw4gm_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8484131066691974861', time=2024-09-22T10:57:05.901985+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1e2SzOM2Ly9aa6h-gkhzEHNrFUUBLnq_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13987586474006498392', time=2024-09-22T10:57:06.087929+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MPhTjv5oT65IGRMZCO5l63xTc5GUxrv_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14709208663251784436', time=2024-09-22T10:57:06.171557+0000, chain.objs.size()=1 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.noj4ZgSEw6xFuHvJERpxH3Cnt5Dc_2D_0 2024-09-22T09:16:02.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4825763011328604978', time=2024-09-22T10:57:06.200392+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qeDKVKxlieBFCHKGHFI3ftoSgTcsCt9_0 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5442560199412880091', time=2024-09-22T10:57:06.448974+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.l1TCrlkBT36T6TQQA5iXGNS1zZhPQ3L_0 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16992525731678696353', time=2024-09-22T10:57:06.627337+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nqHLR1nnhACT5TD-6v0gMvV3fE__ocR_0 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2444064012187688712', time=2024-09-22T10:57:06.741193+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._Bg8WxfQoCbjO3wEfuUyKTwsOOJfBjS_0 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1042636604340664712', time=2024-09-22T10:57:06.764588+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.986+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Od-oGU5aecc2lHCAU_gkOFgJIOKQjIi_0 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.987+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1522074462196559659', time=2024-09-22T10:57:07.859064+0000, chain.objs.size()=1 2024-09-22T09:16:02.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.987+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9Odae2NIFx2bZxW4EOLSl5jhO7pXO22_0 2024-09-22T09:16:02.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.989+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4208573923739111023', time=2024-09-22T10:57:08.993690+0000, chain.objs.size()=1 2024-09-22T09:16:02.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xvzpO626kg0JR3iObiROb4-k7Kntemx_0 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.111957904588600116', time=2024-09-22T10:57:09.028331+0000, chain.objs.size()=1 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yScWbMYrbDi2a-TFAPqH4l0pLyF7QAV_0 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1888463652738698600', time=2024-09-22T10:57:09.222792+0000, chain.objs.size()=1 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.A9Ey_PRbmNBlOiDEsmEDQm6zrTxcypJ_0 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7873438152940739692', time=2024-09-22T10:57:09.553835+0000, chain.objs.size()=1 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ewVZ4uFixX0GO349UBT6NwLeVaInBYB_0 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6522742020183227720', time=2024-09-22T10:57:09.571510+0000, chain.objs.size()=1 2024-09-22T09:16:02.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.990+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rudV9nKGylBfBlfGKX3wvUdPGMdb65c_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12881495474736679815', time=2024-09-22T10:57:09.646576+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Op434qPrLU6Mvc0lfWZqhIr3X6PoAFo_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7568612055826163520', time=2024-09-22T10:57:10.432646+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Dm22mJH08M3UlgGc3C-3lIMRzBK9l-v_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16705054734638614314', time=2024-09-22T10:57:11.010610+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J1HE21HgFbksnToN6ASNRzqbDSrcJyF_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17425623364456592240', time=2024-09-22T10:57:11.470754+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fRjRqu2zC1ahMvuMzNsyVSjjsXGA9EB_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2837144015559195628', time=2024-09-22T10:57:11.807616+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B0GDuTrMWAhjl1s2NbiHld6OwvzNsza_0 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3387773454776802841', time=2024-09-22T10:57:11.823360+0000, chain.objs.size()=1 2024-09-22T09:16:02.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.991+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.R_KUrt2-HcbasC6HV56qgdRmFuXI2qI_0 2024-09-22T09:16:02.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8446560445331916148', time=2024-09-22T10:57:12.184512+0000, chain.objs.size()=1 2024-09-22T09:16:02.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LRIH73rD7AYuTJpbonVsWVYpV1W0JYQ_0 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3828441739622144692', time=2024-09-22T10:57:12.185845+0000, chain.objs.size()=1 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VwSJu0WTmx7x6ksF5r5DErQDWOa2TSZ_0 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17079482216946878111', time=2024-09-22T10:57:12.792117+0000, chain.objs.size()=1 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3J3f2jyWQ4cKQTjyZ5M8j_w8xG4YRJE_0 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8348060011247914354', time=2024-09-22T10:57:13.242297+0000, chain.objs.size()=1 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aN9zD7-rPQBWyoDOMG6aVXw7XaS9vEO_0 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8025463914823807190', time=2024-09-22T10:57:13.428081+0000, chain.objs.size()=1 2024-09-22T09:16:02.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.995+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AGIFaVU5_7-ypV3dJjseK0ZvhMvWUMD_0 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.996+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8240595414199948125', time=2024-09-22T10:57:13.485454+0000, chain.objs.size()=1 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.996+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0EtLcx6Rr_YbmfkS9t0SqLQMvLF666C_0 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10915681387579232816', time=2024-09-22T10:57:13.862771+0000, chain.objs.size()=1 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k4GLCR2uGfGpQ5CmoT8_tuu3o4b_tuW_0 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3488133007920590266', time=2024-09-22T10:57:14.176357+0000, chain.objs.size()=1 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fuxVOjsJdHCk4CgrVv5WPURlRSqFIYx_0 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17937785691069981848', time=2024-09-22T10:57:14.783469+0000, chain.objs.size()=1 2024-09-22T09:16:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Itu_7vodmP9BNcl5LXc69ZuYZaQ3DHG_0 2024-09-22T09:16:02.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13852756235734263503', time=2024-09-22T10:57:14.867072+0000, chain.objs.size()=1 2024-09-22T09:16:02.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xO6u8pSBnywi3Q4i7YizkciwSJ0ztEg_0 2024-09-22T09:16:02.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1657511227611770762', time=2024-09-22T10:57:14.991649+0000, chain.objs.size()=1 2024-09-22T09:16:02.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:02.997+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hNF8Ffouw2FxljpZ8N80lK_r4WfM0RM_0 2024-09-22T09:16:03.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6859628428590165631', time=2024-09-22T10:57:15.484203+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SiX2W4Ot_R5BvBd_r-0wGdieuqIncGE_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18414693847079586060', time=2024-09-22T10:57:15.712533+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.vv34yexqsIWtlYiyPA4M7T70jKHWsKe_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1848774698276658085', time=2024-09-22T10:57:15.871273+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3dHCJlHZv3fDStr9ER9BYeBi2wfWsaW_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17566033360813690476', time=2024-09-22T10:57:16.397735+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kg2FL274l85ZBJ63uxlSwTQFfwifiup_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6884913474737913058', time=2024-09-22T10:57:16.679106+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MTgLP7l9yNGfkDDv60T4Lxo6yUwiiUH_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6224871612611341914', time=2024-09-22T10:57:26.993085+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.280__shadow_.0vlt-Zn-53YlTXSUvuhUqoWZeAsQkFF_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1424028069838351555', time=2024-09-22T10:57:29.424919+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.284__shadow_.uYeHgSNKm6xEOWd0H7yk9E7H0HPuS_C_0 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2799520245710425618', time=2024-09-22T10:57:32.048560+0000, chain.objs.size()=1 2024-09-22T09:16:03.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.288__shadow_.M2qT8YPxYvAl5Zx5UK2hAgHhYWOiOHA_0 2024-09-22T09:16:03.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2595284738428389229', time=2024-09-22T10:57:38.326397+0000, chain.objs.size()=1 2024-09-22T09:16:03.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.001+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.v_iFd5nh-SHLDUIxF9o2FrUSrTY7unv_0 2024-09-22T09:16:03.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.004+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17244815212350318892', time=2024-09-22T10:57:40.406527+0000, chain.objs.size()=1 2024-09-22T09:16:03.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.004+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.297__shadow_.OtCceoqF32N63ZlT8PNFkUWa0oz4pia_0 2024-09-22T09:16:03.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.004+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11292479248675145666', time=2024-09-22T10:57:57.013180+0000, chain.objs.size()=1 2024-09-22T09:16:03.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.004+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.323__shadow_.r80O9M7Hjd_3uCT1-nJLSq-gn6bQAtH_0 2024-09-22T09:16:03.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.005+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3533163859022285330', time=2024-09-22T10:57:57.014534+0000, chain.objs.size()=1 2024-09-22T09:16:03.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.005+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.323__shadow_.rewSyyGPR0l9didx3RIeUU62XpFd5xL_0 2024-09-22T09:16:03.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3665605978005628933', time=2024-09-22T10:58:34.449654+0000, chain.objs.size()=1 2024-09-22T09:16:03.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rrHL0sZkajynU380WZTR-Rf9Hh9jsn4_0 2024-09-22T09:16:03.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18409835625524476148', time=2024-09-22T10:58:34.613181+0000, chain.objs.size()=1 2024-09-22T09:16:03.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oRkjRnQVdZ8VovNZCpV83MGMfUZ4_7W_0 2024-09-22T09:16:03.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13797326964098439892', time=2024-09-22T10:58:34.907858+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.asy4ZRRKF9pfV-U9wdpUJCsUMXYRTov_0 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6610059558260087815', time=2024-09-22T10:58:35.026373+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NB0Q6bN2jHcl5ItGwcBmUCr_2NFXlpL_0 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.894352743884660083', time=2024-09-22T10:58:36.519340+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ymTw3e8pZ9oGxJC98F5Dvx980oa_XGF_0 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4579248109982908333', time=2024-09-22T10:58:36.628097+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xtktu1kpPdodizNbG8Txe98ykKVh2E5_0 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12770343426135636532', time=2024-09-22T10:58:37.689207+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8RTB4yu60RCSRwkiYkgjdg_T2DcpKwB_0 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1435261438548640113', time=2024-09-22T10:58:37.691846+0000, chain.objs.size()=1 2024-09-22T09:16:03.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.007+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7ZAokk7mWtuqLPBYZXPYW_GlScJZQBF_0 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9582062133327526109', time=2024-09-22T10:58:38.092364+0000, chain.objs.size()=1 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VvJWUWhHhAoFlE2yykwR1rGUI-vdPcI_0 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6869272114385021009', time=2024-09-22T10:58:38.920332+0000, chain.objs.size()=1 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9NwTUS6xiR7JwX5r9K61LRYs0qQDuZZ_0 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3644314574025547300', time=2024-09-22T10:58:39.902935+0000, chain.objs.size()=1 2024-09-22T09:16:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.010+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LrcC7f7LpdhTwQNCTWKJymwwpxuFiUK_0 2024-09-22T09:16:03.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7633823323023501167', time=2024-09-22T10:58:40.642281+0000, chain.objs.size()=1 2024-09-22T09:16:03.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.f1JWdURNUvJKu1_z01Rkzfs3hgD4ZyS_0 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15850533687423622009', time=2024-09-22T10:58:40.968849+0000, chain.objs.size()=1 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yHtT6nWi_NyrLmUSj0OGG2bwkVAqsS1_0 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10586670449601556948', time=2024-09-22T10:58:41.294977+0000, chain.objs.size()=1 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TJqso8FK0sPN72DOJu_XYnXpoYIJ7i__0 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9812711337832958094', time=2024-09-22T10:58:41.920243+0000, chain.objs.size()=1 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QZgsgjLLgW6g0ublhSOZHwUgEwju3lw_0 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17044248967292505841', time=2024-09-22T10:58:42.122465+0000, chain.objs.size()=1 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lfM61_qRnDoFbKoMnQ4J7xlNjhGyPfk_0 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16147076085010306297', time=2024-09-22T10:58:42.289340+0000, chain.objs.size()=1 2024-09-22T09:16:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.012+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z01w49x8PTeivgfM2TxCVF5TEq0hRR__0 2024-09-22T09:16:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.013+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16861961820886665098', time=2024-09-22T10:58:42.672269+0000, chain.objs.size()=1 2024-09-22T09:16:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.013+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IyDav_pslc5--49p-BdzTaAb2aea7Ok_0 2024-09-22T09:16:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.013+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1155860731031432630', time=2024-09-22T10:58:43.382922+0000, chain.objs.size()=1 2024-09-22T09:16:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.013+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xlYdnwzepQQCcajP80rKnZZfFkFXslb_0 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13009574583621908465', time=2024-09-22T10:58:43.384470+0000, chain.objs.size()=1 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O3XeR4FR9n6T80PWakwPiz_VeyFc1Hv_0 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2554416634417548250', time=2024-09-22T10:58:44.670047+0000, chain.objs.size()=1 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zrTHv8CP4nrIfsT7BiJWy86BKQCFnC4_0 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16584124379881801636', time=2024-09-22T10:58:44.967593+0000, chain.objs.size()=1 2024-09-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bHchCNbK1XifHGMLBiI42Mi4QaAOEDJ_0 2024-09-22T09:16:03.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11157584709944347051', time=2024-09-22T10:59:22.031414+0000, chain.objs.size()=1 2024-09-22T09:16:03.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.016+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hKGhJ2v6tr3zAyRPNm7dAXlBPceSqtF_0 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.017+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12057264356620482031', time=2024-09-22T10:59:22.314487+0000, chain.objs.size()=1 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.017+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x-QKXn5E0G2qQDpiRk1r6jN26cadqcB_0 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.017+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1250606028643079716', time=2024-09-22T10:59:22.452552+0000, chain.objs.size()=1 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.017+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4CS-wqwKRvNFUMkViWMzkeSa2laAOrG_0 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15457777007425317867', time=2024-09-22T10:59:22.597356+0000, chain.objs.size()=1 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.juK-Ec_I9Mc-o3jAcG6w2JEUzOOqVnj_0 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1302093904649741763', time=2024-09-22T10:59:23.583120+0000, chain.objs.size()=1 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.g9MdmrG1xPl_pjsuQNu0veSopKDNZRc_0 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.612618119989978228', time=2024-09-22T10:59:23.623701+0000, chain.objs.size()=1 2024-09-22T09:16:03.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.N4744v72VrRE5buuNoNUQlLPYrSpbTN_0 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2730492850880367610', time=2024-09-22T10:59:23.997246+0000, chain.objs.size()=1 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.u3OYWfvQMk1j3ZIGbqXvgMJFtsjt0Z5_0 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3141439106679226237', time=2024-09-22T10:59:24.157922+0000, chain.objs.size()=1 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.018+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1NwLeilbeoF4lESbPfBPf-wgiVB5Ody_0 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.019+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11559810498983164036', time=2024-09-22T10:59:25.001159+0000, chain.objs.size()=1 2024-09-22T09:16:03.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.019+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wj2rM0ey_1RVJ-tRTBVi_vh_MZcZIAD_0 2024-09-22T09:16:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.572559728877490864', time=2024-09-22T10:59:25.300738+0000, chain.objs.size()=1 2024-09-22T09:16:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XCflknuN0Ph3-fNLSQjDJf4LMzFG8K__0 2024-09-22T09:16:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10307797868280787555', time=2024-09-22T10:59:25.327957+0000, chain.objs.size()=1 2024-09-22T09:16:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AWmD-Bftd6aOW9lhZijXhKt6MrMsjgy_0 2024-09-22T09:16:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17854820741271521491', time=2024-09-22T10:59:25.329175+0000, chain.objs.size()=1 2024-09-22T09:16:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qx042NC5qKxLCmRqAQ3VChl1T9zx6n1_0 2024-09-22T09:16:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2666484503914327878', time=2024-09-22T10:59:25.371616+0000, chain.objs.size()=1 2024-09-22T09:16:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.021+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pvWPxp4vkNtbAs0aEiq_rX-l5qStj0C_0 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2257683712738157449', time=2024-09-22T10:59:27.412621+0000, chain.objs.size()=1 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kpCcrWscZowAjQ5Ou7WuaCZ1OyNBOTw_0 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1550511592329401728', time=2024-09-22T10:59:27.546733+0000, chain.objs.size()=1 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ylv59gY4iN4PpX_EvG5fv4xG7oq0B-k_0 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10764572756567177993', time=2024-09-22T10:59:27.687929+0000, chain.objs.size()=1 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wQCDhYOlNHgD6YeQn44jlpkQYiI1Dyg_0 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2373874813169972315', time=2024-09-22T10:59:27.752652+0000, chain.objs.size()=1 2024-09-22T09:16:03.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zryYYnlmZaaDxb-Yr_hJuDESVt6fGn-_0 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3466993872460145404', time=2024-09-22T10:59:28.279313+0000, chain.objs.size()=1 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9bI66nDfxWgfpiFoxyj7EErEMjKTFx2_0 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.284004394433625117', time=2024-09-22T10:59:29.911439+0000, chain.objs.size()=1 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oFWStHv0i7CdvJpK4_advd3Ykp-j7Hi_0 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7669941869002170840', time=2024-09-22T10:59:31.223265+0000, chain.objs.size()=1 2024-09-22T09:16:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.023+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KiZykhZKY7q9mLPhuAMN5D2iMSvRObx_0 2024-09-22T09:16:03.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.027+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14934838701780673230', time=2024-09-22T10:59:31.224000+0000, chain.objs.size()=1 2024-09-22T09:16:03.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.027+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pZ1fqSYbwv3CjIOylMUpNQgPMdLkOoN_0 2024-09-22T09:16:03.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11692616793240844638', time=2024-09-22T10:59:31.777977+0000, chain.objs.size()=1 2024-09-22T09:16:03.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lyOLS59tznQQQa0m6l6WFf6xyhtqgmx_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13430965712537194481', time=2024-09-22T10:59:31.845274+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.svzmG7w7b549lydfe7gU2ioOuZ3JuQA_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16768427994853136579', time=2024-09-22T10:59:31.852412+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cAKEOpJ6ZvIIxqLtgF4WKqJ0eina641_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12443944843001686463', time=2024-09-22T10:59:31.884568+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4ic-DKtiRMjIy3D73zYtyxbWF22i_4G_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9042530772439135294', time=2024-09-22T10:59:32.307723+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ekU7dVrwxWh4gqu7QGlBwoOWMCxhvJi_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7422834422888981077', time=2024-09-22T10:59:32.636264+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.36sriN19a5yUW4bQg9c-DZWs0Jk37jb_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6153491570904858468', time=2024-09-22T10:59:32.727053+0000, chain.objs.size()=1 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G5LRCWkmqUA9_ES4g-gMSrzHvyWQjD7_0 2024-09-22T09:16:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10963883046722489035', time=2024-09-22T10:59:32.836014+0000, chain.objs.size()=1 2024-09-22T09:16:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XvIqKAgynB7a2Ct4YdRGPZTIa5HvLbc_0 2024-09-22T09:16:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5013187509250952926', time=2024-09-22T11:01:29.391599+0000, chain.objs.size()=1 2024-09-22T09:16:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.517__multipart_mymultipartcopy.2~56CUNR1TkagxnBHvTlYPKPR_KIdhr9j.1 2024-09-22T09:16:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16717129028018840389', time=2024-09-22T11:02:50.556840+0000, chain.objs.size()=1 2024-09-22T09:16:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.028+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~DMuQIXHvl1I1opJ4s0WfD3K8IJjRXTX.1 2024-09-22T09:16:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.031+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5593917592582409528', time=2024-09-22T11:03:13.897952+0000, chain.objs.size()=1 2024-09-22T09:16:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.031+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.529__shadow_.NKu_-DnlZg2KQQ7Fp4RvmnsKRDpG_U2_0 2024-09-22T09:16:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.035+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/49821 2024-09-22T09:16:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15504078029882530606', time=2024-09-22T11:03:57.880922+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.551__shadow_.9B6A2CMV1NTXXdofOUjXDpPkg6cCrJE_0 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2631143565702256276', time=2024-09-22T11:04:11.209373+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.558__shadow_.e6wYekFfooAtmIeXWVVscR-I36vZlR7_0 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12508203167610457207', time=2024-09-22T11:04:30.803309+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:AAgyj0YZeB.XhRS7Z9spCopZcS8aWv-_.lv_mUnbCRkZAXnhyMPYk9NoHnvlbdX3_0 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17667416597358467077', time=2024-09-22T11:04:35.615553+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:JZXmYOMoTrMkh04LWjfjmq8opa7fMS9_.DbU1gkGseQfdguGhFXaKPbu3H8tYMKt_0 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.54234129651132849', time=2024-09-22T11:04:43.032544+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.574__shadow_._pryEfTB_wizPhGX6zsSqDqfuoGbW2R_0 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9798952603079810214', time=2024-09-22T11:09:31.647946+0000, chain.objs.size()=1 2024-09-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.635__shadow_.hB9tvSvVDx5U2X2wKqoE-J6aDy90NHB_0 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8621677360457327272', time=2024-09-22T11:09:42.270073+0000, chain.objs.size()=2 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.647__shadow_.ZBUekNEi9V59zBKH0IQVcxWy5m0NHfl_0 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.647__shadow_.ZBUekNEi9V59zBKH0IQVcxWy5m0NHfl_1 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13355217674236544216', time=2024-09-22T11:10:12.949855+0000, chain.objs.size()=6 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.1 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.2 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.3 2024-09-22T09:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.037+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.4 2024-09-22T09:16:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.040+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.5 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.661__multipart_bar.2~NgdLW8O6qRYdkDvlNCaaBzwdHkc1G8e.6 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9733179736596456760', time=2024-09-22T11:10:16.048800+0000, chain.objs.size()=1 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.666__shadow_.E10apVA6kgjImOU-bZ6lDDo5JiH8Zne_0 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1238265440911663929', time=2024-09-22T11:11:23.682675+0000, chain.objs.size()=1 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.742__shadow_.anG0knECRGvgSeYxsgmZ390gOTKmTau_0 2024-09-22T09:16:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14334311236976872484', time=2024-09-22T11:15:18.319720+0000, chain.objs.size()=1 2024-09-22T09:16:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.041+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.783__shadow_.g2Vv8spUG6o_u6QMAGe6mtblBNS2nr4_0 2024-09-22T09:16:03.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.045+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.048+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:03.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.056+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53653' 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11104045500702336349', time=2024-09-22T10:54:18.777529+0000, chain.objs.size()=2 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.165__multipart_foo.2~GRfrI32ghzsKeKebYmccl42n01j-gBI.1 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.165__multipart_foo.2~GRfrI32ghzsKeKebYmccl42n01j-gBI.2 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7541020714451768207', time=2024-09-22T10:54:32.754300+0000, chain.objs.size()=1 2024-09-22T09:16:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.180__shadow_.xo2xQ2j7N7kvRwpZWvw1nKKZNHqZg7I_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9455355796926958115', time=2024-09-22T10:56:15.297612+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239__shadow_.iFPzmV-Aom-RVd9GJ1jZd0ay87vlayi_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7474639450352543976', time=2024-09-22T10:56:21.204027+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.248__shadow_.R_Zay158Va76-dhxsj7gL1OkXi_JnG0_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12087173763671491317', time=2024-09-22T10:56:21.205311+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.248__shadow_.8dUtFxiUyFs7rHt-Aca6dGxS4KIpQ8f_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11432005159898201991', time=2024-09-22T10:56:24.889584+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.254__shadow_.7-KigOv-zAvaonVi_HIGFvAAP0yKB4E_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9026791891943172062', time=2024-09-22T10:56:28.450704+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.260__shadow_.ZowSJutyQgzXJ1J14pDJ5N28F9U1LV3_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10835302436351438589', time=2024-09-22T10:57:06.744494+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VccUr1pYq7T6dPIE30Yt0oePRIFWS2f_0 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2490457037859308877', time=2024-09-22T10:57:06.807384+0000, chain.objs.size()=1 2024-09-22T09:16:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1JiUEmHbtWpVhy9YVp9tVt5YhhAr9tj_0 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3628434845417356351', time=2024-09-22T10:57:06.996083+0000, chain.objs.size()=1 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.A-8szgv_EorHS1cG1oNfH_XCw4JcK9T_0 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8298577688061943908', time=2024-09-22T10:57:07.636760+0000, chain.objs.size()=1 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.057+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZHyzuIIQU20Oj3Q1PcOyyU03YGFjUMC_0 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.060+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14274976875354579341', time=2024-09-22T10:57:07.977930+0000, chain.objs.size()=1 2024-09-22T09:16:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.060+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XSRk3VIku4C27c4plrgZ8g7ZgL11fxJ_0 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3612715582338031274', time=2024-09-22T10:57:08.098543+0000, chain.objs.size()=1 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.owNrPc3BuyPR3z5XjUaY5pmh9E1TFfL_0 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12962421228972351873', time=2024-09-22T10:57:08.277385+0000, chain.objs.size()=1 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PdTrW2lgcn6QlfIkhXfIpZugnOVqbDe_0 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5854818666036124321', time=2024-09-22T10:57:08.501263+0000, chain.objs.size()=1 2024-09-22T09:16:03.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.062+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5G1NxPD1JFKEPQ3-0uPsX-XSnYu8NK4_0 2024-09-22T09:16:03.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.296923550999619511', time=2024-09-22T10:57:09.161699+0000, chain.objs.size()=1 2024-09-22T09:16:03.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.h4aqiel9vdqs8bQy8dQIFs5cSlu3G0O_0 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2656340152011326921', time=2024-09-22T10:57:09.521583+0000, chain.objs.size()=1 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bQnL7pbPobdc645CGuyi9nQGuRI7Rbo_0 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11199931844762263126', time=2024-09-22T10:57:10.034401+0000, chain.objs.size()=1 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ClzdnPReB2BWQYBnR08BcHoUI6gxp9o_0 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17565129016160374963', time=2024-09-22T10:57:10.975608+0000, chain.objs.size()=1 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ky0Q3ct2Gl1zdbMi0sbmVC0nAd7p62v_0 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9977897878000505181', time=2024-09-22T10:57:11.471132+0000, chain.objs.size()=1 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DEnldjmhuwHGeFTDQReulcTZ9cvtzBS_0 2024-09-22T09:16:03.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6876427693269876615', time=2024-09-22T10:57:12.186877+0000, chain.objs.size()=1 2024-09-22T09:16:03.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xxFbzBlWR7yfh57qjHTNFY8XZzSK38l_0 2024-09-22T09:16:03.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17332286221547069438', time=2024-09-22T10:57:12.897964+0000, chain.objs.size()=1 2024-09-22T09:16:03.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.064+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.sFhpcIDaTMOhwwT1YgA2ERtQJ0kowTO_0 2024-09-22T09:16:03.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6089251145712346673', time=2024-09-22T10:57:13.241145+0000, chain.objs.size()=1 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.m-Ar4lBeMp9GpCphNqopQDxFvKBjLp7_0 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14823198734634173376', time=2024-09-22T10:57:13.256875+0000, chain.objs.size()=1 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kPC1s-PqXIX-f2GLgfluSaorSVwoPFe_0 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15610060623982794787', time=2024-09-22T10:57:13.349017+0000, chain.objs.size()=1 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J9BQqFSyU0DgaE01ap175PjwUX19lOg_0 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9976118454830047639', time=2024-09-22T10:57:13.665565+0000, chain.objs.size()=1 2024-09-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.066+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bHiNDkGdANjp0Ie9o_WmnfNHhGyxykS_0 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.827756538612578729', time=2024-09-22T10:57:13.666297+0000, chain.objs.size()=1 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9dupApzv6vcj3kcvsyscgI_pIkM1WSM_0 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3546831245548663949', time=2024-09-22T10:57:14.302723+0000, chain.objs.size()=1 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5aNEfeEePdgam9Ek1E9gz2UDbCVAQO3_0 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7675407040757846207', time=2024-09-22T10:57:14.906389+0000, chain.objs.size()=1 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PJTIQP3A3HQUlTiIlfnvGCrs2d4sYDS_0 2024-09-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.792117845167664159', time=2024-09-22T10:57:15.055081+0000, chain.objs.size()=1 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TzTNZqYndj-HIIoAKfD4oogXNV1x4wD_0 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12804719902566711339', time=2024-09-22T10:57:15.443808+0000, chain.objs.size()=1 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.068+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.G1e1BUzBFBLOeeN0YWlD6EcOIB_zxLV_0 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.069+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5791485806747624345', time=2024-09-22T10:57:15.484856+0000, chain.objs.size()=1 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.069+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wPeysCjo12w1ZX5SROOB6J7W9KhxMQY_0 2024-09-22T09:16:03.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.069+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10415024640391069493', time=2024-09-22T10:57:15.601285+0000, chain.objs.size()=1 2024-09-22T09:16:03.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.069+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wWrZ-zSG9wcX2lSHUAT9erkYu-23fQ8_0 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11457189494717205077', time=2024-09-22T10:57:15.853995+0000, chain.objs.size()=1 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7wr36C7a1ARmpGN9jCAskaKXX-uM7gq_0 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3106692439825045578', time=2024-09-22T10:57:16.374823+0000, chain.objs.size()=1 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7F0Nazqq4HmwekCF_g86UfxdOoap83J_0 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17135613500038302868', time=2024-09-22T10:57:16.924033+0000, chain.objs.size()=1 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.071+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._oIkqsFLcHULEVyEhnOw_c4_Y4i7X1w_0 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.072+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4211990498175031663', time=2024-09-22T10:57:27.001204+0000, chain.objs.size()=1 2024-09-22T09:16:03.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.072+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.280__shadow_.d2qvYFKgw0ais_9tD7AVOFNKaqdgsdg_0 2024-09-22T09:16:03.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.073+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667447818089275632', time=2024-09-22T10:57:27.594394+0000, chain.objs.size()=1 2024-09-22T09:16:03.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.073+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.281__shadow_.j8DZnvrLzvVdnavA7Uzd93QxNueyFSH_0 2024-09-22T09:16:03.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.073+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15938020480748702105', time=2024-09-22T10:57:28.808113+0000, chain.objs.size()=1 2024-09-22T09:16:03.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.073+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.283__shadow_.xku5OS_-edL5QPKaOWn3HNC5_YCuFsp_0 2024-09-22T09:16:03.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7018988269595758901', time=2024-09-22T10:57:29.413120+0000, chain.objs.size()=1 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.284__shadow_.geBN9L62ASwsQb97GPzqvkEQLDp2Flk_0 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7640369209349712837', time=2024-09-22T10:57:33.889921+0000, chain.objs.size()=1 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.291__shadow_.arHPkBHd_9AN6_ixOJ7jUqscLaO75ji_0 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.877652363010807937', time=2024-09-22T10:57:39.792814+0000, chain.objs.size()=1 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.296__shadow_.eNKBLjBUso-2bV77U--C9xY-UmsRuIE_0 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3723271164835720648', time=2024-09-22T10:57:42.960169+0000, chain.objs.size()=1 2024-09-22T09:16:03.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.074+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.301__shadow_._ufbSUBwh46adulvWt8CE-iAwaBncQP_0 2024-09-22T09:16:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9428088640073480841', time=2024-09-22T10:57:42.960939+0000, chain.objs.size()=1 2024-09-22T09:16:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.301__shadow_.cgP4pRj9bCULynN9dtE64pNlEgLf3QL_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14873094191809825121', time=2024-09-22T10:57:44.810690+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.304__shadow_.VQyZo7fda79f0ZiOablr9jdD-vn_uoV_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7882741786333846620', time=2024-09-22T10:58:34.751161+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0RWvdA-NPQ799bLlgegu9gu_71Q8Owm_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15757522713325419012', time=2024-09-22T10:58:35.146165+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.R2b4B5FYsFDl0iJSW9M0QkYCXTx0eCc_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10069150933997786978', time=2024-09-22T10:58:35.354152+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Gu73dXx1jSBj_ZUKKY-D4Ui-pfuZUc6_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2755459059783341774', time=2024-09-22T10:58:36.192575+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.H9W2iKKHcXca5EG5ufP02rMVlL7PYoK_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5947836578708290961', time=2024-09-22T10:58:36.252015+0000, chain.objs.size()=1 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MmS98VKV0_ZxzYMtSi6LJKu8F5LrTdX_0 2024-09-22T09:16:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13671598272984166466', time=2024-09-22T10:58:36.289301+0000, chain.objs.size()=1 2024-09-22T09:16:03.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.079+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UJZmazCu1kcDMKbLu6e-rNt6RyRsZCg_0 2024-09-22T09:16:03.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1917783463540303124', time=2024-09-22T10:58:36.980567+0000, chain.objs.size()=1 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cA4ZCLotp8mxjOgM3n-kV8GyBfc2c_2_0 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3486376769165006506', time=2024-09-22T10:58:37.451362+0000, chain.objs.size()=1 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hP4ERn24Dm-oLdE_Yhfc2Ex-hn88dkE_0 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2712893077489227763', time=2024-09-22T10:58:37.599186+0000, chain.objs.size()=1 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1iAL0mBGeL_M9l7NxSfyyiNJ6xye6c1_0 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.741284973979221154', time=2024-09-22T10:58:37.862066+0000, chain.objs.size()=1 2024-09-22T09:16:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.082+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MPtE_kx-3nL8MdVO7aSVSOX7v4wKOiG_0 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15414746160003143852', time=2024-09-22T10:58:38.217183+0000, chain.objs.size()=1 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JnZI0uga9Oh4GKV0narxtlnEKBM5voA_0 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2003709852971126242', time=2024-09-22T10:58:39.501384+0000, chain.objs.size()=1 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RxCXNybIHfVes-UOBPb58GEtBomPyvv_0 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17707113038007086750', time=2024-09-22T10:58:39.544963+0000, chain.objs.size()=1 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2wTucSZT-taDTTsH_e6b9-0-I8m_X9L_0 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8071878827820044331', time=2024-09-22T10:58:40.497265+0000, chain.objs.size()=1 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3firdEeVaMKCruVGMpwmGXKwLibNqOW_0 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1777983404556900466', time=2024-09-22T10:58:40.638371+0000, chain.objs.size()=1 2024-09-22T09:16:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.083+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UD-8VPVkB3_ABKUjkELVZE-l1Kfq3qU_0 2024-09-22T09:16:03.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.084+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6469775910092158640', time=2024-09-22T10:58:40.743471+0000, chain.objs.size()=1 2024-09-22T09:16:03.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cOuqQgoAS1DhuW5Kpv21jcuBER-iS9U_0 2024-09-22T09:16:03.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.084+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15415320116006749415', time=2024-09-22T10:58:40.821740+0000, chain.objs.size()=1 2024-09-22T09:16:03.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.084+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IKvd02-57xzKQ_5cuxp82dUdB5nVl94_0 2024-09-22T09:16:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.086+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6656545701698867319', time=2024-09-22T10:58:40.998413+0000, chain.objs.size()=1 2024-09-22T09:16:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.086+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Gw4T5I5Q7YP2vTaU06j7N-jd5kCPXyy_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13904905314245435144', time=2024-09-22T10:58:41.208903+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.U8umMadymOSPUT5C4ggJsYaVD4zXRkn_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3686014593941925461', time=2024-09-22T10:58:42.168213+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nUV4hofDlSbBwuFj8oVI08MUnTXhr8Z_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10721384821634350675', time=2024-09-22T10:58:42.651047+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.F1JpvnDOiW-4qDTMv0B3FZ3AkMgffhU_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6776730139353283653', time=2024-09-22T10:58:43.242988+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.m6d3tuhebyYqItHLwv6rSvWW0onCeIl_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9664766718023530681', time=2024-09-22T10:58:43.247495+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W3GQHze1CeM9MmOVFWHPGnvdoML_nt5_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11546317051403476605', time=2024-09-22T10:58:43.782745+0000, chain.objs.size()=1 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YXu7LbhDg6hanvy6EKe1qSao74I1pDx_0 2024-09-22T09:16:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3928620891990361046', time=2024-09-22T10:58:43.946776+0000, chain.objs.size()=1 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oNnOb4-ADmBKm6StIgzniI2YuZW4nZD_0 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2483963365859111449', time=2024-09-22T10:58:44.587929+0000, chain.objs.size()=1 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JpUAWmdQpK0301OO6dS0jsK0cfYMsec_0 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4761587837937374394', time=2024-09-22T10:58:44.790459+0000, chain.objs.size()=1 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.087+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VPHn10lOa2ywMvYLR1yYOj9vp-kx1yg_0 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.088+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11283795149835275579', time=2024-09-22T10:58:44.827227+0000, chain.objs.size()=1 2024-09-22T09:16:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.088+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ilaWu5I893xD1W_FMV2NkXt2eKHTrwu_0 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4760370110690419432', time=2024-09-22T10:58:44.885935+0000, chain.objs.size()=1 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9LHhZPv-clYR9ryFpm_DYTnewzbwRZ0_0 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17504480805170833772', time=2024-09-22T10:58:45.061908+0000, chain.objs.size()=1 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pYnC19lIRm-szxVJcEVaCJEo-2a58L3_0 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11768804242346702304', time=2024-09-22T10:59:22.448756+0000, chain.objs.size()=1 2024-09-22T09:16:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.092+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7v41XszHs8giUEsD8xYAB2SFR-0D_Lh_0 2024-09-22T09:16:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14369828581613672577', time=2024-09-22T10:59:22.651665+0000, chain.objs.size()=1 2024-09-22T09:16:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._bH6ZmDNvvVKD1tZKgwWcxAhgjNz7jw_0 2024-09-22T09:16:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11118957799683904457', time=2024-09-22T10:59:22.892258+0000, chain.objs.size()=1 2024-09-22T09:16:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6v7uD__G_jnx_6aEm0Jna53ZMIFjWVy_0 2024-09-22T09:16:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15521666311998729644', time=2024-09-22T10:59:22.930213+0000, chain.objs.size()=1 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.093+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-p0lM_Rw0CrK3sIv10DCeu4nq7bOMXn_0 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16048997894612890622', time=2024-09-22T10:59:22.977517+0000, chain.objs.size()=1 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NK2OR3RJWHcvShikTSWEun3L70F4Bu6_0 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7779081872888669909', time=2024-09-22T10:59:23.572610+0000, chain.objs.size()=1 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vlHY6N1R8WFCj1x49Dz9YxHp0PZY0PO_0 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11229988516656836887', time=2024-09-22T10:59:23.592898+0000, chain.objs.size()=1 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.mAhzd-M2PptkuONb6EW_ysWy4NChJI__0 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8861583689938555564', time=2024-09-22T10:59:24.035656+0000, chain.objs.size()=1 2024-09-22T09:16:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8gp32VmpZ0p9tQP4c66cAZcrnb9j83w_0 2024-09-22T09:16:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6005719219286769809', time=2024-09-22T10:59:24.437701+0000, chain.objs.size()=1 2024-09-22T09:16:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.094+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Fr6Ofb0EI4XdHvO0AnWqVdMA_y6muRa_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.097+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13978402623893675704', time=2024-09-22T10:59:25.159512+0000, chain.objs.size()=1 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.097+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kmNe0epsmwJ1Qh0A-7Zxfmekr3Y6brK_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.097+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7877499061265111611', time=2024-09-22T10:59:25.451830+0000, chain.objs.size()=1 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.097+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oOTht5eZKchPJw1KHqkpwe4W6BVFI8f_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.097+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7385974244071318795', time=2024-09-22T10:59:25.514537+0000, chain.objs.size()=1 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YCFbZGDWWfzPQps4PLQiESwWy0EBGMq_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.856086648060345543', time=2024-09-22T10:59:25.770333+0000, chain.objs.size()=1 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.s00vhCfqpmAmNiKRV_2IBEBqs-CNEW3_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14968528575071863553', time=2024-09-22T10:59:25.904369+0000, chain.objs.size()=1 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EGIJJGFKGz6GW-PQE5gulEs3hpXq96l_0 2024-09-22T09:16:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3026194033884536420', time=2024-09-22T10:59:25.961321+0000, chain.objs.size()=1 2024-09-22T09:16:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VVtuTNdFTVcHCo95FcD7voAtqHtZGYo_0 2024-09-22T09:16:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12490537715065462808', time=2024-09-22T10:59:26.501031+0000, chain.objs.size()=1 2024-09-22T09:16:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.098+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yO40cfBNHShAeDjCq3MJJ-l9Ff-wCls_0 2024-09-22T09:16:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1868334845373942513', time=2024-09-22T10:59:26.748909+0000, chain.objs.size()=1 2024-09-22T09:16:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2WYupvEWlnz6luGqCDp-ukN07eO_GB0_0 2024-09-22T09:16:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9188445768095310235', time=2024-09-22T10:59:26.810388+0000, chain.objs.size()=1 2024-09-22T09:16:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rQfi06FxLZInDAmFYeUdMG74vPc-6_Y_0 2024-09-22T09:16:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13019415856638460273', time=2024-09-22T10:59:26.815126+0000, chain.objs.size()=1 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UEzN24fdrUPm0RlDbOHu2llsjEGku3e_0 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1740676938637580277', time=2024-09-22T10:59:27.273304+0000, chain.objs.size()=1 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.101+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tlfV4814bYSwm9iauLTk0_1fFMOk2e5_0 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6351496496467211265', time=2024-09-22T10:59:27.595287+0000, chain.objs.size()=1 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lOjw84WFWZpfSweYZJW3ApdmCou88-U_0 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7641491731459068144', time=2024-09-22T10:59:28.157299+0000, chain.objs.size()=1 2024-09-22T09:16:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uW3aY89ZL_bcpoywlysPaQlHtKjnuEX_0 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7414705163003667141', time=2024-09-22T10:59:28.790685+0000, chain.objs.size()=1 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.aZq5wc0w8_6DjNu0nC6W2cQ0oFj23wu_0 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6793246846660874356', time=2024-09-22T10:59:28.969754+0000, chain.objs.size()=1 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.74fs1_O4vzhcGltxijk5kDBh7DWqRxW_0 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9660244444996820342', time=2024-09-22T10:59:29.003239+0000, chain.objs.size()=1 2024-09-22T09:16:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.102+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Lgel8lrjCUe8KpH6m1unWWHwh0BpWTS_0 2024-09-22T09:16:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.107+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/53653 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2556917040062642353', time=2024-09-22T10:59:29.092140+0000, chain.objs.size()=1 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qw_bGqfGBA8bcrF0dX0p24IzzRYeO38_0 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12622792836151843724', time=2024-09-22T10:59:29.719001+0000, chain.objs.size()=1 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rpKzylNWuIyeYq0aZuC7dzbCxB6KbO8_0 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3126310013231926873', time=2024-09-22T10:59:30.169725+0000, chain.objs.size()=1 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.slwzd9l30confzu_GjmM9Kr8NQQH0L3_0 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9779533185982228588', time=2024-09-22T10:59:31.062942+0000, chain.objs.size()=1 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EIKoSkfpsre_Yc1Aqx3gk1NPz0SEtHP_0 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3985874514653619411', time=2024-09-22T10:59:31.836451+0000, chain.objs.size()=1 2024-09-22T09:16:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DLEk0omluv7MtNn_UFMJkaRqXzA96gb_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1136097870628887267', time=2024-09-22T10:59:32.154802+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.O3nVtWCziXnANgn8T-U_OwZnF_gsiAh_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17918863280739773889', time=2024-09-22T10:59:32.156360+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jOTYIwjoX6L6VhlkBL-pnH1ViGqc-9d_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14269326769449876620', time=2024-09-22T10:59:32.475071+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.00Fgb9XcxEr7HlH3Phh0UZZt4fy1zCQ_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7606699009310172447', time=2024-09-22T10:59:32.765953+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.despZxKkmNiuUqoqEy-9nvet-JifC0U_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17038383587352392588', time=2024-09-22T10:59:32.798400+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XIaVm91diAPsvKTUld5mm_BCl1qOcnQ_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12790195987632120511', time=2024-09-22T11:00:48.858406+0000, chain.objs.size()=1 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.463__shadow_.n2YsaP7HHAlw3Xxdx1vS9Ufj_ovVUQV_0 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8915552148013630071', time=2024-09-22T11:01:04.056837+0000, chain.objs.size()=3 2024-09-22T09:16:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.109+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_0 2024-09-22T09:16:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.113+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_1 2024-09-22T09:16:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.113+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_2 2024-09-22T09:16:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.113+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.319965878671646923', time=2024-09-22T11:01:04.061225+0000, chain.objs.size()=3 2024-09-22T09:16:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.113+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_0 2024-09-22T09:16:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.113+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_1 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.487__shadow_.-L_ZnAt47m2CR6zry0FCnBxF7yvKZRH_2 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13393969551843347786', time=2024-09-22T11:01:09.589155+0000, chain.objs.size()=1 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.497__shadow_.7YW_rHmFRdDR-uIs74ihEsTK8jcbyUP_0 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.873439570569397140', time=2024-09-22T11:01:14.572421+0000, chain.objs.size()=1 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7343321485578916766', time=2024-09-22T11:02:48.398142+0000, chain.objs.size()=6 2024-09-22T09:16:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.X3r8tiidjEUVtLsieCUEjdDIzHw-6zrW.1 2024-09-22T09:16:03.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.C_DyVEH4RcOfwOxPP3FPTryefaxKUzi9.2 2024-09-22T09:16:03.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart._DQrHKWnbksWFoy2QIEvCwjfSBwG1MdJ.3 2024-09-22T09:16:03.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.114+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.k7ZPY5RdHdrzLnLXSiRoishizvSZ5ND6.4 2024-09-22T09:16:03.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.117+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.oeBW4eyv0z0f0MqxpbBv68NLAGHZfAQe.5 2024-09-22T09:16:03.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.118+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.GYDRtJcABb-c031uD2edy9oymf99xYxo.6 2024-09-22T09:16:03.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.118+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17394952150947334863', time=2024-09-22T11:03:04.997706+0000, chain.objs.size()=3 2024-09-22T09:16:03.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.118+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~2EKYe2ZO0fj294LRdNhW89kpOO6QyiS.1 2024-09-22T09:16:03.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~2EKYe2ZO0fj294LRdNhW89kpOO6QyiS.2 2024-09-22T09:16:03.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~2EKYe2ZO0fj294LRdNhW89kpOO6QyiS.3 2024-09-22T09:16:03.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9909240276305969220', time=2024-09-22T11:05:04.615765+0000, chain.objs.size()=1 2024-09-22T09:16:03.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:9S52XNajhZ31gXm7pkNfF.VoWsPP2Ja_.D8as8HQ6L48f-5BGtaXupZKZQwdHsMl_0 2024-09-22T09:16:03.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3661140731853431203', time=2024-09-22T11:05:29.513170+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:HwWkZTv.iZTgKnaZO5AMVP30rTrxzLL_.KNhYeD5afOjPc9MNlk6qBqHpEkkPjwz_0 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.506864668483066859', time=2024-09-22T11:05:31.703985+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:.PA7uEl9I7Dcp42sG9DGp6-08knnBD2_.II5O5xYROMCCfwCLzPxMP5i3zVCc5mi_0 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10564323757456319338', time=2024-09-22T11:05:37.565948+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:8gyZYqJpveVUm.ttmCAjMj8vzxErTRD_.uTEa9d7RaCwWsWtU4L8gN-gex4VOjAS_0 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9511519698402780295', time=2024-09-22T11:05:46.359715+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.606__shadow_.V8KW-YNWQcEQeFnGm2Qb1nK0alGhKUe_0 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1785273086255060916', time=2024-09-22T11:09:51.767874+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.655__shadow_.EABzPhxgBEZe0_s2c8Whmc90aSFW9MG_0 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15737202840697842256', time=2024-09-22T11:10:14.265854+0000, chain.objs.size()=1 2024-09-22T09:16:03.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.120+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.664__shadow_.GrOmLFBsFsq95hJ0xplVX6hvThKz0r6_0 2024-09-22T09:16:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5616454291272744478', time=2024-09-22T11:10:18.995727+0000, chain.objs.size()=1 2024-09-22T09:16:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.671__shadow_.Z0FSALjEpesikpZ7Z3Ddai01SWmwQgz_0 2024-09-22T09:16:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17437394815175418996', time=2024-09-22T11:10:33.187188+0000, chain.objs.size()=1 2024-09-22T09:16:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.699__shadow:UMZ8OCslnKPvff7vbusHAUq4ESSM6sn_.fEcQyTuRz60L6FIuAXaKUkMlRo5R7Aq_0 2024-09-22T09:16:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18091268716695532834', time=2024-09-22T11:10:33.806975+0000, chain.objs.size()=1 2024-09-22T09:16:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.124+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.700__shadow:bPTLoulkN4I8IM5rCwgCT2oQ7bKtcHd_.XnqLmn_odpkHUn1G1u9LNVAecSbtMxB_0 2024-09-22T09:16:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.126+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2619950696703010845', time=2024-09-22T11:11:21.762908+0000, chain.objs.size()=1 2024-09-22T09:16:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.126+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.740__shadow_._8qTWjrWzwamJ7dZpJaNODvsp-9RtXA_0 2024-09-22T09:16:03.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.127+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12324584298191114903', time=2024-09-22T11:13:05.102802+0000, chain.objs.size()=1 2024-09-22T09:16:03.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.127+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.771__shadow_.j291MeZP3pMrQ4XOq8M5_wxWOV7I246_0 2024-09-22T09:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.130+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.132+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.135+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.135+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44612' 2024-09-22T09:16:03.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_qMSb2DTY-fTB5W18sco0N01O4_NEwAq', time=2024-09-22T10:54:19.012689+0000, chain.objs.size()=2 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.166__shadow_.tWyO4roJzgdbfuQiuWX6kodKiYEq7Sk_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.166__shadow_.tWyO4roJzgdbfuQiuWX6kodKiYEq7Sk_1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10600616871599312928', time=2024-09-22T10:54:21.921039+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.172__shadow_.OaP2O51qjB_0FwRJMGaQxYE0Q-zW1FS_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16446909969426491269', time=2024-09-22T10:56:16.916094+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.242__shadow_.nnm9laadKiCruio3IuW3kePoczHiOIT_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11661970102039260068', time=2024-09-22T10:56:18.448097+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.244__shadow_.mIMnMbbVDxGZC2UsFbA1UUOR2rz76ON_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7060716615043112132', time=2024-09-22T10:56:21.818513+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.136+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.249__shadow_.aM_tgm7BlhUCJXJjFH38Dd2p4JOo-7T_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2878848929629106176', time=2024-09-22T10:56:22.429101+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.250__shadow_.QoQLPVz0dwvhLSm_u9F6R_VfB4JmKF3_0 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6575439185907548086', time=2024-09-22T10:56:26.764219+0000, chain.objs.size()=1 2024-09-22T09:16:03.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.257__shadow_.BlOghOp7-yF8kr4Q_mN66WxVcwCdD8r_0 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17738784802042453587', time=2024-09-22T10:56:27.884211+0000, chain.objs.size()=1 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.259__shadow_.o6V4WTmXms0Jp1JviFbYR3Yf28Fsg-h_0 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9882085002078592793', time=2024-09-22T10:56:29.708400+0000, chain.objs.size()=1 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.262__shadow_.pF4G7v8X7t4VFotkl5V7GBUK1lL6Yfq_0 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2668891559862230524', time=2024-09-22T10:57:05.966170+0000, chain.objs.size()=1 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MEEmNIL1jU3I0IkX4z-nUZ3WsbMb3GJ_0 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17522325217518595279', time=2024-09-22T10:57:05.987773+0000, chain.objs.size()=1 2024-09-22T09:16:03.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.137+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2Bd_-pXtDn7WEabbASCIyxVggohXS6c_0 2024-09-22T09:16:03.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.140+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13724053355277404242', time=2024-09-22T10:57:06.200065+0000, chain.objs.size()=1 2024-09-22T09:16:03.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.140+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bp4csZEoWhXrCdKs_6SrSiaO1kIhvaM_0 2024-09-22T09:16:03.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11403190864260765920', time=2024-09-22T10:57:06.240125+0000, chain.objs.size()=1 2024-09-22T09:16:03.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wEJOdjrzLr9d49rbPbXWmx-zH0UtE-Y_0 2024-09-22T09:16:03.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6661578491418301148', time=2024-09-22T10:57:06.644497+0000, chain.objs.size()=1 2024-09-22T09:16:03.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BmZdJdoUTQ7Z7WQCD1HKPzkmwnxtvIC_0 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3808012284341452252', time=2024-09-22T10:57:06.912502+0000, chain.objs.size()=1 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Og4G5E2Ly6YxBUnDV1WoARRPIf_FWR-_0 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11436188903100985057', time=2024-09-22T10:57:06.985667+0000, chain.objs.size()=1 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.141+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Id8h_yRBHb0-s8A1jEDVJPnk0oe4SJu_0 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7287832554233025169', time=2024-09-22T10:57:07.755178+0000, chain.objs.size()=1 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uNq94W-QwtBqP13Z4StU4hhaH2hmr-q_0 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7765864666882287292', time=2024-09-22T10:57:08.342997+0000, chain.objs.size()=1 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rp3FZPs_ExBdN7XtrxtLn-V7RBTG5Tf_0 2024-09-22T09:16:03.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11054133460528203344', time=2024-09-22T10:57:08.989797+0000, chain.objs.size()=1 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bden2MNhTuUfD4v4N8nNOjuAw2UIf4m_0 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14252032342705681096', time=2024-09-22T10:57:09.039961+0000, chain.objs.size()=1 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XZDhJ5_LcPJWEtbe6C2mrBFfmyVX3Ck_0 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2207776734222592165', time=2024-09-22T10:57:09.161142+0000, chain.objs.size()=1 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.142+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cPVVNYoD8OxhB3XuSr71mtJY1LhOPPL_0 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.143+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2418407766291605717', time=2024-09-22T10:57:09.161849+0000, chain.objs.size()=1 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.143+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.elm_aES7r1CAxdKyp6QZ5dx6zjmFUu2_0 2024-09-22T09:16:03.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.143+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1974250233447530059', time=2024-09-22T10:57:09.162586+0000, chain.objs.size()=1 2024-09-22T09:16:03.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.143+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lH9voIkJDzYChujWuyx1ckokxxzrnCb_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14136864947149876742', time=2024-09-22T10:57:09.299865+0000, chain.objs.size()=1 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LUEvZ3WUB9GGx0g6EE4igx6TpMQupYU_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.321750058555607860', time=2024-09-22T10:57:09.528362+0000, chain.objs.size()=1 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IKig_2uKUcnXbyKQ9LFklk7qpGvBhy-_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4110344242217239369', time=2024-09-22T10:57:09.718244+0000, chain.objs.size()=1 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8awvSeagdRNdf0MGP_oiX4NCuUmmyVP_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17662026830786214705', time=2024-09-22T10:57:09.912166+0000, chain.objs.size()=1 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.F9Xkzw_rgn03gze5FyUvqW6_YQUiM_r_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14607581966728134872', time=2024-09-22T10:57:10.605254+0000, chain.objs.size()=1 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8CrPH2Q7tB2_v703kQo4nZxF4QY2-Xm_0 2024-09-22T09:16:03.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17840194528005334749', time=2024-09-22T10:57:10.888772+0000, chain.objs.size()=1 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.146+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XI5-d_du5uSDTEp5-nn4vQOGmgTu7O6_0 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15835899023743135906', time=2024-09-22T10:57:11.255526+0000, chain.objs.size()=1 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kqpgqQ2rKTTNaUbe0CHQ-KDPAt2yAni_0 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7708264016735809133', time=2024-09-22T10:57:11.256151+0000, chain.objs.size()=1 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IF9RSXCBhUtDe1HwS2PZsq_6ThGx-Ac_0 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7712611255590597254', time=2024-09-22T10:57:11.313236+0000, chain.objs.size()=1 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.147+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.c0_3ZvD8pD_pe69XhBrgq85qxCNRrmc_0 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.148+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3232200928390352031', time=2024-09-22T10:57:11.458797+0000, chain.objs.size()=1 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.148+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.D9Pt2u5bnKSC9wTgiaH-i7eSdk6NGkv_0 2024-09-22T09:16:03.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.148+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9490908240311178846', time=2024-09-22T10:57:11.894694+0000, chain.objs.size()=1 2024-09-22T09:16:03.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.148+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ckwwm2hWTZtwlaQfVZ7s_dOROQ4gM0v_0 2024-09-22T09:16:03.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.150+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.708406398441701954', time=2024-09-22T10:57:12.142688+0000, chain.objs.size()=1 2024-09-22T09:16:03.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.150+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VNGwcKv0a9ZSkREkxv6r3OocoPpanNL_0 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14569268894331410957', time=2024-09-22T10:57:12.312589+0000, chain.objs.size()=1 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kwpTf-whm17jhgb39fOqzYqAU46Hx71_0 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1685044975171517068', time=2024-09-22T10:57:12.448801+0000, chain.objs.size()=1 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-5d4O_XqIixGoy2Y4vM8YMGOoVErOBW_0 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.669420048145421226', time=2024-09-22T10:57:12.587738+0000, chain.objs.size()=1 2024-09-22T09:16:03.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.c7qfL4xIqNomhYJ7ewln1DY2JrwSecD_0 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12833503128167593406', time=2024-09-22T10:57:14.772456+0000, chain.objs.size()=1 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MIfD2ADHYz1wUV4EchCSgT2shzA-AE__0 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4535795177789164915', time=2024-09-22T10:57:15.033741+0000, chain.objs.size()=1 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Mgwy8VAFNpaKexH7loygKOgA1CA58jF_0 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5930918819248567537', time=2024-09-22T10:57:15.403234+0000, chain.objs.size()=1 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qaEudxcMbgJuaY0O9YIvIbG3S7DU2EJ_0 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9605621907676238842', time=2024-09-22T10:57:15.713041+0000, chain.objs.size()=1 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dyTr6xYTbB0D87VhoXH0TotfgiCVKgC_0 2024-09-22T09:16:03.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7634820461171407616', time=2024-09-22T10:57:15.732930+0000, chain.objs.size()=1 2024-09-22T09:16:03.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hNfnUuS5MrMvRvDM8sV_oYGtZ7jtfo3_0 2024-09-22T09:16:03.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8918956674971992575', time=2024-09-22T10:57:16.496422+0000, chain.objs.size()=1 2024-09-22T09:16:03.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dQb1aW6lkqGmvkk_GwgsagmmpTLj0xO_0 2024-09-22T09:16:03.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5163920016296133452', time=2024-09-22T10:57:16.524580+0000, chain.objs.size()=1 2024-09-22T09:16:03.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.151+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.15FvL8aU5xJBfKmD_fgljYtZKb-In3r_0 2024-09-22T09:16:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.155+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7607920148935330420', time=2024-09-22T10:57:16.689642+0000, chain.objs.size()=1 2024-09-22T09:16:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QS7EwGJ7gXGagUSOBe0ZSdTV-Q3JTry_0 2024-09-22T09:16:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3410759180779390532', time=2024-09-22T10:57:16.723581+0000, chain.objs.size()=1 2024-09-22T09:16:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TYCI5xHWsusM8TnSfuPYpVHekA7_PVn_0 2024-09-22T09:16:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10963807763946591861', time=2024-09-22T10:57:24.511534+0000, chain.objs.size()=1 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.276__shadow_.xaTbRP8ssUCFKfRTnjoJTkT8c18qSOO_0 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18274542328172028616', time=2024-09-22T10:57:25.129514+0000, chain.objs.size()=1 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.277__shadow_.CeBRMjS9txYUiMAWkO44bFeZ1orVUFv_0 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.712188357194714632', time=2024-09-22T10:57:30.737195+0000, chain.objs.size()=1 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.156+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.286__shadow_.5uuvEu1c26PkZDezJOLXcO7PUsQu6_V_0 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.637158425865594361', time=2024-09-22T10:57:36.305494+0000, chain.objs.size()=1 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.JNwWVtrJgaG3y2wqtpZQ34fEc_W_5z__0 2024-09-22T09:16:03.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5603725577194439383', time=2024-09-22T10:57:38.231609+0000, chain.objs.size()=1 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.KLCJ_dyWaF4EMsq3sBoHh2fPHIvJ8Vp_0 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18189840475712080117', time=2024-09-22T10:57:39.145602+0000, chain.objs.size()=1 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.295__shadow_.d9i7kjaVzwljMd0HO2by7CkxoBbrjd4_0 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7978566793485818005', time=2024-09-22T10:57:42.357991+0000, chain.objs.size()=1 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.300__shadow_.iIj858JLnm0lN3m1aBVM-lC47IeINQu_0 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11993519215899997403', time=2024-09-22T10:57:46.861513+0000, chain.objs.size()=1 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.307__shadow_.uuzO1cEC6JFufIssAXGdxzi6B_0_1K7_0 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13012494810573094509', time=2024-09-22T10:58:34.597227+0000, chain.objs.size()=1 2024-09-22T09:16:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.157+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rrMfZY9pgA366ENLBaeGGCOdFwcQu4A_0 2024-09-22T09:16:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.160+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16747482918271143868', time=2024-09-22T10:58:34.613557+0000, chain.objs.size()=1 2024-09-22T09:16:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.160+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qPLsd_7omhdJ20WqRJYgr3KBzuTbhXK_0 2024-09-22T09:16:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11763506472546355999', time=2024-09-22T10:58:34.711003+0000, chain.objs.size()=1 2024-09-22T09:16:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CJQc38wAYoQsDVI8zeyo9Phd4ky6gqY_0 2024-09-22T09:16:03.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.973224383871896851', time=2024-09-22T10:58:34.711769+0000, chain.objs.size()=1 2024-09-22T09:16:03.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oQs56L2LhHS9r5wZ-uabVxDinG36tq__0 2024-09-22T09:16:03.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2077954458417037166', time=2024-09-22T10:58:35.065120+0000, chain.objs.size()=1 2024-09-22T09:16:03.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.161+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BcdUOG2lYfnZMEtzmkKV2_1utHSEsVn_0 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.421999719806197563', time=2024-09-22T10:58:36.122194+0000, chain.objs.size()=1 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.eo4iICKDE76BDM8r8jO5jMLZayE96yM_0 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7124008948850563545', time=2024-09-22T10:58:36.234202+0000, chain.objs.size()=1 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ohCgk4bvo_a0qScNFnSoacPkacOKGqW_0 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13713038511918228864', time=2024-09-22T10:58:36.784906+0000, chain.objs.size()=1 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O3GWdlVriIePvH5Z_jbEIs-7anRbEkS_0 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17282226652386782627', time=2024-09-22T10:58:36.801282+0000, chain.objs.size()=1 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BRSm7RKU8kADmTFR8vQulk-34l5CYAY_0 2024-09-22T09:16:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15397335151901839511', time=2024-09-22T10:58:36.868766+0000, chain.objs.size()=1 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.162+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZILo-GP4_r9gGyV9kW3sfVSGddho6_E_0 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12232969465677502108', time=2024-09-22T10:58:36.977156+0000, chain.objs.size()=1 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pMDxL3ZBF2Y-qXdOBG8Gs4EYkHJeID8_0 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12632247748066878590', time=2024-09-22T10:58:38.227688+0000, chain.objs.size()=1 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.i-zSEiJ9oXDa44eIFyY1lN0SVZTmvpC_0 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4095928943560560375', time=2024-09-22T10:58:38.228516+0000, chain.objs.size()=1 2024-09-22T09:16:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.163+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ynotPR_Mn483VcnXDlP8yrCFKO-1spA_0 2024-09-22T09:16:03.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.166+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8780097575524645886', time=2024-09-22T10:58:38.917547+0000, chain.objs.size()=1 2024-09-22T09:16:03.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.166+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z6jZTuRR0tO_wkHLiq3UQlkKyzGb14t_0 2024-09-22T09:16:03.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.166+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2026527745370793818', time=2024-09-22T10:58:39.018108+0000, chain.objs.size()=1 2024-09-22T09:16:03.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.166+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mFFXyP8eb_aYWQCjSZAopj11dIIwVJR_0 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8381040848609521767', time=2024-09-22T10:58:39.224009+0000, chain.objs.size()=1 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kDRmMiGVeXKgj6II8K8rY_RRS9cVEHh_0 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13814631746089819782', time=2024-09-22T10:58:39.432192+0000, chain.objs.size()=1 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CJMVTeL1FBeoRvr1bnI8m2GkxBBF7Uf_0 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15313480460453160847', time=2024-09-22T10:58:39.661862+0000, chain.objs.size()=1 2024-09-22T09:16:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.168+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cb2pzZizt0xOUoZFyDCcwzJT_fVzveh_0 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13995405654153886399', time=2024-09-22T10:58:39.775982+0000, chain.objs.size()=1 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fADHAlNP4_vRzNvOWEIBwpNNAQ-BRTP_0 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16394016769123301992', time=2024-09-22T10:58:39.812124+0000, chain.objs.size()=1 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YZd3pgyqKX7UuBRYqMnlgWiL_Z1EZQ-_0 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6625249146795164995', time=2024-09-22T10:58:39.902489+0000, chain.objs.size()=1 2024-09-22T09:16:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1dN0V-wtDqumbrgbGszpgqtA6r-sPUv_0 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.708785009214100825', time=2024-09-22T10:58:40.290313+0000, chain.objs.size()=1 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.iJQuA9MnFWVKJEJ0OuHZFHo2tt1EJcd_0 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2867306615061130873', time=2024-09-22T10:58:40.962405+0000, chain.objs.size()=1 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vI3ZNVs1L9csuYKr1NvZhWSh81kGwmN_0 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4096334187633560546', time=2024-09-22T10:58:41.063305+0000, chain.objs.size()=1 2024-09-22T09:16:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.169+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cvZ1aedOA0go37q0vMv5gMG2IMVCOrE_0 2024-09-22T09:16:03.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3545650751664563101', time=2024-09-22T10:58:41.649642+0000, chain.objs.size()=1 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.U52oz9RnElM6B8698DjbN1cp-f0DB_a_0 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8971021062507799255', time=2024-09-22T10:58:42.077493+0000, chain.objs.size()=1 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h8fuicVm_2700f7RJzjg192DzvOmHXL_0 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11941767854472754974', time=2024-09-22T10:58:43.102285+0000, chain.objs.size()=1 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.171+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9w8J2P3SHnKgB0jGMk0sS2Dh-LF725r_0 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.172+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3028619828921391944', time=2024-09-22T10:58:43.124320+0000, chain.objs.size()=1 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.172+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TjIOKv-obemzgRkhdmw1c0Q7WTmbGjz_0 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.172+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16430465342971605511', time=2024-09-22T10:58:43.430706+0000, chain.objs.size()=1 2024-09-22T09:16:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.172+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TbbJaUumIETjTwgy1jj5rniPKpmKd9G_0 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.911904071813063897', time=2024-09-22T10:58:43.638681+0000, chain.objs.size()=1 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pWVb22ypJv-lJjsPzX-XpKlWyg_rE6g_0 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6696574420797595582', time=2024-09-22T10:58:43.639407+0000, chain.objs.size()=1 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qp7fxObKOof3NXuFvpUBlOarPpku00B_0 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16335835331774277277', time=2024-09-22T10:58:43.799808+0000, chain.objs.size()=1 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qIUF87Hc4Accow7lpleCZuT7nwOr5ys_0 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18001999326194325662', time=2024-09-22T10:58:43.978771+0000, chain.objs.size()=1 2024-09-22T09:16:03.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.c1ndtcb2npw3W0ojpm_nGFol55ykOoi_0 2024-09-22T09:16:03.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15399113681712125411', time=2024-09-22T10:58:43.987159+0000, chain.objs.size()=1 2024-09-22T09:16:03.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zdXOrkUKMpFZznO2d_4cgLJfcgfpheY_0 2024-09-22T09:16:03.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3712051958890919625', time=2024-09-22T10:58:44.268489+0000, chain.objs.size()=1 2024-09-22T09:16:03.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.174+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.59OxwO2I9KzOfDTo9jpSuakYCu9fLZM_0 2024-09-22T09:16:03.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6343984595717175281', time=2024-09-22T10:58:44.411393+0000, chain.objs.size()=1 2024-09-22T09:16:03.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jsqIHfC8a_hYG1PagFJYNPu6u0rsNnh_0 2024-09-22T09:16:03.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5058411072748316110', time=2024-09-22T10:58:44.820563+0000, chain.objs.size()=1 2024-09-22T09:16:03.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.f4X9Ru_84bEjmZ_iC9r6i_UzdJSW6qP_0 2024-09-22T09:16:03.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6290643278641925335', time=2024-09-22T10:58:45.098266+0000, chain.objs.size()=1 2024-09-22T09:16:03.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8kLugk521tEl0lAQ2cAP19tYpILIGAV_0 2024-09-22T09:16:03.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8121446239268980349', time=2024-09-22T10:59:22.361500+0000, chain.objs.size()=1 2024-09-22T09:16:03.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IJMPw-NS3Q-JyW_vZOdKO9-oqQVNYHc_0 2024-09-22T09:16:03.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9570367625402429890', time=2024-09-22T10:59:23.575665+0000, chain.objs.size()=1 2024-09-22T09:16:03.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.176+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Yb4KNSHdDXjeExGoclx0FhTWWGom08u_0 2024-09-22T09:16:03.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.178+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14401237420726077265', time=2024-09-22T10:59:23.576409+0000, chain.objs.size()=1 2024-09-22T09:16:03.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.178+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gdWKEsuQVYmXvoXJuRsh6i4bPlVUPXi_0 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13875957351737302994', time=2024-09-22T10:59:23.827498+0000, chain.objs.size()=1 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JU83BUoYejizath5TrbNOUUGy7llbaU_0 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17773586341828226108', time=2024-09-22T10:59:23.975207+0000, chain.objs.size()=1 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.orY6TXwvgEjcN6nLHVW7ZyeQ3Xk7HP9_0 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9592148627273305534', time=2024-09-22T10:59:24.115505+0000, chain.objs.size()=1 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pMCrDxQpes6_Lhsl_5ralyQFExPtWbz_0 2024-09-22T09:16:03.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3391442562380993563', time=2024-09-22T10:59:26.025630+0000, chain.objs.size()=1 2024-09-22T09:16:03.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.180+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4sK2acmYmiOqcRaeHmbuN3EY8LjuPGW_0 2024-09-22T09:16:03.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.184+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44612 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1115206951860818763', time=2024-09-22T10:59:26.410839+0000, chain.objs.size()=1 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cEI5jnvEndjghUqCWfkA4y0t1x9EK8F_0 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11620953214902017537', time=2024-09-22T10:59:26.859996+0000, chain.objs.size()=1 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KXaxGd5ZCcc7xpsIYYatwh405bPBdFB_0 2024-09-22T09:16:03.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14772554637325550883', time=2024-09-22T10:59:27.283283+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3fhPo_4l9QxObPOh2emiPn3uGia2PUx_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9748849963650454841', time=2024-09-22T10:59:28.319196+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fNpzh6b-dK7Lj5NOdArKB1Bgz0nY0v5_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7241877642276338793', time=2024-09-22T10:59:28.319963+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7mFy8HPUaE_7fI7ZVuqUe7tKbKeXgN3_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15443757102257061133', time=2024-09-22T10:59:28.434764+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EWDJ8WomPbhSM_nKJVYyeN_dvXz7QWc_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4860942360869090595', time=2024-09-22T10:59:28.967033+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RQz8u06XX2gDO2-07OJtZiOZLOvObrq_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7020830659626998856', time=2024-09-22T10:59:29.663962+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3-FqraT_rpaiLlc4nng61Vk-eTWzCST_0 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3305369966824329299', time=2024-09-22T10:59:29.664681+0000, chain.objs.size()=1 2024-09-22T09:16:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pPkSRVEmwil8O4BRMmOP7AKpfogh8EK_0 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10354255200853472805', time=2024-09-22T10:59:30.180191+0000, chain.objs.size()=1 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NpA6Wg_y6nFwlFuj3fQC1Drhjbt4-oR_0 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12213644824217412731', time=2024-09-22T10:59:30.180972+0000, chain.objs.size()=1 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZjVrJfqBUSU3U67CeqjAjfZ-xMhUs54_0 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12430651289059181984', time=2024-09-22T10:59:30.273548+0000, chain.objs.size()=1 2024-09-22T09:16:03.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.186+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.b6djCz1xMog3RK94fPoSclqeGM_NHIF_0 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1565037717041975499', time=2024-09-22T10:59:30.315201+0000, chain.objs.size()=1 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._e4jKIuJ0kNLrk1ZmEufGT-EwlEZRI1_0 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13177536819665136984', time=2024-09-22T10:59:30.377499+0000, chain.objs.size()=1 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oV2SDDwL8e7HDNsiAGyCyn3jrfiN8YD_0 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2556384861532849452', time=2024-09-22T10:59:31.195369+0000, chain.objs.size()=1 2024-09-22T09:16:03.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.190+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lpG5mF0QDtbpo8SO0x_TfcKMouwpaqq_0 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7173253951761456155', time=2024-09-22T10:59:31.271248+0000, chain.objs.size()=1 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DTTDmJp_ERtcFDBtVZMcvMvQHHLxMZa_0 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6275271036603318693', time=2024-09-22T10:59:31.272633+0000, chain.objs.size()=1 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UBeAURj5_do_uJdAhOBnsSH-RRM3KTe_0 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13539908872237153858', time=2024-09-22T10:59:31.353116+0000, chain.objs.size()=1 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DNQW9N4_yIf3XkeWo4TkACjOZQJAseb_0 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10592762551902012482', time=2024-09-22T10:59:31.560053+0000, chain.objs.size()=1 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Sq0pAB7gYYr57n5AdnuMtmD0JOf6hVw_0 2024-09-22T09:16:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7911646663540390231', time=2024-09-22T10:59:31.603068+0000, chain.objs.size()=1 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AUY-rruYGcNfAaiD9Uw0lJChLiZ6LIZ_0 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2318992546407085924', time=2024-09-22T10:59:31.882743+0000, chain.objs.size()=1 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.191+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yqcvDlqgdYRXmKPIhgkPQoCu5lU1Dg8_0 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.192+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10446997237027428447', time=2024-09-22T10:59:32.444250+0000, chain.objs.size()=1 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.192+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.LsRa3sM5EKsOHW3f2IRt2CmhrpVFphS_0 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.192+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7364130468614701508', time=2024-09-22T10:59:32.587654+0000, chain.objs.size()=1 2024-09-22T09:16:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.192+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3KY4DcjzRp5a6Tir45ZMzuH3RLIF0Ac_0 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6787077427901609463', time=2024-09-22T10:59:32.881300+0000, chain.objs.size()=1 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Xm2Vq9BIg3fwxXOVa9LN2dNr2UKxQiv_0 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12656674322318487037', time=2024-09-22T11:00:02.295518+0000, chain.objs.size()=1 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.382__shadow_.U-NI0CQaf-vtuzduhwix5ztdF04JNF7_0 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15052035856782258595', time=2024-09-22T11:00:11.035262+0000, chain.objs.size()=1 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.395__shadow:kN0jemM1FyuMxs3Sesm1E93QFeRKvT._.wrZtUS3FiJrXRW42XqjJXGUpKrqmVbq_0 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4693632170388440078', time=2024-09-22T11:00:51.486664+0000, chain.objs.size()=1 2024-09-22T09:16:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.195+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.466__shadow_.NapC9sqvv7YtIXI6CBZ3H82Ms_J93O2_0 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13437696097069824740', time=2024-09-22T11:01:23.436326+0000, chain.objs.size()=6 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.197+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.198+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.198+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7519814130297095521', time=2024-09-22T11:02:11.005082+0000, chain.objs.size()=6 2024-09-22T09:16:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.198+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.kpSvk5_fXuq4jmk9f8ysSMvV52OeBrv_.1 2024-09-22T09:16:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.198+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.2 2024-09-22T09:16:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.3 2024-09-22T09:16:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.199+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.4 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.5 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.6 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v', time=2024-09-22T11:03:08.372530+0000, chain.objs.size()=10 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.1 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.2 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.3 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.4 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.5 2024-09-22T09:16:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.202+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.6 2024-09-22T09:16:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.204+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.7 2024-09-22T09:16:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.205+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.8 2024-09-22T09:16:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.205+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.9 2024-09-22T09:16:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.527__multipart_mymultipart.2~FkLlIwUK0P-utQQc4sTSy5O5fWhNn7v.10 2024-09-22T09:16:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17705454435359615441', time=2024-09-22T11:04:14.696897+0000, chain.objs.size()=1 2024-09-22T09:16:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.559__shadow_.AmsKjSC-err5OQ-Lqm-HztexI8yxwu7_0 2024-09-22T09:16:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12814488173452863865', time=2024-09-22T11:04:26.985708+0000, chain.objs.size()=1 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.567__shadow_.uaF2HG1fpc5k7qMdK0ASPsARtUk7U3U_0 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8162037287803861633', time=2024-09-22T11:04:32.653155+0000, chain.objs.size()=1 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:lZD6yaVgfmJ9OeoDPwNTslJMlmIjHPG_.egN8hcQsjy4K5y-rT9dgJRU3OZ6y8so_0 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16265284948950354910', time=2024-09-22T11:04:37.442425+0000, chain.objs.size()=1 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:nYDesrSIC642qYFNHJCCb6DemBkMTmp_.IaVABfoHC-1USSvo0u1W-7_epitHPMB_0 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1399117191284548936', time=2024-09-22T11:04:59.760216+0000, chain.objs.size()=1 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:h3thiio9iTqIRmubvp9Ut8yfxjOTiaw_.C66-854IYSIPA1RA98qfvpVKqKyXho7_0 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2146616565567540327', time=2024-09-22T11:05:26.704070+0000, chain.objs.size()=4 2024-09-22T09:16:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~vhE8iWPB3GxSxAMZO_9u4gVEK0CjHRd.1 2024-09-22T09:16:03.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.207+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~vhE8iWPB3GxSxAMZO_9u4gVEK0CjHRd.2 2024-09-22T09:16:03.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.210+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~vhE8iWPB3GxSxAMZO_9u4gVEK0CjHRd.3 2024-09-22T09:16:03.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.210+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~vhE8iWPB3GxSxAMZO_9u4gVEK0CjHRd.4 2024-09-22T09:16:03.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.210+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16414704588036028021', time=2024-09-22T11:05:27.271942+0000, chain.objs.size()=4 2024-09-22T09:16:03.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.210+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~7XSxwCgt_gO_iup0OfcT-_k4MWHWV9W.1 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~7XSxwCgt_gO_iup0OfcT-_k4MWHWV9W.2 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~7XSxwCgt_gO_iup0OfcT-_k4MWHWV9W.3 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~7XSxwCgt_gO_iup0OfcT-_k4MWHWV9W.4 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14955733915549647734', time=2024-09-22T11:09:34.059267+0000, chain.objs.size()=1 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.639__shadow_.2-sntZLjlZata2x5yHozaDMLswJQn8s_0 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7029529020017394122', time=2024-09-22T11:10:36.984489+0000, chain.objs.size()=1 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.705__shadow:H9e8xgVFHR3IlPRviDHaHzfZb3HDZ-X_.N3kn-Ee5sx3a8HXvdAo9qA9az7Ip1Cz_0 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7708012776362794951', time=2024-09-22T11:13:27.558492+0000, chain.objs.size()=1 2024-09-22T09:16:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.213+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.779__shadow_.nR61H4oeF5h2BwQE6ZBdssBP_9uwy26_0 2024-09-22T09:16:03.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.216+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.219+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:03.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.220+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.221+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44932' 2024-09-22T09:16:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7057674457311205654', time=2024-09-22T10:54:04.252221+0000, chain.objs.size()=2 2024-09-22T09:16:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.8n4yr_oZkph61gUAdWEeYt0INNFdPgr_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.8n4yr_oZkph61gUAdWEeYt0INNFdPgr_1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1619729270732132319', time=2024-09-22T10:56:17.551373+0000, chain.objs.size()=1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.243__shadow_.PNBTAAl_J7Lh4eCidvP4lvMTuI-rU0E_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11203915857537897668', time=2024-09-22T10:56:21.205331+0000, chain.objs.size()=1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.248__shadow_.IMu8Fnqve5AfoWKRFMHg1tt9u-iSub-_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16799021488173482627', time=2024-09-22T10:56:25.562683+0000, chain.objs.size()=1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.255__shadow_.fg8hT3exT0BNANZcSUD5iYRHRTqhByX_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11118348049142748290', time=2024-09-22T10:56:26.758542+0000, chain.objs.size()=1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.257__shadow_._KDtHjTKein7QJDOCiJfN93fIxZEvxO_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7023249902639972277', time=2024-09-22T10:57:05.924458+0000, chain.objs.size()=1 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EgPwgolQbaVl-EOQHdFyehkwtdyN5W7_0 2024-09-22T09:16:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14779684098309897103', time=2024-09-22T10:57:06.849126+0000, chain.objs.size()=1 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Eg3fJ1B-2tLqnBTfg7D9BjWiINUgA7o_0 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14083490253622603076', time=2024-09-22T10:57:07.554813+0000, chain.objs.size()=1 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0hsWpCwIqvuldd1SlyBguiAm7dYVCZU_0 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9607933653259019636', time=2024-09-22T10:57:09.037057+0000, chain.objs.size()=1 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.p5CdloLYvREzbu6ocwlrGMIm4okSpF4_0 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10273753103359701746', time=2024-09-22T10:57:09.275528+0000, chain.objs.size()=1 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CgRGGsULMvIE7x5baUscXB3nJJ30ZvU_0 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17824921719532702913', time=2024-09-22T10:57:09.665212+0000, chain.objs.size()=1 2024-09-22T09:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.222+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JonpgTgNK_EAZBy0_stjA39xN9Ph_Qg_0 2024-09-22T09:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.226+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18043465292183815000', time=2024-09-22T10:57:10.397404+0000, chain.objs.size()=1 2024-09-22T09:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.226+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AIG3TI9eKWRxSrW8ybOF-X8696bFLKc_0 2024-09-22T09:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.226+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9719766450913712525', time=2024-09-22T10:57:10.448490+0000, chain.objs.size()=1 2024-09-22T09:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.226+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hxtjbgLL90vw4llgTdDLX53BNUHbrWT_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7855751468058766482', time=2024-09-22T10:57:11.129058+0000, chain.objs.size()=1 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.B9rFeISoHlC_nXhw_Sr9k31qdT_uLGF_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14521200820453850409', time=2024-09-22T10:57:11.190187+0000, chain.objs.size()=1 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jT4R4Nu3i30dpbC_yJ31VoUKbTKVF24_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12610665750767981550', time=2024-09-22T10:57:11.273744+0000, chain.objs.size()=1 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jLVVhvcEKfTER4iUa3kUt2QKc52gYq-_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16065831794179907590', time=2024-09-22T10:57:12.009048+0000, chain.objs.size()=1 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5dXjOWBzwmYS1EwCCu_Cp0PV3GWvtpu_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13678169529880729878', time=2024-09-22T10:57:12.268118+0000, chain.objs.size()=1 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.l7_lnIZYnnJF71jcabGKKOkKItCXqiE_0 2024-09-22T09:16:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14093128104658727653', time=2024-09-22T10:57:12.703118+0000, chain.objs.size()=1 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zbHdqmMie0HBMzK-UhFvx_N3O7cX_sD_0 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7802305653611490362', time=2024-09-22T10:57:12.773002+0000, chain.objs.size()=1 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RHa6ldTAeVHyTS4ZVyKaEQNdND_sO6B_0 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13587990391615050639', time=2024-09-22T10:57:13.241125+0000, chain.objs.size()=1 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YPs-jwO3rD0r7zzJhNsJuRso3VvrO42_0 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4413086645412157435', time=2024-09-22T10:57:13.256962+0000, chain.objs.size()=1 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.227+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5wRAmjuxVjMYbqfsIe589EXJrTCrTN-_0 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.229+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16634949401956105732', time=2024-09-22T10:57:14.056613+0000, chain.objs.size()=1 2024-09-22T09:16:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.229+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TFHxgVaUn8ABtzqdOqXg56SihOfkGCQ_0 2024-09-22T09:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.232+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4813789304722096970', time=2024-09-22T10:57:14.099329+0000, chain.objs.size()=1 2024-09-22T09:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.232+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.siQdzl3afkYT4p7OFQAOxyMNtk5xRdo_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18291717630918595777', time=2024-09-22T10:57:14.136924+0000, chain.objs.size()=1 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.l_4utnO5aEuxjEzMDFoeMtEh67VSnH3_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15028673912322793481', time=2024-09-22T10:57:14.397921+0000, chain.objs.size()=1 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZqkYLxAZoR-8fwq4xfHdoy9pSNwCqlZ_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3613398734444670981', time=2024-09-22T10:57:15.330353+0000, chain.objs.size()=1 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.w75i_oJKGC1fwalXUsoGRzKdkpVP1MC_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13483389527223836577', time=2024-09-22T10:57:15.763239+0000, chain.objs.size()=1 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.y_2zMndPWddMHitiFeryw1S0De3S36X_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17514064242840480235', time=2024-09-22T10:57:16.189849+0000, chain.objs.size()=1 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9pJB1Voc7CxKnvH57mmhGjti28uWizD_0 2024-09-22T09:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6600389984347271522', time=2024-09-22T10:57:16.292996+0000, chain.objs.size()=1 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GDN1lIBHJbiqULjsQFN9qj-2K9i4iYF_0 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1213742175452159157', time=2024-09-22T10:57:28.808099+0000, chain.objs.size()=1 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.283__shadow_.G-5WkOfsSYDhVSQFX1hp86AevlYERH1_0 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6788322735496865498', time=2024-09-22T10:57:31.424356+0000, chain.objs.size()=1 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.287__shadow_.CuzL4IQwii9jS02dcUGN9vdRIROAoTU_0 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526182386401678958', time=2024-09-22T10:57:39.148732+0000, chain.objs.size()=1 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.295__shadow_.RZs9sXQRGb56HDG3I_1R402iZGQGUj6_0 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17789427670980816964', time=2024-09-22T10:57:39.792737+0000, chain.objs.size()=1 2024-09-22T09:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.233+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.296__shadow_.stLnZadhghK0wItysNI0izNPu12nBE1_0 2024-09-22T09:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.237+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17773419790283093240', time=2024-09-22T10:58:34.752207+0000, chain.objs.size()=1 2024-09-22T09:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.237+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CsJAHuPEN-4xoRRh0fnu50qzVt3E9_P_0 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3884073065280590166', time=2024-09-22T10:58:35.282651+0000, chain.objs.size()=1 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lRySrncZVMu41iIiYX4gsdeQm7PCpVf_0 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13588838969976602648', time=2024-09-22T10:58:35.283371+0000, chain.objs.size()=1 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qswqXmlzGLcwpCSqWe4jjDzpA5kzK-I_0 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9218466426407303992', time=2024-09-22T10:58:35.334875+0000, chain.objs.size()=1 2024-09-22T09:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.238+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Sjv4QkM_vvUxsedW2C6UeIdq25vQlWm_0 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2743402994386960763', time=2024-09-22T10:58:35.948538+0000, chain.objs.size()=1 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8ctuMMag62e_CX2ipVzO8XOaTctlCib_0 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13911311823497229402', time=2024-09-22T10:58:36.648361+0000, chain.objs.size()=1 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.B9knko8QwsK_Ps0NsnGF8okVXeoNP1__0 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8251990977176950414', time=2024-09-22T10:58:36.732774+0000, chain.objs.size()=1 2024-09-22T09:16:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HgFwLjitEQmmC6hTO6tI_JlIyOL5oLt_0 2024-09-22T09:16:03.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12025499904318063261', time=2024-09-22T10:58:37.452916+0000, chain.objs.size()=1 2024-09-22T09:16:03.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.239+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.q_0UqUspzx9UTP-KkmQ2RQHVdRAhPD1_0 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17592105547482530035', time=2024-09-22T10:58:37.737214+0000, chain.objs.size()=1 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wiGpXqWyTg8L5f8Gm2e0Zubxjp-4ZMs_0 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16688130947145119319', time=2024-09-22T10:58:38.012431+0000, chain.objs.size()=1 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qxq87vNgbAVKM-99fpW8nafHp6Cl_hv_0 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16562936066660983074', time=2024-09-22T10:58:38.129371+0000, chain.objs.size()=1 2024-09-22T09:16:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.242+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WeRxkzJYOV9kvjOPQgZjOL5vE3s26Oo_0 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14215645498757915868', time=2024-09-22T10:58:39.181091+0000, chain.objs.size()=1 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TQJZ9zY_j4aWS79pf4lhbeKtMtZ0UA1_0 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10247327047271182329', time=2024-09-22T10:58:40.440559+0000, chain.objs.size()=1 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8Q1nZywyxF6aLbPu5cizSE8G1qVfKKl_0 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14919395291577037362', time=2024-09-22T10:58:40.441749+0000, chain.objs.size()=1 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wKSOEzshHqefArSJ4-IJtWxCSEFEYfN_0 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1062841547038997814', time=2024-09-22T10:58:40.497007+0000, chain.objs.size()=1 2024-09-22T09:16:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.243+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8oKo_2tK90ZCZgqlOQOtVeW84JvnflE_0 2024-09-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14463761222103861791', time=2024-09-22T10:58:40.640037+0000, chain.objs.size()=1 2024-09-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oCECnc_xIlc31bXIrzR1t9yWl42QVEx_0 2024-09-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10614057795612904079', time=2024-09-22T10:58:40.763492+0000, chain.objs.size()=1 2024-09-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7pY_MLNIaBJjsXfp7TAe3tfSLJRQ-FY_0 2024-09-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17866053238096626131', time=2024-09-22T10:58:40.797226+0000, chain.objs.size()=1 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MtZwQvQMfIr9STR-VeEt560LBuaLB4S_0 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8599116551779389685', time=2024-09-22T10:58:40.876659+0000, chain.objs.size()=1 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TbfxgE9dvSRBGSLgfvLptn_O8wJg3kV_0 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7668108182790250088', time=2024-09-22T10:58:40.883912+0000, chain.objs.size()=1 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.p0TRbVeYPvxLJUmyRDS3jhYoK2s1_F5_0 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15242284504633009014', time=2024-09-22T10:58:40.939134+0000, chain.objs.size()=1 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cdSXZhh6wL0bUdj2xeDh14A72wFcQD0_0 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16005376961311191755', time=2024-09-22T10:58:41.867633+0000, chain.objs.size()=1 2024-09-22T09:16:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.245+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AEi6CJTRoV9LR7FgPcWZ5UWznxzrv3g_0 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.246+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2521514657567592709', time=2024-09-22T10:58:41.921763+0000, chain.objs.size()=1 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.246+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I8tNnjT0pHAdQd1vHn9YsVDEWdS73Ue_0 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.247+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8984918708327749440', time=2024-09-22T10:58:42.160200+0000, chain.objs.size()=1 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.247+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KRG8d0teIcrcP5-5KcCE5XpXtiTX6kk_0 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.247+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8410826606879431413', time=2024-09-22T10:58:43.013853+0000, chain.objs.size()=1 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.247+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.O3BXmBxlR4hKHEQWFPyltoz31StTp8i_0 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.248+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8212650126095873452', time=2024-09-22T10:58:43.223181+0000, chain.objs.size()=1 2024-09-22T09:16:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.248+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.M-SJ1sgiTtZ9l1KRXPcPvEdKVFzy7TG_0 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10980033495680303329', time=2024-09-22T10:58:43.927353+0000, chain.objs.size()=1 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KiI-bvQYamDvUOsisGHvD_ajLZUuXQK_0 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2494619855817677911', time=2024-09-22T10:58:44.313979+0000, chain.objs.size()=1 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vcqnS_xWqdtbmm4kg6I3Tko0e1xf1L5_0 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11084621898126388632', time=2024-09-22T10:58:44.411010+0000, chain.objs.size()=1 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xLy0mTrh3gbMDj6OfUuUN01S8p8ezVc_0 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16118908824816891379', time=2024-09-22T10:58:44.661611+0000, chain.objs.size()=1 2024-09-22T09:16:03.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.249+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._IdpG5-NzKHqh3ICxeh3l_DQeBU-KL0_0 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14447905592745754408', time=2024-09-22T10:59:22.624024+0000, chain.objs.size()=1 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5ChGFR8N3ZjsyTh_ZSBusI9yCXDjTi6_0 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1250255535094128780', time=2024-09-22T10:59:22.685445+0000, chain.objs.size()=1 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yNswAcjTyexW2Nz3hZD0gN_nGD6KYQr_0 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15826728170303054774', time=2024-09-22T10:59:22.686081+0000, chain.objs.size()=1 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-QcZulQZEH-kldwYg-_9arxsyQ03rmZ_0 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16752899556516564629', time=2024-09-22T10:59:23.048888+0000, chain.objs.size()=1 2024-09-22T09:16:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.252+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eTgf9M9NOY3YAwNud6DfGxAGurYxxlA_0 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9107348314755919468', time=2024-09-22T10:59:23.999264+0000, chain.objs.size()=1 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.C7RdTx0GlW8nNqNWbzDJM6AThCn-w5u_0 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16670807720272348612', time=2024-09-22T10:59:24.113723+0000, chain.objs.size()=1 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DBU5SJrjaW2yoB2bADHdyrWXpEbkoNP_0 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14612783350265649178', time=2024-09-22T10:59:24.169969+0000, chain.objs.size()=1 2024-09-22T09:16:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.253+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bodLansPzo6PaSJbFIIzH6_Og9gxRnc_0 2024-09-22T09:16:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16355032583507477888', time=2024-09-22T10:59:25.020963+0000, chain.objs.size()=1 2024-09-22T09:16:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KXZsJe7RFcLW0xQOuznU1zmYV08hqAy_0 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15056766901213024588', time=2024-09-22T10:59:25.184656+0000, chain.objs.size()=1 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.keE-xEUyZHidx0Im-LV4koeo7ag_CAN_0 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1728998674405927356', time=2024-09-22T10:59:25.753943+0000, chain.objs.size()=1 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7wQL3ItVyChqNtRFvBQTKENVHdcwOF-_0 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17527288733168416234', time=2024-09-22T10:59:25.905840+0000, chain.objs.size()=1 2024-09-22T09:16:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.255+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ENEbn1aCDANlvVtaWw5AZaQzbTV9LYU_0 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16722895734608139198', time=2024-09-22T10:59:26.465507+0000, chain.objs.size()=1 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.LeKT6prmjsHLYuExit_GIwejl6y2DPL_0 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2690873028752910071', time=2024-09-22T10:59:26.592276+0000, chain.objs.size()=1 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JwOhWcxFA80EnNHIfMQor6BHTHas2HL_0 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18176966624963142664', time=2024-09-22T10:59:26.748425+0000, chain.objs.size()=1 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HusmdYKIj4DPDpAFWpUOoCUXCp3NkNO_0 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4224963632164912212', time=2024-09-22T10:59:27.471925+0000, chain.objs.size()=1 2024-09-22T09:16:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Wi7oXr4Fdk5uJkZ1im5eYQtp-9sjVkI_0 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13681735656248197438', time=2024-09-22T10:59:27.472961+0000, chain.objs.size()=1 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Oa6gft122XsKY82OdpQ0bayFjWAxJYp_0 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9560471664139341984', time=2024-09-22T10:59:27.631033+0000, chain.objs.size()=1 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Fum-Woi5dTm0zr-EngiNvBPYNM9iM3L_0 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8541145580212278041', time=2024-09-22T10:59:28.144961+0000, chain.objs.size()=1 2024-09-22T09:16:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.257+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JqDx8PEJjaL-RR2ItILY-oUX-qPPeoz_0 2024-09-22T09:16:03.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.259+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4757700853527207298', time=2024-09-22T10:59:28.173417+0000, chain.objs.size()=1 2024-09-22T09:16:03.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.259+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-D4xecm8j5DqKslz-pw_9Poi_ZQ81iq_0 2024-09-22T09:16:03.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13524059919457954852', time=2024-09-22T10:59:28.299444+0000, chain.objs.size()=1 2024-09-22T09:16:03.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1470KUfQi72XlLnk4VF_GCL9J4v4PSY_0 2024-09-22T09:16:03.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.260+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1951523459492083273', time=2024-09-22T10:59:29.092120+0000, chain.objs.size()=1 2024-09-22T09:16:03.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.260+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xPNjFqX1WBOYM4OxuJPV4pSSDSJS4ng_0 2024-09-22T09:16:03.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.261+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6659005463750387944', time=2024-09-22T10:59:29.115667+0000, chain.objs.size()=1 2024-09-22T09:16:03.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.261+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Hdopk4-h02Ahm8azIGCe9YKwAnO4cL5_0 2024-09-22T09:16:03.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.261+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10537195238937086838', time=2024-09-22T10:59:29.486561+0000, chain.objs.size()=1 2024-09-22T09:16:03.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.261+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gdjwrEXtMKeu4WhdoezT4LQA9GviR7G_0 2024-09-22T09:16:03.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4959217653153083516', time=2024-09-22T10:59:29.524436+0000, chain.objs.size()=1 2024-09-22T09:16:03.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.IfVcM8jdYsXEHjwa1srvHkzAZ2xwOhj_0 2024-09-22T09:16:03.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6166340338848488075', time=2024-09-22T10:59:29.589155+0000, chain.objs.size()=1 2024-09-22T09:16:03.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.96ca87snmHCgm6K7Y4coPfGkkbp1plY_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16254061709999703153', time=2024-09-22T10:59:29.771199+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PBxz-BlkuK-oce7sj8gD9ct2uIzNEMh_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8402150099453662681', time=2024-09-22T10:59:30.046668+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.WpHaR2GEOr6X6ZzB3zUBCn3NDX15f-s_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14188437658014434101', time=2024-09-22T10:59:30.848917+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eOo4mY1Nc2j9oTaxXMjjKViyKoLdX68_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9035217448908504573', time=2024-09-22T10:59:31.279478+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.QkRukycwiS4D7hcNpU1hno-DrXAwoyA_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5477594176057683520', time=2024-09-22T10:59:31.442994+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Bk4QkW0Q86CV-v2YUycm8M-CXE_Lbvl_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17966367577765876094', time=2024-09-22T10:59:32.715653+0000, chain.objs.size()=1 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PP81J2aqjG3_3WmnEuoYo5ngeYEO-84_0 2024-09-22T09:16:03.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.263+0000 7f56f9933640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x7f55c4091400 msgr2=0x7f55c4091960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:03.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.267+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9975545950536748304', time=2024-09-22T10:59:56.601940+0000, chain.objs.size()=1 2024-09-22T09:16:03.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.267+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.374__shadow_.0OVFNsGr2UYvopGREgmNkmHwsTF23vA_0 2024-09-22T09:16:03.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.269+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14848627343334704306', time=2024-09-22T11:00:38.608799+0000, chain.objs.size()=1 2024-09-22T09:16:03.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.269+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.448__shadow_.vtOoNwe5j95smnH9gkxYEYxRHHCG0QP_0 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15235420167612105621', time=2024-09-22T11:00:40.727414+0000, chain.objs.size()=1 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.452__shadow_.exkZTemf18nC_dYJhnQS3cGNgTiYcwc_0 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4795624249081698033', time=2024-09-22T11:00:49.687531+0000, chain.objs.size()=1 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.464__shadow_.6c-UB1nGI_U911KoKLv6g6LfxT8WSIZ_0 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3591025997413939387', time=2024-09-22T11:01:09.382342+0000, chain.objs.size()=1 2024-09-22T09:16:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.270+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.497__shadow_.7YW_rHmFRdDR-uIs74ihEsTK8jcbyUP_0 2024-09-22T09:16:03.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.274+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44932 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17822752494964985917', time=2024-09-22T11:01:14.305873+0000, chain.objs.size()=1 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7758392782655675704', time=2024-09-22T11:04:31.932558+0000, chain.objs.size()=1 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:Zlp0egPvci1N2ozOKUMY0L8vSfd.MxY_.87SuIh_MOH4807g2vj-wNFPEk1mb0-i_0 2024-09-22T09:16:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3601159360557122343', time=2024-09-22T11:04:33.474046+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:cgmmcldWf3B.kwKkInf7eQnMNg0S61x_.TPjxOWD7iyAMe-u4jyt0qt6PWoxFGdE_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13369505095683748419', time=2024-09-22T11:04:34.481641+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:8PgmIkwlHDHsDqvDRsv6vE0fRVufHpJ_.rh8ghPdlDZF-rZPwu59HIJ4dARihJod_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10926346428884603124', time=2024-09-22T11:04:52.712229+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:sybmWvKf2biwYwktgirFPdddBnHQMbt_.KIaF26UwkWUMIFohmn2vgiwKSlD-aiH_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11061974167220115417', time=2024-09-22T11:05:02.448019+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:XkhXgJfl-ELBe2TTVRgEN823vx8kHB2_.G328FkuGYWdkI2sltNvmcz2ok3FeO4x_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18260678490451693204', time=2024-09-22T11:05:10.199868+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:DIFhIA-.M-1GVVmtmmN86AdorqNgEzK_.ejth6PZz9W600uDgmanNbWIdgCnuhr0_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.568526746649009757', time=2024-09-22T11:05:12.875844+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:oU3NcYuWEbHoZodue2anNz.qVAJs0k3_.fro9cjyzM2Vs_LWUU62JKnJoDUiLaMp_0 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17634345942937930198', time=2024-09-22T11:05:46.906185+0000, chain.objs.size()=1 2024-09-22T09:16:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.276+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.607__shadow_.5roCtVHiGQ905Re1de4CfNHIQR2XRuk_0 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14509045858366607842', time=2024-09-22T11:06:50.877803+0000, chain.objs.size()=1 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.617__shadow_.jNxCDVnIJ6QTKGkD1p2O4ElhGqNbFfo_0 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16351979677535804145', time=2024-09-22T11:07:52.037701+0000, chain.objs.size()=1 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.618__shadow_.US3vl5TRcc-iQRWx2ahAPWlZaNXwb_R_0 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10987158255786157932', time=2024-09-22T11:09:53.186809+0000, chain.objs.size()=2 2024-09-22T09:16:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.277+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.656__shadow_.XTjEGqdTtkUyQ1r5FexuAjQvBnDlKmc_0 2024-09-22T09:16:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.280+0000 7f56f9933640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.171:6816/959803971,v1:172.21.15.171:6817/959803971] conn(0x5570d49935e0 msgr2=0x7f55c408d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.280+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.656__shadow_.XTjEGqdTtkUyQ1r5FexuAjQvBnDlKmc_1 2024-09-22T09:16:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.280+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7950101065089426529', time=2024-09-22T11:11:37.739228+0000, chain.objs.size()=1 2024-09-22T09:16:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.280+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.747__shadow_.Du58LcxyDWsSYJvJjbZeCbuQmtJsAfh_0 2024-09-22T09:16:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.284+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.286+0000 7f56f9933640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.171:6824/2960376290,v1:172.21.15.171:6825/2960376290] conn(0x7f56f4020070 msgr2=0x7f55c408f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.289+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.290+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.290+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46604' 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13215982856699908847', time=2024-09-22T10:53:49.082765+0000, chain.objs.size()=1 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.149__shadow_.qLJS2EBxWmK-biUlHfJS19FgY5mVr9L_0 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_zn1gHJXuFp_j-0E3zNwx-Xc2k3eqLXP', time=2024-09-22T10:54:04.569028+0000, chain.objs.size()=2 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.eL8_uiBTX7LOacIX3vXyniZ0pylWok8_0 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.eL8_uiBTX7LOacIX3vXyniZ0pylWok8_1 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_lECX-_i4fSBdWcm8fKeBtCWxmnmaJfW', time=2024-09-22T10:54:06.194198+0000, chain.objs.size()=2 2024-09-22T09:16:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.WxwhwFkGxLRA-rQu2An1_wWZvyTkxAk_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.WxwhwFkGxLRA-rQu2An1_wWZvyTkxAk_1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.57988342698292767', time=2024-09-22T10:56:09.722792+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.231__shadow_.ZXu9Xtxejv-z5aocZkm6Ga-_5KMTBj5_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1721818558180895772', time=2024-09-22T10:56:11.623248+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.234__shadow_.jIhUqlpcZ0FWycHDj9ucTP88ntNghgl_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5593422686070478895', time=2024-09-22T10:56:26.758298+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.257__shadow_.evUAfvR0NFJw0PNh3ZpCcPZZOk6Wide_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12984816179747786105', time=2024-09-22T10:57:06.579343+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FxtHlXuXEtqDSF-lemdYzgtjEOVSCYr_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16366052248005187057', time=2024-09-22T10:57:06.644478+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LV0_tiijtEmcPadTR6zqzlco3cz3FoF_0 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9493267666846517599', time=2024-09-22T10:57:06.645220+0000, chain.objs.size()=1 2024-09-22T09:16:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ATwPoM2wWUBpxIw61TzJBkMp-GdZmhx_0 2024-09-22T09:16:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6201607050854918991', time=2024-09-22T10:57:06.807998+0000, chain.objs.size()=1 2024-09-22T09:16:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.291+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rx0dLSnkdfKGtdltKDvkbJ2foHAknyD_0 2024-09-22T09:16:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.295+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8965951123178012173', time=2024-09-22T10:57:07.824960+0000, chain.objs.size()=1 2024-09-22T09:16:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.296+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tNWi6zTnZ4sK-7wfs3_g1Io1tmFJsGn_0 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16404780556794518952', time=2024-09-22T10:57:08.066191+0000, chain.objs.size()=1 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.q5C5vrk7xXsc5-HQ20jFuf9rhXRroB0_0 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17484938956924926163', time=2024-09-22T10:57:08.183697+0000, chain.objs.size()=1 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.806eqQxiy8VKgQx-NQ70GhHDKGIrGjR_0 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3931501098123104982', time=2024-09-22T10:57:08.313782+0000, chain.objs.size()=1 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Dw23CK3g9JQ2VsUY2nXPRIIRrimCFDv_0 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13433167969956879523', time=2024-09-22T10:57:09.138370+0000, chain.objs.size()=1 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qIAinGP5pAHCn0T-5z-oJNbUSBes4ua_0 2024-09-22T09:16:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1493330314661420833', time=2024-09-22T10:57:09.492133+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dQiTgQSmyCgMKiSSCM-evVIxAe_lnwW_0 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2956245496652602727', time=2024-09-22T10:57:09.685240+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LKVYG6Myn8haBBULO1M6oWXJHiVB0o8_0 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10193784569533498967', time=2024-09-22T10:57:09.840015+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.f-yOd7RT-VYsFyQw4e78oz-cA3xLzDf_0 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9379553892872445251', time=2024-09-22T10:57:10.642104+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1tn7zy0fNQdkMekGO5C8iBESFG_a0Od_0 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5861673017179921264', time=2024-09-22T10:57:10.643590+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bU7tPTgMUQ7Cb8NqJAbrnlNqIw6jn11_0 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4018880862173091205', time=2024-09-22T10:57:10.945645+0000, chain.objs.size()=1 2024-09-22T09:16:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.297+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.w1pYTIKUMQ13nuwhN_TYx5vd-WIVqtv_0 2024-09-22T09:16:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.300+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2346386107284744037', time=2024-09-22T10:57:10.993735+0000, chain.objs.size()=1 2024-09-22T09:16:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.300+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.koJnX6iyX-snc9L3WddWYsFGbnUwJJe_0 2024-09-22T09:16:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.300+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10407924544327934401', time=2024-09-22T10:57:11.163926+0000, chain.objs.size()=1 2024-09-22T09:16:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.300+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.HhMWb19a6NL83ZD6TneBoYkxmNLW3a1_0 2024-09-22T09:16:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1837704019905704707', time=2024-09-22T10:57:11.349134+0000, chain.objs.size()=1 2024-09-22T09:16:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8UTLG1Ga05BM4vHXWZy3OLlVhb8TjEs_0 2024-09-22T09:16:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4303641230453717259', time=2024-09-22T10:57:12.055055+0000, chain.objs.size()=1 2024-09-22T09:16:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WoAWuhjm4jFMsqxdNbEiBVcehgsmhZ2_0 2024-09-22T09:16:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3762650035264817522', time=2024-09-22T10:57:12.904445+0000, chain.objs.size()=1 2024-09-22T09:16:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.301+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DlBmlRfQ_wfZa5hC3h62oevj2VO_q_6_0 2024-09-22T09:16:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10601058676873626', time=2024-09-22T10:57:14.261302+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.STn-apcjlWX0KpADc8tlvN0j_fvCQ03_0 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5975503284463583856', time=2024-09-22T10:57:14.329243+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8scAiT4OX72D647KaQkICnikbjYHW8q_0 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4375384195441773605', time=2024-09-22T10:57:15.804691+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VxkId9we4Z2G5c4re7d3V3QZaivWbQc_0 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16240026239748163075', time=2024-09-22T10:57:36.321612+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.HTprr302EeXvaG-lBcwUeHXlYzVnNEY_0 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7786273557698641804', time=2024-09-22T10:57:38.198993+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.T752zUY480L3ZfsMJVSdviiG8pf2EC3_0 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6646753380955141646', time=2024-09-22T10:57:47.965690+0000, chain.objs.size()=1 2024-09-22T09:16:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.302+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.308__shadow:cfHkhuie96IiSbKoCHMNaeh52RnysLn_.bMNzEN-Ki8ArTf29ebgL5sSW5P9Wpx8_0 2024-09-22T09:16:03.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.304+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6404077877557107683', time=2024-09-22T10:58:34.521737+0000, chain.objs.size()=1 2024-09-22T09:16:03.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.304+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7pJxXr341gDdqq7L5GDG5hl3lfLV5v2_0 2024-09-22T09:16:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.306+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15227473726587872834', time=2024-09-22T10:58:34.673105+0000, chain.objs.size()=1 2024-09-22T09:16:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.306+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BpxoH_anUvuibWaEEF9xFR0iCyQOusS_0 2024-09-22T09:16:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.306+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13881994254686114616', time=2024-09-22T10:58:35.034534+0000, chain.objs.size()=1 2024-09-22T09:16:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.306+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.gma6xVi-WZrLV5oEGwdS7wKj5s4UDKb_0 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4584857514311525345', time=2024-09-22T10:58:35.950909+0000, chain.objs.size()=1 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Gcz5EgS1SYgVz5dJvy62OrBZkfWYMon_0 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17231462999432940718', time=2024-09-22T10:58:36.386322+0000, chain.objs.size()=1 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rYaXULBjz4vRiNbdFqRVcTJJsubhFTO_0 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1897163907224493412', time=2024-09-22T10:58:36.519906+0000, chain.objs.size()=1 2024-09-22T09:16:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.307+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kDHTSSQYRjPPIIwxtLt7kRsqeGY8kDt_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17998523974671006412', time=2024-09-22T10:58:36.978023+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Pic23Y-HCek9s3Owpw6EzfsKGHqbjLq_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16206231100279750792', time=2024-09-22T10:58:37.467293+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mbPxasYZL2r1eo7RtryJFcEs20MEV9I_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9365958505593754363', time=2024-09-22T10:58:37.468032+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XIRVw0AYe07NwwaQ8F92NJdS7jQVb0w_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14641512280612578046', time=2024-09-22T10:58:37.833962+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FR_8E3DEdod7PM9ehsqCBrFiAxM5z0h_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4427229379016323957', time=2024-09-22T10:58:38.433907+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.r3RabIAvdnXARkByULpCDjlI86iHHQd_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6563130576605377922', time=2024-09-22T10:58:39.407491+0000, chain.objs.size()=1 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zhAC-nHSXHhC6PLPkxv2X66ZUxLdIW4_0 2024-09-22T09:16:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13018550508445870787', time=2024-09-22T10:58:41.056861+0000, chain.objs.size()=1 2024-09-22T09:16:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8ag2I0_DksI0CS-t0E2qoMYvBWoYoJp_0 2024-09-22T09:16:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6055273178792868235', time=2024-09-22T10:58:41.755177+0000, chain.objs.size()=1 2024-09-22T09:16:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.309+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9Vr8I_R2aTbRoxguLd6kB6xf4phYuBe_0 2024-09-22T09:16:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13512825446932433452', time=2024-09-22T10:58:41.886153+0000, chain.objs.size()=1 2024-09-22T09:16:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.eFxu6kPe_P_bDb0SSjpxByOHQUe8st1_0 2024-09-22T09:16:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16606777896154295233', time=2024-09-22T10:58:42.038615+0000, chain.objs.size()=1 2024-09-22T09:16:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.C2Gk1jCiy2L2GkydppfguFIFy6VvKNu_0 2024-09-22T09:16:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14692217027628977359', time=2024-09-22T10:58:42.157171+0000, chain.objs.size()=1 2024-09-22T09:16:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.312+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oFTgA5QNDDNeZr8TQq-5-u49q9IHs71_0 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17946904454739075012', time=2024-09-22T10:58:42.157671+0000, chain.objs.size()=1 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8t8bokbEqqJMv7oeeFxDRLfC8ous3N3_0 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17263251535952956689', time=2024-09-22T10:58:42.320519+0000, chain.objs.size()=1 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9owUpbv6Lvi05eVMAgqsAP1W7KQDE_4_0 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8092737280676264381', time=2024-09-22T10:58:42.395312+0000, chain.objs.size()=1 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yooMZdb8Nj2XxMVWpIYK4S2WtFsOWi2_0 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10744464002561652020', time=2024-09-22T10:58:42.444483+0000, chain.objs.size()=1 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GwdLBRyQo1FDP6v4-W8swtwp4mBa9x__0 2024-09-22T09:16:03.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3437533082548785530', time=2024-09-22T10:58:42.506008+0000, chain.objs.size()=1 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ngErCoSl6N9hK_wZuBfM6ceJnumOpAg_0 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12331183051683478527', time=2024-09-22T10:58:42.971422+0000, chain.objs.size()=1 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.acH9Y2guqP3yUJUiGSYuqpGZZpP_uz9_0 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10604313263196759015', time=2024-09-22T10:58:43.417664+0000, chain.objs.size()=1 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8cSrdUrb-GUExS3R1VHDfqbohhA2BLG_0 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17923470096564317932', time=2024-09-22T10:58:43.532872+0000, chain.objs.size()=1 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.315+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pEIExj_z_aBo65YKV_Fu4m5qKvVG16l_0 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.317+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15325923236993632639', time=2024-09-22T10:58:45.098305+0000, chain.objs.size()=1 2024-09-22T09:16:03.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.317+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hHIIfkyPTvUalA6FpMTmqdwK9_WeDGx_0 2024-09-22T09:16:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.318+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15198061919014362243', time=2024-09-22T10:59:22.007209+0000, chain.objs.size()=1 2024-09-22T09:16:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.318+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G2G2fS_HGMHWlMsT__XQTMiG-f3AHTB_0 2024-09-22T09:16:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.318+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8877180410199531102', time=2024-09-22T10:59:22.129199+0000, chain.objs.size()=1 2024-09-22T09:16:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.318+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NVbtXjhlsc_aJ4d18ItNDLU53YSmjAq_0 2024-09-22T09:16:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9977321284866343334', time=2024-09-22T10:59:22.203555+0000, chain.objs.size()=1 2024-09-22T09:16:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Mft3oY82-bX7bfPMqdVSLgzUWvWsmLy_0 2024-09-22T09:16:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1787169526725219234', time=2024-09-22T10:59:22.243657+0000, chain.objs.size()=1 2024-09-22T09:16:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Az_MPIvxFH9TjSCXL-S7sdgCJrGBFn7_0 2024-09-22T09:16:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6566942576742227617', time=2024-09-22T10:59:22.315017+0000, chain.objs.size()=1 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cQ4Nv4TYjv__GfbKwvD1hFx5glEk4ms_0 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5824708293745206036', time=2024-09-22T10:59:22.474617+0000, chain.objs.size()=1 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5faHvTv-icdEHOwSsiwv_3FaNP7O7Uz_0 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.458556551299854071', time=2024-09-22T10:59:22.909192+0000, chain.objs.size()=1 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jATelBrBDYpJbwivvimkMoc1oVDs3aE_0 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9712025759760381215', time=2024-09-22T10:59:22.941033+0000, chain.objs.size()=1 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.k1VyM_dYIBosVIjPp_Teju9pWTvtGWs_0 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.558946062074960846', time=2024-09-22T10:59:23.024519+0000, chain.objs.size()=1 2024-09-22T09:16:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lx25XO7RjkrTFozwSAnbMu5-tVRKoAu_0 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2861369897303469413', time=2024-09-22T10:59:24.001558+0000, chain.objs.size()=1 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZHiZwgnuEFye57Vd321kfAzQWFJdUY1_0 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3885073596479195549', time=2024-09-22T10:59:24.490409+0000, chain.objs.size()=1 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.320+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6sftibRMe7Ykrg4zmDWviPTqJcBt60c_0 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.322+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17322058331876446781', time=2024-09-22T10:59:24.582762+0000, chain.objs.size()=1 2024-09-22T09:16:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.322+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Tl-Pw_HUa1bBX673AjYYx7iQ2YliHIg_0 2024-09-22T09:16:03.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.324+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14284977381234720193', time=2024-09-22T10:59:25.124297+0000, chain.objs.size()=1 2024-09-22T09:16:03.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.324+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iJZy8jLQBK0TShdjaoiIPl63Z1hPnYu_0 2024-09-22T09:16:03.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5217890986946737969', time=2024-09-22T10:59:25.703273+0000, chain.objs.size()=1 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.alrap4EtOAf0GL6ruAmd7sMp3DeE2TK_0 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18054316253340903783', time=2024-09-22T10:59:25.943186+0000, chain.objs.size()=1 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h831_zhYVeRuh2PgpaFHVoC2CZUEn0t_0 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9307026201153789139', time=2024-09-22T10:59:26.859971+0000, chain.objs.size()=1 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.hbG-x7Cuhdw6VgrOxPsr2lk8O-8_jUH_0 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18244914089060346520', time=2024-09-22T10:59:27.360804+0000, chain.objs.size()=1 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.325+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4MZ-ajDnFT2yLer5Ge6x1rxPK4cykmu_0 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.326+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12552842477839542693', time=2024-09-22T10:59:29.040425+0000, chain.objs.size()=1 2024-09-22T09:16:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.326+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5yO1cCAdetxfaROl7DSqpkkfuy_d6iL_0 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1849147841512903618', time=2024-09-22T10:59:29.760603+0000, chain.objs.size()=1 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FkWNEaGSWPNZ76zt0wSd0AAZaNSxnTV_0 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9565201512412355656', time=2024-09-22T10:59:29.789853+0000, chain.objs.size()=1 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rngmMi6rW0BjylcH5sQ_jrKWJyL81T2_0 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2426877278296210232', time=2024-09-22T10:59:30.026748+0000, chain.objs.size()=1 2024-09-22T09:16:03.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Hb6QJLN6h_nReiwy3Lf90-ZbaXr9wW2_0 2024-09-22T09:16:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3744611396533602142', time=2024-09-22T10:59:30.077782+0000, chain.objs.size()=1 2024-09-22T09:16:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0Dp-cmAlhbXo4Dtb-P_m1ecddhiZ1uU_0 2024-09-22T09:16:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3492111465112552897', time=2024-09-22T10:59:30.415602+0000, chain.objs.size()=1 2024-09-22T09:16:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.327+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3q3tr3pC1ZOV8fSnffAbdG-cHLGLETy_0 2024-09-22T09:16:03.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.330+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10929515929098371596', time=2024-09-22T10:59:30.946101+0000, chain.objs.size()=1 2024-09-22T09:16:03.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.330+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YD69R7C3TKq7J105zKv9lft8XJdHHhJ_0 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1143109560540873708', time=2024-09-22T10:59:30.947723+0000, chain.objs.size()=1 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zesYF1fpY8YtIwnU9ndN9PZfoyv73En_0 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9677868201673002487', time=2024-09-22T10:59:31.418182+0000, chain.objs.size()=1 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.i6_9QhrqSQvXofJksJQeqj3IWCXv72N_0 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13775949997257809380', time=2024-09-22T10:59:31.775272+0000, chain.objs.size()=1 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gEt8V-xgFUsbmrV96s5__fwF82Yivba_0 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4719658157880034248', time=2024-09-22T10:59:32.446405+0000, chain.objs.size()=1 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cdmENkzdQ-GIVhKXpZ3BhpnwDu7cAIA_0 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14365424616534418461', time=2024-09-22T10:59:32.463147+0000, chain.objs.size()=1 2024-09-22T09:16:03.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qkp5NAfqagsYmv8iVC5ekwhT0TTiBK8_0 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16385707243754962330', time=2024-09-22T10:59:32.932190+0000, chain.objs.size()=1 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EwjMmNKA1ChWqlswdnREMC9fVqUOtJS_0 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2176619509148280481', time=2024-09-22T10:59:32.932917+0000, chain.objs.size()=1 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zuq5SMeu1mp4_wWNtOHldu0gsvkPlTd_0 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4862914758430271523', time=2024-09-22T10:59:37.483578+0000, chain.objs.size()=1 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.334__shadow_.xl3YrMOP8l3AuvXaXdgu0ifcc93Ji4A_0 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15651599514792683905', time=2024-09-22T10:59:39.303801+0000, chain.objs.size()=1 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.337__shadow_.zncYDewOEnu0OXLUO1Y-4fe7Q_pO1dV_0 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12161291161928085592', time=2024-09-22T10:59:58.108760+0000, chain.objs.size()=1 2024-09-22T09:16:03.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.332+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.375__shadow_.-SeqRat-Xp--4zeKPuHtKWaDaUmog19_0 2024-09-22T09:16:03.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.333+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13676476285903451226', time=2024-09-22T11:00:45.563055+0000, chain.objs.size()=1 2024-09-22T09:16:03.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.333+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.459__shadow_.YGNuX4D6Kdkq0nmwKokMuCenQ2-hqBa_0 2024-09-22T09:16:03.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17261026564420980266', time=2024-09-22T11:00:47.179489+0000, chain.objs.size()=1 2024-09-22T09:16:03.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.461__shadow_.OodquWSP_kx3Z-1qJuG9izr0floUc1E_0 2024-09-22T09:16:03.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10527466333881738255', time=2024-09-22T11:00:50.533115+0000, chain.objs.size()=1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.465__shadow_.UuE1pNJ0r1sNXSsAC7F79irw1Lezooh_0 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_', time=2024-09-22T11:02:10.984525+0000, chain.objs.size()=1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.2 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1708139429122040149', time=2024-09-22T11:03:06.545579+0000, chain.objs.size()=3 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~HZ7tU3CCLemae3sns9Z7bof0GaqB4ML.1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~HZ7tU3CCLemae3sns9Z7bof0GaqB4ML.2 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~HZ7tU3CCLemae3sns9Z7bof0GaqB4ML.3 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10450280711532755794', time=2024-09-22T11:04:12.185132+0000, chain.objs.size()=1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.558__shadow_.q6OmVLNxsLXCupYKejJYvoxYdLOOMMw_0 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10274283400679081013', time=2024-09-22T11:04:19.065083+0000, chain.objs.size()=1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.562__multipart_mymultipart.2~t7enN0FltB616KkX91kqLqleL4xq_16.1 2024-09-22T09:16:03.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5490369439355824649', time=2024-09-22T11:04:48.770036+0000, chain.objs.size()=1 2024-09-22T09:16:03.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.337+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.576__shadow_.v7HO8OYIkMvPmgU_5zxDdoqH6s21gGJ_0 2024-09-22T09:16:03.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.344+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46604 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7374373663521052696', time=2024-09-22T11:05:00.073520+0000, chain.objs.size()=1 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:PTjYp1IHkUl9FILJjpHrq1mj5XpAFPH_.XNISMrwWdSF98rbtR6C9bGKT-nKPyqY_0 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17841288363803638882', time=2024-09-22T11:05:12.157545+0000, chain.objs.size()=1 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:dvsfDZX-i448KEUI3BHY88FMBEdxJNm_.71pJaxLvYPmOP_x5vhWP3LvwHD-Bb3y_0 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9347067051482576399', time=2024-09-22T11:08:54.282647+0000, chain.objs.size()=1 2024-09-22T09:16:03.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.621__shadow_.kso88Yl-M7CsBGw3QVlrqZ4p4LrA3Lw_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14236255249586657182', time=2024-09-22T11:09:33.350166+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.638__shadow_.VMbmXoALZ2PE2gBLSQGIja_7DZJeHCf_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13208564541872114150', time=2024-09-22T11:09:54.632813+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.657__shadow_.sjLkGGcGvIgGmnax_4YiDilFjJkb6In_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3472660181255749204', time=2024-09-22T11:10:19.745249+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.672__shadow_.OaXLdW3Kf3xZINOssrhRBr_B1NUjo-U_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5625041198537129497', time=2024-09-22T11:10:30.207807+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.694__shadow:vvVaVCgcyyE9s0zM6UQn3PQJet3SrDD_.7jCyUtqLKBBWRWz_eXdHBok71oyhM80_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6516955490017247268', time=2024-09-22T11:10:35.698503+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.703__multipart_file1.2~FtQyB6rj1tjJmHh-QEU34Mh7nbyGZh5.1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12777133833305944947', time=2024-09-22T11:12:11.865259+0000, chain.objs.size()=1 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.753__shadow_.bPEHrZnBSAUE1_r6jweyFigYa1Nt2bz_0 2024-09-22T09:16:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15719233130288650011', time=2024-09-22T11:12:50.528852+0000, chain.objs.size()=1 2024-09-22T09:16:03.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.346+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.766__shadow_.THLgD1F4dK9Azm3oWeMwbHnngtF8kMQ_0 2024-09-22T09:16:03.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.351+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.353+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:03.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.355+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49387' 2024-09-22T09:16:03.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6740755602607508513', time=2024-09-22T10:56:10.360185+0000, chain.objs.size()=1 2024-09-22T09:16:03.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.232__shadow_.FgbwA_lpd-Slm9U323aRiPQSJ91rn8E_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13018460128741789023', time=2024-09-22T10:56:23.631074+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.252__shadow_.P7OLuI0BqajOG4rU7FC3ao1yzrrrkbK_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15012070684369435055', time=2024-09-22T10:57:05.912534+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hfsAHhc-hmvWgFHbc87RRAipTbqz_aJ_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4585157122837242446', time=2024-09-22T10:57:06.333160+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.s7ffjUJ2etdczCC5QvIX3-ymsOzbFvN_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10105387689138892036', time=2024-09-22T10:57:06.334664+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VS0u0AR8Moz7rn2hF5ojpQkCYscxqIg_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17635478283419356621', time=2024-09-22T10:57:06.406576+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.356+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bfidGAZPc-3Y2Fi4xQv2OwjwhBXIN_U_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5122011980895859093', time=2024-09-22T10:57:06.459774+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gG8PRaUgMm-6pLvv-Ab3OYfYQhfPk3w_0 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.188216461729457518', time=2024-09-22T10:57:06.910317+0000, chain.objs.size()=1 2024-09-22T09:16:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Djfplsv8JtVfi72tF6vlgSBIXiO-7Gs_0 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13338015149774234827', time=2024-09-22T10:57:07.525389+0000, chain.objs.size()=1 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GWm-6obgOPr8r5kKae5J4k4HKAniXyJ_0 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9224485148617297323', time=2024-09-22T10:57:08.427887+0000, chain.objs.size()=1 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.s1gk0VLuv_HMvqEY64qtajItMBDy9Zd_0 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4042619160381979087', time=2024-09-22T10:57:08.555256+0000, chain.objs.size()=1 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9j21K-qosJvNTbumM4xQAm6Wy2OSylR_0 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10142872367530821689', time=2024-09-22T10:57:09.204417+0000, chain.objs.size()=1 2024-09-22T09:16:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.357+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MaT-3admtqo05I-p7PY9z15zmbyewDc_0 2024-09-22T09:16:03.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8926835205589400143', time=2024-09-22T10:57:09.556160+0000, chain.objs.size()=1 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7VhY7H7Orcn2rvBtgjbukvC5Ec3vuo4_0 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.360+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1828329059432551837', time=2024-09-22T10:57:09.837935+0000, chain.objs.size()=1 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.360+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bdjbV6_WcOoQSFyURS1OBudl9F3hlRO_0 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6873442317597447910', time=2024-09-22T10:57:09.978988+0000, chain.objs.size()=1 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gY8w3A182hFe_byWz-FOvIGDHiXfkKl_0 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10805233654701793555', time=2024-09-22T10:57:10.018893+0000, chain.objs.size()=1 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YMDfngBDDRtyn1_OE1w2yJ5GpG30iK2_0 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4995699103085822012', time=2024-09-22T10:57:10.481133+0000, chain.objs.size()=1 2024-09-22T09:16:03.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YVJSmHDjl4yyML4gTNQlIAYRtAoF9ko_0 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12923287446327471336', time=2024-09-22T10:57:11.403030+0000, chain.objs.size()=1 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MxuIDI8ShJXkZ8_k8fMFSApjtufZ4rg_0 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1001976810021281992', time=2024-09-22T10:57:11.442135+0000, chain.objs.size()=1 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gMvbOD-p9SAK0sLWBMlQVyBHkhZEzm6_0 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7502669021406914346', time=2024-09-22T10:57:11.442908+0000, chain.objs.size()=1 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9AlX_dFULHtKYfd5uqFK41S3LytWns5_0 2024-09-22T09:16:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.121516802770553342', time=2024-09-22T10:57:11.899637+0000, chain.objs.size()=1 2024-09-22T09:16:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.frAHNpIDMyPBTQg80z9mQ7xGL15CVVs_0 2024-09-22T09:16:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15576226904668744359', time=2024-09-22T10:57:12.270621+0000, chain.objs.size()=1 2024-09-22T09:16:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RyEKRgI_envIW8Se-UosbmFSXwNbB8U_0 2024-09-22T09:16:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15075391156875322127', time=2024-09-22T10:57:12.384820+0000, chain.objs.size()=1 2024-09-22T09:16:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.361+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Y66G3ggvIdVhbBIybYXo40VEC8epBB2_0 2024-09-22T09:16:03.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1800733629217294012', time=2024-09-22T10:57:12.630628+0000, chain.objs.size()=1 2024-09-22T09:16:03.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.VqympaUa6lvf9KK_ypTotc7ZmNd21wU_0 2024-09-22T09:16:03.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15133210001657843704', time=2024-09-22T10:57:12.897172+0000, chain.objs.size()=1 2024-09-22T09:16:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7N6rSkuj6WGX3k_zTgNpxv5QibQC_Jz_0 2024-09-22T09:16:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3434353832682960438', time=2024-09-22T10:57:13.510841+0000, chain.objs.size()=1 2024-09-22T09:16:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.364+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zebWP81BTqlEdU4VO4JhI5qKpteEO8R_0 2024-09-22T09:16:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.365+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16026173881836931996', time=2024-09-22T10:57:13.628890+0000, chain.objs.size()=1 2024-09-22T09:16:03.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.365+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QWNRovvXs8TGsUviVmX1rD4k-anAzQ8_0 2024-09-22T09:16:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13344352713523985520', time=2024-09-22T10:57:13.910327+0000, chain.objs.size()=1 2024-09-22T09:16:03.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fMrUNqjyHW1zWINFJD6rTYqMPSnlazT_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16616108914473178817', time=2024-09-22T10:57:14.143263+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Sp1MYitk4ohoLoC4savi9vOQd75JlOr_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8523759691423789247', time=2024-09-22T10:57:14.223164+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0kuTbfGeSAhZLwEpYyYzZJINQQ8ggP__0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18232024960993186425', time=2024-09-22T10:57:14.320519+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yKFOqP0SY3-p2u_C-0PgMBTwdMM8bjN_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4976452319254672956', time=2024-09-22T10:57:15.030749+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4l7evlp03Y0q4N7YLWey_oKINaehYH-_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10052916318054718255', time=2024-09-22T10:57:15.133360+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dnhL6ZLQliy1Bq5LJL64dKmVVXQcxw4_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11675951738749444342', time=2024-09-22T10:57:15.264436+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WngYfFZTzdEFq6-fzigGFiOaj7eZLDi_0 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13661613396612305742', time=2024-09-22T10:57:15.269589+0000, chain.objs.size()=1 2024-09-22T09:16:03.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.367+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5vEImBbbSYS1Ryb5Ef-ART8Acxcaepb_0 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2253041527581152496', time=2024-09-22T10:57:15.619042+0000, chain.objs.size()=1 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.I3soELZ89p8wS_rFdszVGlA6plgebjb_0 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8579661537714315937', time=2024-09-22T10:57:16.162025+0000, chain.objs.size()=1 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BinfHX1GQQ4gJmRgYBv8Dq5yy3DkrvN_0 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16243264638218981952', time=2024-09-22T10:57:16.280220+0000, chain.objs.size()=1 2024-09-22T09:16:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.370+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u10vHrtNub8T3CfEHmeUURsN4ZyYC7__0 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17944578243593226004', time=2024-09-22T10:57:16.366568+0000, chain.objs.size()=1 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6NtdjGcgjY3OFBXUXHbh0IM90xcuXHx_0 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8797626805673388330', time=2024-09-22T10:57:19.899133+0000, chain.objs.size()=1 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.268__shadow_.abDdqMN3nDdc9OXTr4-vWZAqmrGwha7_0 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3267129922328010102', time=2024-09-22T10:57:29.417529+0000, chain.objs.size()=1 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.284__shadow_.YdK7KTeK2OfleoT9WQ-EA-IRKOX13EV_0 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8433307539278002859', time=2024-09-22T10:57:36.302979+0000, chain.objs.size()=1 2024-09-22T09:16:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.371+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.jbxzuzWPswnThKpBdc1uS4quuFdJhHt_0 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13768552846046978998', time=2024-09-22T10:57:38.236839+0000, chain.objs.size()=1 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.JdHu55pcs920NwXe4ZNagb6UqXGmDkk_0 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18042221775603919961', time=2024-09-22T10:57:38.333076+0000, chain.objs.size()=1 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.dBPypc6atlm2wRm-aAf4lIWUNPz6mQ1_0 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.443951291195570444', time=2024-09-22T10:57:43.605916+0000, chain.objs.size()=1 2024-09-22T09:16:03.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.302__shadow_.WGKv-sUuC-RQogKwnegB-vmazxx3EzA_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14676232125186100735', time=2024-09-22T10:58:34.674511+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.373+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hpZAUD7QIhAqi-DRBPOyHggVCsHU9-I_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16769349781505131358', time=2024-09-22T10:58:35.982124+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I39h7a0mEWcuNZimGEd4wSSebXJzVPc_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9517167562316993278', time=2024-09-22T10:58:36.062365+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZoRk47yFltS4V16_2Y4E-PQtmTHLphV_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8382479111267997111', time=2024-09-22T10:58:36.949859+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.375+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.j6DaCdskl4C8LUEp8Iiq4ebQgkJNIV2_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.376+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11755398756385586559', time=2024-09-22T10:58:37.481868+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.376+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-NSiT1d-3zzBlm4iJRlh8C-yJiHkyYc_0 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.376+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5797173365060227386', time=2024-09-22T10:58:37.880396+0000, chain.objs.size()=1 2024-09-22T09:16:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.376+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pT0PywtMtUDVpKuzjUMJ6dBeKMcbU9__0 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.377+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16080286282572370187', time=2024-09-22T10:58:37.922544+0000, chain.objs.size()=1 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.377+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z6ih0tz3-0g7jAynVb8_TnQ6sWJNajR_0 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10168773385528537624', time=2024-09-22T10:58:38.474615+0000, chain.objs.size()=1 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W6mpU4wymrJRtgdSEKqtcZ4Ncx2pul-_0 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2952253742137835120', time=2024-09-22T10:58:38.886027+0000, chain.objs.size()=1 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NzGeKwHY6NDvhK1A9EnV_Yphy9XmqAg_0 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7526689812562892113', time=2024-09-22T10:58:39.432831+0000, chain.objs.size()=1 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dWRqrIcwfs4LdgJjEgkuLX4Gdly1GdF_0 2024-09-22T09:16:03.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4845157040675814432', time=2024-09-22T10:58:39.510298+0000, chain.objs.size()=1 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.d4XUBnp2V1nnulQGdTFCFrQiuCMTpN0_0 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2007772900205949349', time=2024-09-22T10:58:39.646660+0000, chain.objs.size()=1 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.378+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7eskfMr_RUTTKCPvZLCIW_hePt8Yp_K_0 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14151553352029199170', time=2024-09-22T10:58:40.399255+0000, chain.objs.size()=1 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SK6zMbwvb03v4Hvh3tfJ4AKUrP4ZnSP_0 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.379+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7286720189800795746', time=2024-09-22T10:58:40.912802+0000, chain.objs.size()=1 2024-09-22T09:16:03.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.379+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fR7UutfynNsUH2504VwzQL5ZbC-KQOW_0 2024-09-22T09:16:03.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7122815520571234278', time=2024-09-22T10:58:42.343336+0000, chain.objs.size()=1 2024-09-22T09:16:03.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5JXhKKn2IeCJbkxE8sWcLD1Cg5Fx2l7_0 2024-09-22T09:16:03.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8326695154162355115', time=2024-09-22T10:58:42.983784+0000, chain.objs.size()=1 2024-09-22T09:16:03.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YJYwycC0wtksnJay-RvtrdkEWWMI2Ro_0 2024-09-22T09:16:03.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6154428755135101257', time=2024-09-22T10:58:43.475342+0000, chain.objs.size()=1 2024-09-22T09:16:03.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.380+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W-Um3L3iytiV__iUbje1MHvVoFvCA3O_0 2024-09-22T09:16:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.382+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11268341098766895096', time=2024-09-22T10:58:43.509835+0000, chain.objs.size()=1 2024-09-22T09:16:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.382+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Nn_ie4AkOHd6CyPtPYTrORDy4W_pGPk_0 2024-09-22T09:16:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.382+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16881561204964709483', time=2024-09-22T10:58:44.410555+0000, chain.objs.size()=1 2024-09-22T09:16:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.382+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2BRCZk-lk723AbGouMriGy_qhbXvuS5_0 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6274000682710279319', time=2024-09-22T10:58:44.588924+0000, chain.objs.size()=1 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.c4qqKnRRmvp0Ar-_MoM_u8v_GYvVKq1_0 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.802248901895360593', time=2024-09-22T10:58:44.737529+0000, chain.objs.size()=1 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QqhJp6YQNRsmrZPk2_aw2Z1iTJcfYYU_0 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3116289784707625669', time=2024-09-22T10:58:44.853827+0000, chain.objs.size()=1 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GpVI8_wW_pDd0nt7PB9zGJbBvgyEzr1_0 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5042008348322269288', time=2024-09-22T10:59:22.129494+0000, chain.objs.size()=1 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6HxbV9i3loCnBalTeKnWeU7EUcc8qDj_0 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10999031551713968213', time=2024-09-22T10:59:22.321238+0000, chain.objs.size()=1 2024-09-22T09:16:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.383+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.anDO-Z_pVel6HU1xOSCi2-MJ5LR0ubC_0 2024-09-22T09:16:03.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.384+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14558739663102205628', time=2024-09-22T10:59:22.347417+0000, chain.objs.size()=1 2024-09-22T09:16:03.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.384+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.R_Fiqxr4ABPg0ZO3YlQHz5fIUQn5ZMh_0 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11973751991776531544', time=2024-09-22T10:59:22.892699+0000, chain.objs.size()=1 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fNhqLPyaxFvWofXwdlwObuUmHfrvAIh_0 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17051083389632098944', time=2024-09-22T10:59:23.062292+0000, chain.objs.size()=1 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5Ej_UkEIshlR6uV_JmGXWH8Q8bcEyxx_0 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15633093189117762861', time=2024-09-22T10:59:23.069224+0000, chain.objs.size()=1 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.v4pLx27e33cKHHn-LoH5gRwycWRh7Sy_0 2024-09-22T09:16:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4259177321619148260', time=2024-09-22T10:59:23.703328+0000, chain.objs.size()=1 2024-09-22T09:16:03.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Kg0DCoVmlEsw43wfhIm6bLdJwbEA1B__0 2024-09-22T09:16:03.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12502689359264522296', time=2024-09-22T10:59:23.736723+0000, chain.objs.size()=1 2024-09-22T09:16:03.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.386+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AS0_EhFT32bZHASrq9H-5hXSLKjI1Jx_0 2024-09-22T09:16:03.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.387+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13696297231898249333', time=2024-09-22T10:59:23.788997+0000, chain.objs.size()=1 2024-09-22T09:16:03.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.387+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2FgvJkoBlExsulNVUC7pxlGq0Oq6itb_0 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.388+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1095505187846161250', time=2024-09-22T10:59:23.884145+0000, chain.objs.size()=1 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.388+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.FeQNSj2GDSRd7_ZhCOON6vrm1Th3PHL_0 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.388+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10364952832625717841', time=2024-09-22T10:59:24.112139+0000, chain.objs.size()=1 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.388+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.haz9XmpEn8N9stITE_KjYG5GLKnjZSh_0 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.389+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570038365775475934', time=2024-09-22T10:59:24.112801+0000, chain.objs.size()=1 2024-09-22T09:16:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.389+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DPTKK4DVMhMaSxEhEZm0sd9aJv4Q2rV_0 2024-09-22T09:16:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.389+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5638295794673899297', time=2024-09-22T10:59:25.049396+0000, chain.objs.size()=1 2024-09-22T09:16:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.389+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ki0CGL9xN9jt9sLlUhCnJJQEQEcNkUJ_0 2024-09-22T09:16:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.390+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17041677535217429216', time=2024-09-22T10:59:25.161728+0000, chain.objs.size()=1 2024-09-22T09:16:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.390+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3HQQ3VNkc26Zmpq7a5-o525CB8kiRZy_0 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7917683298051645228', time=2024-09-22T10:59:25.186861+0000, chain.objs.size()=1 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kjkQLapTIySwhojwNvn2k_pOM7Bmm-m_0 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5843850507189296710', time=2024-09-22T10:59:25.534786+0000, chain.objs.size()=1 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7BS3Q2B0RG8yj-if5I-AayIWl6lp2CR_0 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11717238899556199188', time=2024-09-22T10:59:25.760483+0000, chain.objs.size()=1 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OsuzKXFzQqXQk7BzWVmAIODfSrq7oGI_0 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.817815969470081107', time=2024-09-22T10:59:26.019659+0000, chain.objs.size()=1 2024-09-22T09:16:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dhvxmmnhTG2NE_I68m34PdmNUz547ZG_0 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17434110174577345670', time=2024-09-22T10:59:26.022122+0000, chain.objs.size()=1 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Mmvt6EtkddIeUleeaW2ZU5b4U1kZ3Zi_0 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2003884749703036274', time=2024-09-22T10:59:27.238599+0000, chain.objs.size()=1 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oMR1XBn_fn5n-djLaFpaoXgoi0WC0uB_0 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5535430400561371226', time=2024-09-22T10:59:27.303854+0000, chain.objs.size()=1 2024-09-22T09:16:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.392+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Xc5ULtChMbunk_4E7tbi2ssIVUOoU_E_0 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15992278170627288011', time=2024-09-22T10:59:27.492468+0000, chain.objs.size()=1 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SRvDJHT1scKww7Cy63cYtydLrO-7A93_0 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2651893853255642816', time=2024-09-22T10:59:27.528558+0000, chain.objs.size()=1 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qx1b-PAFr16dOZEJJLOgrCvOeY6fEvJ_0 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1491930850893629840', time=2024-09-22T10:59:28.170816+0000, chain.objs.size()=1 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.A752b68SOL95mX7ZPiwc639__7E3wdh_0 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12372487897156463828', time=2024-09-22T10:59:28.388557+0000, chain.objs.size()=1 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.394+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Vh59vA1EzJsjbUIuWwqFQOVBjvwy2FX_0 2024-09-22T09:16:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.395+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16705836620226097955', time=2024-09-22T10:59:29.735812+0000, chain.objs.size()=1 2024-09-22T09:16:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.395+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gn16XH_bPwkb-B90L4Y9PVRpYXw3wQU_0 2024-09-22T09:16:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13040850647076288263', time=2024-09-22T10:59:30.267628+0000, chain.objs.size()=1 2024-09-22T09:16:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Jx_dPw0Za9SIYevaWZZNpuc60FSL8ZX_0 2024-09-22T09:16:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.396+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14871119876530722858', time=2024-09-22T10:59:30.453948+0000, chain.objs.size()=1 2024-09-22T09:16:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.396+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ddcBz0QPuYqfR3EKszA69DzHGeJp8yX_0 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.397+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8013617529224173452', time=2024-09-22T10:59:31.085598+0000, chain.objs.size()=1 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.397+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TWftiR5PON1fo-AGtrwGHpY_zLm1_Co_0 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.397+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17986464705203949525', time=2024-09-22T10:59:31.090096+0000, chain.objs.size()=1 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.397+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wImsr1rG7oH2TeSFj_Y5aHHzeoRLtPB_0 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.398+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15399457056297074652', time=2024-09-22T10:59:31.123536+0000, chain.objs.size()=1 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.398+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PQhR7T8RMA2H65BZDFPCmzquBWQA6Mh_0 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.398+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6943405292474927122', time=2024-09-22T10:59:31.346302+0000, chain.objs.size()=1 2024-09-22T09:16:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.398+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lWrsuB8kfoDBBz8YehNfWQlDsysOAq-_0 2024-09-22T09:16:03.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.399+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4090559326985041696', time=2024-09-22T10:59:31.347099+0000, chain.objs.size()=1 2024-09-22T09:16:03.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.399+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1RPMn7SOIXJcafrPLaNtM94Xihb3Ae__0 2024-09-22T09:16:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.403+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/49387 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1090238979859972686', time=2024-09-22T10:59:31.348726+0000, chain.objs.size()=1 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iYtpTe6DS0rww0Ubo5d28yHLU6b9sGt_0 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3675744190204834763', time=2024-09-22T10:59:31.636371+0000, chain.objs.size()=1 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DjcQesi76wz-0TFgH-M4jprZqg94vRe_0 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12869506544499477296', time=2024-09-22T10:59:32.155953+0000, chain.objs.size()=1 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f9An5_Gy6VStWOHySDNu1Wwa9RJdRLd_0 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11196844542275833682', time=2024-09-22T10:59:32.682380+0000, chain.objs.size()=1 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sDXQRMcymYGyEgb7yCSR3bxgj2tT3Km_0 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9829598065911135668', time=2024-09-22T11:00:27.937716+0000, chain.objs.size()=1 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.430__shadow_.ESmx2bng0j9RIK_HKZ2cRqoIqLq7z-S_0 2024-09-22T09:16:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9122199605397101493', time=2024-09-22T11:00:44.747280+0000, chain.objs.size()=1 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.458__shadow_.PH1xoXBiuIStKNZPz3T_-xxIMzZYLdO_0 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10645597610777937237', time=2024-09-22T11:00:50.534946+0000, chain.objs.size()=1 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.465__shadow_.qkcv_OR2L_vzeW39yQVgT0ijKm-hi23_0 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15254018565221448587', time=2024-09-22T11:00:51.130729+0000, chain.objs.size()=1 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.466__shadow_.RX-CL0qVF8O7Ie9nWeh9JlUVG5lVOGt_0 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18358813276076047241', time=2024-09-22T11:02:55.027860+0000, chain.objs.size()=3 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~wQ8qst8MzEAhXIlv_1ehAdzvJM5Vu4Y.1 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~wQ8qst8MzEAhXIlv_1ehAdzvJM5Vu4Y.2 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~wQ8qst8MzEAhXIlv_1ehAdzvJM5Vu4Y.3 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~d0S3POheX8wb5M3kJ0NvHUW7uk0vyJ-', time=2024-09-22T11:03:19.266864+0000, chain.objs.size()=2 2024-09-22T09:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.405+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.532__multipart_mymultipart.2~d0S3POheX8wb5M3kJ0NvHUW7uk0vyJ-.1 2024-09-22T09:16:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.408+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.532__multipart_mymultipart.2~d0S3POheX8wb5M3kJ0NvHUW7uk0vyJ-.2 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9110698458412810200', time=2024-09-22T11:04:02.023158+0000, chain.objs.size()=1 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.553__shadow_.Sa-8Bnskl0ubY9Jy5dVyJxFS4LTwcdG_0 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5670945322108085617', time=2024-09-22T11:04:57.219815+0000, chain.objs.size()=1 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:jqcJJWJELIRZQGTo22wvmmYfL9x7NIi_.uSSve-LMMoL4bjO_qJZ1w4HbCUf5tJ0_0 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11621278503238168418', time=2024-09-22T11:05:36.097922+0000, chain.objs.size()=1 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.587__shadow:BJRC8k01Tr51pZZeSlD-19DQYJHFXgh_.UFpzhF_cDwEnMJM-KlgIWrFLKjJQG2K_0 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12030465064953231214', time=2024-09-22T11:07:51.892017+0000, chain.objs.size()=1 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.618__shadow_.buunpoN34OBXySXdJY8E9KvVvFtCE-e_0 2024-09-22T09:16:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4916190467219165060', time=2024-09-22T11:09:28.062302+0000, chain.objs.size()=1 2024-09-22T09:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.629__shadow_.rOEr--YxqkIwSCCwR-S4ffD4Mv0FWwU_0 2024-09-22T09:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8923104823354767166', time=2024-09-22T11:09:30.968244+0000, chain.objs.size()=1 2024-09-22T09:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.410+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.634__shadow_.gpQsLOoRIIL27sDnWPGitB9-0lVDU46_0 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5386421861782450423', time=2024-09-22T11:10:23.543628+0000, chain.objs.size()=1 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.680__shadow_.i6hNsR-Nu1QumI-SmN2aKpBzHXrAcXa_0 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4031069293054893777', time=2024-09-22T11:11:04.711146+0000, chain.objs.size()=1 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.719__shadow_.h6urBhKcd1_zQNn9fxZeYUOaSblqXyp_0 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15758868107326804371', time=2024-09-22T11:12:16.601379+0000, chain.objs.size()=1 2024-09-22T09:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.411+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.756__shadow_.QymbXkx8x4i4U5pIcVcahZLbuAEto12_0 2024-09-22T09:16:03.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.416+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.419+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.420+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.421+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50318' 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3962858811692208293', time=2024-09-22T10:54:09.602560+0000, chain.objs.size()=3 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-STANDARD.2~f5CwotMfpBq5j73Q-3rOcrvCBE2hf_3.1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-STANDARD.2~f5CwotMfpBq5j73Q-3rOcrvCBE2hf_3.2 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-STANDARD.2~f5CwotMfpBq5j73Q-3rOcrvCBE2hf_3.3 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~ouh661EzOO-Xn083nU50oLYlSnVNd9R', time=2024-09-22T10:54:49.616902+0000, chain.objs.size()=1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.203__multipart_mymultipart.2~ouh661EzOO-Xn083nU50oLYlSnVNd9R.1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14981124062517065434', time=2024-09-22T10:56:12.244309+0000, chain.objs.size()=1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.235__shadow_.jYFqCqo1Oe0W6abtm6lgcBUPw1F7n3M_0 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2423469845769734819', time=2024-09-22T10:56:26.760643+0000, chain.objs.size()=1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.257__shadow_.2R1M_HJUYg5zHkgSrj2fh8MwKuLe87R_0 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1542532966715879830', time=2024-09-22T10:57:06.087994+0000, chain.objs.size()=1 2024-09-22T09:16:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.k3cvZ7R72tyb_n1kk-iG35t3l9fRd-__0 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13567001579038832130', time=2024-09-22T10:57:06.156323+0000, chain.objs.size()=1 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ph8x5-Dn_H9w865LzloMIfcxT6cpkJD_0 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3182485174052624132', time=2024-09-22T10:57:06.403977+0000, chain.objs.size()=1 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6iCQJSafrBuWn_hxtHZeD4PyfBYnDH__0 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16535904666702253852', time=2024-09-22T10:57:06.794287+0000, chain.objs.size()=1 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BcZEwbndThpVIStszriTEJVgqd_mAVE_0 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11338627716995161385', time=2024-09-22T10:57:07.550661+0000, chain.objs.size()=1 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.33tLAKlbIpF6EWSyhqfO9tt6uA3a7fr_0 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4937206656131175219', time=2024-09-22T10:57:07.587937+0000, chain.objs.size()=1 2024-09-22T09:16:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.422+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3tjsahXFIoVlT4YHT-kzkwGth-RHrk3_0 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5099258021732177780', time=2024-09-22T10:57:07.856574+0000, chain.objs.size()=1 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2Lyq_phylQwSPDG2j0Gikf1EiHcyIPe_0 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12273024934041872939', time=2024-09-22T10:57:07.962410+0000, chain.objs.size()=1 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gfnbhgIpw9rIeE3YER6OGTPAK2HfiOO_0 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2527239118527980102', time=2024-09-22T10:57:08.122222+0000, chain.objs.size()=1 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lk4SuiDlrK-8krkLBuBiqy2MxVOgtjQ_0 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12224806213007517635', time=2024-09-22T10:57:08.464365+0000, chain.objs.size()=1 2024-09-22T09:16:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.425+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9sxmEyRyWw04kQXnkvu8m-jynqeftlj_0 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4430457703562517811', time=2024-09-22T10:57:09.034801+0000, chain.objs.size()=1 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8gKg2H_gOAg4U7JVQ1LLSImW3McSR95_0 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.148769631501025006', time=2024-09-22T10:57:09.160649+0000, chain.objs.size()=1 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lyCpbXCXjJwjmK_bcueAQozKHr0mbY-_0 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12563044784337268761', time=2024-09-22T10:57:09.359046+0000, chain.objs.size()=1 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZFnBWiTjYzoDDJlb5uQaUgHvyA2R1rX_0 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13326766976195823287', time=2024-09-22T10:57:09.565923+0000, chain.objs.size()=1 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.gOXJmhMHcGq9-911Qk-pYZiugfPdOg6_0 2024-09-22T09:16:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8838920774056579186', time=2024-09-22T10:57:09.648762+0000, chain.objs.size()=1 2024-09-22T09:16:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iryXTtOpD3HbxVuSsADkbrfwDOayb44_0 2024-09-22T09:16:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8439068391781066790', time=2024-09-22T10:57:09.982977+0000, chain.objs.size()=1 2024-09-22T09:16:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.427+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SOPKUbU3KB3YXV0_6ob6dqfQTaekLAA_0 2024-09-22T09:16:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.428+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14460065038813942839', time=2024-09-22T10:57:10.790724+0000, chain.objs.size()=1 2024-09-22T09:16:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.428+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.v86M5PJKtkqGQ0SnHSX15CiuZNRJVbq_0 2024-09-22T09:16:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.919262531508232578', time=2024-09-22T10:57:11.262015+0000, chain.objs.size()=1 2024-09-22T09:16:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MrKbFjYLs-9vzYI-fC8U5f-F8TpRRwI_0 2024-09-22T09:16:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5771619685933296930', time=2024-09-22T10:57:12.022806+0000, chain.objs.size()=1 2024-09-22T09:16:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QsKzbu0Ac7aCpM-NOS6zfFV-lghVgpQ_0 2024-09-22T09:16:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8017631269848578873', time=2024-09-22T10:57:12.511018+0000, chain.objs.size()=1 2024-09-22T09:16:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ft7fps5PFhQyAVtqdGvykVCHw8ri68f_0 2024-09-22T09:16:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16223144813848620764', time=2024-09-22T10:57:13.515956+0000, chain.objs.size()=1 2024-09-22T09:16:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3rDDGNNswRZNpqwJzo3cWzcDz_HvTiu_0 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10847733006499335529', time=2024-09-22T10:57:13.692368+0000, chain.objs.size()=1 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.E9nQZbneJsAXZqmgOZOtoVYeftI-yXM_0 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1220192375600669700', time=2024-09-22T10:57:14.333581+0000, chain.objs.size()=1 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.agXsLI9Pce0SC4M2OtRiRa8dfMGfd1C_0 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10939264314130329342', time=2024-09-22T10:57:14.389262+0000, chain.objs.size()=1 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jqGK4OIQDo5l8M8ATB6fOT_61xJgMs-_0 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15367094669000975315', time=2024-09-22T10:57:14.436898+0000, chain.objs.size()=1 2024-09-22T09:16:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.430+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LRproBddOZ88UYL8zCbrn9anmUcZtmZ_0 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.432+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7847683502131398878', time=2024-09-22T10:57:14.768909+0000, chain.objs.size()=1 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.432+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cb_6hK6jBep1n4cix_Q5cGLCVFLuojQ_0 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.432+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7751066879067391309', time=2024-09-22T10:57:15.143599+0000, chain.objs.size()=1 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.432+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wcp9LisiYhiJE9O39Sx794z0pwHGz2K_0 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.433+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4266189204806175471', time=2024-09-22T10:57:16.163567+0000, chain.objs.size()=1 2024-09-22T09:16:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.433+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0nt-mb4eg0PFVUmFdedNhl7MzcpdmGj_0 2024-09-22T09:16:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.434+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11732971369763327021', time=2024-09-22T10:57:16.164189+0000, chain.objs.size()=1 2024-09-22T09:16:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.434+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.M52uygwRWUd4j35CZhSQuKEYpCp8mzt_0 2024-09-22T09:16:03.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.435+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16098189768362576012', time=2024-09-22T10:57:16.851738+0000, chain.objs.size()=1 2024-09-22T09:16:03.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.435+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BVLjuHnTlCYrIHLt0ktdJcj_irbIHbc_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17520573168536395322', time=2024-09-22T10:57:30.738936+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.286__shadow_.QelC9ZgwCIricraAIYuvyOZ9TqyCbej_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14414722965504080850', time=2024-09-22T10:57:34.545510+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.292__shadow_.8oL_vAYUorWcI_ds-3STjiJnIYZ4o1P_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14062228278988729355', time=2024-09-22T10:57:44.202952+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.303__shadow_.rdfVrC6_8DZjSIAjCtKG9HY2rAzbeNB_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9164388559626650494', time=2024-09-22T10:57:57.009526+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.323__shadow_.qrrz3APLlqZl5dBvZ-t77G6JN2LwKVd_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7893341732605468786', time=2024-09-22T10:58:34.652767+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3SCE4XQpIYiU5eBQeOQAIWrJoGTtmyG_0 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15802033899382460806', time=2024-09-22T10:58:35.147329+0000, chain.objs.size()=1 2024-09-22T09:16:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vKwDz9wI-_OBugdFU9kdcNW44FCEHf5_0 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11553900070926031396', time=2024-09-22T10:58:35.177430+0000, chain.objs.size()=1 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.09mrgJ-3k9ulgmeUCY4Sx-Ncsbzc2PZ_0 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1445799899734809242', time=2024-09-22T10:58:36.051557+0000, chain.objs.size()=1 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WR3jmUtjHCUx7NwYdSoUVBD8h78uxJQ_0 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15127403750995186547', time=2024-09-22T10:58:36.135586+0000, chain.objs.size()=1 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TIe_zXCEDVupzDdpfUwDiFv2dTFYTkp_0 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2176636626874391344', time=2024-09-22T10:58:36.153104+0000, chain.objs.size()=1 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dvLdtsgBD4DM_htBqjQCWSMSddcPMNo_0 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2761570667830411907', time=2024-09-22T10:58:36.155711+0000, chain.objs.size()=1 2024-09-22T09:16:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.438+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I1xyLqsE2NYkOk5fhxVgAEyP489ijef_0 2024-09-22T09:16:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7643335646215646535', time=2024-09-22T10:58:36.491027+0000, chain.objs.size()=1 2024-09-22T09:16:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.a5ruPE6wkAoQAr64HXfeOijS1nss8HE_0 2024-09-22T09:16:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.667814462989133581', time=2024-09-22T10:58:36.740601+0000, chain.objs.size()=1 2024-09-22T09:16:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3IRkntdR1ZZixCkVLiA8ijbUaCpKgNk_0 2024-09-22T09:16:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1886812866992876211', time=2024-09-22T10:58:37.467814+0000, chain.objs.size()=1 2024-09-22T09:16:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nQnxdjDdG9rhFppaV3jblduuiSxGN51_0 2024-09-22T09:16:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7500368455711475064', time=2024-09-22T10:58:38.134196+0000, chain.objs.size()=1 2024-09-22T09:16:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.442+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xQSkVEI8fsEeTEpRrvebuQb5TMoYwyh_0 2024-09-22T09:16:03.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7605805462289117812', time=2024-09-22T10:58:38.239753+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6rJAwXz7wlS5ggZwc-WBHdeyGy2oDD9_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10655878006834635744', time=2024-09-22T10:58:38.375148+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XcLAJWf3c1aZn80CIRjbZsHwtv8BknG_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10348498568188799019', time=2024-09-22T10:58:38.375899+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0k3GJ37zKYe0O8Fs9RNkQGWF4JjQCIS_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4376371485152602596', time=2024-09-22T10:58:38.915070+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6j-MItQ4bjULCPfIphgjxnIT0gX4XE9_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14349481105015272959', time=2024-09-22T10:58:39.312715+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-hvORwaJIOSF-Z289jKLjHGJ6CRE57s_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5806284161502639920', time=2024-09-22T10:58:39.436233+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PY14QCSrETGLvarUDdbapeQFFJgpOiX_0 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9695583738223544946', time=2024-09-22T10:58:39.475720+0000, chain.objs.size()=1 2024-09-22T09:16:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3UqOH9fxfdC37ChKgD4tE6T2nMWqHxW_0 2024-09-22T09:16:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2910642602970205723', time=2024-09-22T10:58:39.528830+0000, chain.objs.size()=1 2024-09-22T09:16:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.445+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xVL9nmZk2hrUJk_uHCxrmWP08JkwYDZ_0 2024-09-22T09:16:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.446+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3973583416070143009', time=2024-09-22T10:58:39.687877+0000, chain.objs.size()=1 2024-09-22T09:16:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.446+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NANhWOzvH5fJOETn_LflmB6hJhnKSfA_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11807372817904839606', time=2024-09-22T10:58:39.898466+0000, chain.objs.size()=1 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PBcJTkzlHxFc9oxAPwYFeGnsBh_Camp_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2692540345957219654', time=2024-09-22T10:58:40.332219+0000, chain.objs.size()=1 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TWlkw80J8TuziegP8Enm1jZvYIt9dYD_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18331953744873572515', time=2024-09-22T10:58:40.747268+0000, chain.objs.size()=1 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ar_ILmIcCATW94ErzgymjY_77smAzmx_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7795575047886296638', time=2024-09-22T10:58:41.635245+0000, chain.objs.size()=1 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2ScykX_AfyIIZAz9AR-3Tb7l9NdmDDf_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8365170738655859805', time=2024-09-22T10:58:41.650875+0000, chain.objs.size()=1 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5L9KkooIvVsCFFq9mLnD0AXifQV9M6x_0 2024-09-22T09:16:03.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3464065809279806363', time=2024-09-22T10:58:42.090061+0000, chain.objs.size()=1 2024-09-22T09:16:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.448+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.sO5VlpbZ5wTlOyUHSpO4cFBSBpqxoER_0 2024-09-22T09:16:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.449+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7808597733301629709', time=2024-09-22T10:58:43.016569+0000, chain.objs.size()=1 2024-09-22T09:16:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.449+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8ITqpPPjNw9U6PvAexE6zgl9M5VMuhj_0 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4190083030002462043', time=2024-09-22T10:58:43.222562+0000, chain.objs.size()=1 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WL80XnhjyurkblNdFuoFltf2bUXquie_0 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2402869496697976739', time=2024-09-22T10:58:43.353244+0000, chain.objs.size()=1 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._9Sw5fC6KFJOWIkqjiUVBXR2267EUqd_0 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17921039804661530632', time=2024-09-22T10:58:43.774752+0000, chain.objs.size()=1 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2EL0xdiHQNhFFA-W5Bnt0xgnB7R3rZX_0 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7949824411196051545', time=2024-09-22T10:58:43.789063+0000, chain.objs.size()=1 2024-09-22T09:16:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.451+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VzEQAuoGNJqnOlEfEkoVs_uNu1zyjDg_0 2024-09-22T09:16:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.453+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1663858740731120204', time=2024-09-22T10:58:43.981285+0000, chain.objs.size()=1 2024-09-22T09:16:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.453+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Dv_Y3B46FHcE-Lfxcw_VdrnITVPmCQ5_0 2024-09-22T09:16:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.454+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16740015296832931485', time=2024-09-22T10:58:44.278697+0000, chain.objs.size()=1 2024-09-22T09:16:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.454+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MgiV5L0sxb_eZAJgf-TkX_cxunXhX-z_0 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11230813457480902725', time=2024-09-22T10:58:45.028605+0000, chain.objs.size()=1 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.03yzhmFEHz7dLpV7FqYwJpwY521OyIS_0 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13411569864257084530', time=2024-09-22T10:58:45.082483+0000, chain.objs.size()=1 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RsF3VwrGVwnrX9X3wCyV5axOhF3alO-_0 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1433554356078442329', time=2024-09-22T10:59:22.028904+0000, chain.objs.size()=1 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6_X7We3fK4zx40OnxdcYm2C-lOLTjFR_0 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6356461732264895073', time=2024-09-22T10:59:22.253204+0000, chain.objs.size()=1 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.aliLexQvvQFVo6Q3gjp9DsKFTSBB0wA_0 2024-09-22T09:16:03.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56f9933640 0 -- 172.21.15.78:0/1183497556 >> [v2:172.21.15.171:6800/1364473755,v1:172.21.15.171:6801/1364473755] conn(0x7f55c40885f0 msgr2=0x7f55c408aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12385126583720778257', time=2024-09-22T10:59:22.356666+0000, chain.objs.size()=1 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.q2Dq1IH-i207VPeVjSLCUW5zcxDtciy_0 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15262521077865514353', time=2024-09-22T10:59:22.413010+0000, chain.objs.size()=1 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.uocbCZw80A837xNAwXVB8XX3GUiGrk9_0 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17681684998394159059', time=2024-09-22T10:59:22.755550+0000, chain.objs.size()=1 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ABixjUur0L6W4B8pmKuxUXS3cc_ZhtA_0 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10787646276683285230', time=2024-09-22T10:59:22.756408+0000, chain.objs.size()=1 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EB7rQ0kQt5a6itYol5UNoA2iXXz30hP_0 2024-09-22T09:16:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8906333454705940652', time=2024-09-22T10:59:22.805176+0000, chain.objs.size()=1 2024-09-22T09:16:03.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.455+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NBzICyxbPEjCHVChH9d-DNIM5pQ_Eh__0 2024-09-22T09:16:03.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.456+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2749723708848157218', time=2024-09-22T10:59:22.805644+0000, chain.objs.size()=1 2024-09-22T09:16:03.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.456+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.X3kW0Qz2I8HDFNMpX7bFoCFiRIkzjTV_0 2024-09-22T09:16:03.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.458+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8662572548743881487', time=2024-09-22T10:59:22.871501+0000, chain.objs.size()=1 2024-09-22T09:16:03.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.458+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h6xCvMo1lDrWs76XnHxb-KO3lxiSCJk_0 2024-09-22T09:16:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.460+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13335278744566841483', time=2024-09-22T10:59:22.908781+0000, chain.objs.size()=1 2024-09-22T09:16:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ox9hF1D6ojgBQVj9ZW3nMamd3mafbhC_0 2024-09-22T09:16:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.460+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14886408056811597268', time=2024-09-22T10:59:23.903486+0000, chain.objs.size()=1 2024-09-22T09:16:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.460+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6jMbrq_lgBieLL8ercoTXl4s9BxO0qR_0 2024-09-22T09:16:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18282897653282529409', time=2024-09-22T10:59:25.560247+0000, chain.objs.size()=1 2024-09-22T09:16:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.I6cRN7eWNErbpVCtoxbuCHC0tbfOUUF_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4668865331132538334', time=2024-09-22T10:59:26.518903+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XlHfbAaHOI0maESCcvWYR7FxNz9XOwQ_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16045414001974175393', time=2024-09-22T10:59:27.457644+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oBb68lvxadNjNQU2FmwJ6Bn68IhHzPB_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16917892709973318160', time=2024-09-22T10:59:28.280110+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VUeiWkwRdnJkeWgrfRdyYZoMpNrCo_t_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14079397459211505013', time=2024-09-22T10:59:28.427288+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qx6mzNyS4T8y2HvMVu6JyWgMGxQrfBi_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13529240601091102238', time=2024-09-22T10:59:28.575522+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zOasVq_fX6jVanwVzEgRGvFH2jsJOEg_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12115897333857289497', time=2024-09-22T10:59:28.586927+0000, chain.objs.size()=1 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DIlGZLfKTayhROUlIEhQ-iDbliUaqdE_0 2024-09-22T09:16:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1909983713977013861', time=2024-09-22T10:59:29.106935+0000, chain.objs.size()=1 2024-09-22T09:16:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yzJFjA0MnmgF8eVLY_-VkfCHSzhTV2j_0 2024-09-22T09:16:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15900665719691677593', time=2024-09-22T10:59:29.108048+0000, chain.objs.size()=1 2024-09-22T09:16:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.461+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.iFu5oSIkoLnup7R964bYTW2FfOO5Iy__0 2024-09-22T09:16:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8057341450205096840', time=2024-09-22T10:59:29.109327+0000, chain.objs.size()=1 2024-09-22T09:16:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._vK2quB77c1bmIcDN9xzwgZhomYD1kD_0 2024-09-22T09:16:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16768025194635651922', time=2024-09-22T10:59:29.801758+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ddmYvXwaaKhbBsykNr97TJJkfuDd_ZN_0 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14073598250202850049', time=2024-09-22T10:59:29.907366+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.r4L-ipUYg6-qz78VBLWj7XbE5Pb0zlr_0 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3844417111458010902', time=2024-09-22T10:59:30.065362+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jYQU-VjavSdfl6ADSv7xgTIBBTUcOob_0 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15212051746291274259', time=2024-09-22T10:59:30.249483+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.466+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x5rcFPWBHCelRSlv8_kky_555mq0HJE_0 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.467+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14851722411182788604', time=2024-09-22T10:59:30.445123+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.467+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Lx1FlePjRwXZBAxzieUFlyP_9Lm_Bpu_0 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.467+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7154837163970439299', time=2024-09-22T10:59:30.916044+0000, chain.objs.size()=1 2024-09-22T09:16:03.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.467+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GFN_aQrcdep9-75_fh8eL6qoJRJRDof_0 2024-09-22T09:16:03.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.471+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/50318 2024-09-22T09:16:03.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-22T09:16:03.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16960360111259103594', time=2024-09-22T10:59:31.311007+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.58SENBiIHSr6nRypKpFGM0p3eMlpWBZ_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3885691322837050964', time=2024-09-22T10:59:31.609930+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1zNa83z6s56lHYAxBcUnVrePyrpPkfh_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12944351180899494109', time=2024-09-22T10:59:31.610535+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.VGkwVo5jepD0zJ_sHemzYvxw9C3488E_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10882328794266689314', time=2024-09-22T10:59:31.773186+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.--7teZf_GMS0JD8EXAYFupiwq4qFM3m_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3039467633252831623', time=2024-09-22T10:59:32.162260+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lBkklwXxcy8wVoMlerZ0wxSuN_QSNQY_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15796113889178306880', time=2024-09-22T10:59:32.254762+0000, chain.objs.size()=1 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.F3K6DC6j654pPKxvOaz6-IxW6lZQAv5_0 2024-09-22T09:16:03.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6739998945855346716', time=2024-09-22T10:59:32.275365+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6Gme2tJtACWgtLZHSJPdb1Ayll3j8D7_0 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6970534347869272872', time=2024-09-22T10:59:32.586205+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NAtdzozc2SdgCLX_9lV8WU3qMMGCWpD_0 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7313816841560806179', time=2024-09-22T10:59:32.759917+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6O4PHou5aS58OKE-kj7RRp3TYOp1dzu_0 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6408675895072312591', time=2024-09-22T10:59:32.970610+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TH_3T-VrfdyxgVRf95GXoPqPFszNudD_0 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6931528212651318655', time=2024-09-22T10:59:36.488990+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.332__shadow_.3f32Fu5Z5G1p5rWqRevS_6vaUHnhiHI_0 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.492190937474339780', time=2024-09-22T11:01:14.297819+0000, chain.objs.size()=1 2024-09-22T09:16:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.474+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:03.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.476+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9484237021563512384', time=2024-09-22T11:01:14.306584+0000, chain.objs.size()=1 2024-09-22T09:16:03.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.476+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.504__shadow:TpY30ZZ.XHh58PIb57m6s580cOL4PcK_.DCAu19gIzYg8BWpBX5iGMqhTOOvuEFP_0 2024-09-22T09:16:03.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.477+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13694515878124867738', time=2024-09-22T11:01:56.744291+0000, chain.objs.size()=3 2024-09-22T09:16:03.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.477+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:Xu0840-Uck-A5AwlyHLgXTvN2qO.rBc_.4QXm_2thTZqlI_l0iMripUUK9fk0utM_0 2024-09-22T09:16:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:Xu0840-Uck-A5AwlyHLgXTvN2qO.rBc_.4QXm_2thTZqlI_l0iMripUUK9fk0utM_1 2024-09-22T09:16:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.478+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.521__shadow:Xu0840-Uck-A5AwlyHLgXTvN2qO.rBc_.4QXm_2thTZqlI_l0iMripUUK9fk0utM_2 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5216230969096468133', time=2024-09-22T11:02:52.807415+0000, chain.objs.size()=2 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~yJzbCtocdyqMs3vL56ZcHh_cxHKrshK.1 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~yJzbCtocdyqMs3vL56ZcHh_cxHKrshK.2 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18157175164149564247', time=2024-09-22T11:03:41.020607+0000, chain.objs.size()=1 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.537__multipart_mymultipart.2~C6ztAE9Z_nVdM_rX3Yf3qHMx3Rwj2jP.1 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8244421682329807552', time=2024-09-22T11:04:02.331551+0000, chain.objs.size()=1 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.553__shadow_.-RF79kXFrvtH041nhS0alDswgIkcPIc_0 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13665050355122526258', time=2024-09-22T11:04:05.158672+0000, chain.objs.size()=1 2024-09-22T09:16:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.555__shadow_.JKjUxXYbgKUhAsDjxm58dnpMK82QODi_0 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZuntCymeipRQartO91ShVga_pwOwMi9', time=2024-09-22T11:04:19.260739+0000, chain.objs.size()=1 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.479+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.562__multipart_mymultipart.2~ZuntCymeipRQartO91ShVga_pwOwMi9.1 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.480+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16729682886167760865', time=2024-09-22T11:04:29.799689+0000, chain.objs.size()=1 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.480+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:XnoMOmWzXsj3nJfQVhjSNBQ17sSwa9q_.Ga5Wv9K1twWijbeosUh0os_wiEtKA2w_0 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.481+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16802703266030362855', time=2024-09-22T11:04:30.111132+0000, chain.objs.size()=1 2024-09-22T09:16:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.481+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:W7KeLOjl6VpeYAsb01cifbNU-eVVeWb_.uPLPy72AEU48CSwMx2CGSLORDM1dwxF_0 2024-09-22T09:16:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.482+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6153102050830158357', time=2024-09-22T11:04:47.354217+0000, chain.objs.size()=1 2024-09-22T09:16:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.482+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:46gvTyEEQZaaeasenMR8yezI0pQaArc_.3KD-wELkghPlNZqj2BKhTQUjG1CboLg_0 2024-09-22T09:16:03.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.483+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6591994863905876186', time=2024-09-22T11:05:31.366108+0000, chain.objs.size()=1 2024-09-22T09:16:03.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.483+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:Ek1a7JFr6ThV6S3t5W31WptIrMCm3Xv_.O94syB9TynRekP0-4I1x4UpjAU15SIn_0 2024-09-22T09:16:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.484+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.829639576532409874', time=2024-09-22T11:05:45.037809+0000, chain.objs.size()=1 2024-09-22T09:16:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.604__shadow_.FICXx84rPSRZV6PCCygIetVkQy8imkY_0 2024-09-22T09:16:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.484+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12774112974483531323', time=2024-09-22T11:10:13.450054+0000, chain.objs.size()=6 2024-09-22T09:16:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.1 2024-09-22T09:16:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.484+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.2 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.3 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.4 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.5 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.663__multipart_foo.2~Ta6OfBNnAs0NjzXL4ObSuRsDAsnU2xX.6 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11212109355604262193', time=2024-09-22T11:13:17.803288+0000, chain.objs.size()=1 2024-09-22T09:16:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.485+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.775__shadow_.e0skXAfhqjR5Dp72E75-xI33m_bvVhs_0 2024-09-22T09:16:03.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.491+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.493+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:03.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.495+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53474' 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4735904213558016102', time=2024-09-22T10:53:58.993601+0000, chain.objs.size()=2 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.159__shadow_.rmbMUDiIWjeD9gyRFbwLedWtQ6dG0lV_0 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.159__shadow_.rmbMUDiIWjeD9gyRFbwLedWtQ6dG0lV_1 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12740747646493301531', time=2024-09-22T10:56:09.727177+0000, chain.objs.size()=1 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.231__shadow_.dVt0jw2Euixwro-qpkd4e7od2l5_zlV_0 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12904949308593045152', time=2024-09-22T10:56:12.252601+0000, chain.objs.size()=1 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.235__shadow_.YgZQ52JxrqT4qipjop6i8I_F-eSs-fR_0 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14372551689498260945', time=2024-09-22T10:56:12.849658+0000, chain.objs.size()=1 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.236__shadow_.gOuJELUcbT7IE0PfU5xm1P5enx7-c4W_0 2024-09-22T09:16:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1607643846857041539', time=2024-09-22T10:56:13.506020+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.237__shadow_.qKcIRC6g5UdIvW_gi25poJi9vTl0uKX_0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1904959570094403810', time=2024-09-22T10:56:14.417525+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.238__shadow_.C9_uU2mXhLDn6VK1_8bIAWW0flLmyYm_0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3463433424083875576', time=2024-09-22T10:56:19.360788+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.245__shadow_.iSn0RJ3uwWeJ8pT1YkFphXatvnRnjZ1_0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14336566262777688642', time=2024-09-22T10:57:05.947630+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2mzXvz4G_M7_nv4aLxsy2oMeboOmClf_0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2679101728359115025', time=2024-09-22T10:57:07.700124+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tNf4W3W8x86BQb1WdHCTlDa1L_k7n7__0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3740214876838401771', time=2024-09-22T10:57:07.754928+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JilYWYBHxZBsUgLyQ8cm5rgmnVj1VdX_0 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5992334199004971154', time=2024-09-22T10:57:08.546966+0000, chain.objs.size()=1 2024-09-22T09:16:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.496+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oZgLKBPRcP77RHgaR6nH5ywSteDJHSP_0 2024-09-22T09:16:03.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14096959060782075979', time=2024-09-22T10:57:09.373033+0000, chain.objs.size()=1 2024-09-22T09:16:03.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kXzLcd_nBP9TnD1_tEwB0DaduUyyYNJ_0 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3702445706176460490', time=2024-09-22T10:57:09.993351+0000, chain.objs.size()=1 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iWmUnbpQFOfMnR05K9jnCHy8IX8gwvD_0 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9621338814947566978', time=2024-09-22T10:57:10.473314+0000, chain.objs.size()=1 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._lcF77X5Jg6kC_Zpf7VP3WLlsIVRE1a_0 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3004185929545738314', time=2024-09-22T10:57:10.473975+0000, chain.objs.size()=1 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kE1Swcl81gUdTKIVrLPH3-c8LiweZEe_0 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15506054161946999301', time=2024-09-22T10:57:10.862642+0000, chain.objs.size()=1 2024-09-22T09:16:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.i29emQUUFQr2STRxIFdncc6iAPNWe_r_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16085351048573565992', time=2024-09-22T10:57:10.912303+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DGSRnBOaEuUL8ssSLTUJQ9IQ3-YfM0G_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5178716064635662505', time=2024-09-22T10:57:11.122006+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cLgoDT_rWO6sFOcdJn7PktS45G29V11_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4302550873606146986', time=2024-09-22T10:57:11.150481+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._iHI46_iGxZAFRZYFankJgmgKalIVlj_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13579903916381278628', time=2024-09-22T10:57:11.202976+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.n_2p8ooenjfa83xhqZofJX8G2f6T8eN_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9787183123766399312', time=2024-09-22T10:57:11.248103+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RTw8bl4aI5Eng0sHdIGIN5DtHqvjumW_0 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7679478297886901133', time=2024-09-22T10:57:11.850482+0000, chain.objs.size()=1 2024-09-22T09:16:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.500+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.y_XbSimFhlHoAynFcpKbqo951ajjn8g_0 2024-09-22T09:16:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1948031170632691212', time=2024-09-22T10:57:11.896904+0000, chain.objs.size()=1 2024-09-22T09:16:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8KNo_MCifu5D0PcppmqIelS6Vs9NlIV_0 2024-09-22T09:16:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.326414352229793254', time=2024-09-22T10:57:12.236121+0000, chain.objs.size()=1 2024-09-22T09:16:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.GcBffVDxWvUJw6qBlreXAQBcKhHXb_y_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14557851768302360095', time=2024-09-22T10:57:12.303689+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nzjVbiNjKWVejGRaKVcTYMx6JbFZ7MF_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10729491524174889493', time=2024-09-22T10:57:12.642681+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qr3-ka_3CMzL3J01r_OVHZWnac2HslL_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4204860863243148750', time=2024-09-22T10:57:12.683257+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7Zg0n3t_PRzV8mJqaDFLFs-V03W2cLk_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17610629723181199609', time=2024-09-22T10:57:12.684098+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Obg0MZ1UNhkTO5zHr7D88aaJ1yQVmr7_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2085499072041490505', time=2024-09-22T10:57:13.594310+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uo8g7KGaeBm77GM_46q8lDfnb6SmmDF_0 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8018599384527863027', time=2024-09-22T10:57:13.920393+0000, chain.objs.size()=1 2024-09-22T09:16:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wrjkIhMDL1p7k-k9EeUx0yn8_YpweYh_0 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8374150155315558705', time=2024-09-22T10:57:15.000263+0000, chain.objs.size()=1 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.D4r8H40gOvVzkumpf4dP2gRro6Tauic_0 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16343343502316043206', time=2024-09-22T10:57:15.306754+0000, chain.objs.size()=1 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jxYOGVX99R1xJK1VsQkzThMXL8EEalb_0 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3947874644460480087', time=2024-09-22T10:57:15.460073+0000, chain.objs.size()=1 2024-09-22T09:16:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.506+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yHMlY7WSPXCj95ftgleD7PxExsCVaBs_0 2024-09-22T09:16:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.509+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.788080018178177890', time=2024-09-22T10:57:16.156568+0000, chain.objs.size()=1 2024-09-22T09:16:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.509+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-HpkCfskJkMKQUR4-rc1wfm4pZJZ-9l_0 2024-09-22T09:16:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.510+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17794023306918019495', time=2024-09-22T10:57:16.717701+0000, chain.objs.size()=1 2024-09-22T09:16:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.510+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-ZwdsT7qWEi1eU5oKLnoGEBRdAN2q3v_0 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1651460758902597539', time=2024-09-22T10:57:16.808828+0000, chain.objs.size()=1 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IyNM_iTyFzWrQZsJuWMJW7uyQFWBZNb_0 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16756990637222301198', time=2024-09-22T10:57:16.878026+0000, chain.objs.size()=1 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CdLaO9g20O-GAnqLD_5Rs5IX1np0a4U_0 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3036350192745027971', time=2024-09-22T10:57:21.612341+0000, chain.objs.size()=1 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.271__shadow_.1N2M68_msjLfVSSL1qaVaqlc767DO5x_0 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2993956654737323472', time=2024-09-22T10:57:22.222840+0000, chain.objs.size()=1 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.272__shadow_.RoH2Ru_v05ApUhsoDDUUJthE5ZaFSxZ_0 2024-09-22T09:16:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9673069362800418931', time=2024-09-22T10:57:36.341976+0000, chain.objs.size()=1 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.syr9Y3661_xZkmo6r0cMiaLoYQTiq1S_0 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3553359790808700838', time=2024-09-22T10:57:36.342802+0000, chain.objs.size()=1 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.S6HQr_jkcrLj94QBWbUNSO6c4PBub8j_0 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16210875458707230987', time=2024-09-22T10:57:36.445986+0000, chain.objs.size()=1 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_._vtx-s3pKlSLLohDJDUHM1a8aJENjvk_0 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18302492890537215857', time=2024-09-22T10:57:36.446678+0000, chain.objs.size()=1 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.id9YWKUe3ntq3KSyB6dw6dKEitNMKyE_0 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10489899794920040695', time=2024-09-22T10:57:38.313352+0000, chain.objs.size()=1 2024-09-22T09:16:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.511+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.pJEFUi_pq2Fyoh-4BcWNgoob6Kp09zP_0 2024-09-22T09:16:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.513+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17883699178452504572', time=2024-09-22T10:57:56.220520+0000, chain.objs.size()=1 2024-09-22T09:16:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.513+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.322__shadow_.Hlj8MKcZFGEMoVmbUCQuRcoX4RfLrhz_0 2024-09-22T09:16:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.513+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10042586739942628336', time=2024-09-22T10:58:34.647595+0000, chain.objs.size()=1 2024-09-22T09:16:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.513+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.UZVZ0uM2Zv4hM5j_iE_vZG_gzzZ2fNF_0 2024-09-22T09:16:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.515+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12775346887441383740', time=2024-09-22T10:58:34.927790+0000, chain.objs.size()=1 2024-09-22T09:16:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.515+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.SRjULwCwNFkhU5WXnGnmfBB_06eIMRw_0 2024-09-22T09:16:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.516+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4830869389446061758', time=2024-09-22T10:58:35.363944+0000, chain.objs.size()=1 2024-09-22T09:16:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.516+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.B9ZwfG2ZXTur9Ebz5wYnvU0uXwD6Nhq_0 2024-09-22T09:16:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.517+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10073116600677051541', time=2024-09-22T10:58:35.428851+0000, chain.objs.size()=1 2024-09-22T09:16:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.517+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ivQZyHuwSRVyu-Ebx6mweD97db6QGxe_0 2024-09-22T09:16:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.517+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5055957096063015867', time=2024-09-22T10:58:36.089504+0000, chain.objs.size()=1 2024-09-22T09:16:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.517+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cihxpp8MS7eGPPhF1yifv-LJwBLHMjw_0 2024-09-22T09:16:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7353456699867490208', time=2024-09-22T10:58:36.276847+0000, chain.objs.size()=1 2024-09-22T09:16:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W2GYLCblhxURQRTpvfB5tJntfd33sjc_0 2024-09-22T09:16:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3533942714486629788', time=2024-09-22T10:58:36.879677+0000, chain.objs.size()=1 2024-09-22T09:16:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wDVETrZMowM4GRdHpw59ceYH7PhEKht_0 2024-09-22T09:16:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16307659571774086191', time=2024-09-22T10:58:36.914028+0000, chain.objs.size()=1 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7Q4TaRwecOOmUDSfYoycmT-61K8PGGQ_0 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10756652927368558782', time=2024-09-22T10:58:36.914765+0000, chain.objs.size()=1 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WTTa7v91ggWV8dq2g3gsZFUjEQX7TGI_0 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1587037843416590710', time=2024-09-22T10:58:37.695641+0000, chain.objs.size()=1 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.R8Vuly5YMZ6OEoi10AbgVmljquAZwPT_0 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15004845187164830675', time=2024-09-22T10:58:37.733784+0000, chain.objs.size()=1 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JQ5uglH3LEvXy27Ieydk258okJx7n-I_0 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8589677746117769125', time=2024-09-22T10:58:37.734611+0000, chain.objs.size()=1 2024-09-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.518+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WDm6ncjDldUTQReFy0C4LhV7FX2jTyf_0 2024-09-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.520+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11593801462575384030', time=2024-09-22T10:58:37.928093+0000, chain.objs.size()=1 2024-09-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.520+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RC-6n4hRmTiMn1PQMiWu7BgSLxaEWxU_0 2024-09-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.520+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7692518337253394897', time=2024-09-22T10:58:37.993049+0000, chain.objs.size()=1 2024-09-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.520+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GGy5TBbcCXMYYue_g7Wddl5RTshYe6c_0 2024-09-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.521+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10092210647833481878', time=2024-09-22T10:58:37.993747+0000, chain.objs.size()=1 2024-09-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.521+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.25u3MC0udOED8C8i9J1Y2CT-nKssZGi_0 2024-09-22T09:16:03.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.523+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18119895247778344497', time=2024-09-22T10:58:38.087844+0000, chain.objs.size()=1 2024-09-22T09:16:03.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.523+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N3b42gJdJTR31fCFXGGZv-zq2XKGYZt_0 2024-09-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17883617657187791433', time=2024-09-22T10:58:38.191291+0000, chain.objs.size()=1 2024-09-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Soqj_KvBjz-yqLU_LQnW6vtbPjkXUiL_0 2024-09-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14760189907394042470', time=2024-09-22T10:58:38.280185+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZToZjOpsnPu91MyMC8ZeiBzwa-JELd1_0 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4808645607341751150', time=2024-09-22T10:58:39.090653+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1Vsf_H6N4IrSRuW8MUWhAD0vAl2OwSJ_0 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4543833340705245785', time=2024-09-22T10:58:40.978123+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VBMX8Byj-hnURcMU85xs_ZQB-1Iwqlv_0 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13496583974020418300', time=2024-09-22T10:58:41.206195+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pBI536oQe6jWiVRtHxdZHKMiEjhSs5z_0 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11091935389162054687', time=2024-09-22T10:58:41.597835+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1T1hAVwr9oBmfGVJuQ4DUKOKy7FJldz_0 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2305455785890778742', time=2024-09-22T10:58:41.618601+0000, chain.objs.size()=1 2024-09-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.524+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._6ATOeISaf-HTYEiBBzf_f37bT2I5QN_0 2024-09-22T09:16:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12811608761895304345', time=2024-09-22T10:58:42.115993+0000, chain.objs.size()=1 2024-09-22T09:16:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Wbyl8WjHs2nYID9LUfQSHNKRWoQI571_0 2024-09-22T09:16:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14802539859732552881', time=2024-09-22T10:58:43.906422+0000, chain.objs.size()=1 2024-09-22T09:16:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3rIBZklU6wLEomrMLCwT781j0BB70Fz_0 2024-09-22T09:16:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10901773669982141255', time=2024-09-22T10:58:44.792071+0000, chain.objs.size()=1 2024-09-22T09:16:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.sVWYo2NelrSaHoAnszlErTPFOFMkPLV_0 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8310200203181853755', time=2024-09-22T10:58:44.851283+0000, chain.objs.size()=1 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.527+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mCTdHgI8ZDoyxoRLaIsIrN4YwDOPs5l_0 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.528+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12134979728676261856', time=2024-09-22T10:58:45.031816+0000, chain.objs.size()=1 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.528+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_._uEBY1KAc-1n9Pgm-uES3NgOF8CL8wF_0 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.528+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.258767752946088310', time=2024-09-22T10:59:22.526902+0000, chain.objs.size()=1 2024-09-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.528+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0FHLO8lHwybipfI40v3xNH-TVJY4jOl_0 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11047789982562188283', time=2024-09-22T10:59:22.789186+0000, chain.objs.size()=1 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9EmgwFYsAS_dNFrAY5r8a4TAKRGYHDU_0 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13328950537476564511', time=2024-09-22T10:59:22.857325+0000, chain.objs.size()=1 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nL4OWbHZh3OWO5w70cnQmpfVERQkms8_0 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14920701936080248789', time=2024-09-22T10:59:23.848887+0000, chain.objs.size()=1 2024-09-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._T62HvS3GywZzFgrPYcNeZVaz8MlmLY_0 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15761598950508024445', time=2024-09-22T10:59:24.098513+0000, chain.objs.size()=1 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.KScyvIDmjuQzjgaSU89ycb14yB-Q8fK_0 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8821192333175814650', time=2024-09-22T10:59:24.278275+0000, chain.objs.size()=1 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-q54FgNOQLseRtvQi6ks6tIR5ZRJpBv_0 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16195826593729355250', time=2024-09-22T10:59:25.288224+0000, chain.objs.size()=1 2024-09-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.530+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RQ_t4UtnmQ3md-9TOeSH8FpCQzTR7pM_0 2024-09-22T09:16:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15695955084376882701', time=2024-09-22T10:59:25.413868+0000, chain.objs.size()=1 2024-09-22T09:16:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Q9zF5PzXbjZLkqy_aSPZitwichbj3HF_0 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8935983031382123756', time=2024-09-22T10:59:25.466734+0000, chain.objs.size()=1 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.z4ii8r9NewJMU8wiK7ocd_JgC4DSnsQ_0 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13995193760284172083', time=2024-09-22T10:59:26.732658+0000, chain.objs.size()=1 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DSEMhHF6F1FZHSRGM16fgVXfD63fKti_0 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1132822917405357424', time=2024-09-22T10:59:27.780937+0000, chain.objs.size()=1 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.533+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dtRwI6fKf5IeaqJ-XXSLMDHdGJ2NRys_0 2024-09-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8034273129187586316', time=2024-09-22T10:59:28.403134+0000, chain.objs.size()=1 2024-09-22T09:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8PcMYvMfd6ZptgYpV41w0VUfjcF9TDZ_0 2024-09-22T09:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.534+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18051713079061631365', time=2024-09-22T10:59:28.809479+0000, chain.objs.size()=1 2024-09-22T09:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.534+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x2WZ3DLBN62DD5Njo0jwP5k9Bgu5o9v_0 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17156001701835293178', time=2024-09-22T10:59:29.529430+0000, chain.objs.size()=1 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Mi_DKJRc9Z7jCuKeZGQPPBZypRQWdhV_0 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16002198815260599505', time=2024-09-22T10:59:29.530117+0000, chain.objs.size()=1 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BVagdLvdjXV2lvsM522G5axWvRuNwHY_0 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8455729449774124053', time=2024-09-22T10:59:29.662880+0000, chain.objs.size()=1 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.erRiF4h2pZIDnxQNI7cbXg0n8yfmKuc_0 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9044774530305091367', time=2024-09-22T10:59:30.489482+0000, chain.objs.size()=1 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EUVWz367mGLO80afb1T7SS_4UTbkUQS_0 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15105611940754530954', time=2024-09-22T10:59:32.167678+0000, chain.objs.size()=1 2024-09-22T09:16:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.536+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Y2mV25KLU48f7UGYKIIiFnyrPywJHNr_0 2024-09-22T09:16:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.537+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2013968550683247637', time=2024-09-22T10:59:35.995439+0000, chain.objs.size()=1 2024-09-22T09:16:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.537+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.331__shadow_.vyBFUV9du5YszD7Ur349sLskocHTe8X_0 2024-09-22T09:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8490261766018088970', time=2024-09-22T11:00:48.033660+0000, chain.objs.size()=1 2024-09-22T09:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.462__shadow_.A6QGc0ax5D827hlfrG46h2rYNbDqSt3_0 2024-09-22T09:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8927153177391490847', time=2024-09-22T11:00:51.235767+0000, chain.objs.size()=1 2024-09-22T09:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.466__shadow_.bbsWxzN0DL6CWDB3hxHmLhbloyjrL8w_0 2024-09-22T09:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14722313986632066206', time=2024-09-22T11:01:23.399186+0000, chain.objs.size()=6 2024-09-22T09:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.1 2024-09-22T09:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.2 2024-09-22T09:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.539+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.3 2024-09-22T09:16:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.4 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.5 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.508__multipart_srcmultipart.2~C0zNFGK_l82xezf9j7PB-_XuCqiZUL8.6 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3060350404404181445', time=2024-09-22T11:01:34.993199+0000, chain.objs.size()=1 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.518__shadow_.2MPR3JO1xGZUcPafOb4cpAS586bQB2T_0 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15893198819813634224', time=2024-09-22T11:02:30.119336+0000, chain.objs.size()=6 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.541+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.1 2024-09-22T09:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.542+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.2 2024-09-22T09:16:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.kCHYfQaAEHULtJcZzEIAeJrNSDK0lmux.3 2024-09-22T09:16:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.4 2024-09-22T09:16:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.5 2024-09-22T09:16:03.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~ZXk2DcuWctfnHmi4joCo-n-YFmMFIbT.6 2024-09-22T09:16:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6951981466532048047', time=2024-09-22T11:03:00.282306+0000, chain.objs.size()=1 2024-09-22T09:16:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.544+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~UacQ2hzfPSB5BZd6zSsek_5HenH3wWb.1 2024-09-22T09:16:03.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.548+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5580408964322036646', time=2024-09-22T11:03:07.359823+0000, chain.objs.size()=2 2024-09-22T09:16:03.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.548+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~Vq9BpJ9qzDUg8mw68VGTeMWNR1uCQGA.1 2024-09-22T09:16:03.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.548+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.526__multipart_mymultipart.2~Vq9BpJ9qzDUg8mw68VGTeMWNR1uCQGA.2 2024-09-22T09:16:03.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.552+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18276599691588632489', time=2024-09-22T11:04:29.417156+0000, chain.objs.size()=1 2024-09-22T09:16:03.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.552+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:DKXi3qiRQiPxJaMMwIcaUamv3XyuNPH_.SW31xCeCKAhY55mTE7ONFV1qH0aCSMN_0 2024-09-22T09:16:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.555+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/53474 2024-09-22T09:16:03.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-22T09:16:03.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11382517757873643394', time=2024-09-22T11:04:31.618022+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:.n.jSBe7yfgRK1t6sia9suI5vAw2YJz_.ckw-vjUb746r_-VpiGBBImCCdTnebCT_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14609145735755601701', time=2024-09-22T11:04:39.522131+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:L4aPuxvwo-QXONVfcp61uIPINikFH7j_.rNPjTElrsPm3pGs5y75o4MliowfTzmT_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12826315351808445971', time=2024-09-22T11:04:57.858864+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:NsZxbvBGljPHBZ403lj6DFwDZzKqCUR_.7Y9QaHVM6cms7Mo2gRzUiKQz0sNx4UJ_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2453270303680245250', time=2024-09-22T11:05:04.995214+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:0P99zkaY0Bs-tHQS.dvWkyPk61M0--7_.TVJRjIoM6U8k7UqkQhMFGa2hIzShH1q_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14397554339336422066', time=2024-09-22T11:11:12.897002+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.735__shadow_.RXlJO0WUPm734rsddDKRCpaR75Cds1p_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7864835242502978917', time=2024-09-22T11:11:28.999318+0000, chain.objs.size()=1 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.745__shadow_.V-fhs7fuONeBwpjWcmS-KZI2vnnZi7h_0 2024-09-22T09:16:03.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2503180814834072525', time=2024-09-22T11:13:00.153463+0000, chain.objs.size()=1 2024-09-22T09:16:03.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.557+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.770__shadow_.-gq6CVlq1IjyEpdLLqR0s9VGMND8rpV_0 2024-09-22T09:16:03.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.560+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.563+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.564+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.565+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/148291' 2024-09-22T09:16:03.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17286478726906496506', time=2024-09-22T10:54:16.189111+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.163__shadow_.bv05xcelSmzfDoz3Z7DMNTRWrCgpRX3_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16267851647934449929', time=2024-09-22T10:56:13.500082+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.237__shadow_.wFmeUPAohyICsVzkAYBbZgQt-DBOVAR_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9084445123638241926', time=2024-09-22T10:56:28.455375+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.260__shadow_.Bu4s2hOMbSlbv0ziRZy-vKKee7KhSwC_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6418577079056502193', time=2024-09-22T10:57:06.086427+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8eLI8G_rDSX-cA-lqJkNQKp2OlIjl4U_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13286038760364507534', time=2024-09-22T10:57:06.164246+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dOLlMNJUpB76qAO6qcjQLvppc5cWNyi_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11453272670788226740', time=2024-09-22T10:57:06.493172+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.QVwr0FeI3b_RhdUa_Qmlm_ReqHj85H__0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1459786503613541305', time=2024-09-22T10:57:06.945731+0000, chain.objs.size()=1 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KMWgbldnocHwLbYo5cIgf1llrgpf0E4_0 2024-09-22T09:16:03.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17092115648577584049', time=2024-09-22T10:57:07.546774+0000, chain.objs.size()=1 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3Hr1GMcOwBNra-JBIgisjVl5rM00JnZ_0 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12645311006208286996', time=2024-09-22T10:57:07.752762+0000, chain.objs.size()=1 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZAsmXCfUq5Yj9H2MSNHP8DRtcH9FxQt_0 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1643893733963433498', time=2024-09-22T10:57:08.526853+0000, chain.objs.size()=1 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.X_HvMySaOOxLIF58qi05lQA78os1fwS_0 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2859109431883989000', time=2024-09-22T10:57:08.993623+0000, chain.objs.size()=1 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J3AI2AjGZ-7fvDBnkN4GFgTnGzukro7_0 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4507269312937588080', time=2024-09-22T10:57:09.296292+0000, chain.objs.size()=1 2024-09-22T09:16:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.566+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yIeyAcTtAc-7P24FmiuHtaqp6ljj103_0 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5207533787683821564', time=2024-09-22T10:57:09.357251+0000, chain.objs.size()=1 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ldTxsmXbc4FAk1saB_sv4PclM0uZ5Fy_0 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11113477951910133288', time=2024-09-22T10:57:09.423213+0000, chain.objs.size()=1 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6pcuZMPR4tGaFi83yVu2clqNmaHKn8A_0 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6230806036838519570', time=2024-09-22T10:57:09.524823+0000, chain.objs.size()=1 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Di_ncdeIZHyuq59Vu0oL0-7kpcWNKRT_0 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.569+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11071093467764321831', time=2024-09-22T10:57:10.022990+0000, chain.objs.size()=1 2024-09-22T09:16:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u9g43ZxuZUUfnoZmy3ylWdOF-VsqDlA_0 2024-09-22T09:16:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.570+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3680038119508360806', time=2024-09-22T10:57:10.428918+0000, chain.objs.size()=1 2024-09-22T09:16:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.570+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mwh6qRNTGlHMZjt4uriHJRkF_UKsRva_0 2024-09-22T09:16:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9021144835489112601', time=2024-09-22T10:57:10.507220+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nYY6DdLgGLtQ-YyF1heyiX0HzteFdcI_0 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7990068196022663205', time=2024-09-22T10:57:10.592039+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kRb6d6EZee253p8DbEuga7ZgIbRLBux_0 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14955951762290617766', time=2024-09-22T10:57:10.674611+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.RdoqJlPu7f7_IJhxd2fX0OS3Xs1_4n6_0 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16290698544475235723', time=2024-09-22T10:57:10.772749+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Z7wHX1D6OFoPGzAJTo20rwum9v04k1W_0 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10724882240872324953', time=2024-09-22T10:57:10.786547+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pr-5XCD_Tc8USVd9LyHCXnZPCA0CV7r_0 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11558638919373443591', time=2024-09-22T10:57:10.865751+0000, chain.objs.size()=1 2024-09-22T09:16:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.571+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jeCzfHUMxmS7m1du4M3LFHZVJnmyWWs_0 2024-09-22T09:16:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.572+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5475724845633243874', time=2024-09-22T10:57:10.912536+0000, chain.objs.size()=1 2024-09-22T09:16:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.572+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.m5n1uLinro5Jt1UBU9dNbvtsI_Kzm54_0 2024-09-22T09:16:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6939825445727065345', time=2024-09-22T10:57:11.394850+0000, chain.objs.size()=1 2024-09-22T09:16:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9FfltLBU_8ac9bilPH4FJyCJkMfoSFf_0 2024-09-22T09:16:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8238962381840370687', time=2024-09-22T10:57:11.885477+0000, chain.objs.size()=1 2024-09-22T09:16:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.opEUvKjkKjd9MXpHMsYVCyT1L19jXaJ_0 2024-09-22T09:16:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5266969307314970078', time=2024-09-22T10:57:12.029304+0000, chain.objs.size()=1 2024-09-22T09:16:03.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ctiGGx3zdSBvr2j7kFIAr0kNHviyKCv_0 2024-09-22T09:16:03.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.574+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16351576877318319488', time=2024-09-22T10:57:12.034173+0000, chain.objs.size()=1 2024-09-22T09:16:03.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.575+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jk1tcp_s7OWiXJwDJND_ACO1xC6hdDj_0 2024-09-22T09:16:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5208592445277205104', time=2024-09-22T10:57:12.274817+0000, chain.objs.size()=1 2024-09-22T09:16:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zouqAxxrFHXk6-8fp0rq0pC7Lqc8cw3_0 2024-09-22T09:16:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6054146157670047087', time=2024-09-22T10:57:12.408033+0000, chain.objs.size()=1 2024-09-22T09:16:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.31L5NUxJOxr8dT9U7vWDT0TTYbYE1gu_0 2024-09-22T09:16:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10288382202866497320', time=2024-09-22T10:57:12.701562+0000, chain.objs.size()=1 2024-09-22T09:16:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.csFB3I_MHqXaHiyyYIhkahhBdL_DWAD_0 2024-09-22T09:16:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10259393062037162089', time=2024-09-22T10:57:12.775403+0000, chain.objs.size()=1 2024-09-22T09:16:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.576+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uh_Vv22sKemoTfTYo1His1WkCGO13Bf_0 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6045157637755944726', time=2024-09-22T10:57:12.792080+0000, chain.objs.size()=1 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LsmNlCm9H0AqRqqVYRScd9MLTbizset_0 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6789463859255144691', time=2024-09-22T10:57:12.865234+0000, chain.objs.size()=1 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.YXbDcgFcLk86DQxm4Fn99IGyPdsJvvp_0 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8993001453353251396', time=2024-09-22T10:57:13.256625+0000, chain.objs.size()=1 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5i-aVO1cxdHoDTwCJ0C8Aigel8WhHDQ_0 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9738965167242222082', time=2024-09-22T10:57:14.112994+0000, chain.objs.size()=1 2024-09-22T09:16:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.577+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xE7188T8zVrGhjE3-zbcv2BsjpL9i89_0 2024-09-22T09:16:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.579+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6627119394202298072', time=2024-09-22T10:57:14.138282+0000, chain.objs.size()=1 2024-09-22T09:16:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.579+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zocXXiY372gD1Ag0VY8-jOEPye1suek_0 2024-09-22T09:16:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.579+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9181284141849178981', time=2024-09-22T10:57:14.383993+0000, chain.objs.size()=1 2024-09-22T09:16:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.579+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TAmg0D3AN8QpIo2zvhZJWWYN99iPbpX_0 2024-09-22T09:16:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.580+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5298353413664640759', time=2024-09-22T10:57:15.078733+0000, chain.objs.size()=1 2024-09-22T09:16:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.580+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rsONr-js7SjWnUgUd0KxsY6Gewkqcil_0 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.528301791106386807', time=2024-09-22T10:57:15.079459+0000, chain.objs.size()=1 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Y-h4TWFqWBkt5EFrCcWeVi0hKuNmMjT_0 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14818338717768684756', time=2024-09-22T10:57:15.403797+0000, chain.objs.size()=1 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.F9PlOKVhOxg8wdu5-cmrFcahTHeR4u5_0 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15158399301497877320', time=2024-09-22T10:57:15.484314+0000, chain.objs.size()=1 2024-09-22T09:16:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.nBXWm2Ye5nWRVAQffS165B-87_XW9TK_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17842971626198811990', time=2024-09-22T10:57:15.596745+0000, chain.objs.size()=1 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.cioz0v9Wf8AUv3xVn4S2YtPUyRpMb6x_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17425232459244116750', time=2024-09-22T10:57:16.260842+0000, chain.objs.size()=1 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.msj17PwxBzhP_nc58v9A-KwbEyfKcah_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14949739488012295999', time=2024-09-22T10:57:16.527989+0000, chain.objs.size()=1 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.F3zRqoBMPCsV2EQE9mqA3uqz7zJvZ5b_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.110154508870568929', time=2024-09-22T10:57:16.553018+0000, chain.objs.size()=1 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qTZ8YrvBfI7EE0ON3jZPqPJFyQDuemK_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3257134235438885782', time=2024-09-22T10:57:16.633581+0000, chain.objs.size()=1 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.582+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.FiU9JgPHmfxEi9aaoV1XX0cXKRWQESQ_0 2024-09-22T09:16:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10966509403269151588', time=2024-09-22T10:57:17.583779+0000, chain.objs.size()=1 2024-09-22T09:16:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.264__shadow_.hQCnuh9Mf5I74jV99IyhoKyeAO3eMhW_0 2024-09-22T09:16:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.583+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7626127250487098644', time=2024-09-22T10:57:18.748156+0000, chain.objs.size()=1 2024-09-22T09:16:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.583+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.266__shadow_.IIrrWCQOE69IEKJ7sSXD2xhnbdYANhD_0 2024-09-22T09:16:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.273696871151187508', time=2024-09-22T10:57:18.749982+0000, chain.objs.size()=1 2024-09-22T09:16:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.266__shadow_.Lh7mcX3atCRV7d6KWsvJr_A8f90idgw_0 2024-09-22T09:16:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.586+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2873398573479056056', time=2024-09-22T10:57:22.791412+0000, chain.objs.size()=1 2024-09-22T09:16:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.586+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.273__shadow_.HJd_lmKSia7uByBFO-ZyExBNG9zTzGH_0 2024-09-22T09:16:03.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5140752386267674396', time=2024-09-22T10:57:32.652010+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.289__shadow_.44ZNEc7nTqSJ8DtLzLbKxXk_-VVeyvY_0 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3445341727058951119', time=2024-09-22T10:57:36.359232+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.JsdTm_PM5husiP5tUqt30Bta1rcHadx_0 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16583220146898509679', time=2024-09-22T10:57:44.802894+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.304__shadow_.vYOHCrdf9FZhvWVY0Xag_WuhNmPKg0p_0 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17587274006473048195', time=2024-09-22T10:58:34.749199+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Y34M4DQUZlLQorUCUK7uHKtwriSwXNE_0 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.222517528682125230', time=2024-09-22T10:58:35.259234+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.tZuyKqPuULzETc-AH14GzQezh8esGl3_0 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14226472248994897529', time=2024-09-22T10:58:35.422905+0000, chain.objs.size()=1 2024-09-22T09:16:03.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.587+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OjpNRQXqeyaH5pseZ90wf7S9v0ZapuE_0 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1501528880828854438', time=2024-09-22T10:58:35.971443+0000, chain.objs.size()=1 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fH2AvjUH7ywjS58nT0BYa_2rEx9GTRn_0 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.428983934597405128', time=2024-09-22T10:58:36.444017+0000, chain.objs.size()=1 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Dles1y5ANnJJFNXTHyifDGf_awHESjc_0 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5573404195803993418', time=2024-09-22T10:58:36.758338+0000, chain.objs.size()=1 2024-09-22T09:16:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.588+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.5K3af3PaCZbo8qCzQkOfX3oOs4bbe9T_0 2024-09-22T09:16:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.590+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2623071972646606749', time=2024-09-22T10:58:37.820226+0000, chain.objs.size()=1 2024-09-22T09:16:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.590+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bzQbTigyMNIsoLsu3Fx-M6q-baNqbk9_0 2024-09-22T09:16:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14051900232044479231', time=2024-09-22T10:58:38.016248+0000, chain.objs.size()=1 2024-09-22T09:16:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.N0ZYJmDEmXQx9TA8e7XJh3p1f4u2hqu_0 2024-09-22T09:16:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.591+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13989276037168017408', time=2024-09-22T10:58:38.240792+0000, chain.objs.size()=1 2024-09-22T09:16:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.591+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.o3a7d9v_jC3FcISpLUmY5Ogvwpu_dxY_0 2024-09-22T09:16:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5793202832144919519', time=2024-09-22T10:58:39.201449+0000, chain.objs.size()=1 2024-09-22T09:16:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.q4s2aEnNpXn5E4_6f8817pqlumQcS8S_0 2024-09-22T09:16:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.593+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17536770737949149342', time=2024-09-22T10:58:40.964987+0000, chain.objs.size()=1 2024-09-22T09:16:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.593+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.YHB1wmiDzFBOcI9uRo3myL9kxKAMY1B_0 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2738828777619276454', time=2024-09-22T10:58:41.075458+0000, chain.objs.size()=1 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VfxHxsZYhc8Ar0Pvx7ENMuwy46A6g2k_0 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14845406414780087390', time=2024-09-22T10:58:41.615551+0000, chain.objs.size()=1 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.S4kcG-rNkkmuy0rRilcaNe2QqCBxqAm_0 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14192419012184524635', time=2024-09-22T10:58:41.758904+0000, chain.objs.size()=1 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I2vtQHTkwrJPYEdZcW2ri0i3bHv2aVB_0 2024-09-22T09:16:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.233423912530921843', time=2024-09-22T10:58:41.767669+0000, chain.objs.size()=1 2024-09-22T09:16:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.re6wquR2hMrwQpnGyIDPK5T2tHrlhMd_0 2024-09-22T09:16:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5899425156015786608', time=2024-09-22T10:58:41.810973+0000, chain.objs.size()=1 2024-09-22T09:16:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.yXNd-TlMJ8NTJxuBVOhsEJQ87pADUAo_0 2024-09-22T09:16:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4353473611246046682', time=2024-09-22T10:58:41.831893+0000, chain.objs.size()=1 2024-09-22T09:16:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.595+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CEJv5W43Rgkx_FuxjrDUo5bivccufLf_0 2024-09-22T09:16:03.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5782109463284179743', time=2024-09-22T10:58:42.001897+0000, chain.objs.size()=1 2024-09-22T09:16:03.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7RH2R36ePYwy0keDAxQsHkx-waer91l_0 2024-09-22T09:16:03.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5388129429587750585', time=2024-09-22T10:58:42.341298+0000, chain.objs.size()=1 2024-09-22T09:16:03.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.7jczvwyLHsBgphJAFp5-QNslAyis02u_0 2024-09-22T09:16:03.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16569034658707807574', time=2024-09-22T10:58:42.373475+0000, chain.objs.size()=1 2024-09-22T09:16:03.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.597+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DV7llgF1NJzJJYKKXoa6FLZMeIBSYh9_0 2024-09-22T09:16:03.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.599+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1894153996359389182', time=2024-09-22T10:58:42.421828+0000, chain.objs.size()=1 2024-09-22T09:16:03.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.599+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hhwwuB7uJ1gUKhhUs_aEUS28uHMSbuz_0 2024-09-22T09:16:03.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.600+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9339269874624846636', time=2024-09-22T10:58:43.130965+0000, chain.objs.size()=1 2024-09-22T09:16:03.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.600+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kdW2YiijnVNKDgZt0--Iw6IxaXTPkLH_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10480744551660752420', time=2024-09-22T10:58:43.487887+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1FYqeZiknb0x4eoWv0TGcArKJZDMtFv_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5032982023810175509', time=2024-09-22T10:58:43.490154+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.rBqkG1uy6oDB4IOF1TAXm4TbIw7LOaq_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3821121380880013137', time=2024-09-22T10:58:43.929532+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LPjOr_dNitr3YCNk5FHvDDFxd4DtlcT_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5422809762300455333', time=2024-09-22T10:58:44.288120+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GGNPwFH5mGAvox2UpIlqyzJE3mKxXr5_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5186412162942070464', time=2024-09-22T10:58:44.289150+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uwLxVvt-h8ggnd46FmPW9lcFx5lII70_0 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1614546095850959000', time=2024-09-22T10:58:44.832748+0000, chain.objs.size()=1 2024-09-22T09:16:03.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.8ptbTpGGUWBcitppI9fuSPtrV9Fypxr_0 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5476624332640551507', time=2024-09-22T10:58:44.968737+0000, chain.objs.size()=1 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.oqP7oXYph62h_WZVih0qAqOqML-O5Gh_0 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.735698966668056383', time=2024-09-22T10:58:45.083257+0000, chain.objs.size()=1 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CWJppzbVCS7LpFJAtPUmNQjYVRYC6t3_0 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1274893105560262189', time=2024-09-22T10:59:22.497370+0000, chain.objs.size()=1 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2CSSQk_TAVjwHsZ6odKy7iIZI2DsQiY_0 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5816171096821323867', time=2024-09-22T10:59:22.732149+0000, chain.objs.size()=1 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.602+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ucSKgExuK4gJlcFZxfaY5B2tSYYo_PK_0 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.604+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6519840796463567079', time=2024-09-22T10:59:24.349484+0000, chain.objs.size()=1 2024-09-22T09:16:03.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.604+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AwdVNe_0E8gLxll5CTKJeHqHAJYOsF-_0 2024-09-22T09:16:03.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.606+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15923111561932847019', time=2024-09-22T10:59:24.582149+0000, chain.objs.size()=1 2024-09-22T09:16:03.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.606+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HoD1eizDPvfyfEKWCxkHqqhTDlUVYno_0 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11293428879818030849', time=2024-09-22T10:59:25.724937+0000, chain.objs.size()=1 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.z_j_BoeqW99Gc8lWZx2RZhAsKaGTG2R_0 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18049363878923432992', time=2024-09-22T10:59:27.523615+0000, chain.objs.size()=1 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.4P21T2_RC6Nu3LiigNChF3F_s8xVww9_0 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6223763203874963723', time=2024-09-22T10:59:28.157151+0000, chain.objs.size()=1 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.49JHlY0CKn923OrbJBYZGtE8mC1fmlB_0 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7763532483537678491', time=2024-09-22T10:59:28.316178+0000, chain.objs.size()=1 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.608+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.COzOG1iJ-QT_Frh1yQCE55B_CIKudMH_0 2024-09-22T09:16:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1446133836055267548', time=2024-09-22T10:59:28.566001+0000, chain.objs.size()=1 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DVtufeDqaWrrRxC_Dw1jsmthYAH8mcF_0 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12928925098877030304', time=2024-09-22T10:59:28.678199+0000, chain.objs.size()=1 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6jHnv9nQBGcR5NtL3j3C5RHnxgGQLaJ_0 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10145520991509681399', time=2024-09-22T10:59:28.796436+0000, chain.objs.size()=1 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.SbvmKhCR4CvnaUHlZuRw1W6ZLvaVEGE_0 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18294454854323644908', time=2024-09-22T10:59:28.845207+0000, chain.objs.size()=1 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XCUs2t3Slfajfnm-NtztelSKg4bmc-F_0 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13961812566560595527', time=2024-09-22T10:59:28.998528+0000, chain.objs.size()=1 2024-09-22T09:16:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.609+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AU3m1Y0t6B8drL6bjj8YZC2KIQprOor_0 2024-09-22T09:16:03.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13813161535067105157', time=2024-09-22T10:59:28.999913+0000, chain.objs.size()=1 2024-09-22T09:16:03.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5harWiFNhT_-7gODfJqHG6r0i0aj1Yg_0 2024-09-22T09:16:03.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.611+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18429069986065504599', time=2024-09-22T10:59:29.146739+0000, chain.objs.size()=1 2024-09-22T09:16:03.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.611+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.htYxNxkqEd25ztywTNrfmGCbcM84wMO_0 2024-09-22T09:16:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.613+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15478751884871113665', time=2024-09-22T10:59:29.664439+0000, chain.objs.size()=1 2024-09-22T09:16:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.613+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AQbAVUk_1BHmExliyy_xIH5EMmyzicW_0 2024-09-22T09:16:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.615+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/148291 2024-09-22T09:16:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11670547873836701219', time=2024-09-22T10:59:30.123833+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._Y999k7fjgPCIXiBY1_vcyvU6hYwY2U_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10171566628630420519', time=2024-09-22T10:59:30.904473+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8rW_yrQcSR1BcDxk0JVyu3krcQbG1ba_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13554482722999795101', time=2024-09-22T10:59:31.048094+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.55lVxlf8Ij965XCE1EcnMJhoHPZuNgD_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4327934331109653591', time=2024-09-22T10:59:31.076950+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.icIF0dbp7TjJ7ghTGR1jyq0gLrICn63_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14125873462153128645', time=2024-09-22T10:59:31.644555+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ytETY1yz387kec4-CndOGbhhZR7m2gP_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7099525611866964596', time=2024-09-22T10:59:32.162866+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.gkkHHe2Qe4aLS76VNp2JnZd9lxHcvWd_0 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6792830083395444293', time=2024-09-22T10:59:32.349858+0000, chain.objs.size()=1 2024-09-22T09:16:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jUmSNt7HBnjlWMTfizdbCme8Sp0mQ_p_0 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4417437723997755520', time=2024-09-22T10:59:32.524726+0000, chain.objs.size()=1 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7VbZSt-bwNreoxH2MZMKnHCCvk60uj2_0 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.455670396590855325', time=2024-09-22T10:59:35.431515+0000, chain.objs.size()=1 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.330__shadow_.J5mqEbbXlnzqnoYFr9rjaiC7QjjfAn-_0 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12171139936163702923', time=2024-09-22T11:00:59.842559+0000, chain.objs.size()=1 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.xG83zmLK-h1CRejzsJhC4Yzfuuk3peK_0 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.375376720458566081', time=2024-09-22T11:01:00.957402+0000, chain.objs.size()=1 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.486__shadow_.p4_1LcnSc6LKOHIkV8OkaoV62s2cLrv_0 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9382188203760785716', time=2024-09-22T11:01:10.541401+0000, chain.objs.size()=1 2024-09-22T09:16:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.618+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.498__shadow_.wQkTFEo4Srx67QCYyUW774QW3hQn9GX_0 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10767629588169679820', time=2024-09-22T11:01:11.963587+0000, chain.objs.size()=1 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.501__shadow_.wtgoFKkHImqLfEjFl68R2X5xz8cWp_G_0 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11354627971918793312', time=2024-09-22T11:01:55.786866+0000, chain.objs.size()=3 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~nmNLDwQUOm1CJS8HyuqmTMT5s-5AgBc.1 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~nmNLDwQUOm1CJS8HyuqmTMT5s-5AgBc.2 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.522__multipart_mymultipart.2~nmNLDwQUOm1CJS8HyuqmTMT5s-5AgBc.3 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1193291434146959775', time=2024-09-22T11:02:56.371025+0000, chain.objs.size()=3 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~DJzCpAUvEOm9T2pDOASmOPBOr4qg66m.1 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~DJzCpAUvEOm9T2pDOASmOPBOr4qg66m.2 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~DJzCpAUvEOm9T2pDOASmOPBOr4qg66m.3 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13311591790946301184', time=2024-09-22T11:03:11.594286+0000, chain.objs.size()=4 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.528__multipart_mymultipart.2~tt6Z9WSOiaIuCsVxB95XVrrngSXWW3E.1 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.528__multipart_mymultipart.2~tt6Z9WSOiaIuCsVxB95XVrrngSXWW3E.2 2024-09-22T09:16:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.528__multipart_mymultipart.2~tt6Z9WSOiaIuCsVxB95XVrrngSXWW3E.3 2024-09-22T09:16:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.622+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.528__multipart_mymultipart.2~tt6Z9WSOiaIuCsVxB95XVrrngSXWW3E.4 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~6Ok-tNsSus8QR6-IcRA4_6fByTojyq1', time=2024-09-22T11:03:20.662784+0000, chain.objs.size()=1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.534__multipart_mymultipart.2~6Ok-tNsSus8QR6-IcRA4_6fByTojyq1.1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17454908310588342309', time=2024-09-22T11:04:32.179889+0000, chain.objs.size()=1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:g5Xh14rJwbnKUSVb9F-engeBKJfrsdS_.BqInEFdXeyXYIUUossw8UtojxbiluAa_0 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5110060919681644776', time=2024-09-22T11:05:29.477153+0000, chain.objs.size()=1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:xJsWoNKvRSscSPt2MURJlk9OE5FNX8W_.hdYYpqFgMsduO0qVWeL7GzjTQ1YGMZQ_0 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2692509825680781618', time=2024-09-22T11:05:32.239607+0000, chain.objs.size()=1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.583__shadow:vjZDU5CcsMrKlKWLRdEY3cONz5tXeIt_.hWsMzhiDgBrHv4swUrtJVnMigdHssK8_0 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8568292376107866024', time=2024-09-22T11:05:32.256075+0000, chain.objs.size()=1 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.629+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.583__shadow:KzIhiQoVCwHwfoIRzec8gKJZ8110-Wp_.QSW81Q7BU9CFeLR5aO6dcw34EYYMfWL_0 2024-09-22T09:16:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14980417957925584063', time=2024-09-22T11:09:29.900461+0000, chain.objs.size()=1 2024-09-22T09:16:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.632__shadow_.XtRCRz1W__ODuKBIWDVRJ2-Bs9eCv6w_0 2024-09-22T09:16:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.630+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17858269264071681412', time=2024-09-22T11:10:38.245565+0000, chain.objs.size()=1 2024-09-22T09:16:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.630+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.707__shadow_.4nv39nLljOrgRIwYYyK7ROKo12j702z_0 2024-09-22T09:16:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.634+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.636+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.638+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45093' 2024-09-22T09:16:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11245068189676211362', time=2024-09-22T10:56:22.424762+0000, chain.objs.size()=1 2024-09-22T09:16:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.250__shadow_.P6hhcE4CX3ZkC4k2S2fOuO5OdTLVL3__0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17618822710142456320', time=2024-09-22T10:56:25.564572+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.255__shadow_.4dDile-UhXVTxFscfn4wjNCjq3o-GXA_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7362428750600618512', time=2024-09-22T10:56:26.163924+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.256__shadow_.o5rgr2j289578mHqykm1PqcC0D4nA4S_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5189348554129166239', time=2024-09-22T10:57:05.923172+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.OXs3iq4xZWT3HGtaIpEK6ovLsECh6fj_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18060531594249872434', time=2024-09-22T10:57:05.928954+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tWTQ17-f_7owS3qirVd4v_Cgc9DbvD-_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3211915259002490206', time=2024-09-22T10:57:06.268213+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.l2Kytaqr86HsYSjj1nBgPJN5_wejTNq_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8602754937242116595', time=2024-09-22T10:57:06.543719+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UZ4qUcJjzybFR861uwwTaQLQx3c_5Lg_0 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5440687091535143618', time=2024-09-22T10:57:07.021407+0000, chain.objs.size()=1 2024-09-22T09:16:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1-CIElwxnbjUJUt4_oDMWZPtNs6R1y1_0 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12825388939440475430', time=2024-09-22T10:57:07.802642+0000, chain.objs.size()=1 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0DPr_pWnEE7MQ2LqOpXDYZvEZoTBmrU_0 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5110931303762796547', time=2024-09-22T10:57:08.182581+0000, chain.objs.size()=1 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EF2tZK66xseREdXnFnM2rP3DqLFKru3_0 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15871633345383239372', time=2024-09-22T10:57:09.032621+0000, chain.objs.size()=1 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2KB4PPgXdRmaiM_ysPLxzdfjcXAdAwh_0 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5566426947504272191', time=2024-09-22T10:57:09.486526+0000, chain.objs.size()=1 2024-09-22T09:16:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.639+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9BqwfjnaVyuxIZsJVzh6TR157TBndnK_0 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17580701514763724308', time=2024-09-22T10:57:09.784347+0000, chain.objs.size()=1 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qUiEbM6dvKvNT9r6HrfRM51sGGMGpxg_0 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4213839998580288307', time=2024-09-22T10:57:11.195333+0000, chain.objs.size()=1 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fqlLUj-LQcdCeIUQR_5T7GXvqb8atUA_0 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.136481494320673291', time=2024-09-22T10:57:11.393135+0000, chain.objs.size()=1 2024-09-22T09:16:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g2cKFIcPjcMKRLWnt0TPWXZ_5ntaecX_0 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8180539870385476292', time=2024-09-22T10:57:11.430695+0000, chain.objs.size()=1 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dt2h2u-N8Syp2_Z84wbmjb1B5AOXCx8_0 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14936478765056733790', time=2024-09-22T10:57:11.446556+0000, chain.objs.size()=1 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8Z1saIQFRfKQ3fJbl_Gxsy0twABsuhT_0 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17478353474985362079', time=2024-09-22T10:57:11.992650+0000, chain.objs.size()=1 2024-09-22T09:16:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.643+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.e9bFxpeHE7y-WgTasU-6lMMcy8HbhMZ_0 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11142686288110706229', time=2024-09-22T10:57:12.480548+0000, chain.objs.size()=1 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.T3xPjDvavC0x6AFsUuP_KKu0qhlPIHT_0 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1223421106024449171', time=2024-09-22T10:57:12.543195+0000, chain.objs.size()=1 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SwGau58q2Knl1gP7qpP1KBPH3oiCt7J_0 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17158638883931756110', time=2024-09-22T10:57:12.775412+0000, chain.objs.size()=1 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3ztN7ezPOeth5PeA8Xo05KpdyFKwRkk_0 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11836530462357219482', time=2024-09-22T10:57:12.885647+0000, chain.objs.size()=1 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.645+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lBgLO2GfU2X94_orBTGmeg2SSCuL1PO_0 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.646+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14076172663008555438', time=2024-09-22T10:57:13.545611+0000, chain.objs.size()=1 2024-09-22T09:16:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.646+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.edCbkV0iP9Q3e4dakcIbPLo38K5PAP3_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12293342014918860795', time=2024-09-22T10:57:14.058220+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4kvXGd3K52ceyf9bevUooN9m9ELPxMg_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13251498352338835713', time=2024-09-22T10:57:14.194979+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.J2E3RY5tWCYWEfUupYPY9OQmE4f06Js_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5631155636989796684', time=2024-09-22T10:57:14.808582+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.jXY1pcJ7qmAxJuWY1ArlogW-r2vudXo_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11625133653101620242', time=2024-09-22T10:57:15.820340+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JqJLbeuutvy4h1glJdOsYmoabzbpDTj_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8332194131870161608', time=2024-09-22T10:57:15.836916+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._E_fuax0ZAiXV4wZqS88gk-5uyS1p45_0 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11257884646328041937', time=2024-09-22T10:57:16.426986+0000, chain.objs.size()=1 2024-09-22T09:16:03.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.648+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.5F7n-nkUGBfl1lAv6suTDdApHzDGzpb_0 2024-09-22T09:16:03.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.649+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14380471630366903712', time=2024-09-22T10:57:16.999423+0000, chain.objs.size()=1 2024-09-22T09:16:03.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.649+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qIf8pjzLGyqw9S9hrJkLO8Vk1zg42sv_0 2024-09-22T09:16:03.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.649+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15507404611164451022', time=2024-09-22T10:57:23.345113+0000, chain.objs.size()=1 2024-09-22T09:16:03.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.649+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.274__shadow_.OpmHjSZYWtZ-TEYV0QTiYJxg0r21oUO_0 2024-09-22T09:16:03.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9309345911815766916', time=2024-09-22T10:57:26.993039+0000, chain.objs.size()=1 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.280__shadow_.pfRHHSwe66B-LbkT7aniCTEJdZ7Gxze_0 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6959611239286948295', time=2024-09-22T10:57:28.201054+0000, chain.objs.size()=1 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.282__shadow_.Q0gUqKa9Atv6R4xJGq-YCr-Fa6pJVVV_0 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11926133220091281721', time=2024-09-22T10:57:30.061346+0000, chain.objs.size()=1 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.285__shadow_.Na20Ozq4dcmkxa6LiXFiJuSubaoHROe_0 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13266169785522061276', time=2024-09-22T10:57:32.651831+0000, chain.objs.size()=1 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.651+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.289__shadow_.gSthJmsNNONdGBNO8dU9hrizIgh6XgQ_0 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.652+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3058884204912296218', time=2024-09-22T10:57:38.190441+0000, chain.objs.size()=1 2024-09-22T09:16:03.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.652+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.rV68en4qOaY1ErN2DWxCJjqokd2WQh-_0 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2539670661493582251', time=2024-09-22T10:57:38.224024+0000, chain.objs.size()=1 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.294__shadow_.jkNUg99b4fJcJBZnQizjqhcKB6wG2Ac_0 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17947054343828193053', time=2024-09-22T10:57:43.604833+0000, chain.objs.size()=1 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.302__shadow_.qf1Vy4UNVYYDG6SrEzwLa0V3kQ2fAye_0 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14899637518603065156', time=2024-09-22T10:57:46.006909+0000, chain.objs.size()=1 2024-09-22T09:16:03.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.306__shadow_.Pm0I8SMubZ7mrZuXnmjVmQlSc5iRZKr_0 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4456655933475462105', time=2024-09-22T10:57:47.966049+0000, chain.objs.size()=1 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.308__shadow:cw2GmzvMelSKUpNqXgtH5tu-L.yARkg_.f71WFsQu4KzFTESkkYA_ThXQv7igxzP_0 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4640234953876415348', time=2024-09-22T10:57:55.113716+0000, chain.objs.size()=1 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.320__shadow:6y1gPpqCv7qsaOP9gGgLZmMz0YvHY1W_.z6bBNDI-dD0nBm4GXppGOugPYUphgYN_0 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12986435914784558567', time=2024-09-22T10:57:56.212733+0000, chain.objs.size()=1 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.322__shadow_.30Znfd0Kp8FwmBwvu74rf8sISaBI9_-_0 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11918470073031824594', time=2024-09-22T10:58:35.383516+0000, chain.objs.size()=1 2024-09-22T09:16:03.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.654+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BbqQovMAa8Usq3GudtoqsFRYsywP4dd_0 2024-09-22T09:16:03.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4212426417144502486', time=2024-09-22T10:58:35.440320+0000, chain.objs.size()=1 2024-09-22T09:16:03.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Ed7yqMiEC74BI76f1cGxtneDc02vo2Y_0 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1806952685302046353', time=2024-09-22T10:58:36.311815+0000, chain.objs.size()=1 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.joAE-sExXGM3MtLvpHAmuFLqV9qLFKI_0 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6319280536489516539', time=2024-09-22T10:58:36.495309+0000, chain.objs.size()=1 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.b4iM-OCefv-au0zmXnupBp4j6RVjPvD_0 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11048770002983983869', time=2024-09-22T10:58:36.499622+0000, chain.objs.size()=1 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.656+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.mbiYLQGK50ryIBO6FvUAxsq6LSofTpt_0 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.657+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7836389659808353840', time=2024-09-22T10:58:36.628104+0000, chain.objs.size()=1 2024-09-22T09:16:03.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.657+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RR8dPsBV_iJ-kluQVyBVCV7T9Cq0y-4_0 2024-09-22T09:16:03.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.658+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7022435776628187747', time=2024-09-22T10:58:37.609305+0000, chain.objs.size()=1 2024-09-22T09:16:03.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.658+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.JRHm_8C4tiKdSNk1XdEpfCvM6_09R5m_0 2024-09-22T09:16:03.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.658+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.711576630953141705', time=2024-09-22T10:58:37.737631+0000, chain.objs.size()=1 2024-09-22T09:16:03.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.658+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.n37fQffmJKCLLYnr_CRwLBSCwq7F52C_0 2024-09-22T09:16:03.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2622571886363583480', time=2024-09-22T10:58:37.764454+0000, chain.objs.size()=1 2024-09-22T09:16:03.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qxKZrdju_IB-08G1ZBUdY-YR2JKZp9V_0 2024-09-22T09:16:03.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6543107948105519514', time=2024-09-22T10:58:37.913927+0000, chain.objs.size()=1 2024-09-22T09:16:03.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ptFOuhzDTzkH1T1AtqhvV7j2Q_FlWR0_0 2024-09-22T09:16:03.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15761864186141490828', time=2024-09-22T10:58:38.128208+0000, chain.objs.size()=1 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ChXSSfECpVfLBwk7TdQMh2tv_cF6qHb_0 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1866841460673822759', time=2024-09-22T10:58:38.293501+0000, chain.objs.size()=1 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3FpLlug2TwJ6wl4pXi5AgnSWxxn9A51_0 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11933630303088192005', time=2024-09-22T10:58:39.026535+0000, chain.objs.size()=1 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.R0lJWP1dSqhCF04BnEHAP9TDhMp0fo0_0 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13857095638359898627', time=2024-09-22T10:58:39.790025+0000, chain.objs.size()=1 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.57PwVK7u5Z44SNAZLHML9CjDI0wQwI3_0 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16847685882124383086', time=2024-09-22T10:58:39.884995+0000, chain.objs.size()=1 2024-09-22T09:16:03.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.660+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TscBiVwNQkBoQ0MbQscgi3l6Ftu2qCI_0 2024-09-22T09:16:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.662+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3725688419263274591', time=2024-09-22T10:58:40.300596+0000, chain.objs.size()=1 2024-09-22T09:16:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.662+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.zrMvqLU7x3WTTFvdtHoK8G2ri1PyXqB_0 2024-09-22T09:16:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.662+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12407736052611480371', time=2024-09-22T10:58:40.301749+0000, chain.objs.size()=1 2024-09-22T09:16:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.662+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZNwiZW7Snv8pUSN8Plozjh_6NQXf4Bx_0 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.377879724579208314', time=2024-09-22T10:58:40.439778+0000, chain.objs.size()=1 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.H6fgcVxLob26RjtawVw56yaTBykXc8p_0 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.930268503543036613', time=2024-09-22T10:58:41.128789+0000, chain.objs.size()=1 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZtcgP8dNeytNfwWOIVR0EuHJXOaui38_0 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8870770806399567265', time=2024-09-22T10:58:41.188604+0000, chain.objs.size()=1 2024-09-22T09:16:03.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.664+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.AMUEfdQTwZDBYOqy2KziXt0TOZjHhf3_0 2024-09-22T09:16:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6576150130965067325', time=2024-09-22T10:58:41.270168+0000, chain.objs.size()=1 2024-09-22T09:16:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RNCIwVYEIFH0y111fDWSeaKhlAJgjTF_0 2024-09-22T09:16:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14869463511578723575', time=2024-09-22T10:58:41.810835+0000, chain.objs.size()=1 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.x9x9-a3LQotoEkK6iLz43CUJYqo-6Qf_0 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13433400752563500170', time=2024-09-22T10:58:41.957570+0000, chain.objs.size()=1 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4i_TU-WjPz5Tn3s4xnlNEulncLWMiNb_0 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13224856386554771676', time=2024-09-22T10:58:42.252914+0000, chain.objs.size()=1 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HgWHFPrFFm7TjJDx4UeKFKlUfKJvtzg_0 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8229741624784745935', time=2024-09-22T10:58:42.546195+0000, chain.objs.size()=1 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FrbKoJ_0_oz-EiUMjefe6foGUHbyaiU_0 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2291755647834991420', time=2024-09-22T10:58:43.228697+0000, chain.objs.size()=1 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.666+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RdpCY8nDJ7GF5RETAMIK4Ze50gZvVzi_0 2024-09-22T09:16:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14466184566842700442', time=2024-09-22T10:58:43.966181+0000, chain.objs.size()=1 2024-09-22T09:16:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9X5E3f3yPnSyVgr2YVYI3nCv87RbkSr_0 2024-09-22T09:16:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.667+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2917642939047313959', time=2024-09-22T10:58:44.262310+0000, chain.objs.size()=1 2024-09-22T09:16:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.667+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IiyVZkhdPWzLst50SJqmZ2mAkzAz1wU_0 2024-09-22T09:16:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2278190888207761218', time=2024-09-22T10:58:44.407178+0000, chain.objs.size()=1 2024-09-22T09:16:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.glfiqGv8LllIuVD-SVQe20zKIHn7Zsi_0 2024-09-22T09:16:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.668+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8218401166669367626', time=2024-09-22T10:58:44.424355+0000, chain.objs.size()=1 2024-09-22T09:16:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.668+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.k1x_VrP5Osy2EdiJlOwuiQVynnHnWU8_0 2024-09-22T09:16:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.669+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9672671755239029628', time=2024-09-22T10:58:44.436456+0000, chain.objs.size()=1 2024-09-22T09:16:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.669+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QNBUibVo_sDkRHh_OPFs6T9E83F3sqI_0 2024-09-22T09:16:03.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.670+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9707654234822970117', time=2024-09-22T10:58:44.564295+0000, chain.objs.size()=1 2024-09-22T09:16:03.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.670+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.H-8971aXemrAgQ6Lxi0HwBWW6nkiyaD_0 2024-09-22T09:16:03.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.670+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6729196301310949980', time=2024-09-22T10:58:44.814328+0000, chain.objs.size()=1 2024-09-22T09:16:03.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.670+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.l10ycfkQJ3Lno9fUVIQOMMQJRRdu_E__0 2024-09-22T09:16:03.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.671+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1832395516898094308', time=2024-09-22T10:58:44.841563+0000, chain.objs.size()=1 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.671+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xn22S6f0z89zUsC8A_f3LVyvOqnQkCs_0 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18064583463744837676', time=2024-09-22T10:58:44.946867+0000, chain.objs.size()=1 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.F2LzYNRbzBUD72bzcXMsnLdKHUrlkTu_0 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2999872988420685056', time=2024-09-22T10:59:21.995836+0000, chain.objs.size()=1 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Wq2LQRFl_DID0_BX8eaQFQUcfA9Mjeu_0 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16373782332653764194', time=2024-09-22T10:59:24.038970+0000, chain.objs.size()=1 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._nZAZqJRHpCp1A6-pIvP2diqR9p-C2i_0 2024-09-22T09:16:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12203434108107912715', time=2024-09-22T10:59:24.071991+0000, chain.objs.size()=1 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.OyR678Ky1YXQr9r87kx37wmNsjiajZP_0 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6225134659941846690', time=2024-09-22T10:59:24.440455+0000, chain.objs.size()=1 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.672+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YwW_zsZ-e88z7k_8QLyI3fcVAXEC0x8_0 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10195971983430052873', time=2024-09-22T10:59:25.870920+0000, chain.objs.size()=1 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G_3go7Gkw3cbbIkgSZ2wT-i94KDNh-4_0 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14275774506415384378', time=2024-09-22T10:59:27.791064+0000, chain.objs.size()=1 2024-09-22T09:16:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.D7D0FhlO3UI9yA5GEZr4vP0RlJ15knZ_0 2024-09-22T09:16:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5112132046428651926', time=2024-09-22T10:59:28.190538+0000, chain.objs.size()=1 2024-09-22T09:16:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.673+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.MiXYk48dkaAH77RXWBBkhs2pcm0o6lp_0 2024-09-22T09:16:03.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.675+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17638625191928359533', time=2024-09-22T10:59:28.248506+0000, chain.objs.size()=1 2024-09-22T09:16:03.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.675+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PrLdWLnUHCpGmyy_NLWYvhjv5-hMs5B_0 2024-09-22T09:16:03.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.675+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8376488693113991127', time=2024-09-22T10:59:28.620747+0000, chain.objs.size()=1 2024-09-22T09:16:03.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.675+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.G6OyV6cYhObogpv9Kdyq4Cj_UYdzFw8_0 2024-09-22T09:16:03.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.677+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8108116343176309751', time=2024-09-22T10:59:28.715565+0000, chain.objs.size()=1 2024-09-22T09:16:03.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.677+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.aL5Ej5tOCoRfKRgsHNM8G4oai4DoKuk_0 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8144014018733371568', time=2024-09-22T10:59:29.515529+0000, chain.objs.size()=1 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.pwALBjpR5VnsMZQuciycRPvG3t1ASsE_0 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7405457974512466865', time=2024-09-22T10:59:30.225517+0000, chain.objs.size()=1 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Dz5aiBW1jG7e2RjTfqSHS89qcFMk7Rt_0 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6623090831529749239', time=2024-09-22T10:59:31.030130+0000, chain.objs.size()=1 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZjfJYm0lepMVn8E-ZaiaV6nSnNXGiAO_0 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10082506887860954278', time=2024-09-22T10:59:31.195488+0000, chain.objs.size()=1 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HrxJdun2cHOoKUwPURB_JQdzmO0G_Bz_0 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10310832677266143867', time=2024-09-22T10:59:31.509380+0000, chain.objs.size()=1 2024-09-22T09:16:03.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kLy4omPJvkoHd5p_1NSImuZE3_wVGwD_0 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17827344441496410194', time=2024-09-22T10:59:32.609529+0000, chain.objs.size()=1 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fBeOEUTF5iDF7KFkBwZnUET6kZjJ9mK_0 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2882056434158408195', time=2024-09-22T10:59:32.954245+0000, chain.objs.size()=1 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.678+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6_y_JrLHPWjwAi_48PhEbJoF-Xnql3g_0 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.679+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17384795156709167095', time=2024-09-22T10:59:56.066334+0000, chain.objs.size()=1 2024-09-22T09:16:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.679+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.373__shadow_.sG8YmRJtEOQGtcaZ0fiFNUX3Jg6oxpr_0 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7541730431139028330', time=2024-09-22T10:59:59.170669+0000, chain.objs.size()=1 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.377__shadow_.TPgbk8YzqJqjgUi40y9BNS_OZhSRuZr_0 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10693389883319802642', time=2024-09-22T11:00:03.509442+0000, chain.objs.size()=1 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.384__shadow_.gp-qNqpLaTdmMNNqS45QTrBk_aVc9pA_0 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11150792172453589260', time=2024-09-22T11:00:42.246713+0000, chain.objs.size()=1 2024-09-22T09:16:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.682+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.455__shadow_._eA9XgBVTaM_DZKOnb31IBKS_MsATbi_0 2024-09-22T09:16:03.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.683+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4482909139399986393', time=2024-09-22T11:00:48.855235+0000, chain.objs.size()=1 2024-09-22T09:16:03.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.683+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.463__shadow_.wM0ciypm3-kuxqpqmPue5j14zJTmj9K_0 2024-09-22T09:16:03.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.683+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16506742093736317535', time=2024-09-22T11:00:59.842530+0000, chain.objs.size()=1 2024-09-22T09:16:03.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.683+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.1IMFww5RlELpMV1EgWW5MtCNLXFWEIc_0 2024-09-22T09:16:03.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.687+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/45093 2024-09-22T09:16:03.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T09:16:03.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13734298031959068000', time=2024-09-22T11:01:00.582340+0000, chain.objs.size()=1 2024-09-22T09:16:03.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.485__shadow_.qH6RysiulvivXcEN43tZ9-W7Rh8trtR_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12596833827051894977', time=2024-09-22T11:01:04.699118+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.488__shadow_.r_3AcEkeFEJj1B1ARyjAjPy8O2TAVAt_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2568015650971987902', time=2024-09-22T11:01:06.266817+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.491__shadow_.V9kvDATq1ylGOh8KwxZ25TVf58MgTbz_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2568015650971987902', time=2024-09-22T11:01:06.467982+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.491__shadow_.V9kvDATq1ylGOh8KwxZ25TVf58MgTbz_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15242659552702139552', time=2024-09-22T11:01:10.787977+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.499__shadow_.noDeVW3fAE4w2RNCxppJvRdgfxAVFwt_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3199115533526688954', time=2024-09-22T11:04:25.919869+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.565__shadow_.CmgdPutwQkJaAhuAPXMUMNZm9No4vlt_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5134594183903258716', time=2024-09-22T11:04:47.681019+0000, chain.objs.size()=1 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.575__shadow:d0RezXxuxZhFDqMQjfjzyxlmfZk-3J9_.h-0PGnxL2XZoIN7FhOtse2GewMldSJb_0 2024-09-22T09:16:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10303501540219238705', time=2024-09-22T11:04:50.807119+0000, chain.objs.size()=1 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:wxiqq3HxSycLf0fQ0oX9dPz9fO9HzA9_.ivuTNOqG6WRjlZ-KLoTBpIzF4NW_Rw8_0 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.176048926027062636', time=2024-09-22T11:04:55.743423+0000, chain.objs.size()=1 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:wdhcdg-tjgfcTzUJX530mJ1t1qV4fwH_.SMT7z-ye-qlGQY0lvBm7S7EQj7Hh_zO_0 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2603538609174988943', time=2024-09-22T11:05:31.706905+0000, chain.objs.size()=1 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:.PA7uEl9I7Dcp42sG9DGp6-08knnBD2_.II5O5xYROMCCfwCLzPxMP5i3zVCc5mi_0 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14091283577864520157', time=2024-09-22T11:10:15.184220+0000, chain.objs.size()=1 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.665__shadow_.hjlvUEfGxJdzHQRORw3Hz4i2G5sX55P_0 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6864353051994577154', time=2024-09-22T11:10:32.034866+0000, chain.objs.size()=1 2024-09-22T09:16:03.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.689+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.697__shadow:9vxgMtL-vbZrVU3L13S-BmT.MH5UTVj_.1SDRjv4uAYcFqu4TdnwtKaUNbyVxNyI_0 2024-09-22T09:16:03.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.692+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5585157120036412143', time=2024-09-22T11:10:34.987182+0000, chain.objs.size()=1 2024-09-22T09:16:03.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.692+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.702__shadow:LZj1qy3a.i-pd8OaKlfVTiCG3nfapoa_.L-IGBR2tNwraT5v5dc7OUtCNp-ahZtE_0 2024-09-22T09:16:03.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17565332732348347449', time=2024-09-22T11:10:36.410793+0000, chain.objs.size()=1 2024-09-22T09:16:03.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.704__shadow:FdcqZkc5oSwSA8zeZlAdZ2V3491FFc8_.dEWD9pBBEn1RuLC0UcSPLlUHNG7zaEN_0 2024-09-22T09:16:03.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.693+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14298651549567529386', time=2024-09-22T11:10:42.432482+0000, chain.objs.size()=1 2024-09-22T09:16:03.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.693+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.714__shadow:GvcsTBUWho0HoeIxAAJg06d9FCSKwow_.0SCyS37SHVXipHRJE8W4R6w8ZBB43lB_0 2024-09-22T09:16:03.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.694+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.660388000544620202', time=2024-09-22T11:12:28.808163+0000, chain.objs.size()=1 2024-09-22T09:16:03.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.694+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.761__shadow_.QgorAjuwqID8n0uqMOWvt_qEDR5EvFt_0 2024-09-22T09:16:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.697+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.699+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:03.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.700+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.700+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50896' 2024-09-22T09:16:03.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_XonTxBU0otvFQkzU6IQI4rcLNH7fyIn', time=2024-09-22T10:54:14.493317+0000, chain.objs.size()=2 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.hmcl9SzKuTNyfgUO_veBQS151ahT9bW_0 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.hmcl9SzKuTNyfgUO_veBQS151ahT9bW_1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~yw9gdrLJnT0EwfQUvrCxN4bEZd-rDL4', time=2024-09-22T10:54:47.970381+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.202__multipart_mymultipart.2~yw9gdrLJnT0EwfQUvrCxN4bEZd-rDL4.1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.69864600029227735', time=2024-09-22T10:56:08.882653+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.229__shadow_.HM0LGNcEihpKXU4TFpZKBPFo4rzLd64_0 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15760162448799903755', time=2024-09-22T10:56:14.416462+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.238__shadow_.SeuPgC4H16ZXBdEkIfljAbpkGnqqHRu_0 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7451829282512005841', time=2024-09-22T10:56:17.542118+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.243__shadow_.2TJgJN75IHN-v-6FJ3BLeVUIYiHyNmU_0 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.154121578442799595', time=2024-09-22T10:56:18.451040+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.244__shadow_.HdZS1r47gQToEt7lxiCxns853oNA3eX_0 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10820480113343867081', time=2024-09-22T10:56:19.968039+0000, chain.objs.size()=1 2024-09-22T09:16:03.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.246__shadow_.rZWgP03NyRNo8WJlRsx4cgAC8vsYBet_0 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17619527128946098892', time=2024-09-22T10:56:24.887225+0000, chain.objs.size()=1 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.254__shadow_.196vQ9j9Sq-9nd7R5O1SaFER2s1pEBY_0 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3605507621622126092', time=2024-09-22T10:56:27.328377+0000, chain.objs.size()=1 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.258__shadow_.BexAmX_QghNfx04kPkew7CfxqL3CgHn_0 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12837020495537275601', time=2024-09-22T10:57:06.578230+0000, chain.objs.size()=1 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.UGbd4L4NbkKguvOtUtfuiDW8DQWP39Z_0 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15626783751181445109', time=2024-09-22T10:57:06.790961+0000, chain.objs.size()=1 2024-09-22T09:16:03.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.702+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2L5xPS5Ji3XUz_HFFZE8ncQ9dZvduGX_0 2024-09-22T09:16:03.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.705+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7574016736789078783', time=2024-09-22T10:57:07.673996+0000, chain.objs.size()=1 2024-09-22T09:16:03.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.705+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ohs3dGHW8IyOdYPyKNW93Nmn_XtyOP__0 2024-09-22T09:16:03.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7201682378074979021', time=2024-09-22T10:57:08.014488+0000, chain.objs.size()=1 2024-09-22T09:16:03.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iy19F1t6bKgGXUhbOssE5RroFLRreKq_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1764797360929591332', time=2024-09-22T10:57:09.686793+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Xrh9X5-eGCGiUGQuEzD04VOnRPBvtFT_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10967758093177637904', time=2024-09-22T10:57:09.941898+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2dkw4GM2mXFLH7py60_yNil_hdPltwV_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13016152890762459076', time=2024-09-22T10:57:10.004896+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.CMg1t2p0Gt2cGTUb5qHz5a1cXDGnrLo_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14993783712980802049', time=2024-09-22T10:57:10.413923+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Rqo8GgeiaXN09g6qkm6EGk3NEwcZaLt_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12262812272296962505', time=2024-09-22T10:57:10.484843+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BvrGWeFA4A6lZum7FaZAa40xHuXipLi_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3620012666470236409', time=2024-09-22T10:57:10.674596+0000, chain.objs.size()=1 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KqKFJDKMb2Xg6KNi_mHXufXKcJbgOJN_0 2024-09-22T09:16:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11445653659158079669', time=2024-09-22T10:57:10.797128+0000, chain.objs.size()=1 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ryqjLyHLBIrMd4lyOYa0PPv8e_VNvtX_0 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4495831014701554285', time=2024-09-22T10:57:11.853364+0000, chain.objs.size()=1 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.BEiZJpXtcod_iiPtRl6YGFf-Q-ElJsC_0 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7720682887301238129', time=2024-09-22T10:57:12.017869+0000, chain.objs.size()=1 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.706+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.DI4AYUIH7Ax6o_bRFJZ9eOO3GHntJOZ_0 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.708+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2238073357080298687', time=2024-09-22T10:57:13.259336+0000, chain.objs.size()=1 2024-09-22T09:16:03.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.708+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Jts6Z-RNSBGPFdpr8t6fPtJA7sI28rw_0 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3167739269848672629', time=2024-09-22T10:57:13.482217+0000, chain.objs.size()=1 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JB7yVA7DEex0rTr_6pcrtS-TFJT6l6Q_0 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16198328788242326702', time=2024-09-22T10:57:13.483906+0000, chain.objs.size()=1 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.MlJUEP7sVQRkvk6-exocEcf0JiEiKJ9_0 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5762709113843120304', time=2024-09-22T10:57:13.703658+0000, chain.objs.size()=1 2024-09-22T09:16:03.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IY8dJpS0HK7-fa5nbUsdz0CkUbSgpb8_0 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3680334517520900672', time=2024-09-22T10:57:14.012009+0000, chain.objs.size()=1 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.710+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IgLoBHyRl9QoAdl2--LSgzQbKjVwy3Y_0 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12622275423835182457', time=2024-09-22T10:57:14.234043+0000, chain.objs.size()=1 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mlnpAWRhA4eO_BQX2mw7QydWHR9RTPf_0 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12287703391699080265', time=2024-09-22T10:57:14.234585+0000, chain.objs.size()=1 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mp-iUGL4lbVlGt0yNU3gb_5cXIXUNak_0 2024-09-22T09:16:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4937335656483386929', time=2024-09-22T10:57:14.448711+0000, chain.objs.size()=1 2024-09-22T09:16:03.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.711+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.r5MNYsU2Y6SCyfJymFKqrI4b90PyYKO_0 2024-09-22T09:16:03.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16468414794149109301', time=2024-09-22T10:57:14.782033+0000, chain.objs.size()=1 2024-09-22T09:16:03.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rlPtpSl9UUOBVtox8ycRsYRX57Q1hvW_0 2024-09-22T09:16:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11158324732157983104', time=2024-09-22T10:57:15.084401+0000, chain.objs.size()=1 2024-09-22T09:16:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.KJG6BrwDF3JjB9BYVH1SsUnL-Nz4qE9_0 2024-09-22T09:16:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12653196035162048536', time=2024-09-22T10:57:15.841935+0000, chain.objs.size()=1 2024-09-22T09:16:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.712+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Zfs2WbghTvxt_H94M4j4GlSBKeVXYLF_0 2024-09-22T09:16:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.714+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12602334937227651299', time=2024-09-22T10:57:16.265217+0000, chain.objs.size()=1 2024-09-22T09:16:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.714+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Hnoi85u7CJdzWybFcaWCypGyrCLU2JG_0 2024-09-22T09:16:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4552321602536305443', time=2024-09-22T10:57:16.295658+0000, chain.objs.size()=1 2024-09-22T09:16:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.NMmY4UQB1IuaIuvfYYL6xKQwqUbqlWE_0 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16721016317374071811', time=2024-09-22T10:57:16.439276+0000, chain.objs.size()=1 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xHs7cYsXEHWP_C90TbE0QnpvSDagZ4E_0 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9282766893564981215', time=2024-09-22T10:57:16.598057+0000, chain.objs.size()=1 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xYdn2-kcXPmt81lEbEvWqjrEFox8lCW_0 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3159678839500394602', time=2024-09-22T10:57:16.948445+0000, chain.objs.size()=1 2024-09-22T09:16:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.716+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7Bn6TBsedlc-Ryt1L-K0USWMcnN4Xt__0 2024-09-22T09:16:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1270290681374127725', time=2024-09-22T10:57:28.802401+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.283__shadow_.loL5uWiW5rMVCmo6Bv6gF_AQAjjTD6S_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12291611556906232106', time=2024-09-22T10:57:32.037749+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.288__shadow_.0P17_h2iPA1TkLIlQpCUQopvzdDnWzK_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5548672839698076593', time=2024-09-22T10:57:32.648792+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.289__shadow_.XNObAyhCBOrbwzdA7_KybEATNL-DSGv_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10334992839054037687', time=2024-09-22T10:57:33.258970+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.290__shadow_.70eSC3Pdms0qdceb0iHx3d8f_ycdtD2_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2195001406499437446', time=2024-09-22T10:57:36.373875+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.jk0-vMGPa9UTwqwJTvRbkAfBUzpesEC_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18297836276324650391', time=2024-09-22T10:58:34.446695+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.QnL4Qav_TryeRObPJJ8Zxlez2Dl__gE_0 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16136219920459603089', time=2024-09-22T10:58:34.914704+0000, chain.objs.size()=1 2024-09-22T09:16:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.718+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vz31UvAMsaH18XRdHXkv0UD80jL0AC1_0 2024-09-22T09:16:03.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.720+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5669608475158503198', time=2024-09-22T10:58:34.950176+0000, chain.objs.size()=1 2024-09-22T09:16:03.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.720+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.avfZ3Ivz_1sCLEaR_V68aUH4e5e9vTB_0 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2908624356274353245', time=2024-09-22T10:58:35.138811+0000, chain.objs.size()=1 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.g0HizOY97lt4aRUBkm2ih9XZnKBVKvV_0 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3258668437680115707', time=2024-09-22T10:58:35.429013+0000, chain.objs.size()=1 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.BrkyvWm80QBrdNSCRnCrOdtSrOJmm5a_0 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18415695600205949200', time=2024-09-22T10:58:36.258562+0000, chain.objs.size()=1 2024-09-22T09:16:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.721+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.HyufOQ5W4qo3pwD4Y2G0RTh_4tin9cC_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8470787972061536931', time=2024-09-22T10:58:36.344193+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.W26TPB1xEUxR1qOCMDRNSDR3KpD_hiN_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8480052327671358489', time=2024-09-22T10:58:37.767186+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wKEgdJDSTul-79gSv3CSRKCt2whoIi7_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5545640225458183247', time=2024-09-22T10:58:37.806200+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PfKbLVQ3lU2SmMBP0Yk2h84lzzHgD0d_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10205816067524697658', time=2024-09-22T10:58:38.044983+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PoZnV1Q3oPFx2VtJU618bq-juB8o19G_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2478828595638148750', time=2024-09-22T10:58:38.095706+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IH8eLWwqH7iyrUIkHz7rDAXaXDRuo-Q_0 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18382131342806256659', time=2024-09-22T10:58:38.241197+0000, chain.objs.size()=1 2024-09-22T09:16:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.722+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.uZtRX1LzDbYKqFRBojeyfS4j2WavAea_0 2024-09-22T09:16:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.724+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.131762961227546476', time=2024-09-22T10:58:38.418871+0000, chain.objs.size()=1 2024-09-22T09:16:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.724+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RoDAnrpljyAZ6K_pCOLQKFLIZnjlJOA_0 2024-09-22T09:16:03.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.725+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15074974881092478089', time=2024-09-22T10:58:38.474658+0000, chain.objs.size()=1 2024-09-22T09:16:03.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.725+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xEsFtScMCJb9STT74i1qnLIPZODiwx2_0 2024-09-22T09:16:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7779273743464160453', time=2024-09-22T10:58:38.994707+0000, chain.objs.size()=1 2024-09-22T09:16:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4Cc37u3F767Vvx5BqU9Uu25zeL9Cni5_0 2024-09-22T09:16:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16704179593843959148', time=2024-09-22T10:58:39.581754+0000, chain.objs.size()=1 2024-09-22T09:16:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.9efryDFy-W2Yj4yVjF_v4b38ssagWGL_0 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8070052876904755285', time=2024-09-22T10:58:39.903976+0000, chain.objs.size()=1 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.727+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qtFawx3mEZMMyxgoclT33FLPnCGJXRt_0 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14598922834728514557', time=2024-09-22T10:58:40.307917+0000, chain.objs.size()=1 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KmO9y-IkN8Ib2mlkLmFRmNvVDAjRJFr_0 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6960087694474986752', time=2024-09-22T10:58:40.535407+0000, chain.objs.size()=1 2024-09-22T09:16:03.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.txz8a9WPmwguMpp-_YE1CWlJw6eJ4op_0 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14567258926249804794', time=2024-09-22T10:58:40.569230+0000, chain.objs.size()=1 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vu1-SdPuWjHFcy_v-12cb32tV2Bhht7_0 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12300833993307194298', time=2024-09-22T10:58:40.806904+0000, chain.objs.size()=1 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ntPeYoEnnIgDbQtXruKO7I0kHJPoIr9_0 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5226223408964907517', time=2024-09-22T10:58:41.039675+0000, chain.objs.size()=1 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dWWUOyQqf5bszLuIjZjNsWxpTCdazv__0 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.266577378863944114', time=2024-09-22T10:58:41.794992+0000, chain.objs.size()=1 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.OPCxjb0AuL4yNc-5wsV9eKCavml3FpS_0 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18164079734591454595', time=2024-09-22T10:58:41.799153+0000, chain.objs.size()=1 2024-09-22T09:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.728+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CMbgUGeLKFRWSdQ13AHRn31FhUrrrmt_0 2024-09-22T09:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.729+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.606191800046505045', time=2024-09-22T10:58:42.194119+0000, chain.objs.size()=1 2024-09-22T09:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.729+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2n-gCi5zLgl_mkvn3D_UFn04TeYBU7u_0 2024-09-22T09:16:03.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.731+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4615094185399102273', time=2024-09-22T10:58:42.293087+0000, chain.objs.size()=1 2024-09-22T09:16:03.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.731+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3emCf_bpSCQXJw1dBWIEDOp3o_7l3qV_0 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.909039106491034902', time=2024-09-22T10:58:42.311499+0000, chain.objs.size()=1 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WZH5f3A3HdN3hfLX2_c0MTksvJ9m8hK_0 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5218564133848767149', time=2024-09-22T10:58:42.519296+0000, chain.objs.size()=1 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.NpFjtZNRUWp9J04WBK3DSkFwR9X1HBg_0 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11485430626778685936', time=2024-09-22T10:58:43.167936+0000, chain.objs.size()=1 2024-09-22T09:16:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4CPFIhhwwc99BHpZZDH3fLgK67a3pGR_0 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17456262648929114413', time=2024-09-22T10:58:43.363019+0000, chain.objs.size()=1 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jaV3ZKPgek0F7z36Ale9MkjPhah7Rud_0 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14095292460842917698', time=2024-09-22T10:58:43.752779+0000, chain.objs.size()=1 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.q6XWHdcHUzktHSRLFhZTxYDahRyno7l_0 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14406647730287679841', time=2024-09-22T10:58:44.006336+0000, chain.objs.size()=1 2024-09-22T09:16:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.732+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.54hzKq8qbGIsgxK-H57rOZFn_ujXSwJ_0 2024-09-22T09:16:03.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.734+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.56834933089921961', time=2024-09-22T10:58:44.448409+0000, chain.objs.size()=1 2024-09-22T09:16:03.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.734+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Z7aVrc8sTvXy_TL6FC7DIr_mVuMsacf_0 2024-09-22T09:16:03.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5743677071467286242', time=2024-09-22T10:58:44.689993+0000, chain.objs.size()=1 2024-09-22T09:16:03.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pHEA0kSw8LMGnQ090GXdF6W4o3Dz7wH_0 2024-09-22T09:16:03.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10610352436053549458', time=2024-09-22T10:59:22.278714+0000, chain.objs.size()=1 2024-09-22T09:16:03.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.p2KS4Qqm1aAKkOgnxiTEYE2BE8bhOGV_0 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15845584429029308521', time=2024-09-22T10:59:22.629048+0000, chain.objs.size()=1 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.k4EmCa3xWR3qbzoSlv0Cy0ctw3tYFDY_0 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5583885773998163483', time=2024-09-22T10:59:23.926208+0000, chain.objs.size()=1 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cOtbuOTLNGFuH2jdRTA0B6bNCxbFmYk_0 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18025769119644840436', time=2024-09-22T10:59:24.129892+0000, chain.objs.size()=1 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zXu_fbKGMLqezX4LyeXyC9sum-s0XxJ_0 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7639153305330659278', time=2024-09-22T10:59:24.393633+0000, chain.objs.size()=1 2024-09-22T09:16:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.736+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.y_p3X7Ip1wsDpIrY4-dJvlYA52PrSIk_0 2024-09-22T09:16:03.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.738+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13122730290948226997', time=2024-09-22T10:59:24.583926+0000, chain.objs.size()=1 2024-09-22T09:16:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.738+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8dkSHcQf3ff4hq9s82wyQ4kY5n12aT8_0 2024-09-22T09:16:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10994071652454910110', time=2024-09-22T10:59:25.589828+0000, chain.objs.size()=1 2024-09-22T09:16:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bZ1tkcU4PLEPQMFO2zEnLTdXwDwy89M_0 2024-09-22T09:16:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7200128532647105505', time=2024-09-22T10:59:26.450838+0000, chain.objs.size()=1 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.f5eyMOtPEBxO9q59JEErtWZCiRNiX7-_0 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17007325956906606491', time=2024-09-22T10:59:26.596013+0000, chain.objs.size()=1 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.d8UXOjwlYZBsc2ymQ5g9T_MDlraTiXq_0 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5011238923174794862', time=2024-09-22T10:59:27.275757+0000, chain.objs.size()=1 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.739+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._NBHfnponplhzspDNy5LZ4HV97pwSx__0 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.740+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17921484126800274044', time=2024-09-22T10:59:27.753822+0000, chain.objs.size()=1 2024-09-22T09:16:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.740+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DuD2u1huuMXgIRAfDhZmFQRRDLWMjXR_0 2024-09-22T09:16:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.741+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8585814742845160680', time=2024-09-22T10:59:28.472779+0000, chain.objs.size()=1 2024-09-22T09:16:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.741+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fHn6JOLnk4_j3jkLUhMDr0NlvV_ODlZ_0 2024-09-22T09:16:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.741+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8449735833991943552', time=2024-09-22T10:59:28.473308+0000, chain.objs.size()=1 2024-09-22T09:16:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.741+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.DKY3UadDk1CqFpNwOmNgzWFzxn9Lesm_0 2024-09-22T09:16:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2497417567868003499', time=2024-09-22T10:59:28.968015+0000, chain.objs.size()=1 2024-09-22T09:16:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.l6FtEIFvmmLX0UXfJ9EXGotWOwEte2I_0 2024-09-22T09:16:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10974592348012195673', time=2024-09-22T10:59:29.137616+0000, chain.objs.size()=1 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.rEdJNoOIyelDY8XosJ-Mj0H8Qq4ZAga_0 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17745963649094734254', time=2024-09-22T10:59:30.141379+0000, chain.objs.size()=1 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.PFRpbvWIBi2coiFPoSF5D13nHegjmgN_0 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1468932514768382133', time=2024-09-22T10:59:30.421530+0000, chain.objs.size()=1 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.NM39VKPh9u1__aQrCCre5Efa4jPnb20_0 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12758808256301668360', time=2024-09-22T10:59:31.510712+0000, chain.objs.size()=1 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.EYx6CDqDByWh5awMZPXucuA0K9fSBYV_0 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2796974371038240146', time=2024-09-22T10:59:31.594765+0000, chain.objs.size()=1 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qxyCrbWM1azTgN93l3kIrJZjZAHdqOy_0 2024-09-22T09:16:03.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4187918742538286494', time=2024-09-22T11:00:19.016599+0000, chain.objs.size()=1 2024-09-22T09:16:03.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.742+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.411__shadow_.0nHgSSaDMOFdHeQlOAMrrkhg-ZC2SX7_0 2024-09-22T09:16:03.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.743+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18367414013243332774', time=2024-09-22T11:01:08.897898+0000, chain.objs.size()=1 2024-09-22T09:16:03.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.743+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.496__shadow_.QRIb58LATU_05MUcYPOeWcn0I2sLh_Q_0 2024-09-22T09:16:03.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.746+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3710693044226682178', time=2024-09-22T11:02:20.593909+0000, chain.objs.size()=6 2024-09-22T09:16:03.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.746+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.1 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.g3-D2_JLIQOBb9DWJBjK82BxZ05BlezC.2 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.3 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.4 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.5 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~dLqzM4Zd6v17AGpFCusz4It2pFatL3_.6 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4332606516848003760', time=2024-09-22T11:04:03.394901+0000, chain.objs.size()=1 2024-09-22T09:16:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.748+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.554__shadow_.Rm015kPW2lqL2KbtHIjxpWTsID3ayUz_0 2024-09-22T09:16:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.752+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/50896 2024-09-22T09:16:03.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-22T09:16:03.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17457721576984448976', time=2024-09-22T11:04:42.107303+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.573__shadow:6Q1cQWISmpe9oXzyttYdP3WpzvTRV1U_.mQ7T8Yywz-5m7I9Nal9ZpPK-W5HhFNd_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16644106047533189816', time=2024-09-22T11:04:51.505346+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:pQznb0oXR5-GEMBerEjqwNR6XigHRXY_.ZVWiP8AVfG6x9F-xvB9qtegcgYnhFH1_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15511675418330616420', time=2024-09-22T11:04:53.663549+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:mmklKKM0ynspKxgw2PilA3mScZuzX50_.qhtFD3hxeDOIp8RFpgLjKFqojJgt-wK_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17549412353704081663', time=2024-09-22T11:05:14.588590+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:GAUWZ6U6XK-xYglBB1KTlxcI5UZmVGB_.JPhdnCDEUy7GnB5yY7wtjfozriFu9sf_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12684188555541600126', time=2024-09-22T11:05:37.494565+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:fRa3Mtc1E8uyVRQWNhQHc5z54FBt666_.NqaPzB1LTrFyKU2Y9hU6hC3S1BfyECS_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4194154467521555021', time=2024-09-22T11:09:40.824372+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.646__shadow_.ZgbpPVPxiHzbjviSjJrjXaFJ4sxfFB0_0 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4773168146083364173', time=2024-09-22T11:11:05.361412+0000, chain.objs.size()=1 2024-09-22T09:16:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.754+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.720__shadow_.rlS3V072AL7gdGPq_m2gyFJL0XmuEFe_0 2024-09-22T09:16:03.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.757+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.760+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:03.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.761+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44952' 2024-09-22T09:16:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16966585861102767936', time=2024-09-22T10:53:59.044543+0000, chain.objs.size()=1 2024-09-22T09:16:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.159__shadow_.P83FhccnYrFYcjkfHQ2SJy9f7ILfZzF_0 2024-09-22T09:16:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2806672390742056877', time=2024-09-22T10:56:14.397249+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.238__shadow_.t0Ds5zjB_m24pX2toQfaf4NFbEuzY6D_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12933965716235632124', time=2024-09-22T10:56:19.963316+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.246__shadow_.zeyuScHPc2Ow8WXOW9QchQ5ZZlZr8NH_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9163326554080060727', time=2024-09-22T10:56:23.025931+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.251__shadow_.E7X3zeDtbP_HI8brwEz7orybs2BVuSA_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3847804686047814230', time=2024-09-22T10:56:29.714723+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.262__shadow_.2umbv7NoQQOupTBLOlvcJ6GdImZOrGZ_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5236488493343392940', time=2024-09-22T10:57:06.031402+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TpiBHq6nCaWV9wyS40_CZ3odfahKjln_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11345937260925011632', time=2024-09-22T10:57:06.032000+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.2nuVQFgIa1UqqvLmOzjULP24ey92k-E_0 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11096466164143075259', time=2024-09-22T10:57:06.625381+0000, chain.objs.size()=1 2024-09-22T09:16:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WGVzctceXUz-BdrvCR9mlskxSGw2gbh_0 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16400239976326429982', time=2024-09-22T10:57:07.021715+0000, chain.objs.size()=1 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LUPaIzdPvjRsiYTQNV1g5_fyX4FlwBh_0 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13482308527035740025', time=2024-09-22T10:57:08.084509+0000, chain.objs.size()=1 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IbhK-SzPbgn_fjxk1eqhaRGx7SamY6q_0 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9686270376653402734', time=2024-09-22T10:57:08.245056+0000, chain.objs.size()=1 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XuAVgEipROZxkz9yPqWVQU0ZzSt_ZW__0 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5041226688222333212', time=2024-09-22T10:57:08.467688+0000, chain.objs.size()=1 2024-09-22T09:16:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.763+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ykNIhCXnz74_58rwdqUZEZQk2xE-H7j_0 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.767+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2574581957880007149', time=2024-09-22T10:57:09.308941+0000, chain.objs.size()=1 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0MsokTXat--kb_LuzqCVLbTuaT1Z-RK_0 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11309321519198945234', time=2024-09-22T10:57:09.491912+0000, chain.objs.size()=1 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.lTFK1U-zDhOHWvGYOroYsuGZwM7ppER_0 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3803804555706092823', time=2024-09-22T10:57:09.826959+0000, chain.objs.size()=1 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qu6eBkWK0DYUF4XnxjV1PtSljJ1trl9_0 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13319480644598386323', time=2024-09-22T10:57:10.022957+0000, chain.objs.size()=1 2024-09-22T09:16:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Jwo9eCGRT6ntXFcS7LPL7ikvdHaX0vC_0 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7240693624344011378', time=2024-09-22T10:57:10.040662+0000, chain.objs.size()=1 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rJXuO1aHxMjjLPcXTS5w0-96LrmlTM4_0 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6318014080309782554', time=2024-09-22T10:57:10.473315+0000, chain.objs.size()=1 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.wALWH8kakfP5bQqpAo7oHNylqvaxJVq_0 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5528656743894596211', time=2024-09-22T10:57:10.604927+0000, chain.objs.size()=1 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.768+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AB7ZypjEvRP50V3g9G5yNnr6AXdniwY_0 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6379811371546764497', time=2024-09-22T10:57:11.011807+0000, chain.objs.size()=1 2024-09-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LsiUoluVkv2XV5DFruQUflNetgaQaFD_0 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7712489694179937930', time=2024-09-22T10:57:11.151720+0000, chain.objs.size()=1 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Y2c_khDYB08o9VZ5FoXivoPDOZu8FUo_0 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11620797529709176849', time=2024-09-22T10:57:11.961845+0000, chain.objs.size()=1 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u--OCYvz44eJAv-iSvJ8Y88eBnfzzHJ_0 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13260892612398559694', time=2024-09-22T10:57:12.501052+0000, chain.objs.size()=1 2024-09-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.769+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.qO0AiGsWpeY8MhZmwHXQZSgY88MEGLp_0 2024-09-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9672536748328034071', time=2024-09-22T10:57:13.389958+0000, chain.objs.size()=1 2024-09-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ttdpJ8J_UT8pT297THTJ2OwtTeXaZV__0 2024-09-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3869138475244319918', time=2024-09-22T10:57:14.818746+0000, chain.objs.size()=1 2024-09-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9rsd9dPQ-LXIWqq36g8Jgm1nLx_raG0_0 2024-09-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3319842410468062623', time=2024-09-22T10:57:15.309674+0000, chain.objs.size()=1 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.aKlfl-9R4v8ghMS2rr6jE4DvdnArj-t_0 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18444119407245997663', time=2024-09-22T10:57:15.424190+0000, chain.objs.size()=1 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EimsM46BwqraV2dM0WLe8H0fOK8vEkn_0 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7666863979010226895', time=2024-09-22T10:57:15.651600+0000, chain.objs.size()=1 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.0ZPRr37_KyRLf-r4jPnGDmGbZqT1POE_0 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8245967974998571061', time=2024-09-22T10:57:15.700722+0000, chain.objs.size()=1 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.772+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ugXuV8YbYBOA90nryOmYCPk1BUA_z12_0 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.773+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3104310767332497392', time=2024-09-22T10:57:15.827750+0000, chain.objs.size()=1 2024-09-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.773+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xoQyvlCI9fzJG8560RPOS3Syt7t_3Ee_0 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14984187751088513690', time=2024-09-22T10:57:16.156537+0000, chain.objs.size()=1 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.9H24r5mg3YtkRe6MTiqrpKCdvTt-FpX_0 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7806941001127052963', time=2024-09-22T10:57:16.397482+0000, chain.objs.size()=1 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.x4RfGmK6G1yAUqZHf_yZICS0SJIMOj0_0 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8589723938852513155', time=2024-09-22T10:57:16.462900+0000, chain.objs.size()=1 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3Cf58biGl7FiOHi0BgnHp3_657uu2b__0 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1509879910938449231', time=2024-09-22T10:57:25.791202+0000, chain.objs.size()=1 2024-09-22T09:16:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.774+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.278__shadow_.i_4J5TqA0MHg1RM3S2OlOBm3ER4ZKet_0 2024-09-22T09:16:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12997254199574754502', time=2024-09-22T10:57:27.597477+0000, chain.objs.size()=1 2024-09-22T09:16:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.281__shadow_.8P-gK4Zsj_6LIXJzKY5f825yTUZKI57_0 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11603303999607965077', time=2024-09-22T10:57:28.195668+0000, chain.objs.size()=1 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.282__shadow_.YFrfi0bg6JrT8b6lRRAhUHa1lCUxgQs_0 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10981722743159238948', time=2024-09-22T10:57:29.424394+0000, chain.objs.size()=1 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.284__shadow_.-RvRXg0rIkVavd1FrUGozVD-PL4_8Sf_0 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13597230772529814905', time=2024-09-22T10:57:36.341871+0000, chain.objs.size()=1 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.778+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_._QrSPLg_MbI1pVXx4QmBjBc5rUowETL_0 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8199445824419712912', time=2024-09-22T10:57:36.425564+0000, chain.objs.size()=1 2024-09-22T09:16:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293__shadow_.hyPokm9-8gct_lf1E7cvkOuB4-3z5_s_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17092332805970891862', time=2024-09-22T10:57:40.392235+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.297__shadow_.Gql8CW34bIjDD8CBANQFJ5Bz1E9dCYP_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10919794851682191004', time=2024-09-22T10:57:44.213483+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.303__shadow_.cmqjk26ZOnZ8Ka9rr-we-LsjdW-Vm3-_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9351487174355238887', time=2024-09-22T10:57:44.815467+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.304__shadow_.odMwValqREezRzCDgGrjCkem6T5mKzJ_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8973818183995500268', time=2024-09-22T10:58:34.533975+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ikLL0UdeWRLUETL8AxPMlDX1FzPTAPf_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9650212841162602791', time=2024-09-22T10:58:35.215351+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.RGZ_ETX7AQOxRYm8PC0wUSyPiV1gdRG_0 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8152906532492222111', time=2024-09-22T10:58:36.238240+0000, chain.objs.size()=1 2024-09-22T09:16:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.779+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nJWfHzmLHMnrqsHdDQhykZHRz6MFPJl_0 2024-09-22T09:16:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4728042081254084448', time=2024-09-22T10:58:36.610468+0000, chain.objs.size()=1 2024-09-22T09:16:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nGlLTIvO-2mLZI9yVQqEsfHG_rhGuEc_0 2024-09-22T09:16:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14935438621064755563', time=2024-09-22T10:58:36.739823+0000, chain.objs.size()=1 2024-09-22T09:16:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.6airljzUCxhS-Y-ramiUVafL_dAvOob_0 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17657934504530215396', time=2024-09-22T10:58:36.740533+0000, chain.objs.size()=1 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.782+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ceGkTJ5u6bxDlrTPvfVUJaanfr9CG1Z_0 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.765990852139763587', time=2024-09-22T10:58:37.599839+0000, chain.objs.size()=1 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.u1ugUzafxfT7dqmEO-n51AD3imtISv4_0 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.783+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1851432041107373781', time=2024-09-22T10:58:37.600563+0000, chain.objs.size()=1 2024-09-22T09:16:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.783+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.A-u8PU-VsAGDTJEucOELekIm7RMnewz_0 2024-09-22T09:16:03.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17750376977275963450', time=2024-09-22T10:58:38.087862+0000, chain.objs.size()=1 2024-09-22T09:16:03.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Xmca_EI-NxvJhrBkJC3abo_nSJ25cIt_0 2024-09-22T09:16:03.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6545526611293370625', time=2024-09-22T10:58:38.449944+0000, chain.objs.size()=1 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bttSDb1HDH4-RpyQkkcoH9Dfc3BCowa_0 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5278830959495324193', time=2024-09-22T10:58:39.004041+0000, chain.objs.size()=1 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.KV6PVYJlcqYOagc2NBYV3VPfun8RftN_0 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15225550818174631291', time=2024-09-22T10:58:39.186228+0000, chain.objs.size()=1 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.FkV6Xl0OtvzeVDhxUxvDUIsW32U1CC__0 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1486466164473056851', time=2024-09-22T10:58:39.539843+0000, chain.objs.size()=1 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CeQEGIt6B0LHTJazZzaKIQwvNxpKf9W_0 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5420371962736067539', time=2024-09-22T10:58:41.618622+0000, chain.objs.size()=1 2024-09-22T09:16:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.784+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.VoPn-RwyQfUzv_0T1adZwGsbZdLrtLb_0 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16084401007258094286', time=2024-09-22T10:58:41.955418+0000, chain.objs.size()=1 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.I0H0kDXc84dYKfGNscgsLgoMbX-U96K_0 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2791801918626828656', time=2024-09-22T10:58:42.147851+0000, chain.objs.size()=1 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.v36uh_0O2q4HF6iRnKcCnOV2UjFgGOh_0 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18226343636874398443', time=2024-09-22T10:58:42.408025+0000, chain.objs.size()=1 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.jxOO3PQDFoMh2880euCH64wBjIRxNzO_0 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8885949623072372197', time=2024-09-22T10:58:42.451630+0000, chain.objs.size()=1 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.DRTS5csIuumFS3XzfmfrC5dtmQIN36r_0 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16900912694475462266', time=2024-09-22T10:58:42.634958+0000, chain.objs.size()=1 2024-09-22T09:16:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.XOFP9dW9TkCLYzd4bF4TUG42Ip0xgCB_0 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4423242381215059745', time=2024-09-22T10:58:42.975196+0000, chain.objs.size()=1 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.r1Zatq9rV6A2TwiMOSPh-vyPeaUHP_5_0 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11807164353593348731', time=2024-09-22T10:58:43.103412+0000, chain.objs.size()=1 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.bZtgX2EVLWaVJ63KKhpVYtzxFeatyWC_0 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10685409531115916532', time=2024-09-22T10:58:43.614385+0000, chain.objs.size()=1 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.o_5rxW4qz_xA4Xqi1GgD0E0px3xc6ne_0 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7888762694699284298', time=2024-09-22T10:58:44.412768+0000, chain.objs.size()=1 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.92SlzhjC3DG3Q4U-Bo2jiVCHbs1i4fd_0 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11113084106769520835', time=2024-09-22T10:58:44.639931+0000, chain.objs.size()=1 2024-09-22T09:16:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.788+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.dUyF6-XPwX2PHTPegAXfiRHXyepX8bn_0 2024-09-22T09:16:03.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.791+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12438045691469432526', time=2024-09-22T10:58:44.974587+0000, chain.objs.size()=1 2024-09-22T09:16:03.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.791+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.X0CYZESq9u8TG2BgPqogTkCI_ENxTAu_0 2024-09-22T09:16:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12426228872656035692', time=2024-09-22T10:59:22.526902+0000, chain.objs.size()=1 2024-09-22T09:16:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.CzIC8Q9_IAqiXad187SOKW-28ytlsgq_0 2024-09-22T09:16:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1098718189976622949', time=2024-09-22T10:59:22.583579+0000, chain.objs.size()=1 2024-09-22T09:16:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UKhALzjESEZwMVQBQ9OJD9L6HnGAMSS_0 2024-09-22T09:16:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11078241835342656263', time=2024-09-22T10:59:22.584368+0000, chain.objs.size()=1 2024-09-22T09:16:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3wwTzfUrPY4Fc1E8U0aOXjLWSyZFGTC_0 2024-09-22T09:16:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4889007683510985703', time=2024-09-22T10:59:22.789324+0000, chain.objs.size()=1 2024-09-22T09:16:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.793+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.qD1v9FvmE3vjFQUcVUW-VqJPQs_RJgg_0 2024-09-22T09:16:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6895919534820235666', time=2024-09-22T10:59:22.913117+0000, chain.objs.size()=1 2024-09-22T09:16:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Y_3sdBFqJhwgOLzQ2gIY3vuI6wl_XHL_0 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15589581335954090482', time=2024-09-22T10:59:23.534190+0000, chain.objs.size()=1 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zkvy0-XCNQ2N7xLtsbm4fqQHSBfz_hb_0 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6187957119212222356', time=2024-09-22T10:59:23.736772+0000, chain.objs.size()=1 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.794+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.feLcw2TKrI4VqNjaTgUMe3da4oRP2Pm_0 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2868071655655061182', time=2024-09-22T10:59:23.848885+0000, chain.objs.size()=1 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.d0Bc5DX952MVTgJYJ5hmZsftpi1Dex2_0 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10856213470756250344', time=2024-09-22T10:59:24.219027+0000, chain.objs.size()=1 2024-09-22T09:16:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.eAQa5ZBM_neJvwKKZFNxrvdj5dEMnGu_0 2024-09-22T09:16:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9561336956496919692', time=2024-09-22T10:59:24.368039+0000, chain.objs.size()=1 2024-09-22T09:16:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.kisO4b2V1SreoNnfi8wTX3vhj9ety3V_0 2024-09-22T09:16:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6393772523250127604', time=2024-09-22T10:59:24.395722+0000, chain.objs.size()=1 2024-09-22T09:16:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.795+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nHV2Fw18Soh3eLEcWSpqbMRnCfIGsno_0 2024-09-22T09:16:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.797+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17095404534784052956', time=2024-09-22T10:59:24.479543+0000, chain.objs.size()=1 2024-09-22T09:16:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.797+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9VjBdmbdwLsCUUy0goMgpX61ivfxdrH_0 2024-09-22T09:16:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.798+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.629765245383101576', time=2024-09-22T10:59:24.526401+0000, chain.objs.size()=1 2024-09-22T09:16:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.798+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dxuQ5vfsMh-9TfvS6-jaiLx9jHT8FPH_0 2024-09-22T09:16:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.798+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5908332182582698525', time=2024-09-22T10:59:25.025169+0000, chain.objs.size()=1 2024-09-22T09:16:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.798+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ecnwAehAFMw_rF1ybjmJH2vFVhDjPHN_0 2024-09-22T09:16:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.799+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10133943294724242468', time=2024-09-22T10:59:25.026620+0000, chain.objs.size()=1 2024-09-22T09:16:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.799+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5S8qLxucJGbIimP5iG9sT139sTLCDxi_0 2024-09-22T09:16:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.799+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7357785214665811816', time=2024-09-22T10:59:25.707721+0000, chain.objs.size()=1 2024-09-22T09:16:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.799+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.B5DCKtsHqySkEmBJYvQMRvhyqi_1cwa_0 2024-09-22T09:16:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3559858363404932012', time=2024-09-22T10:59:26.509706+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ZXlv05YnkPoMHGxFvqk-DHOPygpX2lY_0 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11667084516103411974', time=2024-09-22T10:59:26.595746+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.9bp6TT93hGKzkNgg1Yooh87N17YDMbc_0 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11910700195199836561', time=2024-09-22T10:59:26.596345+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.bN9fEOo-G0hmjsAIOFdwG7yvDVZnFVh_0 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13552518254010286649', time=2024-09-22T10:59:26.682242+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fD7s352W3BGAeJ66VLBkJyBFh5OVMDl_0 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18196653547602169494', time=2024-09-22T10:59:28.888925+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2LPUPUZhwZBUxCL-e-gARN3KMb1kktC_0 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8087683664497437358', time=2024-09-22T10:59:28.889656+0000, chain.objs.size()=1 2024-09-22T09:16:03.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.800+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.xPEQN0PrJOar5xAAn9XVGK7aCVU29tJ_0 2024-09-22T09:16:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.803+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7619761073441312179', time=2024-09-22T10:59:28.914239+0000, chain.objs.size()=1 2024-09-22T09:16:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.803+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.t4ykTRiUNT14A_qsSO2l5S8cJyqJp-Y_0 2024-09-22T09:16:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.803+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8229981749695415389', time=2024-09-22T10:59:29.817293+0000, chain.objs.size()=1 2024-09-22T09:16:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.803+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jxpSiFiubCTHBbNEr1O9byjIObbGGHd_0 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9019161764850680263', time=2024-09-22T10:59:30.370521+0000, chain.objs.size()=1 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vxhVTWyojeEfrLEcbYyIvKVN8buHMzF_0 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12693415864621106981', time=2024-09-22T10:59:30.396680+0000, chain.objs.size()=1 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.z5UMcRfS5qRhhJOEIn0hywfQRNB0mNJ_0 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1131808281423759931', time=2024-09-22T10:59:30.849869+0000, chain.objs.size()=1 2024-09-22T09:16:03.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.805+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5NmHfEZmL82451edEnh9u6ZDP8aHLaT_0 2024-09-22T09:16:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1711766439274850712', time=2024-09-22T10:59:31.190813+0000, chain.objs.size()=1 2024-09-22T09:16:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sGzcesQl4qclw6pfkHaXXtSZQvjH4Ly_0 2024-09-22T09:16:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13843727067931569952', time=2024-09-22T10:59:31.343414+0000, chain.objs.size()=1 2024-09-22T09:16:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.h0VrBp8qTARuh3etWQ6gVCAghttAOIL_0 2024-09-22T09:16:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14926909896030160479', time=2024-09-22T10:59:31.443513+0000, chain.objs.size()=1 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.L4axeSUt9UabXmEr39fXdC8drkrDF5Z_0 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8409698007343794116', time=2024-09-22T10:59:31.732018+0000, chain.objs.size()=1 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.aO_RGspfVfK5bdUjgyGlTkdJ4CqE2eB_0 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4390813941100027034', time=2024-09-22T10:59:32.461758+0000, chain.objs.size()=1 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zi6HvqIOkj3VgrxzY7e5NXCscJRM0LX_0 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17129662958820208641', time=2024-09-22T10:59:32.863825+0000, chain.objs.size()=1 2024-09-22T09:16:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.807+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.UXcssPlUxBgRonI60WdbMOswx4RRRUP_0 2024-09-22T09:16:03.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.812+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44952 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17685632454269598988', time=2024-09-22T10:59:32.956053+0000, chain.objs.size()=1 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.lnn8UEW3VZnYzpWF7NdkNHnjuXzasln_0 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17209768896167895719', time=2024-09-22T11:00:47.178313+0000, chain.objs.size()=1 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.461__shadow_.cq6BulrqNYkkNC41NUifsyRHsXSmQGF_0 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3578294107182447499', time=2024-09-22T11:00:59.859271+0000, chain.objs.size()=1 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.484__shadow_.1pU6Xn3Ya8zpSPPnW6xBDaLx3_TwJ_m_0 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13775933321916791835', time=2024-09-22T11:01:07.184136+0000, chain.objs.size()=1 2024-09-22T09:16:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.492__shadow_.NVvrZwC1QbKzbg1ZyEd9vBygsa9UVgv_0 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12011686745460918196', time=2024-09-22T11:01:11.960234+0000, chain.objs.size()=1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.501__shadow_.wtgoFKkHImqLfEjFl68R2X5xz8cWp_G_0 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~7NVNfZ0hXCtEPMgH67728bjByj78vSm', time=2024-09-22T11:03:15.990161+0000, chain.objs.size()=2 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.530__multipart_mymultipart.2~7NVNfZ0hXCtEPMgH67728bjByj78vSm.1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.530__multipart_mymultipart.2~7NVNfZ0hXCtEPMgH67728bjByj78vSm.2 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~4X0vTYtOSyeE7gU7MTDhotArLGAj9un', time=2024-09-22T11:03:19.231928+0000, chain.objs.size()=1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.532__multipart_mymultipart.2~4X0vTYtOSyeE7gU7MTDhotArLGAj9un.1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17235495575783836208', time=2024-09-22T11:05:37.053994+0000, chain.objs.size()=1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:-WVQH1FopRTOapJEqhBfbDEqn5WJqGN_.PA3WmvKUA-AXoj9a4oBWm5kxefPbqqx_0 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.612244250898596387', time=2024-09-22T11:05:37.352837+0000, chain.objs.size()=1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.588__shadow:XmkWkN6A-rANlz-gLTtEhAZNjtmx12E_.Pw2OaH1HuCutWnyK3hXBSuOWXRrjTLE_0 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9407352410058042833', time=2024-09-22T11:05:45.818626+0000, chain.objs.size()=1 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.605__shadow_.4ICUbb8_MGGn84MwsFrkMs8-yuJX_1Y_0 2024-09-22T09:16:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17443937845326028176', time=2024-09-22T11:09:38.085972+0000, chain.objs.size()=1 2024-09-22T09:16:03.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.814+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.644__shadow_.-oppEreC5yRqt0I4ntQV7LoHJqUa9wL_0 2024-09-22T09:16:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.818+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6462584783639800', time=2024-09-22T11:09:49.186555+0000, chain.objs.size()=1 2024-09-22T09:16:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.818+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.652__shadow_.aREnyvVNtVYW9jbg9hoa4qvSSim1Rck_0 2024-09-22T09:16:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7560610209290243333', time=2024-09-22T11:10:40.671218+0000, chain.objs.size()=1 2024-09-22T09:16:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.711__shadow:H9QnlsvXsX1BPBdjEVEXeEh-1xioEoa_.uRqY_xEmHjsC38mHUXCvEF7upjObEeB_0 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9024089223967895348', time=2024-09-22T11:12:14.817962+0000, chain.objs.size()=1 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.754__shadow_.k6WRMzTtMLcSKQcf1hNUbEvcgcU1bnw_0 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2129824056924254481', time=2024-09-22T11:12:59.119396+0000, chain.objs.size()=1 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.769__shadow_.Hj3wKHjVHBYlEs6epyiGkEuHd2WuPj2_0 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2081188269826888435', time=2024-09-22T11:13:23.045660+0000, chain.objs.size()=1 2024-09-22T09:16:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.819+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.777__shadow_.ixT6x7e9Vc7fN-Mq0JDfmtVJtUHXAe1_0 2024-09-22T09:16:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.823+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.825+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.826+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.827+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/69714' 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11892030857060529193', time=2024-09-22T10:54:13.655958+0000, chain.objs.size()=3 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-FROZEN.2~ZqkEIRO-tUkF-EazA0-sVPzzhGJ6onx.1 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-FROZEN.2~ZqkEIRO-tUkF-EazA0-sVPzzhGJ6onx.2 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-FROZEN.2~ZqkEIRO-tUkF-EazA0-sVPzzhGJ6onx.3 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9474270452633030291', time=2024-09-22T10:54:31.241435+0000, chain.objs.size()=1 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.177__shadow_.Bp7cZdD1zGYIQq3NgOBPEIj_mC4FE5f_0 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13991200030068987716', time=2024-09-22T10:54:37.258161+0000, chain.objs.size()=1 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.190__shadow_.6pscvGoOdSJIdk1IEcL65_qze9zYYOf_0 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3664317116953668799', time=2024-09-22T10:56:14.393629+0000, chain.objs.size()=1 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.238__shadow_.GpfIUr31b-jpB-oP4bS07y9n-qBH6jl_0 2024-09-22T09:16:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16807709263534145056', time=2024-09-22T10:56:15.779321+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.240__shadow_.3ewCZUdA8YrDqXU1oIgOciS4HiVNzqV_0 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1817893590220624941', time=2024-09-22T10:56:16.907095+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.242__shadow_.c6kvLnCw-DCvvLU22obmSkAycQUojGu_0 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9107749051225468792', time=2024-09-22T10:56:19.964280+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.246__shadow_.3b_8bqjd1z1exHUYXXOTen-oe9rM5dL_0 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16045049551819780410', time=2024-09-22T10:56:25.553930+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.255__shadow_.9CYAt3cpeWO6llMWRxV_ihoADczufMC_0 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5083545428789259721', time=2024-09-22T10:57:05.923135+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.TT9Y467ijNQ1kQROM2lwkI4S9D6zGxk_0 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13524317106259723391', time=2024-09-22T10:57:06.114576+0000, chain.objs.size()=1 2024-09-22T09:16:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.828+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.G56bOjttAbtbTR3pbgtWICepgmiZ4Fa_0 2024-09-22T09:16:03.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.831+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8659417101773060641', time=2024-09-22T10:57:06.237481+0000, chain.objs.size()=1 2024-09-22T09:16:03.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.831+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.8phqq_lutc40_NCkQLEfj4AgrCX9BqZ_0 2024-09-22T09:16:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11504948367184524973', time=2024-09-22T10:57:06.322095+0000, chain.objs.size()=1 2024-09-22T09:16:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.r8mQdzCME6NFOPJb-qSCkg0R78x5WBf_0 2024-09-22T09:16:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18338938863762470793', time=2024-09-22T10:57:06.533249+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pnY2aEwMVnRdYj4JkxcRgU72TLRPosB_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.440260259759255045', time=2024-09-22T10:57:06.681347+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.R7mhu2YD8qLfbs6Vts1MSb3LFxkasFW_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18346434613161599764', time=2024-09-22T10:57:06.682261+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LfQiCORTC4CpeZOlYXFD5hKgpLiZu2b_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3550914008985146049', time=2024-09-22T10:57:07.678029+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.c9NHCGbUQmbmh6j5ZQADBLS2ho3hsVn_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9746195693892887388', time=2024-09-22T10:57:07.819023+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pZ8DPy-YY0esec5z61RALWeAb9aXXfJ_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11025430555739264383', time=2024-09-22T10:57:08.219295+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xiUMoLKcvsllEgRWSm_Xi8E09h4O5OA_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5413263203656088239', time=2024-09-22T10:57:08.502257+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uZlWX3qmrIqwcUP6nFGridEo-o6_aAB_0 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11432863855134388083', time=2024-09-22T10:57:08.526819+0000, chain.objs.size()=1 2024-09-22T09:16:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.g1b36P5Tmz6mwYY0TaUBWlJzt7YzTvX_0 2024-09-22T09:16:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10683593922562809134', time=2024-09-22T10:57:09.296283+0000, chain.objs.size()=1 2024-09-22T09:16:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.833+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JeXuBw2DrllHd0Tf54cceA3RHdENAjo_0 2024-09-22T09:16:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.836+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12693388174750265999', time=2024-09-22T10:57:09.386937+0000, chain.objs.size()=1 2024-09-22T09:16:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.836+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XvMZsUQxCxVsFI_USqBknX_EeqZRoUy_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8094808729548356287', time=2024-09-22T10:57:09.784319+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pYq0Dxa-GYIL3aiR06YDTZBULMp6V-r_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11781770637480161339', time=2024-09-22T10:57:09.882727+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.-xUXx_2KEXcIF335t_6hPxwzhI7R8V6_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8493337156319505623', time=2024-09-22T10:57:10.033276+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.xsmqfZjVlS1iN7Qt4aNayMK08cCpsRO_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4065196826938455918', time=2024-09-22T10:57:10.878935+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.EVSbq4Yo62pmDO90MC3Vwx4LpgAdkyT_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16069909783722882671', time=2024-09-22T10:57:11.195294+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.4PZi8ababTKWthDXZdeApcIuyEItkkK_0 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555028878303376878', time=2024-09-22T10:57:11.885510+0000, chain.objs.size()=1 2024-09-22T09:16:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.XKlxZdwjXB_EakL9qR9bStmOzVuR1nI_0 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7678030921236503257', time=2024-09-22T10:57:12.096055+0000, chain.objs.size()=1 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.He8Np1eCC39WbdlTJeXRymDgGacC3RQ_0 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9092071110349860341', time=2024-09-22T10:57:12.186564+0000, chain.objs.size()=1 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zUmRXcfUXDKD_hYxAOXosmOvsVULH5e_0 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1424692749146111362', time=2024-09-22T10:57:12.300340+0000, chain.objs.size()=1 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.tpYEh6fFDwtY_l3XiZfokZdPEUS83Bw_0 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10212121809612735797', time=2024-09-22T10:57:12.655259+0000, chain.objs.size()=1 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.838+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Cu0qI9u2P9GKt4Z4TJmNLpWsMHSmA53_0 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.839+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.374468486681913379', time=2024-09-22T10:57:12.674936+0000, chain.objs.size()=1 2024-09-22T09:16:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.839+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6DF7-aS11oJSbn8Tl8V8We3mCcmtlCq_0 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.168209864320497561', time=2024-09-22T10:57:13.218972+0000, chain.objs.size()=1 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.SeCfN8rO6o__s6X5yLC2WB8akZGhlr1_0 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6214655214215626454', time=2024-09-22T10:57:13.356668+0000, chain.objs.size()=1 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.AGfxI-OCW4bcX9kFsLqYjTFCGxFT10x_0 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11055535112598955944', time=2024-09-22T10:57:14.766611+0000, chain.objs.size()=1 2024-09-22T09:16:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pC9WTI8B43JtiVkROCAPtm9zX1dmWNR_0 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12873970695426427190', time=2024-09-22T10:57:15.216127+0000, chain.objs.size()=1 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.azzDQUhBaTca6CWYWbb31u3vEUpDbkq_0 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9161317691961171053', time=2024-09-22T10:57:15.265579+0000, chain.objs.size()=1 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.PIujieK4cRoN_eOnwRY3vha7iCNssG0_0 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11851185862302062947', time=2024-09-22T10:57:15.509249+0000, chain.objs.size()=1 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.hMmr3mo7Edx_YKRpuj8BQo0SfcQvEGB_0 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16996292028710888496', time=2024-09-22T10:57:16.129997+0000, chain.objs.size()=1 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.843+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.C4-wjoC9xlvw1VVxRweXZ-wJ20IGoPv_0 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.751991232260785891', time=2024-09-22T10:57:16.151616+0000, chain.objs.size()=1 2024-09-22T09:16:03.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JW8AtVcYUvjzu__czRfwYejz9YHOEhn_0 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.293658995973283094', time=2024-09-22T10:57:16.396982+0000, chain.objs.size()=1 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.fa9x6H4CKVc1iZhADJnWEcNmKosu4eS_0 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9540869468983204622', time=2024-09-22T10:57:16.848606+0000, chain.objs.size()=1 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.844+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rIy2VIPGn8AIINH5G-u4pOPoUjPdphZ_0 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.845+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7796179137616258697', time=2024-09-22T10:57:18.192543+0000, chain.objs.size()=1 2024-09-22T09:16:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.845+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.265__shadow_.11n3MCJVpvQj9kpVRE9NebRrOb3UoQt_0 2024-09-22T09:16:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.847+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4240305304534570399', time=2024-09-22T10:57:26.388675+0000, chain.objs.size()=1 2024-09-22T09:16:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.847+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.279__shadow_.OIfFDVaG2Ok9e1ZTopQ35Qk_OwfhD3Q_0 2024-09-22T09:16:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.847+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2200106704424183173', time=2024-09-22T10:57:32.643528+0000, chain.objs.size()=1 2024-09-22T09:16:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.847+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.289__shadow_.rWdfMrGM2zwYDDY3VdWmKeNxSqvKuUw_0 2024-09-22T09:16:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.847+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9841850539551464412', time=2024-09-22T10:57:33.252378+0000, chain.objs.size()=1 2024-09-22T09:16:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.290__shadow_.bvl_IiB2J-peUoOdg5yN6MKs9jYVE42_0 2024-09-22T09:16:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3340141076528666004', time=2024-09-22T10:57:39.797393+0000, chain.objs.size()=1 2024-09-22T09:16:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.296__shadow_.zzeATpcAd8Vk91FlD5K52ArrJads9Vb_0 2024-09-22T09:16:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14072886806925225714', time=2024-09-22T10:57:40.404967+0000, chain.objs.size()=1 2024-09-22T09:16:03.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.297__shadow_.swwL2YEoCluMCJSvXO8nZpmNzXTgOtW_0 2024-09-22T09:16:03.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6187195675681550822', time=2024-09-22T10:57:43.604928+0000, chain.objs.size()=1 2024-09-22T09:16:03.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.848+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.302__shadow_.-jt85aZ198y90ugIMLqrvzwYmY05HCu_0 2024-09-22T09:16:03.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5077275537073783964', time=2024-09-22T10:57:45.415580+0000, chain.objs.size()=1 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.305__shadow_.mo0WalMeRYJIroqJG0cYH23wEZlle73_0 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17626635918091084534', time=2024-09-22T10:57:55.115622+0000, chain.objs.size()=1 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.320__shadow:8UgFWNYmB6x-yXpvxiagOqdwfEGrgPp_.MzsxBG9D2K7Bl-zEyeGBDQ9dPJxSQSt_0 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7425754802312682478', time=2024-09-22T10:58:34.396155+0000, chain.objs.size()=1 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.qB9PLCxfkZWdHg-V0Xt6_Qb3KaXoZ91_0 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17519741875405989510', time=2024-09-22T10:58:34.872358+0000, chain.objs.size()=1 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.849+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.CjstT8ZTG5l7H_MLZHnOrDSo3V3XK0i_0 2024-09-22T09:16:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.850+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9085111641206389501', time=2024-09-22T10:58:34.951916+0000, chain.objs.size()=1 2024-09-22T09:16:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.850+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wB3Z58AjnuGJvKYgnMiqrEjglgV2XbR_0 2024-09-22T09:16:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.851+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2342369875559796330', time=2024-09-22T10:58:35.218039+0000, chain.objs.size()=1 2024-09-22T09:16:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.851+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.LJb1a_tCHtEdjvaeaceRdMsety-S8A8_0 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16659822044264325880', time=2024-09-22T10:58:35.971438+0000, chain.objs.size()=1 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Yn45bwZDRUSWTWgt7qtauSTyYhhLOru_0 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7685031633126173962', time=2024-09-22T10:58:36.499668+0000, chain.objs.size()=1 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.If_vaZ8jzBBUaK9Y58UJx_CoOOaRljq_0 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14663190307689231887', time=2024-09-22T10:58:36.926410+0000, chain.objs.size()=1 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.853+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.nOrpkE92WpyOsdEZyQiFZqCzQ1lPwSU_0 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9698071499385988591', time=2024-09-22T10:58:36.966998+0000, chain.objs.size()=1 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MkQHnQs3lse7cnU2QPGyPsO049wKmfe_0 2024-09-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3465651901574482127', time=2024-09-22T10:58:37.468568+0000, chain.objs.size()=1 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.pfys-YL7s3_60QaVDV7sYP7kVGwCSlj_0 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8024617312162671941', time=2024-09-22T10:58:37.603635+0000, chain.objs.size()=1 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.854+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.cYt1bUMm6OOjXVhPc08ROJRHLusH5zm_0 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3835891665656607549', time=2024-09-22T10:58:37.859795+0000, chain.objs.size()=1 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4K-b4cFs0yTGUQsQoqljQMdIcGW2TkJ_0 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9048163865845249349', time=2024-09-22T10:58:37.937747+0000, chain.objs.size()=1 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.lwJE443AZqmRlQ68R45OnXFmIplisVy_0 2024-09-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15171629046759421810', time=2024-09-22T10:58:38.376610+0000, chain.objs.size()=1 2024-09-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.855+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZLed0dIRqHa-3GGZeepvb1av-NAhsK5_0 2024-09-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.856+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2372096276917185056', time=2024-09-22T10:58:39.163045+0000, chain.objs.size()=1 2024-09-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.856+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WChNgyZka8FXy_ZRxO-g8HTivjDIqCv_0 2024-09-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.856+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5256972656198125555', time=2024-09-22T10:58:39.532560+0000, chain.objs.size()=1 2024-09-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.856+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.hqAz3avg5hJIYuwm7Jb4MjRUxf_F6ml_0 2024-09-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11484146732895290397', time=2024-09-22T10:58:39.596400+0000, chain.objs.size()=1 2024-09-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.0dSS2Izp1fiA_cjLoy7q6p9yrxMiEDx_0 2024-09-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5006054339533324375', time=2024-09-22T10:58:40.439860+0000, chain.objs.size()=1 2024-09-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.fBTXw0E6778GswtoJ6J1pebXS6WomD3_0 2024-09-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.312504098434666700', time=2024-09-22T10:58:40.477610+0000, chain.objs.size()=1 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.EDex0d8wHYYEU-eDklNktrY-u2LvZwQ_0 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10540331850181417615', time=2024-09-22T10:58:40.763619+0000, chain.objs.size()=1 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ct9A9yED5t4spuGectOp4bz1ZWLh6on_0 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4214828044211259948', time=2024-09-22T10:58:41.038545+0000, chain.objs.size()=1 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.l9FTCoNK8sTS2I9PpaYYiMt45Ikp_G2_0 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8544335760855425709', time=2024-09-22T10:58:41.988839+0000, chain.objs.size()=1 2024-09-22T09:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.858+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.IaVXPsDbeLLuFlLMxJYvQ3c53kiMjNH_0 2024-09-22T09:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.860+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4894393582434939028', time=2024-09-22T10:58:42.468621+0000, chain.objs.size()=1 2024-09-22T09:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.860+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.Cte16cSF2YJNj1nt0gd1sxgiRdXxhTY_0 2024-09-22T09:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12773002901434302057', time=2024-09-22T10:58:43.221993+0000, chain.objs.size()=1 2024-09-22T09:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xfzQNntDSG8aCZeC800ePUWv6c2TcSJ_0 2024-09-22T09:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18089775647677996477', time=2024-09-22T10:58:43.511842+0000, chain.objs.size()=1 2024-09-22T09:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4HL6QtZI_I9x9d80w8jwnS6JauuGw0k_0 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15947814792225330903', time=2024-09-22T10:58:44.740518+0000, chain.objs.size()=1 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-nYzluOGCn8nPWNCVO4gmg4UgwE4w6y_0 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11089108627873101368', time=2024-09-22T10:58:44.741122+0000, chain.objs.size()=1 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.PMrbXYI8BjQEtAOBVkzj-IKMb6DHly8_0 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.171964259905179178', time=2024-09-22T10:58:45.010347+0000, chain.objs.size()=1 2024-09-22T09:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.861+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.MaCiCKqdPSUFxvrw4avSXlCbOvF0I0s_0 2024-09-22T09:16:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1879125483243306526', time=2024-09-22T10:59:21.988200+0000, chain.objs.size()=1 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0TSArorMkCrdI8i-UDyc71IfnIgrecR_0 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2444701184162129236', time=2024-09-22T10:59:22.132826+0000, chain.objs.size()=1 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.HUr9ojAr9Ep45acUL6x7A0xtEysblMF_0 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15914602827979968912', time=2024-09-22T10:59:22.342862+0000, chain.objs.size()=1 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.jZMIsA8MABb-5Ouz5PUpzGvEaewv-9B_0 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13521225390659863032', time=2024-09-22T10:59:22.497394+0000, chain.objs.size()=1 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.863+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.x4UmGpIb40au-QG2GDncGLoWamoFra5_0 2024-09-22T09:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.864+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16471446242296256668', time=2024-09-22T10:59:22.624871+0000, chain.objs.size()=1 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.864+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.0Bu3uHMPpksgAWCxuIWOCDgwNV5Hdhv_0 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.864+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11517217400200829994', time=2024-09-22T10:59:23.623036+0000, chain.objs.size()=1 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.864+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.s6iesuuXZSTLjBOKB7r3z6lV8252hzg_0 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.865+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13370726134376385101', time=2024-09-22T10:59:23.671454+0000, chain.objs.size()=1 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.865+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Do-OxyY1pA5cKRzkyASATFJhsZ5gqXz_0 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.865+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6075188296977531298', time=2024-09-22T10:59:23.704889+0000, chain.objs.size()=1 2024-09-22T09:16:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.865+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Dv3P9Sn9EhHR3e_vXib_l8vVnokWSGn_0 2024-09-22T09:16:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11035596601691841546', time=2024-09-22T10:59:23.823754+0000, chain.objs.size()=1 2024-09-22T09:16:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.sKXz4JlOTXEhK3NUdayEU0loWChHuyN_0 2024-09-22T09:16:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.552632223910214897', time=2024-09-22T10:59:24.194863+0000, chain.objs.size()=1 2024-09-22T09:16:03.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.fgeCsHb5cfBhXzFTQhYuVkMHiLlII19_0 2024-09-22T09:16:03.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9158847551039961079', time=2024-09-22T10:59:25.666803+0000, chain.objs.size()=1 2024-09-22T09:16:03.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.867+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.5826-b8zFU2oMylQT_f8QjvAVbE-hQR_0 2024-09-22T09:16:03.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7470624051857788839', time=2024-09-22T10:59:26.731669+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.twbcNGUfwbSlTD2PeVPo-4VkpwPr285_0 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12129452936542588107', time=2024-09-22T10:59:26.838774+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TKG5LFTPR-dgcjVIIie8Vs1KJ6OO890_0 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2575842566416007615', time=2024-09-22T10:59:27.416266+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Ihm_mqaVMCsCAwfHrLop6MvLTPtXT5e_0 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2379149168772879561', time=2024-09-22T10:59:28.960678+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.acjrldTbYxmSBkkwn4twCemtjetoV2S_0 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6236459078376341542', time=2024-09-22T10:59:29.078295+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.zaVf0Ooun4FmLo4gFydNpHD-cIEs4lD_0 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11135169662859673645', time=2024-09-22T10:59:29.910550+0000, chain.objs.size()=1 2024-09-22T09:16:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.869+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6rjGegJrrD6jzgcA246-C4lki2a-n-y_0 2024-09-22T09:16:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.870+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6290444548950004715', time=2024-09-22T10:59:29.952102+0000, chain.objs.size()=1 2024-09-22T09:16:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.870+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.ea7oW03iJPewjZQ3L9XMHoKMWuv-4nj_0 2024-09-22T09:16:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.870+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5012610441519190966', time=2024-09-22T10:59:30.124621+0000, chain.objs.size()=1 2024-09-22T09:16:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.870+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RADWFGds-9-xSqE0ntaw6G2YWLVEXRa_0 2024-09-22T09:16:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1317489161450703206', time=2024-09-22T10:59:30.126275+0000, chain.objs.size()=1 2024-09-22T09:16:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-UWIQ5mi4ojsLe20N3iDRgFYu_QdUlK_0 2024-09-22T09:16:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.872+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17866536019820999126', time=2024-09-22T10:59:30.528796+0000, chain.objs.size()=1 2024-09-22T09:16:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.872+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.3p7Pswo4DjbK8mSwA6CHQKV4ppZ1o79_0 2024-09-22T09:16:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.876+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/69714 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16947679421733428938', time=2024-09-22T10:59:30.903234+0000, chain.objs.size()=1 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.cw80Z4A2jHsoY0BBJyYolpTIFxrKcuT_0 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17388875882167719298', time=2024-09-22T10:59:30.944429+0000, chain.objs.size()=1 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.c759NzzADw5j36jQ9rLj5wcI_Hqy7JQ_0 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13135969287641723011', time=2024-09-22T10:59:31.065635+0000, chain.objs.size()=1 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qy2H2rek_4Rq2Y5UuQwkrLzPbX4w08x_0 2024-09-22T09:16:03.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16598597457038185401', time=2024-09-22T10:59:31.076846+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.AvbAnGHtjNVYd7raS7jIe75Z_lHJEio_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13254456244300466924', time=2024-09-22T10:59:31.317928+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.Qa5AmSem3oWNAFqLwoPn_DhQrZ7tDqJ_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13264530669293700489', time=2024-09-22T10:59:31.344212+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.JYcUkuSZR6IDG5_LJy47PiaYl9Ahh4s_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15829786567433386838', time=2024-09-22T10:59:32.162611+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.al8j1TnYYBd26EeGAMUaMYe6d6_oUvI_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17992029778680698452', time=2024-09-22T10:59:32.793243+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_._QXHlJk-VJw4jum_poMZ2-vfTY28WDS_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.55535332388196374', time=2024-09-22T10:59:39.835460+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.338__shadow_.HjcNvngvFdTxxw01nU9Ke86iDtC79Jr_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12113263488976547333', time=2024-09-22T11:00:02.980771+0000, chain.objs.size()=1 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.383__shadow_.VfOC7Dyyu_PoSUYu_clMAaeH1MmMnlc_0 2024-09-22T09:16:03.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3260858896732295161', time=2024-09-22T11:00:04.169872+0000, chain.objs.size()=1 2024-09-22T09:16:03.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.385__shadow_.G_lPaXrSPNkHPYSmhVU2qHpf6wassky_0 2024-09-22T09:16:03.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.51406133549419055', time=2024-09-22T11:00:43.931248+0000, chain.objs.size()=1 2024-09-22T09:16:03.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.879+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.457__shadow_.h26Gkb2GV_tIeiWzgtBMTubl-N6twJ3_0 2024-09-22T09:16:03.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.882+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17766151096106859959', time=2024-09-22T11:01:07.437919+0000, chain.objs.size()=1 2024-09-22T09:16:03.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.882+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.492__shadow_.NVvrZwC1QbKzbg1ZyEd9vBygsa9UVgv_0 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9573467009726407912', time=2024-09-22T11:01:11.707904+0000, chain.objs.size()=1 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.500__shadow_.MqykUcMQ2Ge2tdK6-g2kR3ju3Vn2QzL_0 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15555864610317219041', time=2024-09-22T11:01:34.987398+0000, chain.objs.size()=1 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.518__shadow_.8YzGW7CWW5rgO6JAZ7rNk635cNL8hLr_0 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO', time=2024-09-22T11:02:01.721682+0000, chain.objs.size()=1 2024-09-22T09:16:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.883+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.523__multipart_mymultipart.2~xay2ePqZt5IdC1NLsDEkTbclqn7ipGO.1 2024-09-22T09:16:03.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.884+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13909754149076064993', time=2024-09-22T11:02:51.429467+0000, chain.objs.size()=2 2024-09-22T09:16:03.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.884+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~OcQkTyUl3hcafAN3yRrbSvnyXopicRt.1 2024-09-22T09:16:03.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.524__multipart_mymultipart.2~OcQkTyUl3hcafAN3yRrbSvnyXopicRt.2 2024-09-22T09:16:03.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18321889108187386918', time=2024-09-22T11:04:33.787692+0000, chain.objs.size()=1 2024-09-22T09:16:03.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.570__shadow:BnFCuqJCPwuCJUAOdx9au6Hy.h0pm.h_.y5sP9F_dUrKCQ75kTU-GeTgpSX8-0xQ_0 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.716051648232383779', time=2024-09-22T11:05:00.322315+0000, chain.objs.size()=1 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:8CiWX9upGvMCOUzBRscdJkTddNSnEdu_.2Hzlj_XaFfkAHwTp25UfUHqcjkj1xJO_0 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1643468681346238049', time=2024-09-22T11:05:10.759926+0000, chain.objs.size()=1 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:gdY6AH.iq-6HyvUG8Wd16vDi76SXN3S_.D9wDeYkiNKrgScdSussmPFPle4RBjzD_0 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13268903590106406037', time=2024-09-22T11:05:25.869775+0000, chain.objs.size()=4 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~MI5W0zfXJBsqrgT-K1s_R26sW4CtLAp.1 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~MI5W0zfXJBsqrgT-K1s_R26sW4CtLAp.2 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.885+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~MI5W0zfXJBsqrgT-K1s_R26sW4CtLAp.3 2024-09-22T09:16:03.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.886+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.579__multipart_testobj.2~MI5W0zfXJBsqrgT-K1s_R26sW4CtLAp.4 2024-09-22T09:16:03.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4635906516388093242', time=2024-09-22T11:05:29.420685+0000, chain.objs.size()=1 2024-09-22T09:16:03.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.580__shadow:L-08HbbEWLv2FQ0xVhYSzhubQDKckS6_.qoOddLPpFYCVlrdZR81aZGeSnYGGbPg_0 2024-09-22T09:16:03.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.887+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2113715542207785918', time=2024-09-22T11:05:31.706873+0000, chain.objs.size()=1 2024-09-22T09:16:03.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.887+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:zGvY61yiMqbYmcM8Z6loyfc3ljNg.Lj_.dIrkZHXTgEHZlC5U2mhLuGBHfzJmpkB_0 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9', time=2024-09-22T11:09:26.538456+0000, chain.objs.size()=6 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.1 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.2 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.3 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.4 2024-09-22T09:16:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.890+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.5 2024-09-22T09:16:03.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.626__multipart_multipart_enc.2~6Dxt2Xwv4eejm1os9hHaXeA1Scaqqz9.6 2024-09-22T09:16:03.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.891+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9913771444279572691', time=2024-09-22T11:10:18.429082+0000, chain.objs.size()=1 2024-09-22T09:16:03.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.891+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.669__shadow_.PWh2HS864G4Ong1HWL7N0gWQbEHLZGJ_0 2024-09-22T09:16:03.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17760193416597259960', time=2024-09-22T11:10:34.414916+0000, chain.objs.size()=1 2024-09-22T09:16:03.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.701__shadow:y23Fj.E6dW4yZ4t1OwN7UrlUq6J-C3D_.aV054ZevyXUzcz4Y1cM2X-8eOPLZZPk_0 2024-09-22T09:16:03.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.893+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.18424503124486871815', time=2024-09-22T11:10:38.808029+0000, chain.objs.size()=1 2024-09-22T09:16:03.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.893+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.708__shadow:Rj8aero6SLPkdEMSnbJyiiZ3m9DmtW0_.Nq_vzg0frUMrDI-ths_Wp0XjzUoF_6U_0 2024-09-22T09:16:03.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.898+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.901+0000 7f56fdd25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:03.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:03.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.902+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:03.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48624' 2024-09-22T09:16:03.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3147670536661588764', time=2024-09-22T10:53:55.508276+0000, chain.objs.size()=1 2024-09-22T09:16:03.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.158__shadow:XaFJAbeUu5kS9bfqG2clgvoiD8fV-4J_.4_a8hbTg5DKICSgZSQicWLmzfDWeLeY_0 2024-09-22T09:16:03.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_XEkf5jhlu4PTJP4YuXHSfDiDQjW4JdO', time=2024-09-22T10:54:07.800189+0000, chain.objs.size()=2 2024-09-22T09:16:03.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.G0Evb1fR7QUTkwrhncFkotV0-nuCiql_0 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.161__shadow_.G0Evb1fR7QUTkwrhncFkotV0-nuCiql_1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='_nj63RP3eFdIrLcQQNbNHtANc71s5Syv', time=2024-09-22T10:54:09.739752+0000, chain.objs.size()=1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__shadow_.6ukvCDlKCpaLwONOl47CYXaBZtEN573_0 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1382012178375325724', time=2024-09-22T10:54:11.470462+0000, chain.objs.size()=3 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-LUKEWARM.2~41-x9_beLIPxJdHnb8lg7_sagOjPKL9.1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-LUKEWARM.2~41-x9_beLIPxJdHnb8lg7_sagOjPKL9.2 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.162__multipart_foo-LUKEWARM.2~41-x9_beLIPxJdHnb8lg7_sagOjPKL9.3 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14569675021027114117', time=2024-09-22T10:56:20.567864+0000, chain.objs.size()=1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.247__shadow_.lObu5g_59RRJvEMf7GfhpJ9YSIep8AR_0 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.609308813201701744', time=2024-09-22T10:56:24.237398+0000, chain.objs.size()=1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.253__shadow_._C64ZNSUuBPTwk3LMltN3LVAZQyNuAF_0 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6459377992073152902', time=2024-09-22T10:57:06.082052+0000, chain.objs.size()=1 2024-09-22T09:16:03.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ruq_y7uCMHFaXiodjSE98JgvetRr-SP_0 2024-09-22T09:16:03.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16382869386331168360', time=2024-09-22T10:57:06.457415+0000, chain.objs.size()=1 2024-09-22T09:16:03.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.LlmNkHLWck_W_y0XoY7-WoXXuRJNwPi_0 2024-09-22T09:16:03.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.946712737005339472', time=2024-09-22T10:57:06.526117+0000, chain.objs.size()=1 2024-09-22T09:16:03.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.903+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.3x3kmPggI5wrUKGwY1EtQ7kOvicNWw-_0 2024-09-22T09:16:03.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.906+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1040676292912033268', time=2024-09-22T10:57:06.683682+0000, chain.objs.size()=1 2024-09-22T09:16:03.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.906+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.kQES47sqn9oxmB39JTtYRGjAauk_XAS_0 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5324575163002546309', time=2024-09-22T10:57:06.789173+0000, chain.objs.size()=1 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ao8FatVgjUfLCTE3udAPgES8zWo0HOw_0 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9139124404363293045', time=2024-09-22T10:57:06.812802+0000, chain.objs.size()=1 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.dXDowfNETchtEKwiRg0rdLTwsC-JaHo_0 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3018903993553817125', time=2024-09-22T10:57:06.864799+0000, chain.objs.size()=1 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.907+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zVB6Ayh3qYXvEQ9KwcqiTN6Znbz6YhB_0 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.239597935531174774', time=2024-09-22T10:57:07.529908+0000, chain.objs.size()=1 2024-09-22T09:16:03.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1-5XLU_L0v2Hj8YmCWZK419qBSn6cj0_0 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10834760982767189181', time=2024-09-22T10:57:07.731039+0000, chain.objs.size()=1 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.bmPCTL1_2uiViugqarlOXWrx_YAcg-d_0 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2942860411945807288', time=2024-09-22T10:57:07.875097+0000, chain.objs.size()=1 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.WxD2-_Tz62y4H6aChiUuEd1tqt1lVW3_0 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10325356377450706201', time=2024-09-22T10:57:08.219975+0000, chain.objs.size()=1 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.908+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mN_ipqZHJQ_XQANmngvjLc4yanaq5hs_0 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1515333363784152577', time=2024-09-22T10:57:08.321164+0000, chain.objs.size()=1 2024-09-22T09:16:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.91RG9UbLY2H4udnXnF0H9xx5egF-eVe_0 2024-09-22T09:16:03.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8277210844538448838', time=2024-09-22T10:57:09.056077+0000, chain.objs.size()=1 2024-09-22T09:16:03.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.zwWlMRoWBVMbTiZO2igFY8mnM4AHJ5E_0 2024-09-22T09:16:03.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15962233597750266452', time=2024-09-22T10:57:09.358568+0000, chain.objs.size()=1 2024-09-22T09:16:03.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.909+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.HOe1u4o3Vezbo_PBDez81ap5ksP6of9_0 2024-09-22T09:16:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10341240712447368835', time=2024-09-22T10:57:09.554284+0000, chain.objs.size()=1 2024-09-22T09:16:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.oxh3IyxQVLlvlf-tQ9QDqtYZwiotBxh_0 2024-09-22T09:16:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.602162322538763234', time=2024-09-22T10:57:09.646086+0000, chain.objs.size()=1 2024-09-22T09:16:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ZdeCmRR0rSPHhVn3ZOtOySU7_lmf1my_0 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14138869595872877630', time=2024-09-22T10:57:09.695840+0000, chain.objs.size()=1 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.JQ5n1PZQTfiOFq5oNi3t6v33sEAKaZI_0 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5260534356567159482', time=2024-09-22T10:57:09.806234+0000, chain.objs.size()=1 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.7odrllbYLh4oTbO4wu-i9_IrCmztnFw_0 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2283348417638524811', time=2024-09-22T10:57:10.439060+0000, chain.objs.size()=1 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.T0oZ3r3YrqX-VKouVY66JR9_NxnUul9_0 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16690946118374144603', time=2024-09-22T10:57:10.764391+0000, chain.objs.size()=1 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.j4myIrZ_jL_xsqf3yuoqd2oW1lLBN0n_0 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8818474948379933527', time=2024-09-22T10:57:11.321220+0000, chain.objs.size()=1 2024-09-22T09:16:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.912+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Ju3zA6RkKCyjwdjco1q8ZFk0HjHfN0h_0 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13987490412016234796', time=2024-09-22T10:57:11.452624+0000, chain.objs.size()=1 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.pFwOZS23hSugh3YlL2HPDAz8W7vy57D_0 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17505804167965071804', time=2024-09-22T10:57:11.991244+0000, chain.objs.size()=1 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.HVkt25hGdfkceG4kp5iFi3VKdzL0lcg_0 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6354282489607564832', time=2024-09-22T10:57:12.402878+0000, chain.objs.size()=1 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.913+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1Ptb8rveaL9R3SNIZnnIjJquWYl-6kM_0 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.914+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7755587601598774582', time=2024-09-22T10:57:12.494692+0000, chain.objs.size()=1 2024-09-22T09:16:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.914+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.Rr6rQEpUD4h5MZP7GXcyE5SWvneD3Ot_0 2024-09-22T09:16:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.917+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13969889408107352186', time=2024-09-22T10:57:13.441771+0000, chain.objs.size()=1 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.917+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.ElAHarOyJh71QujIWtnY2_ytnYbm0I7_0 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12032936945349808118', time=2024-09-22T10:57:13.594005+0000, chain.objs.size()=1 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.u02wbWGXjOcmsvlHmZCAtA0NLQe8Zkx_0 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5337450770406854316', time=2024-09-22T10:57:13.869188+0000, chain.objs.size()=1 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.1It5hRJOflRZwsvCp7lKR-0LZHW1itS_0 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16103106449175017490', time=2024-09-22T10:57:13.912214+0000, chain.objs.size()=1 2024-09-22T09:16:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.W5TvUNYRJ5q8XkbRLPTgubQMZGyQbAA_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15103352540495292035', time=2024-09-22T10:57:13.968172+0000, chain.objs.size()=1 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yGHUM2tiaiR7mdVMrEqcDc-9gIiNg6y_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2581375019360875472', time=2024-09-22T10:57:14.298634+0000, chain.objs.size()=1 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.yiQYVnpKV6M3iKMniikwkKxR9tLeM9w_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15090771209373076330', time=2024-09-22T10:57:14.361530+0000, chain.objs.size()=1 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.iH5jAUjYkqHkOuc9NYl_jI6AsT0I9Sn_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1476291728236209817', time=2024-09-22T10:57:14.387756+0000, chain.objs.size()=1 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.IjMfGRnj1wfcp1kJ-fO2F9rHtuta2YU_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11052720963580146288', time=2024-09-22T10:57:15.065856+0000, chain.objs.size()=1 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.74OqT7IiRX-pbj8oQSVzJIZ9wHENpNM_0 2024-09-22T09:16:03.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11248707865786710525', time=2024-09-22T10:57:15.306956+0000, chain.objs.size()=1 2024-09-22T09:16:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.piPjriW7ctxOfulBVzSCeSmMEAgt1eR_0 2024-09-22T09:16:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.583333897565880820', time=2024-09-22T10:57:15.461331+0000, chain.objs.size()=1 2024-09-22T09:16:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.918+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_._ibdKM1Xr4jS_2leiL_bTeEuSCKI_nX_0 2024-09-22T09:16:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.921+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12346304951004260341', time=2024-09-22T10:57:15.862209+0000, chain.objs.size()=1 2024-09-22T09:16:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.921+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.6HhXd5j5KJQFSD-zv5VUK2ogDY1N-Y3_0 2024-09-22T09:16:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8955492076558611790', time=2024-09-22T10:57:16.294725+0000, chain.objs.size()=1 2024-09-22T09:16:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.mGiUc5QmPUhDTMjb_KI-aiD-gVBEhi5_0 2024-09-22T09:16:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10086223657090198882', time=2024-09-22T10:57:16.349295+0000, chain.objs.size()=1 2024-09-22T09:16:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.uSZyOB7yPOEIkgfaxfHLL0q2ESV3my9_0 2024-09-22T09:16:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15695560113946049682', time=2024-09-22T10:57:16.833909+0000, chain.objs.size()=1 2024-09-22T09:16:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.263__shadow_.rO9FaoiDHwNSzNqxkPvpb-xtu0Pig0n_0 2024-09-22T09:16:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3420151407156185522', time=2024-09-22T10:57:25.134744+0000, chain.objs.size()=1 2024-09-22T09:16:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.922+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.277__shadow_.tY5kBHAHpMbCqef3kAeG8hY89ww7ihl_0 2024-09-22T09:16:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15973674833766919951', time=2024-09-22T10:57:27.600230+0000, chain.objs.size()=1 2024-09-22T09:16:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.281__shadow_.R9cQMopzDGM5aaTyyosYoXKhbEGHzjk_0 2024-09-22T09:16:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5223171626135970693', time=2024-09-22T10:57:28.801210+0000, chain.objs.size()=1 2024-09-22T09:16:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.283__shadow_.CbyppclL4MIpg9zOOkpsuy7zA5cH4JA_0 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10936919189947990763', time=2024-09-22T10:57:30.060134+0000, chain.objs.size()=1 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.285__shadow_.n651-haGjHgPqRqOyO0O792Cwtp5X9z_0 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15006089859099952622', time=2024-09-22T10:58:34.443395+0000, chain.objs.size()=1 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.2RKTP-ixbHATOrxQW3ayQHRsyC64Tl6_0 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13223773092836191320', time=2024-09-22T10:58:34.786667+0000, chain.objs.size()=1 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.kLw77N7Y3vZUOxB34lODErzNiB3qYDL_0 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10454796503403098979', time=2024-09-22T10:58:34.937531+0000, chain.objs.size()=1 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.TrSOCM-q3_Ll2uInNQrnpB68U8vpWZL_0 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2301544023620368126', time=2024-09-22T10:58:35.103619+0000, chain.objs.size()=1 2024-09-22T09:16:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.924+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.GQT3t8F2l-sf5F9ywHgRZzsO_kHjWfM_0 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14649728855718810509', time=2024-09-22T10:58:36.018665+0000, chain.objs.size()=1 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.h-OwAGb-gKAKgx7w2fgWYxyXDtP41xO_0 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12141370672844772770', time=2024-09-22T10:58:36.197665+0000, chain.objs.size()=1 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.td8VmoKoS7Ta-8MEkfwF31aP2npOT1X_0 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2160365082513532833', time=2024-09-22T10:58:36.317228+0000, chain.objs.size()=1 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZxXZEdR_pZNmIYCNREgBGpT3iv0Ce8I_0 2024-09-22T09:16:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8614543991022156592', time=2024-09-22T10:58:36.425230+0000, chain.objs.size()=1 2024-09-22T09:16:03.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.3wFzP22fK-ytQrzhhGsBwmcSETd_SzN_0 2024-09-22T09:16:03.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4132423802486127403', time=2024-09-22T10:58:36.458732+0000, chain.objs.size()=1 2024-09-22T09:16:03.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.928+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.e-bE74TEtx9aYLlQVGET-eFj8uZUHs-_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17599339664753952757', time=2024-09-22T10:58:36.791101+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wdWBXWthc7lPQcOWDg4t64g0ajVHWvs_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9152059005752562221', time=2024-09-22T10:58:36.838395+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.wt9-UMomZoXFLXzRAZ1MvIbf4wDaHQq_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4226700953588988689', time=2024-09-22T10:58:38.063763+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.j2uRYsPlhiF8RX3IxtpX-j-WNrNSftk_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8020485489078341056', time=2024-09-22T10:58:38.236344+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.f5ZtxTT0BpwYzrkPEK-uC50gkEojO37_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8295888222919452238', time=2024-09-22T10:58:38.491214+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4dsgZEl8WREgLR9OhdNhwqDFhrRHQSO_0 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11741087360243325064', time=2024-09-22T10:58:39.043432+0000, chain.objs.size()=1 2024-09-22T09:16:03.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.930+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.k53Cdk6YuY2-GC8vbESedeSXOJWvIbe_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4677703014909822881', time=2024-09-22T10:58:39.065844+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.u34uE0_Oppc9miw0gJWu-Ep5GaGYFNq_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13451156183229958010', time=2024-09-22T10:58:39.523221+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.xhAQqwre6LxwVsVV_-JTawW3-tv0Uuu_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7983955902922948565', time=2024-09-22T10:58:39.656746+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.1rtsHlp9PmDCArjtksVY_AjlH1Qjo1C_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9816224584149270982', time=2024-09-22T10:58:39.690180+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ubPi8EQMOo96hbPXevWd4MqmksI3-IO_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1617053427185014028', time=2024-09-22T10:58:39.810595+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WLt6m6XVGxBxW9XGxIPoGPzIkMTOMeY_0 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3765238950141098826', time=2024-09-22T10:58:40.392848+0000, chain.objs.size()=1 2024-09-22T09:16:03.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.933+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-L0cIj0V9mhJd8WzIzA6aTScscc99wm_0 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.934+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2960088564678505973', time=2024-09-22T10:58:41.125477+0000, chain.objs.size()=1 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.934+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ETWPz6ldw73yT6dnHX-p8ZlMzip9sve_0 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5483488414108900993', time=2024-09-22T10:58:41.897867+0000, chain.objs.size()=1 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-hcehW2RubQZphYe0YxNx3E6_Jvu6Dg_0 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5440508030799855219', time=2024-09-22T10:58:42.066830+0000, chain.objs.size()=1 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZFEas7Wnuq9NYZiZPgp159CFTgth3Xi_0 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15916986046672843258', time=2024-09-22T10:58:42.280505+0000, chain.objs.size()=1 2024-09-22T09:16:03.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.vDykEK9SRQ2pbEGQXeUIHOHtV0RG3EW_0 2024-09-22T09:16:03.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.12212148321346652027', time=2024-09-22T10:58:42.455802+0000, chain.objs.size()=1 2024-09-22T09:16:03.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.935+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.j0bYnZT1OMeFu_OozRtJahXI_2O2-iK_0 2024-09-22T09:16:03.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.937+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5330033960976860366', time=2024-09-22T10:58:43.005202+0000, chain.objs.size()=1 2024-09-22T09:16:03.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.937+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.La-0hKz8ko96KBl7_r7ZoWvA3DfG6EQ_0 2024-09-22T09:16:03.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.937+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15283754067685757127', time=2024-09-22T10:58:44.269444+0000, chain.objs.size()=1 2024-09-22T09:16:03.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.937+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.4K3-apMdOJns6KqY7UZnTS8OojTMA9t_0 2024-09-22T09:16:03.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.939+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3635493883419347342', time=2024-09-22T10:58:44.383223+0000, chain.objs.size()=1 2024-09-22T09:16:03.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.939+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.P3DWNGl4XIz3-_D3IL6eF_79XhVqsEc_0 2024-09-22T09:16:03.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.939+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10346758609634166258', time=2024-09-22T10:58:44.811129+0000, chain.objs.size()=1 2024-09-22T09:16:03.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.939+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.-7G1Du4YfCgUgiT1igTZ5GmmEWb8-uS_0 2024-09-22T09:16:03.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.940+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6363060148599687576', time=2024-09-22T10:58:44.929062+0000, chain.objs.size()=1 2024-09-22T09:16:03.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.940+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.K1m0y9yEnjTl_0_X4V7lcqmDKQQi4oq_0 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.941+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10064664472688630867', time=2024-09-22T10:58:45.065022+0000, chain.objs.size()=1 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.941+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.WfWL7z1TRN3jGtVNNOHTxt9a3aWS9Fm_0 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.941+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.10837056046566451071', time=2024-09-22T10:58:45.082768+0000, chain.objs.size()=1 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.941+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.324__shadow_.ZRL8b17brb1C-XwamJV5odCYuVxatAk_0 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.153925399981400333', time=2024-09-22T10:59:22.033726+0000, chain.objs.size()=1 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.RohHTk8G5PLchZyFNUqCT4ry9B2REp3_0 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3307928919774273541', time=2024-09-22T10:59:22.034441+0000, chain.objs.size()=1 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.j0i56XV_eZ0knU_SDoNzQa0W76za98o_0 2024-09-22T09:16:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11570525035878975088', time=2024-09-22T10:59:22.346412+0000, chain.objs.size()=1 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.wcpaJebIMaaNuYT2pIkfhUUexhteRdz_0 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16907007882734068761', time=2024-09-22T10:59:22.731878+0000, chain.objs.size()=1 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1bHsn4iwz8Fu2XOsZ9Aq7P_Udhw4pXH_0 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15452787423267497945', time=2024-09-22T10:59:23.016495+0000, chain.objs.size()=1 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.XBNSfzMTEGUKdQQqi1VYn7m6uEiDXtm_0 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4577721621563322390', time=2024-09-22T10:59:23.824444+0000, chain.objs.size()=1 2024-09-22T09:16:03.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.942+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.GUiiPGMpzlOjQ0QJ_2PlreYZPqbVBa8_0 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2184657815946891702', time=2024-09-22T10:59:24.038764+0000, chain.objs.size()=1 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.8LS5ozK6vH9uLka3xrt5xaTlPwMftht_0 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.6186438499234296205', time=2024-09-22T10:59:24.126379+0000, chain.objs.size()=1 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.dvsJUYprbiNkTrihbo-oz_ixiGC7-e-_0 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9087674214842097501', time=2024-09-22T10:59:24.316850+0000, chain.objs.size()=1 2024-09-22T09:16:03.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.943+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.BFWAhFwKtM39BOgt05v0KwU_Z3WU_l__0 2024-09-22T09:16:03.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.945+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3222903864201130830', time=2024-09-22T10:59:24.400957+0000, chain.objs.size()=1 2024-09-22T09:16:03.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.945+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.t4W2kY7xVJoVa7iilIbq2Rh4PfQ5GsR_0 2024-09-22T09:16:03.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.945+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16802004550987923451', time=2024-09-22T10:59:24.454913+0000, chain.objs.size()=1 2024-09-22T09:16:03.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.945+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6x7yZ8xrUUTZpmbUXM7VV44RP7IP8aQ_0 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4242113731846162965', time=2024-09-22T10:59:25.293058+0000, chain.objs.size()=1 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.V_U1k498KitiTzPjnr3yZqX8SNnPlFv_0 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11570183982741998734', time=2024-09-22T10:59:25.382864+0000, chain.objs.size()=1 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.N1veXkfl94JTG812c8KTPBebi4jfBOi_0 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16160828703682164033', time=2024-09-22T10:59:25.498269+0000, chain.objs.size()=1 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.io41n9bTtsyIRYZgS0uPMFW8gDFqeQE_0 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2083598897068044420', time=2024-09-22T10:59:25.755324+0000, chain.objs.size()=1 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.946+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.X0FQP0QDYJuEO1uMo770ojG4BPip_Kd_0 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.630793311832515325', time=2024-09-22T10:59:25.851509+0000, chain.objs.size()=1 2024-09-22T09:16:03.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.2bN_6-5Svcw2vANXhz55cy8Dr3Hgwbr_0 2024-09-22T09:16:03.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.947+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7387141298897567963', time=2024-09-22T10:59:26.556072+0000, chain.objs.size()=1 2024-09-22T09:16:03.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.947+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.K_njyaUV-RU0Ms3sp3pg3_fgNPo4k5a_0 2024-09-22T09:16:03.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.951+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 0/48624 2024-09-22T09:16:03.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-22T09:16:03.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.1205740653188807373', time=2024-09-22T10:59:28.318752+0000, chain.objs.size()=1 2024-09-22T09:16:03.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.TnVIa0PZrMsSnsVnRIY7GuO2uy4SIQ__0 2024-09-22T09:16:03.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.733217381716932372', time=2024-09-22T10:59:28.319393+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7YUZndxH3sPUOGk-xPZREZoh4jEp9mS_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4010801643343349881', time=2024-09-22T10:59:28.617561+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.vRj7nuRBbyVfRqKaUSkhyJTkslOmE2y_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.17913685478904733976', time=2024-09-22T10:59:28.711786+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.oa9ozL5nqFyBg9kB2pEv9JkO3ALVRzh_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2798113119661018321', time=2024-09-22T10:59:28.752137+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7RNiE2M7nWMMuXDsxvbYMTh4U7YqIxu_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16577227409444014455', time=2024-09-22T10:59:28.789255+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.grLtd_dsCT2SKslRcXtxjO44KojiTiV_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16858024456115870622', time=2024-09-22T10:59:28.936575+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.tVyLnK44_eQhQ3w1OdjtJTc6eG9xrdd_0 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13494315584324283123', time=2024-09-22T10:59:29.134093+0000, chain.objs.size()=1 2024-09-22T09:16:03.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.w6ltSJSETg-RH8BrVBtRR-JC6Bk3sQn_0 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16054325604864552653', time=2024-09-22T10:59:29.845642+0000, chain.objs.size()=1 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.nf_B4nkI6qJauZjD8IJT0TKb9OhUWtm_0 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7681146270078848881', time=2024-09-22T10:59:29.876700+0000, chain.objs.size()=1 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YSCRmikuW90p0mUOWA-_uzPURkUliph_0 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8800588406368301872', time=2024-09-22T10:59:30.515966+0000, chain.objs.size()=1 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.7OIun_9uAlHFl6KNhedAhKOzds7ZKc2_0 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5780507668466191643', time=2024-09-22T10:59:31.498904+0000, chain.objs.size()=1 2024-09-22T09:16:03.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.954+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.YuTkNtodh35oI-yl2mjDmXK5EPvyG1E_0 2024-09-22T09:16:03.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.958+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.3299230608776388694', time=2024-09-22T10:59:32.166103+0000, chain.objs.size()=1 2024-09-22T09:16:03.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.958+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.yvy09WGXqooLmcNsqRiWQ8nWU7e51iZ_0 2024-09-22T09:16:03.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.177864583972680453', time=2024-09-22T10:59:32.166641+0000, chain.objs.size()=1 2024-09-22T09:16:03.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.6r0EOvKnidL8l9cfT4wUK8x3mgVWnsz_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16118973181110466883', time=2024-09-22T10:59:32.259103+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.-3FTm0vK4fxJfbpN6iLj2e_epkRw_qP_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15975688641579336078', time=2024-09-22T10:59:32.552186+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.F9i9r_gGEq16o_iZirz_Lk_fmmIR9rx_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11657726188021267589', time=2024-09-22T10:59:32.606321+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.325__shadow_.1vLWcqhg2qvjps8tWCei33Erbu9_Zcq_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.9157512860180833472', time=2024-09-22T10:59:34.403126+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.328__shadow_.KpDOMKPzJ28OkTDT3grUybMLtVMHRSH_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15828155817866790939', time=2024-09-22T10:59:59.613848+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.378__shadow_.rvlNtgPLlJ4G1Z6tJ5vbiu8vIyfdkzp_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.8399631120077133775', time=2024-09-22T11:00:34.857305+0000, chain.objs.size()=1 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.442__shadow_.pBArdOArG8WzA-SD7RbIC_P34L3kgbN_0 2024-09-22T09:16:03.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.14903176017377204871', time=2024-09-22T11:01:11.712614+0000, chain.objs.size()=1 2024-09-22T09:16:03.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.500__shadow_.MqykUcMQ2Ge2tdK6-g2kR3ju3Vn2QzL_0 2024-09-22T09:16:03.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7064964920699514190', time=2024-09-22T11:04:54.601942+0000, chain.objs.size()=1 2024-09-22T09:16:03.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.577__shadow:wuqXP6v8Ihqroi65WU7r5H6WtP4I78H_.iAIogOQ4Gc4ZzCet0bUy5DxW2cBAMh2_0 2024-09-22T09:16:03.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.7697216771889798891', time=2024-09-22T11:05:06.958194+0000, chain.objs.size()=1 2024-09-22T09:16:03.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.959+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.578__shadow:DMJFqPLbdWFPi3wsMkdazvkiJ5V86gN_.ZEgF6pMk4dHgmPjc7hzCNLqgCZKVVpy_0 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.13796060769913761173', time=2024-09-22T11:05:31.363601+0000, chain.objs.size()=1 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:Ek1a7JFr6ThV6S3t5W31WptIrMCm3Xv_.O94syB9TynRekP0-4I1x4UpjAU15SIn_0 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.4440790803575350650', time=2024-09-22T11:05:31.434557+0000, chain.objs.size()=1 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.581__shadow:zGvY61yiMqbYmcM8Z6loyfc3ljNg.Lj_.dIrkZHXTgEHZlC5U2mhLuGBHfzJmpkB_0 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.16811831461521445595', time=2024-09-22T11:09:29.370712+0000, chain.objs.size()=1 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.631__shadow_.Uwf7Eg0q9W7Q3lLBNljo_oCk-zJGgLx_0 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.2500770236985426959', time=2024-09-22T11:10:16.044927+0000, chain.objs.size()=1 2024-09-22T09:16:03.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.963+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.666__shadow_.eEjkTbA5RC5X11ny9CElHvyID6na15-_0 2024-09-22T09:16:03.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.11626919965453531008', time=2024-09-22T11:10:53.489504+0000, chain.objs.size()=1 2024-09-22T09:16:03.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.716__shadow:cgHQL.Qqhu3ydEJdJAz1HtdJsB5sqL._.tMD6sTIA4x5pSzZOLCXGWuQ7HlgIHJN_0 2024-09-22T09:16:03.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.15961137350308953600', time=2024-09-22T11:10:54.046176+0000, chain.objs.size()=1 2024-09-22T09:16:03.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.717__shadow:9.NNLGh.hhdIT01WLhuGaDm8f6xxd20_.Qff7iLhIY7x8VUtkcwd07AMVzq02c0q_0 2024-09-22T09:16:03.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 20 garbage collection: RGWGC::process iterating over entry tag='bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.5043313528230171769', time=2024-09-22T11:12:18.593218+0000, chain.objs.size()=1 2024-09-22T09:16:03.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.965+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bc0aebe0-ca0a-4994-95e6-6b086c1a6ba2.4734.757__shadow_.c9YUMTXUimaXCL8ul1ZjzbuNNJxcgI6_0 2024-09-22T09:16:03.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.969+0000 7f56fdd25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.973+0000 7f55ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:03.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.975+0000 7f56fdd25800 20 remove_watcher() i=0 2024-09-22T09:16:03.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.975+0000 7f56fdd25800 2 removed watcher, disabling cache 2024-09-22T09:16:03.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.976+0000 7f56fdd25800 20 remove_watcher() i=1 2024-09-22T09:16:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.977+0000 7f56fdd25800 20 remove_watcher() i=2 2024-09-22T09:16:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.979+0000 7f56fdd25800 20 remove_watcher() i=3 2024-09-22T09:16:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.980+0000 7f56fdd25800 20 remove_watcher() i=4 2024-09-22T09:16:03.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.981+0000 7f56fdd25800 20 remove_watcher() i=5 2024-09-22T09:16:03.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.981+0000 7f56fdd25800 20 remove_watcher() i=6 2024-09-22T09:16:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-22T09:16:03.983+0000 7f56fdd25800 20 remove_watcher() i=7 2024-09-22T09:16:03.995 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-22T09:16:04.015 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T09:16:04.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T09:16:04.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:04.356 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:04.369 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2017,"stamp":"2024-09-22T09:16:03.851499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504953925,"num_objects":3436,"num_object_clones":0,"num_object_copies":12762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3436,"num_whiteouts":0,"num_read":310723,"num_read_kb":2860000,"num_write":162585,"num_write_kb":2483133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14052,"ondisk_log_size":14052,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2661772,"kb_used_data":1003188,"kb_used_omap":12,"kb_used_meta":1658291,"kb_avail":752312948,"statfs":{"total":773094113280,"available":770368458752,"internally_reserved":0,"allocated":1027264512,"data_stored":1011244416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1698090544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-233044184,"num_objects":-1421,"num_object_clones":0,"num_object_copies":-5652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1421,"num_whiteouts":0,"num_read":1594,"num_read_kb":1405,"num_write":1506,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005293"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962647+0000","last_change":"2024-09-22T08:51:48.551836+0000","last_active":"2024-09-22T09:11:47.962647+0000","last_peered":"2024-09-22T09:11:47.962647+0000","last_clean":"2024-09-22T09:11:47.962647+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:11:47.962647+0000","last_undegraded":"2024-09-22T09:11:47.962647+0000","last_fullsized":"2024-09-22T09:11:47.962647+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:38.864929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972822+0000","last_change":"2024-09-22T08:36:17.554312+0000","last_active":"2024-09-22T09:13:47.972822+0000","last_peered":"2024-09-22T09:13:47.972822+0000","last_clean":"2024-09-22T09:13:47.972822+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:13:47.972822+0000","last_undegraded":"2024-09-22T09:13:47.972822+0000","last_fullsized":"2024-09-22T09:13:47.972822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:29.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753733+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:11:16.753733+0000","last_peered":"2024-09-22T09:11:16.753733+0000","last_clean":"2024-09-22T09:11:16.753733+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:11:16.753733+0000","last_undegraded":"2024-09-22T09:11:16.753733+0000","last_fullsized":"2024-09-22T09:11:16.753733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:58.101135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869100+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:13:47.869100+0000","last_peered":"2024-09-22T09:13:47.869100+0000","last_clean":"2024-09-22T09:13:47.869100+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:13:47.869100+0000","last_undegraded":"2024-09-22T09:13:47.869100+0000","last_fullsized":"2024-09-22T09:13:47.869100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:31.386282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756266+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:11:16.756266+0000","last_peered":"2024-09-22T09:11:16.756266+0000","last_clean":"2024-09-22T09:11:16.756266+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:11:16.756266+0000","last_undegraded":"2024-09-22T09:11:16.756266+0000","last_fullsized":"2024-09-22T09:11:16.756266+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:02.785298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779072+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:13:46.779072+0000","last_peered":"2024-09-22T09:13:46.779072+0000","last_clean":"2024-09-22T09:13:46.779072+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:13:46.779072+0000","last_undegraded":"2024-09-22T09:13:46.779072+0000","last_fullsized":"2024-09-22T09:13:46.779072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784216+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:14:21.784216+0000","last_peered":"2024-09-22T09:14:21.784216+0000","last_clean":"2024-09-22T09:14:21.784216+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:14:21.784216+0000","last_undegraded":"2024-09-22T09:14:21.784216+0000","last_fullsized":"2024-09-22T09:14:21.784216+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:55.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749175+0000","last_change":"2024-09-22T08:33:33.306873+0000","last_active":"2024-09-22T09:11:06.749175+0000","last_peered":"2024-09-22T09:11:06.749175+0000","last_clean":"2024-09-22T09:11:06.749175+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:11:06.749175+0000","last_undegraded":"2024-09-22T09:11:06.749175+0000","last_fullsized":"2024-09-22T09:11:06.749175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:59.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756178+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:11:16.756178+0000","last_peered":"2024-09-22T09:11:16.756178+0000","last_clean":"2024-09-22T09:11:16.756178+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:11:16.756178+0000","last_undegraded":"2024-09-22T09:11:16.756178+0000","last_fullsized":"2024-09-22T09:11:16.756178+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:26.766525+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:12:26.766525+0000","last_peered":"2024-09-22T09:12:26.766525+0000","last_clean":"2024-09-22T09:12:26.766525+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:12:26.766525+0000","last_undegraded":"2024-09-22T09:12:26.766525+0000","last_fullsized":"2024-09-22T09:12:26.766525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:26.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988838+0000","last_change":"2024-09-22T08:36:14.521822+0000","last_active":"2024-09-22T09:15:52.988838+0000","last_peered":"2024-09-22T09:15:52.988838+0000","last_clean":"2024-09-22T09:15:52.988838+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:15:52.988838+0000","last_undegraded":"2024-09-22T09:15:52.988838+0000","last_fullsized":"2024-09-22T09:15:52.988838+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:17.576650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749152+0000","last_change":"2024-09-22T08:33:33.299815+0000","last_active":"2024-09-22T09:11:06.749152+0000","last_peered":"2024-09-22T09:11:06.749152+0000","last_clean":"2024-09-22T09:11:06.749152+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:11:06.749152+0000","last_undegraded":"2024-09-22T09:11:06.749152+0000","last_fullsized":"2024-09-22T09:11:06.749152+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:22.030960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968129+0000","last_change":"2024-09-22T08:36:17.552221+0000","last_active":"2024-09-22T09:12:37.968129+0000","last_peered":"2024-09-22T09:12:37.968129+0000","last_clean":"2024-09-22T09:12:37.968129+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:12:37.968129+0000","last_undegraded":"2024-09-22T09:12:37.968129+0000","last_fullsized":"2024-09-22T09:12:37.968129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:55.269454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:24.487629+0000","last_change":"2024-09-22T08:33:33.312653+0000","last_active":"2024-09-22T09:11:24.487629+0000","last_peered":"2024-09-22T09:11:24.487629+0000","last_clean":"2024-09-22T09:11:24.487629+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:11:24.487629+0000","last_undegraded":"2024-09-22T09:11:24.487629+0000","last_fullsized":"2024-09-22T09:11:24.487629+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:50.718606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772098+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:12:42.772098+0000","last_peered":"2024-09-22T09:12:42.772098+0000","last_clean":"2024-09-22T09:12:42.772098+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:12:42.772098+0000","last_undegraded":"2024-09-22T09:12:42.772098+0000","last_fullsized":"2024-09-22T09:12:42.772098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.867290+0000","last_change":"2024-09-22T08:33:33.314397+0000","last_active":"2024-09-22T09:13:32.867290+0000","last_peered":"2024-09-22T09:13:32.867290+0000","last_clean":"2024-09-22T09:13:32.867290+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:13:32.867290+0000","last_undegraded":"2024-09-22T09:13:32.867290+0000","last_fullsized":"2024-09-22T09:13:32.867290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:17.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855481+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:11:47.855481+0000","last_peered":"2024-09-22T09:11:47.855481+0000","last_clean":"2024-09-22T09:11:47.855481+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:11:47.855481+0000","last_undegraded":"2024-09-22T09:11:47.855481+0000","last_fullsized":"2024-09-22T09:11:47.855481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:01.855409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:17.852152+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:11:17.852152+0000","last_peered":"2024-09-22T09:11:17.852152+0000","last_clean":"2024-09-22T09:11:17.852152+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:11:17.852152+0000","last_undegraded":"2024-09-22T09:11:17.852152+0000","last_fullsized":"2024-09-22T09:11:17.852152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:15.681167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975679+0000","last_change":"2024-09-22T08:36:14.522217+0000","last_active":"2024-09-22T09:13:47.975679+0000","last_peered":"2024-09-22T09:13:47.975679+0000","last_clean":"2024-09-22T09:13:47.975679+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:13:47.975679+0000","last_undegraded":"2024-09-22T09:13:47.975679+0000","last_fullsized":"2024-09-22T09:13:47.975679+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.786028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":747,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765671+0000","last_change":"2024-09-22T08:33:33.306368+0000","last_active":"2024-09-22T09:12:21.765671+0000","last_peered":"2024-09-22T09:12:21.765671+0000","last_clean":"2024-09-22T09:12:21.765671+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:12:21.765671+0000","last_undegraded":"2024-09-22T09:12:21.765671+0000","last_fullsized":"2024-09-22T09:12:21.765671+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:28.062281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962738+0000","last_change":"2024-09-22T08:51:48.550754+0000","last_active":"2024-09-22T09:11:47.962738+0000","last_peered":"2024-09-22T09:11:47.962738+0000","last_clean":"2024-09-22T09:11:47.962738+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:11:47.962738+0000","last_undegraded":"2024-09-22T09:11:47.962738+0000","last_fullsized":"2024-09-22T09:11:47.962738+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:50.620910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753658+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:11:16.753658+0000","last_peered":"2024-09-22T09:11:16.753658+0000","last_clean":"2024-09-22T09:11:16.753658+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:11:16.753658+0000","last_undegraded":"2024-09-22T09:11:16.753658+0000","last_fullsized":"2024-09-22T09:11:16.753658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:47.415229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.750304+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:11:16.750304+0000","last_peered":"2024-09-22T09:11:16.750304+0000","last_clean":"2024-09-22T09:11:16.750304+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:11:16.750304+0000","last_undegraded":"2024-09-22T09:11:16.750304+0000","last_fullsized":"2024-09-22T09:11:16.750304+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:00.150168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758893+0000","last_change":"2024-09-22T08:33:33.303993+0000","last_active":"2024-09-22T09:12:16.758893+0000","last_peered":"2024-09-22T09:12:16.758893+0000","last_clean":"2024-09-22T09:12:16.758893+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:12:16.758893+0000","last_undegraded":"2024-09-22T09:12:16.758893+0000","last_fullsized":"2024-09-22T09:12:16.758893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:11.898143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767414+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:12:31.767414+0000","last_peered":"2024-09-22T09:12:31.767414+0000","last_clean":"2024-09-22T09:12:31.767414+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:12:31.767414+0000","last_undegraded":"2024-09-22T09:12:31.767414+0000","last_fullsized":"2024-09-22T09:12:31.767414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.762920+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:11:27.762920+0000","last_peered":"2024-09-22T09:11:27.762920+0000","last_clean":"2024-09-22T09:11:27.762920+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:11:27.762920+0000","last_undegraded":"2024-09-22T09:11:27.762920+0000","last_fullsized":"2024-09-22T09:11:27.762920+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.757596+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:11:26.757596+0000","last_peered":"2024-09-22T09:11:26.757596+0000","last_clean":"2024-09-22T09:11:26.757596+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:11:26.757596+0000","last_undegraded":"2024-09-22T09:11:26.757596+0000","last_fullsized":"2024-09-22T09:11:26.757596+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984645+0000","last_change":"2024-09-22T08:36:14.525609+0000","last_active":"2024-09-22T09:14:57.984645+0000","last_peered":"2024-09-22T09:14:57.984645+0000","last_clean":"2024-09-22T09:14:57.984645+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:14:57.984645+0000","last_undegraded":"2024-09-22T09:14:57.984645+0000","last_fullsized":"2024-09-22T09:14:57.984645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:03.854966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764817+0000","last_change":"2024-09-22T08:33:33.315166+0000","last_active":"2024-09-22T09:12:16.764817+0000","last_peered":"2024-09-22T09:12:16.764817+0000","last_clean":"2024-09-22T09:12:16.764817+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:12:16.764817+0000","last_undegraded":"2024-09-22T09:12:16.764817+0000","last_fullsized":"2024-09-22T09:12:16.764817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:41.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'7","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767497+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:12:31.767497+0000","last_peered":"2024-09-22T09:12:31.767497+0000","last_clean":"2024-09-22T09:12:31.767497+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:12:31.767497+0000","last_undegraded":"2024-09-22T09:12:31.767497+0000","last_fullsized":"2024-09-22T09:12:31.767497+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767456+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:12:31.767456+0000","last_peered":"2024-09-22T09:12:31.767456+0000","last_clean":"2024-09-22T09:12:31.767456+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:12:31.767456+0000","last_undegraded":"2024-09-22T09:12:31.767456+0000","last_fullsized":"2024-09-22T09:12:31.767456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764788+0000","last_change":"2024-09-22T08:33:33.311367+0000","last_active":"2024-09-22T09:12:16.764788+0000","last_peered":"2024-09-22T09:12:16.764788+0000","last_clean":"2024-09-22T09:12:16.764788+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:12:16.764788+0000","last_undegraded":"2024-09-22T09:12:16.764788+0000","last_fullsized":"2024-09-22T09:12:16.764788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:18.812618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.969239+0000","last_change":"2024-09-22T08:51:48.549838+0000","last_active":"2024-09-22T09:12:47.969239+0000","last_peered":"2024-09-22T09:12:47.969239+0000","last_clean":"2024-09-22T09:12:47.969239+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:12:47.969239+0000","last_undegraded":"2024-09-22T09:12:47.969239+0000","last_fullsized":"2024-09-22T09:12:47.969239+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:35.628007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967550+0000","last_change":"2024-09-22T08:36:17.553737+0000","last_active":"2024-09-22T09:12:32.967550+0000","last_peered":"2024-09-22T09:12:32.967550+0000","last_clean":"2024-09-22T09:12:32.967550+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:12:32.967550+0000","last_undegraded":"2024-09-22T09:12:32.967550+0000","last_fullsized":"2024-09-22T09:12:32.967550+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:21.818626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971629+0000","last_change":"2024-09-22T08:36:14.520890+0000","last_active":"2024-09-22T09:13:37.971629+0000","last_peered":"2024-09-22T09:13:37.971629+0000","last_clean":"2024-09-22T09:13:37.971629+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:13:37.971629+0000","last_undegraded":"2024-09-22T09:13:37.971629+0000","last_fullsized":"2024-09-22T09:13:37.971629+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.858239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774744+0000","last_change":"2024-09-22T08:33:33.310293+0000","last_active":"2024-09-22T09:13:16.774744+0000","last_peered":"2024-09-22T09:13:16.774744+0000","last_clean":"2024-09-22T09:13:16.774744+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:13:16.774744+0000","last_undegraded":"2024-09-22T09:13:16.774744+0000","last_fullsized":"2024-09-22T09:13:16.774744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:23:54.882161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971695+0000","last_change":"2024-09-22T08:36:14.521414+0000","last_active":"2024-09-22T09:13:37.971695+0000","last_peered":"2024-09-22T09:13:37.971695+0000","last_clean":"2024-09-22T09:13:37.971695+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:13:37.971695+0000","last_undegraded":"2024-09-22T09:13:37.971695+0000","last_fullsized":"2024-09-22T09:13:37.971695+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:00.328885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865324+0000","last_change":"2024-09-22T08:33:33.305009+0000","last_active":"2024-09-22T09:13:12.865324+0000","last_peered":"2024-09-22T09:13:12.865324+0000","last_clean":"2024-09-22T09:13:12.865324+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:13:12.865324+0000","last_undegraded":"2024-09-22T09:13:12.865324+0000","last_fullsized":"2024-09-22T09:13:12.865324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:50.446180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'9","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778511+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:13:37.778511+0000","last_peered":"2024-09-22T09:13:37.778511+0000","last_clean":"2024-09-22T09:13:37.778511+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:13:37.778511+0000","last_undegraded":"2024-09-22T09:13:37.778511+0000","last_fullsized":"2024-09-22T09:13:37.778511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":26642,"num_write":14,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971719+0000","last_change":"2024-09-22T08:36:14.515004+0000","last_active":"2024-09-22T09:13:37.971719+0000","last_peered":"2024-09-22T09:13:37.971719+0000","last_clean":"2024-09-22T09:13:37.971719+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:13:37.971719+0000","last_undegraded":"2024-09-22T09:13:37.971719+0000","last_fullsized":"2024-09-22T09:13:37.971719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:07.837552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774690+0000","last_change":"2024-09-22T08:33:33.306842+0000","last_active":"2024-09-22T09:13:16.774690+0000","last_peered":"2024-09-22T09:13:16.774690+0000","last_clean":"2024-09-22T09:13:16.774690+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:13:16.774690+0000","last_undegraded":"2024-09-22T09:13:16.774690+0000","last_fullsized":"2024-09-22T09:13:16.774690+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:03.666172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764814+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:12:16.764814+0000","last_peered":"2024-09-22T09:12:16.764814+0000","last_clean":"2024-09-22T09:12:16.764814+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:12:16.764814+0000","last_undegraded":"2024-09-22T09:12:16.764814+0000","last_fullsized":"2024-09-22T09:12:16.764814+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:23.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.858820+0000","last_change":"2024-09-22T08:36:14.524581+0000","last_active":"2024-09-22T09:12:17.858820+0000","last_peered":"2024-09-22T09:12:17.858820+0000","last_clean":"2024-09-22T09:12:17.858820+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:12:17.858820+0000","last_undegraded":"2024-09-22T09:12:17.858820+0000","last_fullsized":"2024-09-22T09:12:17.858820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:13.432035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":173,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761303+0000","last_change":"2024-09-22T08:33:33.310511+0000","last_active":"2024-09-22T09:11:56.761303+0000","last_peered":"2024-09-22T09:11:56.761303+0000","last_clean":"2024-09-22T09:11:56.761303+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:11:56.761303+0000","last_undegraded":"2024-09-22T09:11:56.761303+0000","last_fullsized":"2024-09-22T09:11:56.761303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:28.111555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.961550+0000","last_change":"2024-09-22T08:51:48.553902+0000","last_active":"2024-09-22T09:12:02.961550+0000","last_peered":"2024-09-22T09:12:02.961550+0000","last_clean":"2024-09-22T09:12:02.961550+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:12:02.961550+0000","last_undegraded":"2024-09-22T09:12:02.961550+0000","last_fullsized":"2024-09-22T09:12:02.961550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:09.641607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764757+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:12:16.764757+0000","last_peered":"2024-09-22T09:12:16.764757+0000","last_clean":"2024-09-22T09:12:16.764757+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:12:16.764757+0000","last_undegraded":"2024-09-22T09:12:16.764757+0000","last_fullsized":"2024-09-22T09:12:16.764757+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:59.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758982+0000","last_change":"2024-09-22T08:36:14.523378+0000","last_active":"2024-09-22T09:12:16.758982+0000","last_peered":"2024-09-22T09:12:16.758982+0000","last_clean":"2024-09-22T09:12:16.758982+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:12:16.758982+0000","last_undegraded":"2024-09-22T09:12:16.758982+0000","last_fullsized":"2024-09-22T09:12:16.758982+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:26.533836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.765353+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:11:47.765353+0000","last_peered":"2024-09-22T09:11:47.765353+0000","last_clean":"2024-09-22T09:11:47.765353+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:11:47.765353+0000","last_undegraded":"2024-09-22T09:11:47.765353+0000","last_fullsized":"2024-09-22T09:11:47.765353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764842+0000","last_change":"2024-09-22T08:36:14.521867+0000","last_active":"2024-09-22T09:12:16.764842+0000","last_peered":"2024-09-22T09:12:16.764842+0000","last_clean":"2024-09-22T09:12:16.764842+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:12:16.764842+0000","last_undegraded":"2024-09-22T09:12:16.764842+0000","last_fullsized":"2024-09-22T09:12:16.764842+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:20.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.959622+0000","last_change":"2024-09-22T08:33:33.301439+0000","last_active":"2024-09-22T09:11:47.959622+0000","last_peered":"2024-09-22T09:11:47.959622+0000","last_clean":"2024-09-22T09:11:47.959622+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:11:47.959622+0000","last_undegraded":"2024-09-22T09:11:47.959622+0000","last_fullsized":"2024-09-22T09:11:47.959622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:31.274044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970549+0000","last_change":"2024-09-22T08:51:48.546986+0000","last_active":"2024-09-22T09:13:27.970549+0000","last_peered":"2024-09-22T09:13:27.970549+0000","last_clean":"2024-09-22T09:13:27.970549+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:13:27.970549+0000","last_undegraded":"2024-09-22T09:13:27.970549+0000","last_fullsized":"2024-09-22T09:13:27.970549+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:43.329879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764990+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:12:16.764990+0000","last_peered":"2024-09-22T09:12:16.764990+0000","last_clean":"2024-09-22T09:12:16.764990+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:12:16.764990+0000","last_undegraded":"2024-09-22T09:12:16.764990+0000","last_fullsized":"2024-09-22T09:12:16.764990+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:47.077061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'1","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765840+0000","last_change":"2024-09-22T08:36:14.525673+0000","last_active":"2024-09-22T09:12:21.765840+0000","last_peered":"2024-09-22T09:12:21.765840+0000","last_clean":"2024-09-22T09:12:21.765840+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:12:21.765840+0000","last_undegraded":"2024-09-22T09:12:21.765840+0000","last_fullsized":"2024-09-22T09:12:21.765840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:00.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755324+0000","last_change":"2024-09-22T08:33:33.306105+0000","last_active":"2024-09-22T09:11:51.755324+0000","last_peered":"2024-09-22T09:11:51.755324+0000","last_clean":"2024-09-22T09:11:51.755324+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:11:51.755324+0000","last_undegraded":"2024-09-22T09:11:51.755324+0000","last_fullsized":"2024-09-22T09:11:51.755324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:07.948747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763478+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:12:06.763478+0000","last_peered":"2024-09-22T09:12:06.763478+0000","last_clean":"2024-09-22T09:12:06.763478+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:12:06.763478+0000","last_undegraded":"2024-09-22T09:12:06.763478+0000","last_fullsized":"2024-09-22T09:12:06.763478+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:21.783822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:06.773227+0000","last_change":"2024-09-22T08:36:14.521057+0000","last_active":"2024-09-22T09:13:06.773227+0000","last_peered":"2024-09-22T09:13:06.773227+0000","last_clean":"2024-09-22T09:13:06.773227+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:13:06.773227+0000","last_undegraded":"2024-09-22T09:13:06.773227+0000","last_fullsized":"2024-09-22T09:13:06.773227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:07.181295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755291+0000","last_change":"2024-09-22T08:33:33.312566+0000","last_active":"2024-09-22T09:11:51.755291+0000","last_peered":"2024-09-22T09:11:51.755291+0000","last_clean":"2024-09-22T09:11:51.755291+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:11:51.755291+0000","last_undegraded":"2024-09-22T09:11:51.755291+0000","last_fullsized":"2024-09-22T09:11:51.755291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:30.177728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.857195+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:12:02.857195+0000","last_peered":"2024-09-22T09:12:02.857195+0000","last_clean":"2024-09-22T09:12:02.857195+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:12:02.857195+0000","last_undegraded":"2024-09-22T09:12:02.857195+0000","last_fullsized":"2024-09-22T09:12:02.857195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:52.143784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.879891+0000","last_change":"2024-09-22T08:36:17.553257+0000","last_active":"2024-09-22T09:15:17.879891+0000","last_peered":"2024-09-22T09:15:17.879891+0000","last_clean":"2024-09-22T09:15:17.879891+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:15:17.879891+0000","last_undegraded":"2024-09-22T09:15:17.879891+0000","last_fullsized":"2024-09-22T09:15:17.879891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:25.217554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'4","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:16.794622+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:15:16.794622+0000","last_peered":"2024-09-22T09:15:16.794622+0000","last_clean":"2024-09-22T09:15:16.794622+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:15:16.794622+0000","last_undegraded":"2024-09-22T09:15:16.794622+0000","last_fullsized":"2024-09-22T09:15:16.794622+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":249,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.861248+0000","last_change":"2024-09-22T08:33:33.306309+0000","last_active":"2024-09-22T09:12:37.861248+0000","last_peered":"2024-09-22T09:12:37.861248+0000","last_clean":"2024-09-22T09:12:37.861248+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:12:37.861248+0000","last_undegraded":"2024-09-22T09:12:37.861248+0000","last_fullsized":"2024-09-22T09:12:37.861248+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:31.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.964588+0000","last_change":"2024-09-22T08:51:48.549815+0000","last_active":"2024-09-22T09:12:02.964588+0000","last_peered":"2024-09-22T09:12:02.964588+0000","last_clean":"2024-09-22T09:12:02.964588+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:12:02.964588+0000","last_undegraded":"2024-09-22T09:12:02.964588+0000","last_fullsized":"2024-09-22T09:12:02.964588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:49.616078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'1","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758941+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:12:16.758941+0000","last_peered":"2024-09-22T09:12:16.758941+0000","last_clean":"2024-09-22T09:12:16.758941+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:12:16.758941+0000","last_undegraded":"2024-09-22T09:12:16.758941+0000","last_fullsized":"2024-09-22T09:12:16.758941+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:15.190970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.773987+0000","last_change":"2024-09-22T08:36:14.520376+0000","last_active":"2024-09-22T09:13:11.773987+0000","last_peered":"2024-09-22T09:13:11.773987+0000","last_clean":"2024-09-22T09:13:11.773987+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:13:11.773987+0000","last_undegraded":"2024-09-22T09:13:11.773987+0000","last_fullsized":"2024-09-22T09:13:11.773987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:17.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763014+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:12:06.763014+0000","last_peered":"2024-09-22T09:12:06.763014+0000","last_clean":"2024-09-22T09:12:06.763014+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:12:06.763014+0000","last_undegraded":"2024-09-22T09:12:06.763014+0000","last_fullsized":"2024-09-22T09:12:06.763014+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:35.688578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.972039+0000","last_change":"2024-09-22T08:36:17.557866+0000","last_active":"2024-09-22T09:13:12.972039+0000","last_peered":"2024-09-22T09:13:12.972039+0000","last_clean":"2024-09-22T09:13:12.972039+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:13:12.972039+0000","last_undegraded":"2024-09-22T09:13:12.972039+0000","last_fullsized":"2024-09-22T09:13:12.972039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:04.889097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.769069+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:12:17.769069+0000","last_peered":"2024-09-22T09:12:17.769069+0000","last_clean":"2024-09-22T09:12:17.769069+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:12:17.769069+0000","last_undegraded":"2024-09-22T09:12:17.769069+0000","last_fullsized":"2024-09-22T09:12:17.769069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:44.749004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967432+0000","last_change":"2024-09-22T08:33:33.314991+0000","last_active":"2024-09-22T09:12:32.967432+0000","last_peered":"2024-09-22T09:12:32.967432+0000","last_clean":"2024-09-22T09:12:32.967432+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:12:32.967432+0000","last_undegraded":"2024-09-22T09:12:32.967432+0000","last_fullsized":"2024-09-22T09:12:32.967432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:02.113618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968162+0000","last_change":"2024-09-22T08:51:48.548861+0000","last_active":"2024-09-22T09:12:37.968162+0000","last_peered":"2024-09-22T09:12:37.968162+0000","last_clean":"2024-09-22T09:12:37.968162+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:12:37.968162+0000","last_undegraded":"2024-09-22T09:12:37.968162+0000","last_fullsized":"2024-09-22T09:12:37.968162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:02.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780808+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:13:56.780808+0000","last_peered":"2024-09-22T09:13:56.780808+0000","last_clean":"2024-09-22T09:13:56.780808+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:13:56.780808+0000","last_undegraded":"2024-09-22T09:13:56.780808+0000","last_fullsized":"2024-09-22T09:13:56.780808+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4198,"num_write":11,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779807+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:13:47.779807+0000","last_peered":"2024-09-22T09:13:47.779807+0000","last_clean":"2024-09-22T09:13:47.779807+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:13:47.779807+0000","last_undegraded":"2024-09-22T09:13:47.779807+0000","last_fullsized":"2024-09-22T09:13:47.779807+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768411+0000","last_change":"2024-09-22T08:33:33.310686+0000","last_active":"2024-09-22T09:12:36.768411+0000","last_peered":"2024-09-22T09:12:36.768411+0000","last_clean":"2024-09-22T09:12:36.768411+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:12:36.768411+0000","last_undegraded":"2024-09-22T09:12:36.768411+0000","last_fullsized":"2024-09-22T09:12:36.768411+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:29.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968185+0000","last_change":"2024-09-22T08:51:48.549659+0000","last_active":"2024-09-22T09:12:37.968185+0000","last_peered":"2024-09-22T09:12:37.968185+0000","last_clean":"2024-09-22T09:12:37.968185+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:12:37.968185+0000","last_undegraded":"2024-09-22T09:12:37.968185+0000","last_fullsized":"2024-09-22T09:12:37.968185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:29.047532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778994+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:13:46.778994+0000","last_peered":"2024-09-22T09:13:46.778994+0000","last_clean":"2024-09-22T09:13:46.778994+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:13:46.778994+0000","last_undegraded":"2024-09-22T09:13:46.778994+0000","last_fullsized":"2024-09-22T09:13:46.778994+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.986858+0000","last_change":"2024-09-22T08:36:17.549474+0000","last_active":"2024-09-22T09:15:17.986858+0000","last_peered":"2024-09-22T09:15:17.986858+0000","last_clean":"2024-09-22T09:15:17.986858+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:15:17.986858+0000","last_undegraded":"2024-09-22T09:15:17.986858+0000","last_fullsized":"2024-09-22T09:15:17.986858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:12.074363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864628+0000","last_change":"2024-09-22T08:36:14.518932+0000","last_active":"2024-09-22T09:13:07.864628+0000","last_peered":"2024-09-22T09:13:07.864628+0000","last_clean":"2024-09-22T09:13:07.864628+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:13:07.864628+0000","last_undegraded":"2024-09-22T09:13:07.864628+0000","last_fullsized":"2024-09-22T09:13:07.864628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:01.574307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865380+0000","last_change":"2024-09-22T08:33:33.310910+0000","last_active":"2024-09-22T09:13:12.865380+0000","last_peered":"2024-09-22T09:13:12.865380+0000","last_clean":"2024-09-22T09:13:12.865380+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:13:12.865380+0000","last_undegraded":"2024-09-22T09:13:12.865380+0000","last_fullsized":"2024-09-22T09:13:12.865380+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:27.693570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.771403+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:12:37.771403+0000","last_peered":"2024-09-22T09:12:37.771403+0000","last_clean":"2024-09-22T09:12:37.771403+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:12:37.771403+0000","last_undegraded":"2024-09-22T09:12:37.771403+0000","last_fullsized":"2024-09-22T09:12:37.771403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:27.349451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774038+0000","last_change":"2024-09-22T08:33:33.309150+0000","last_active":"2024-09-22T09:13:11.774038+0000","last_peered":"2024-09-22T09:13:11.774038+0000","last_clean":"2024-09-22T09:13:11.774038+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:13:11.774038+0000","last_undegraded":"2024-09-22T09:13:11.774038+0000","last_fullsized":"2024-09-22T09:13:11.774038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:51.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778939+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:13:46.778939+0000","last_peered":"2024-09-22T09:13:46.778939+0000","last_clean":"2024-09-22T09:13:46.778939+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:13:46.778939+0000","last_undegraded":"2024-09-22T09:13:46.778939+0000","last_fullsized":"2024-09-22T09:13:46.778939+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12859,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:22.859462+0000","last_change":"2024-09-22T08:36:14.518063+0000","last_active":"2024-09-22T09:12:22.859462+0000","last_peered":"2024-09-22T09:12:22.859462+0000","last_clean":"2024-09-22T09:12:22.859462+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:12:22.859462+0000","last_undegraded":"2024-09-22T09:12:22.859462+0000","last_fullsized":"2024-09-22T09:12:22.859462+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:02.424058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":100,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864566+0000","last_change":"2024-09-22T08:33:33.305508+0000","last_active":"2024-09-22T09:13:07.864566+0000","last_peered":"2024-09-22T09:13:07.864566+0000","last_clean":"2024-09-22T09:13:07.864566+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:13:07.864566+0000","last_undegraded":"2024-09-22T09:13:07.864566+0000","last_fullsized":"2024-09-22T09:13:07.864566+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:55.651981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:27.770184+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:12:27.770184+0000","last_peered":"2024-09-22T09:12:27.770184+0000","last_clean":"2024-09-22T09:12:27.770184+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:12:27.770184+0000","last_undegraded":"2024-09-22T09:12:27.770184+0000","last_fullsized":"2024-09-22T09:12:27.770184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:49.958042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885192+0000","last_change":"2024-09-22T08:36:17.553023+0000","last_active":"2024-09-22T09:15:52.885192+0000","last_peered":"2024-09-22T09:15:52.885192+0000","last_clean":"2024-09-22T09:15:52.885192+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:15:52.885192+0000","last_undegraded":"2024-09-22T09:15:52.885192+0000","last_fullsized":"2024-09-22T09:15:52.885192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:05.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.791107+0000","last_change":"2024-09-22T08:36:14.520504+0000","last_active":"2024-09-22T09:15:51.791107+0000","last_peered":"2024-09-22T09:15:51.791107+0000","last_clean":"2024-09-22T09:15:51.791107+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:15:51.791107+0000","last_undegraded":"2024-09-22T09:15:51.791107+0000","last_fullsized":"2024-09-22T09:15:51.791107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:49.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869033+0000","last_change":"2024-09-22T08:36:17.548527+0000","last_active":"2024-09-22T09:13:47.869033+0000","last_peered":"2024-09-22T09:13:47.869033+0000","last_clean":"2024-09-22T09:13:47.869033+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:13:47.869033+0000","last_undegraded":"2024-09-22T09:13:47.869033+0000","last_fullsized":"2024-09-22T09:13:47.869033+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'4","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988796+0000","last_change":"2024-09-22T08:36:14.524325+0000","last_active":"2024-09-22T09:15:52.988796+0000","last_peered":"2024-09-22T09:15:52.988796+0000","last_clean":"2024-09-22T09:15:52.988796+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:15:52.988796+0000","last_undegraded":"2024-09-22T09:15:52.988796+0000","last_fullsized":"2024-09-22T09:15:52.988796+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:58.736096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":87,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.867830+0000","last_change":"2024-09-22T08:33:33.312962+0000","last_active":"2024-09-22T09:13:37.867830+0000","last_peered":"2024-09-22T09:13:37.867830+0000","last_clean":"2024-09-22T09:13:37.867830+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:13:37.867830+0000","last_undegraded":"2024-09-22T09:13:37.867830+0000","last_fullsized":"2024-09-22T09:13:37.867830+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:56.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'369","reported_seq":1234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.838797+0000","last_change":"2024-09-22T08:17:38.305362+0000","last_active":"2024-09-22T09:16:02.838797+0000","last_peered":"2024-09-22T09:16:02.838797+0000","last_clean":"2024-09-22T09:16:02.838797+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:02.838797+0000","last_undegraded":"2024-09-22T09:16:02.838797+0000","last_fullsized":"2024-09-22T09:16:02.838797+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.646132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397343,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1411,"num_read_kb":46472,"num_write":1250,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'948","reported_seq":2499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.763135+0000","last_change":"2024-09-22T08:17:40.306852+0000","last_active":"2024-09-22T09:15:22.763135+0000","last_peered":"2024-09-22T09:15:22.763135+0000","last_clean":"2024-09-22T09:15:22.763135+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:15:22.763135+0000","last_undegraded":"2024-09-22T09:15:22.763135+0000","last_fullsized":"2024-09-22T09:15:22.763135+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.143716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'348","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787102+0000","last_change":"2024-09-22T08:17:38.302453+0000","last_active":"2024-09-22T09:16:01.787102+0000","last_peered":"2024-09-22T09:16:01.787102+0000","last_clean":"2024-09-22T09:16:01.787102+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:01.787102+0000","last_undegraded":"2024-09-22T09:16:01.787102+0000","last_fullsized":"2024-09-22T09:16:01.787102+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:03.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604406,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":736,"num_read_kb":45729,"num_write":1233,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'767","reported_seq":2185,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.179987+0000","last_change":"2024-09-22T08:17:40.311740+0000","last_active":"2024-09-22T09:13:23.179987+0000","last_peered":"2024-09-22T09:13:23.179987+0000","last_clean":"2024-09-22T09:13:23.179987+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:13:23.179987+0000","last_undegraded":"2024-09-22T09:13:23.179987+0000","last_fullsized":"2024-09-22T09:13:23.179987+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:16.749258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'295","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775013+0000","last_change":"2024-09-22T08:17:38.306945+0000","last_active":"2024-09-22T09:16:01.775013+0000","last_peered":"2024-09-22T09:16:01.775013+0000","last_clean":"2024-09-22T09:16:01.775013+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:01.775013+0000","last_undegraded":"2024-09-22T09:16:01.775013+0000","last_fullsized":"2024-09-22T09:16:01.775013+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:40.207206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16401162,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":571,"num_read_kb":64383,"num_write":1175,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'498","reported_seq":2127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.699167+0000","last_change":"2024-09-22T08:17:40.314265+0000","last_active":"2024-09-22T09:13:27.699167+0000","last_peered":"2024-09-22T09:13:27.699167+0000","last_clean":"2024-09-22T09:13:27.699167+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:13:27.699167+0000","last_undegraded":"2024-09-22T09:13:27.699167+0000","last_fullsized":"2024-09-22T09:13:27.699167+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:49.672590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'359","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.816128+0000","last_change":"2024-09-22T08:17:38.311385+0000","last_active":"2024-09-22T09:16:02.816128+0000","last_peered":"2024-09-22T09:16:02.816128+0000","last_clean":"2024-09-22T09:16:02.816128+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:02.816128+0000","last_undegraded":"2024-09-22T09:16:02.816128+0000","last_fullsized":"2024-09-22T09:16:02.816128+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:11.719876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28432,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":644,"num_read_kb":100162,"num_write":1116,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'533","reported_seq":2199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697914+0000","last_change":"2024-09-22T08:17:40.315145+0000","last_active":"2024-09-22T09:13:27.697914+0000","last_peered":"2024-09-22T09:13:27.697914+0000","last_clean":"2024-09-22T09:13:27.697914+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:13:27.697914+0000","last_undegraded":"2024-09-22T09:13:27.697914+0000","last_fullsized":"2024-09-22T09:13:27.697914+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:28.617427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'342","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.934222+0000","last_change":"2024-09-22T08:17:38.308912+0000","last_active":"2024-09-22T09:16:02.934222+0000","last_peered":"2024-09-22T09:16:02.934222+0000","last_clean":"2024-09-22T09:16:02.934222+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:02.934222+0000","last_undegraded":"2024-09-22T09:16:02.934222+0000","last_fullsized":"2024-09-22T09:16:02.934222+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:46.873844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360779,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":579,"num_read_kb":101850,"num_write":1113,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'577","reported_seq":2234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975730+0000","last_change":"2024-09-22T08:17:40.308097+0000","last_active":"2024-09-22T09:13:47.975730+0000","last_peered":"2024-09-22T09:13:47.975730+0000","last_clean":"2024-09-22T09:13:47.975730+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:13:47.975730+0000","last_undegraded":"2024-09-22T09:13:47.975730+0000","last_fullsized":"2024-09-22T09:13:47.975730+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:54.012368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'367","reported_seq":998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.770862+0000","last_change":"2024-09-22T08:17:38.311987+0000","last_active":"2024-09-22T09:16:02.770862+0000","last_peered":"2024-09-22T09:16:02.770862+0000","last_clean":"2024-09-22T09:16:02.770862+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:02.770862+0000","last_undegraded":"2024-09-22T09:16:02.770862+0000","last_fullsized":"2024-09-22T09:16:02.770862+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:46.139865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805173,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":548,"num_read_kb":20767,"num_write":1074,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1040","reported_seq":2582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976885+0000","last_change":"2024-09-22T08:17:40.316422+0000","last_active":"2024-09-22T09:13:57.976885+0000","last_peered":"2024-09-22T09:13:57.976885+0000","last_clean":"2024-09-22T09:13:57.976885+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:13:57.976885+0000","last_undegraded":"2024-09-22T09:13:57.976885+0000","last_fullsized":"2024-09-22T09:13:57.976885+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:15.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'302","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.977069+0000","last_change":"2024-09-22T08:17:38.301886+0000","last_active":"2024-09-22T09:16:02.977069+0000","last_peered":"2024-09-22T09:16:02.977069+0000","last_clean":"2024-09-22T09:16:02.977069+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:02.977069+0000","last_undegraded":"2024-09-22T09:16:02.977069+0000","last_fullsized":"2024-09-22T09:16:02.977069+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:54.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2287637,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":505,"num_read_kb":9374,"num_write":1002,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'494","reported_seq":2087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870234+0000","last_change":"2024-09-22T08:17:40.318246+0000","last_active":"2024-09-22T09:13:57.870234+0000","last_peered":"2024-09-22T09:13:57.870234+0000","last_clean":"2024-09-22T09:13:57.870234+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:13:57.870234+0000","last_undegraded":"2024-09-22T09:13:57.870234+0000","last_fullsized":"2024-09-22T09:13:57.870234+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:12.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'326","reported_seq":980,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.799765+0000","last_change":"2024-09-22T08:17:38.312231+0000","last_active":"2024-09-22T09:16:01.799765+0000","last_peered":"2024-09-22T09:16:01.799765+0000","last_clean":"2024-09-22T09:16:01.799765+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:01.799765+0000","last_undegraded":"2024-09-22T09:16:01.799765+0000","last_fullsized":"2024-09-22T09:16:01.799765+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:59.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6934894,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":722,"num_read_kb":32987,"num_write":1042,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'638","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780919+0000","last_change":"2024-09-22T08:17:40.319835+0000","last_active":"2024-09-22T09:13:56.780919+0000","last_peered":"2024-09-22T09:13:56.780919+0000","last_clean":"2024-09-22T09:13:56.780919+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:13:56.780919+0000","last_undegraded":"2024-09-22T09:13:56.780919+0000","last_fullsized":"2024-09-22T09:13:56.780919+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:37.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'401","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779056+0000","last_change":"2024-09-22T08:17:40.313776+0000","last_active":"2024-09-22T09:13:42.779056+0000","last_peered":"2024-09-22T09:13:42.779056+0000","last_clean":"2024-09-22T09:13:42.779056+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:13:42.779056+0000","last_undegraded":"2024-09-22T09:13:42.779056+0000","last_fullsized":"2024-09-22T09:13:42.779056+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:46.265677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'272","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614964+0000","last_change":"2024-09-22T08:17:38.304440+0000","last_active":"2024-09-22T09:16:02.614964+0000","last_peered":"2024-09-22T09:16:02.614964+0000","last_clean":"2024-09-22T09:16:02.614964+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:02.614964+0000","last_undegraded":"2024-09-22T09:16:02.614964+0000","last_fullsized":"2024-09-22T09:16:02.614964+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:45.235908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193566,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":483,"num_read_kb":25983,"num_write":949,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'393","reported_seq":1922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975164+0000","last_change":"2024-09-22T08:17:40.314476+0000","last_active":"2024-09-22T09:13:42.975164+0000","last_peered":"2024-09-22T09:13:42.975164+0000","last_clean":"2024-09-22T09:13:42.975164+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:13:42.975164+0000","last_undegraded":"2024-09-22T09:13:42.975164+0000","last_fullsized":"2024-09-22T09:13:42.975164+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.686734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'266","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.811806+0000","last_change":"2024-09-22T08:17:38.308456+0000","last_active":"2024-09-22T09:16:02.811806+0000","last_peered":"2024-09-22T09:16:02.811806+0000","last_clean":"2024-09-22T09:16:02.811806+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:02.811806+0000","last_undegraded":"2024-09-22T09:16:02.811806+0000","last_fullsized":"2024-09-22T09:16:02.811806+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:02.910243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":430,"num_read_kb":1407,"num_write":855,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'765","reported_seq":2317,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:50.660940+0000","last_change":"2024-09-22T08:17:40.313996+0000","last_active":"2024-09-22T09:12:50.660940+0000","last_peered":"2024-09-22T09:12:50.660940+0000","last_clean":"2024-09-22T09:12:50.660940+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:12:50.660940+0000","last_undegraded":"2024-09-22T09:12:50.660940+0000","last_fullsized":"2024-09-22T09:12:50.660940+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:04.332313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'281","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.951343+0000","last_change":"2024-09-22T08:17:38.304225+0000","last_active":"2024-09-22T09:16:02.951343+0000","last_peered":"2024-09-22T09:16:02.951343+0000","last_clean":"2024-09-22T09:16:02.951343+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:02.951343+0000","last_undegraded":"2024-09-22T09:16:02.951343+0000","last_fullsized":"2024-09-22T09:16:02.951343+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:43.663554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1418,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":518,"num_read_kb":31210,"num_write":1004,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'769","reported_seq":2398,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211151+0000","last_change":"2024-09-22T08:17:40.320968+0000","last_active":"2024-09-22T09:14:02.211151+0000","last_peered":"2024-09-22T09:14:02.211151+0000","last_clean":"2024-09-22T09:14:02.211151+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:14:02.211151+0000","last_undegraded":"2024-09-22T09:14:02.211151+0000","last_fullsized":"2024-09-22T09:14:02.211151+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:57.247773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'294","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.790767+0000","last_change":"2024-09-22T08:17:38.303600+0000","last_active":"2024-09-22T09:16:02.790767+0000","last_peered":"2024-09-22T09:16:02.790767+0000","last_clean":"2024-09-22T09:16:02.790767+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:02.790767+0000","last_undegraded":"2024-09-22T09:16:02.790767+0000","last_fullsized":"2024-09-22T09:16:02.790767+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:42.862930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14241026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":607,"num_read_kb":14446,"num_write":1044,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.948204+0000","last_change":"2024-09-22T08:17:40.319549+0000","last_active":"2024-09-22T09:13:17.948204+0000","last_peered":"2024-09-22T09:13:17.948204+0000","last_clean":"2024-09-22T09:13:17.948204+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:13:17.948204+0000","last_undegraded":"2024-09-22T09:13:17.948204+0000","last_fullsized":"2024-09-22T09:13:17.948204+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:41.286507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'303","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.736928+0000","last_change":"2024-09-22T08:17:38.301639+0000","last_active":"2024-09-22T09:16:01.736928+0000","last_peered":"2024-09-22T09:16:01.736928+0000","last_clean":"2024-09-22T09:16:01.736928+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:01.736928+0000","last_undegraded":"2024-09-22T09:16:01.736928+0000","last_fullsized":"2024-09-22T09:16:01.736928+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:54.649295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429564,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":570,"num_read_kb":1523,"num_write":1167,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'580","reported_seq":2198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211841+0000","last_change":"2024-09-22T08:17:40.306201+0000","last_active":"2024-09-22T09:14:02.211841+0000","last_peered":"2024-09-22T09:14:02.211841+0000","last_clean":"2024-09-22T09:14:02.211841+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:14:02.211841+0000","last_undegraded":"2024-09-22T09:14:02.211841+0000","last_fullsized":"2024-09-22T09:14:02.211841+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:03.473601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'355","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.677487+0000","last_change":"2024-09-22T08:17:38.297373+0000","last_active":"2024-09-22T09:16:01.677487+0000","last_peered":"2024-09-22T09:16:01.677487+0000","last_clean":"2024-09-22T09:16:01.677487+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:01.677487+0000","last_undegraded":"2024-09-22T09:16:01.677487+0000","last_fullsized":"2024-09-22T09:16:01.677487+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662425,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":718,"num_read_kb":14779,"num_write":1428,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'120","reported_seq":619,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.502060+0000","last_change":"2024-09-22T08:17:48.369855+0000","last_active":"2024-09-22T09:14:05.502060+0000","last_peered":"2024-09-22T09:14:05.502060+0000","last_clean":"2024-09-22T09:14:05.502060+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:14:05.502060+0000","last_undegraded":"2024-09-22T09:14:05.502060+0000","last_fullsized":"2024-09-22T09:14:05.502060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:27.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'994","reported_seq":2719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.506452+0000","last_change":"2024-09-22T08:17:40.316511+0000","last_active":"2024-09-22T09:14:04.506452+0000","last_peered":"2024-09-22T09:14:04.506452+0000","last_clean":"2024-09-22T09:14:04.506452+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:14:04.506452+0000","last_undegraded":"2024-09-22T09:14:04.506452+0000","last_fullsized":"2024-09-22T09:14:04.506452+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:57.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'335","reported_seq":1205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.764861+0000","last_change":"2024-09-22T08:17:38.318139+0000","last_active":"2024-09-22T09:16:02.764861+0000","last_peered":"2024-09-22T09:16:02.764861+0000","last_clean":"2024-09-22T09:16:02.764861+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:02.764861+0000","last_undegraded":"2024-09-22T09:16:02.764861+0000","last_fullsized":"2024-09-22T09:16:02.764861+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.934545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15176067,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1309,"num_read_kb":67744,"num_write":1219,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776258+0000","last_change":"2024-09-22T08:17:42.313314+0000","last_active":"2024-09-22T09:13:17.776258+0000","last_peered":"2024-09-22T09:13:17.776258+0000","last_clean":"2024-09-22T09:13:17.776258+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:13:17.776258+0000","last_undegraded":"2024-09-22T09:13:17.776258+0000","last_fullsized":"2024-09-22T09:13:17.776258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:45.452672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796727+0000","last_change":"2024-09-22T08:17:44.340362+0000","last_active":"2024-09-22T09:15:46.796727+0000","last_peered":"2024-09-22T09:15:46.796727+0000","last_clean":"2024-09-22T09:15:46.796727+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:15:46.796727+0000","last_undegraded":"2024-09-22T09:15:46.796727+0000","last_fullsized":"2024-09-22T09:15:46.796727+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:24.766194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1054,"num_write":440,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970119+0000","last_change":"2024-09-22T08:17:46.352688+0000","last_active":"2024-09-22T09:13:22.970119+0000","last_peered":"2024-09-22T09:13:22.970119+0000","last_clean":"2024-09-22T09:13:22.970119+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:13:22.970119+0000","last_undegraded":"2024-09-22T09:13:22.970119+0000","last_fullsized":"2024-09-22T09:13:22.970119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:01.237921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'146","reported_seq":654,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970576+0000","last_change":"2024-09-22T08:17:48.369501+0000","last_active":"2024-09-22T09:13:27.970576+0000","last_peered":"2024-09-22T09:13:27.970576+0000","last_clean":"2024-09-22T09:13:27.970576+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:13:27.970576+0000","last_undegraded":"2024-09-22T09:13:27.970576+0000","last_fullsized":"2024-09-22T09:13:27.970576+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:58.815501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'462","reported_seq":2124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.524494+0000","last_change":"2024-09-22T08:17:40.313282+0000","last_active":"2024-09-22T09:14:04.524494+0000","last_peered":"2024-09-22T09:14:04.524494+0000","last_clean":"2024-09-22T09:14:04.524494+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:14:04.524494+0000","last_undegraded":"2024-09-22T09:14:04.524494+0000","last_fullsized":"2024-09-22T09:14:04.524494+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:54.516463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'321","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.780547+0000","last_change":"2024-09-22T08:17:38.302469+0000","last_active":"2024-09-22T09:16:01.780547+0000","last_peered":"2024-09-22T09:16:01.780547+0000","last_clean":"2024-09-22T09:16:01.780547+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:01.780547+0000","last_undegraded":"2024-09-22T09:16:01.780547+0000","last_fullsized":"2024-09-22T09:16:01.780547+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:18.971472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595357,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":11781,"num_write":1181,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:31.756444+0000","last_change":"2024-09-22T08:17:42.314952+0000","last_active":"2024-09-22T09:11:31.756444+0000","last_peered":"2024-09-22T09:11:31.756444+0000","last_clean":"2024-09-22T09:11:31.756444+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:11:31.756444+0000","last_undegraded":"2024-09-22T09:11:31.756444+0000","last_fullsized":"2024-09-22T09:11:31.756444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:23.058529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'89","reported_seq":606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970112+0000","last_change":"2024-09-22T08:17:44.340327+0000","last_active":"2024-09-22T09:13:22.970112+0000","last_peered":"2024-09-22T09:13:22.970112+0000","last_clean":"2024-09-22T09:13:22.970112+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:13:22.970112+0000","last_undegraded":"2024-09-22T09:13:22.970112+0000","last_fullsized":"2024-09-22T09:13:22.970112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:28.780689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970081+0000","last_change":"2024-09-22T08:17:46.352088+0000","last_active":"2024-09-22T09:13:22.970081+0000","last_peered":"2024-09-22T09:13:22.970081+0000","last_clean":"2024-09-22T09:13:22.970081+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:13:22.970081+0000","last_undegraded":"2024-09-22T09:13:22.970081+0000","last_fullsized":"2024-09-22T09:13:22.970081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:40.458281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763658+0000","last_change":"2024-09-22T08:17:48.367697+0000","last_active":"2024-09-22T09:12:51.763658+0000","last_peered":"2024-09-22T09:12:51.763658+0000","last_clean":"2024-09-22T09:12:51.763658+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:12:51.763658+0000","last_undegraded":"2024-09-22T09:12:51.763658+0000","last_fullsized":"2024-09-22T09:12:51.763658+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:46.458711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183074+0000","last_change":"2024-09-22T08:17:40.317797+0000","last_active":"2024-09-22T09:13:23.183074+0000","last_peered":"2024-09-22T09:13:23.183074+0000","last_clean":"2024-09-22T09:13:23.183074+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:13:23.183074+0000","last_undegraded":"2024-09-22T09:13:23.183074+0000","last_fullsized":"2024-09-22T09:13:23.183074+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:17.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'293","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.676943+0000","last_change":"2024-09-22T08:17:38.317777+0000","last_active":"2024-09-22T09:16:02.676943+0000","last_peered":"2024-09-22T09:16:02.676943+0000","last_clean":"2024-09-22T09:16:02.676943+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:02.676943+0000","last_undegraded":"2024-09-22T09:16:02.676943+0000","last_fullsized":"2024-09-22T09:16:02.676943+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:33.381885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98644,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":649,"num_read_kb":483,"num_write":993,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774779+0000","last_change":"2024-09-22T08:17:42.318734+0000","last_active":"2024-09-22T09:13:16.774779+0000","last_peered":"2024-09-22T09:13:16.774779+0000","last_clean":"2024-09-22T09:13:16.774779+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:13:16.774779+0000","last_undegraded":"2024-09-22T09:13:16.774779+0000","last_fullsized":"2024-09-22T09:13:16.774779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:10.711823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'121","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:58.536458+0000","last_change":"2024-09-22T08:17:44.337759+0000","last_active":"2024-09-22T09:12:58.536458+0000","last_peered":"2024-09-22T09:12:58.536458+0000","last_clean":"2024-09-22T09:12:58.536458+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:12:58.536458+0000","last_undegraded":"2024-09-22T09:12:58.536458+0000","last_fullsized":"2024-09-22T09:12:58.536458+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:58.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'792","reported_seq":2565,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.374834+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:01.374834+0000","last_peered":"2024-09-22T09:16:01.374834+0000","last_clean":"2024-09-22T09:16:01.374834+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:01.374834+0000","last_undegraded":"2024-09-22T09:16:01.374834+0000","last_fullsized":"2024-09-22T09:16:01.374834+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'183","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.560177+0000","last_change":"2024-09-22T08:17:48.368241+0000","last_active":"2024-09-22T09:14:05.560177+0000","last_peered":"2024-09-22T09:14:05.560177+0000","last_clean":"2024-09-22T09:14:05.560177+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:14:05.560177+0000","last_undegraded":"2024-09-22T09:14:05.560177+0000","last_fullsized":"2024-09-22T09:14:05.560177+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:32.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'506","reported_seq":2212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.784964+0000","last_change":"2024-09-22T08:17:40.319980+0000","last_active":"2024-09-22T09:15:22.784964+0000","last_peered":"2024-09-22T09:15:22.784964+0000","last_clean":"2024-09-22T09:15:22.784964+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:15:22.784964+0000","last_undegraded":"2024-09-22T09:15:22.784964+0000","last_fullsized":"2024-09-22T09:15:22.784964+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:14.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'381","reported_seq":1042,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.924631+0000","last_change":"2024-09-22T08:17:38.306751+0000","last_active":"2024-09-22T09:16:02.924631+0000","last_peered":"2024-09-22T09:16:02.924631+0000","last_clean":"2024-09-22T09:16:02.924631+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:02.924631+0000","last_undegraded":"2024-09-22T09:16:02.924631+0000","last_fullsized":"2024-09-22T09:16:02.924631+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:13.757965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146123,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":756,"num_read_kb":8421,"num_write":1241,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776278+0000","last_change":"2024-09-22T08:17:42.314890+0000","last_active":"2024-09-22T09:13:17.776278+0000","last_peered":"2024-09-22T09:13:17.776278+0000","last_clean":"2024-09-22T09:13:17.776278+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:13:17.776278+0000","last_undegraded":"2024-09-22T09:13:17.776278+0000","last_fullsized":"2024-09-22T09:13:17.776278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:40.671613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'295","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.928483+0000","last_change":"2024-09-22T08:17:44.330975+0000","last_active":"2024-09-22T09:16:01.928483+0000","last_peered":"2024-09-22T09:16:01.928483+0000","last_clean":"2024-09-22T09:16:01.928483+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:01.928483+0000","last_undegraded":"2024-09-22T09:16:01.928483+0000","last_fullsized":"2024-09-22T09:16:01.928483+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:22.872610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'810","reported_seq":2602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.380266+0000","last_change":"2024-09-22T08:17:46.354277+0000","last_active":"2024-09-22T09:16:01.380266+0000","last_peered":"2024-09-22T09:16:01.380266+0000","last_clean":"2024-09-22T09:16:01.380266+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:01.380266+0000","last_undegraded":"2024-09-22T09:16:01.380266+0000","last_fullsized":"2024-09-22T09:16:01.380266+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:59.717058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'410","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.341702+0000","last_change":"2024-09-22T08:17:40.312740+0000","last_active":"2024-09-22T09:14:05.341702+0000","last_peered":"2024-09-22T09:14:05.341702+0000","last_clean":"2024-09-22T09:14:05.341702+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:14:05.341702+0000","last_undegraded":"2024-09-22T09:14:05.341702+0000","last_fullsized":"2024-09-22T09:14:05.341702+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:15.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'332","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.916653+0000","last_change":"2024-09-22T08:17:38.307222+0000","last_active":"2024-09-22T09:16:02.916653+0000","last_peered":"2024-09-22T09:16:02.916653+0000","last_clean":"2024-09-22T09:16:02.916653+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:02.916653+0000","last_undegraded":"2024-09-22T09:16:02.916653+0000","last_fullsized":"2024-09-22T09:16:02.916653+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:22.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378682,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":559,"num_read_kb":44787,"num_write":1058,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.960306+0000","last_change":"2024-09-22T08:17:42.318610+0000","last_active":"2024-09-22T09:11:52.960306+0000","last_peered":"2024-09-22T09:11:52.960306+0000","last_clean":"2024-09-22T09:11:52.960306+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:11:52.960306+0000","last_undegraded":"2024-09-22T09:11:52.960306+0000","last_fullsized":"2024-09-22T09:11:52.960306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:36.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'352","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.741049+0000","last_change":"2024-09-22T08:17:44.337617+0000","last_active":"2024-09-22T09:16:02.741049+0000","last_peered":"2024-09-22T09:16:02.741049+0000","last_clean":"2024-09-22T09:16:02.741049+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:02.741049+0000","last_undegraded":"2024-09-22T09:16:02.741049+0000","last_fullsized":"2024-09-22T09:16:02.741049+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:07.429989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:46.754597+0000","last_change":"2024-09-22T08:17:46.352678+0000","last_active":"2024-09-22T09:11:46.754597+0000","last_peered":"2024-09-22T09:11:46.754597+0000","last_clean":"2024-09-22T09:11:46.754597+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:11:46.754597+0000","last_undegraded":"2024-09-22T09:11:46.754597+0000","last_fullsized":"2024-09-22T09:11:46.754597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:08.207868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'558","reported_seq":1369,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285872+0000","last_change":"2024-09-22T08:17:48.368074+0000","last_active":"2024-09-22T09:15:24.285872+0000","last_peered":"2024-09-22T09:15:24.285872+0000","last_clean":"2024-09-22T09:15:24.285872+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:15:24.285872+0000","last_undegraded":"2024-09-22T09:15:24.285872+0000","last_fullsized":"2024-09-22T09:15:24.285872+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:24.210621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'822","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.758885+0000","last_change":"2024-09-22T08:17:40.313132+0000","last_active":"2024-09-22T09:15:22.758885+0000","last_peered":"2024-09-22T09:15:22.758885+0000","last_clean":"2024-09-22T09:15:22.758885+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:15:22.758885+0000","last_undegraded":"2024-09-22T09:15:22.758885+0000","last_fullsized":"2024-09-22T09:15:22.758885+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:10.031355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'327","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.863693+0000","last_change":"2024-09-22T08:17:38.312208+0000","last_active":"2024-09-22T09:16:02.863693+0000","last_peered":"2024-09-22T09:16:02.863693+0000","last_clean":"2024-09-22T09:16:02.863693+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:02.863693+0000","last_undegraded":"2024-09-22T09:16:02.863693+0000","last_fullsized":"2024-09-22T09:16:02.863693+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.033575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486432,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":504,"num_read_kb":29046,"num_write":992,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755206+0000","last_change":"2024-09-22T08:17:42.312266+0000","last_active":"2024-09-22T09:11:51.755206+0000","last_peered":"2024-09-22T09:11:51.755206+0000","last_clean":"2024-09-22T09:11:51.755206+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:11:51.755206+0000","last_undegraded":"2024-09-22T09:11:51.755206+0000","last_fullsized":"2024-09-22T09:11:51.755206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:19.806611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'269","reported_seq":833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.246095+0000","last_change":"2024-09-22T08:17:44.341288+0000","last_active":"2024-09-22T09:15:24.246095+0000","last_peered":"2024-09-22T09:15:24.246095+0000","last_clean":"2024-09-22T09:15:24.246095+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:15:24.246095+0000","last_undegraded":"2024-09-22T09:15:24.246095+0000","last_fullsized":"2024-09-22T09:15:24.246095+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:38.968334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":889,"num_write":346,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763009+0000","last_change":"2024-09-22T08:17:46.353515+0000","last_active":"2024-09-22T09:12:06.763009+0000","last_peered":"2024-09-22T09:12:06.763009+0000","last_clean":"2024-09-22T09:12:06.763009+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:12:06.763009+0000","last_undegraded":"2024-09-22T09:12:06.763009+0000","last_fullsized":"2024-09-22T09:12:06.763009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:30.603577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2489","reported_seq":4315,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589709+0000","last_change":"2024-09-22T08:17:48.370106+0000","last_active":"2024-09-22T09:15:22.589709+0000","last_peered":"2024-09-22T09:15:22.589709+0000","last_clean":"2024-09-22T09:15:22.589709+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:15:22.589709+0000","last_undegraded":"2024-09-22T09:15:22.589709+0000","last_fullsized":"2024-09-22T09:15:22.589709+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:41.845103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'408","reported_seq":1953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.767224+0000","last_change":"2024-09-22T08:17:40.318012+0000","last_active":"2024-09-22T09:15:22.767224+0000","last_peered":"2024-09-22T09:15:22.767224+0000","last_clean":"2024-09-22T09:15:22.767224+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:15:22.767224+0000","last_undegraded":"2024-09-22T09:15:22.767224+0000","last_fullsized":"2024-09-22T09:15:22.767224+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:28.192120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772629+0000","last_change":"2024-09-22T08:17:38.308728+0000","last_active":"2024-09-22T09:16:02.772629+0000","last_peered":"2024-09-22T09:16:02.772629+0000","last_clean":"2024-09-22T09:16:02.772629+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:02.772629+0000","last_undegraded":"2024-09-22T09:16:02.772629+0000","last_fullsized":"2024-09-22T09:16:02.772629+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:31.777927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1806494,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":70122,"num_write":1065,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759708+0000","last_change":"2024-09-22T08:17:42.319503+0000","last_active":"2024-09-22T09:11:41.759708+0000","last_peered":"2024-09-22T09:11:41.759708+0000","last_clean":"2024-09-22T09:11:41.759708+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:11:41.759708+0000","last_undegraded":"2024-09-22T09:11:41.759708+0000","last_fullsized":"2024-09-22T09:11:41.759708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:21.120703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'352","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.275090+0000","last_change":"2024-09-22T08:17:44.337630+0000","last_active":"2024-09-22T09:15:24.275090+0000","last_peered":"2024-09-22T09:15:24.275090+0000","last_clean":"2024-09-22T09:15:24.275090+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:15:24.275090+0000","last_undegraded":"2024-09-22T09:15:24.275090+0000","last_fullsized":"2024-09-22T09:15:24.275090+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.579003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":565,"num_read_kb":1137,"num_write":474,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'810","reported_seq":4728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.381488+0000","last_change":"2024-09-22T08:17:46.356930+0000","last_active":"2024-09-22T09:16:01.381488+0000","last_peered":"2024-09-22T09:16:01.381488+0000","last_clean":"2024-09-22T09:16:01.381488+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:01.381488+0000","last_undegraded":"2024-09-22T09:16:01.381488+0000","last_fullsized":"2024-09-22T09:16:01.381488+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:21.225230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'120","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589147+0000","last_change":"2024-09-22T08:17:48.366165+0000","last_active":"2024-09-22T09:15:22.589147+0000","last_peered":"2024-09-22T09:15:22.589147+0000","last_clean":"2024-09-22T09:15:22.589147+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:15:22.589147+0000","last_undegraded":"2024-09-22T09:15:22.589147+0000","last_fullsized":"2024-09-22T09:15:22.589147+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:59.292369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1207","reported_seq":2863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:14.961172+0000","last_change":"2024-09-22T08:17:40.315829+0000","last_active":"2024-09-22T09:12:14.961172+0000","last_peered":"2024-09-22T09:12:14.961172+0000","last_clean":"2024-09-22T09:12:14.961172+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:12:14.961172+0000","last_undegraded":"2024-09-22T09:12:14.961172+0000","last_fullsized":"2024-09-22T09:12:14.961172+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:53.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'330","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.990520+0000","last_change":"2024-09-22T08:17:38.300056+0000","last_active":"2024-09-22T09:16:02.990520+0000","last_peered":"2024-09-22T09:16:02.990520+0000","last_clean":"2024-09-22T09:16:02.990520+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:02.990520+0000","last_undegraded":"2024-09-22T09:16:02.990520+0000","last_fullsized":"2024-09-22T09:16:02.990520+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:30.384600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":614742,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":623,"num_read_kb":2439,"num_write":1133,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.756824+0000","last_change":"2024-09-22T08:17:42.313688+0000","last_active":"2024-09-22T09:12:01.756824+0000","last_peered":"2024-09-22T09:12:01.756824+0000","last_clean":"2024-09-22T09:12:01.756824+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:12:01.756824+0000","last_undegraded":"2024-09-22T09:12:01.756824+0000","last_fullsized":"2024-09-22T09:12:01.756824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:46.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'492","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.391572+0000","last_change":"2024-09-22T08:17:44.340359+0000","last_active":"2024-09-22T09:16:01.391572+0000","last_peered":"2024-09-22T09:16:01.391572+0000","last_clean":"2024-09-22T09:16:01.391572+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:01.391572+0000","last_undegraded":"2024-09-22T09:16:01.391572+0000","last_fullsized":"2024-09-22T09:16:01.391572+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:10.001858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":853,"num_read_kb":1907,"num_write":716,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761810+0000","last_change":"2024-09-22T08:17:46.349859+0000","last_active":"2024-09-22T09:11:56.761810+0000","last_peered":"2024-09-22T09:11:56.761810+0000","last_clean":"2024-09-22T09:11:56.761810+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:11:56.761810+0000","last_undegraded":"2024-09-22T09:11:56.761810+0000","last_fullsized":"2024-09-22T09:11:56.761810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:54.379436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'132","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.496396+0000","last_change":"2024-09-22T08:17:48.368083+0000","last_active":"2024-09-22T09:14:05.496396+0000","last_peered":"2024-09-22T09:14:05.496396+0000","last_clean":"2024-09-22T09:14:05.496396+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:14:05.496396+0000","last_undegraded":"2024-09-22T09:14:05.496396+0000","last_fullsized":"2024-09-22T09:14:05.496396+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:52.729529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.211236+0000","last_change":"2024-09-22T08:17:40.315498+0000","last_active":"2024-09-22T09:13:21.211236+0000","last_peered":"2024-09-22T09:13:21.211236+0000","last_clean":"2024-09-22T09:13:21.211236+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:13:21.211236+0000","last_undegraded":"2024-09-22T09:13:21.211236+0000","last_fullsized":"2024-09-22T09:13:21.211236+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:32.268795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'341","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.746703+0000","last_change":"2024-09-22T08:17:38.301804+0000","last_active":"2024-09-22T09:16:01.746703+0000","last_peered":"2024-09-22T09:16:01.746703+0000","last_clean":"2024-09-22T09:16:01.746703+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:01.746703+0000","last_undegraded":"2024-09-22T09:16:01.746703+0000","last_fullsized":"2024-09-22T09:16:01.746703+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:48.176948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633961,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":524,"num_read_kb":12203,"num_write":1212,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.758407+0000","last_change":"2024-09-22T08:17:42.317745+0000","last_active":"2024-09-22T09:11:41.758407+0000","last_peered":"2024-09-22T09:11:41.758407+0000","last_clean":"2024-09-22T09:11:41.758407+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:11:41.758407+0000","last_undegraded":"2024-09-22T09:11:41.758407+0000","last_fullsized":"2024-09-22T09:11:41.758407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:55.976576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'298","reported_seq":862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.252674+0000","last_change":"2024-09-22T08:17:44.340384+0000","last_active":"2024-09-22T09:15:24.252674+0000","last_peered":"2024-09-22T09:15:24.252674+0000","last_clean":"2024-09-22T09:15:24.252674+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:15:24.252674+0000","last_undegraded":"2024-09-22T09:15:24.252674+0000","last_fullsized":"2024-09-22T09:15:24.252674+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:51.178814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58980,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1020,"num_write":460,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761329+0000","last_change":"2024-09-22T08:17:46.357757+0000","last_active":"2024-09-22T09:11:56.761329+0000","last_peered":"2024-09-22T09:11:56.761329+0000","last_clean":"2024-09-22T09:11:56.761329+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:11:56.761329+0000","last_undegraded":"2024-09-22T09:11:56.761329+0000","last_fullsized":"2024-09-22T09:11:56.761329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.170661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'175","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:12.994093+0000","last_change":"2024-09-22T08:17:48.369209+0000","last_active":"2024-09-22T09:15:12.994093+0000","last_peered":"2024-09-22T09:15:12.994093+0000","last_clean":"2024-09-22T09:15:12.994093+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:15:12.994093+0000","last_undegraded":"2024-09-22T09:15:12.994093+0000","last_fullsized":"2024-09-22T09:15:12.994093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:22.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'371","reported_seq":1863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183818+0000","last_change":"2024-09-22T08:17:40.318025+0000","last_active":"2024-09-22T09:13:23.183818+0000","last_peered":"2024-09-22T09:13:23.183818+0000","last_clean":"2024-09-22T09:13:23.183818+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:13:23.183818+0000","last_undegraded":"2024-09-22T09:13:23.183818+0000","last_fullsized":"2024-09-22T09:13:23.183818+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'441","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.623110+0000","last_change":"2024-09-22T08:17:38.322735+0000","last_active":"2024-09-22T09:16:02.623110+0000","last_peered":"2024-09-22T09:16:02.623110+0000","last_clean":"2024-09-22T09:16:02.623110+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:02.623110+0000","last_undegraded":"2024-09-22T09:16:02.623110+0000","last_fullsized":"2024-09-22T09:16:02.623110+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:20.868798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9152989,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1020,"num_read_kb":33703,"num_write":1375,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759746+0000","last_change":"2024-09-22T08:17:42.317557+0000","last_active":"2024-09-22T09:11:41.759746+0000","last_peered":"2024-09-22T09:11:41.759746+0000","last_clean":"2024-09-22T09:11:41.759746+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:11:41.759746+0000","last_undegraded":"2024-09-22T09:11:41.759746+0000","last_fullsized":"2024-09-22T09:11:41.759746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:12.874066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'314","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.284114+0000","last_change":"2024-09-22T08:17:44.331471+0000","last_active":"2024-09-22T09:15:24.284114+0000","last_peered":"2024-09-22T09:15:24.284114+0000","last_clean":"2024-09-22T09:15:24.284114+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:15:24.284114+0000","last_undegraded":"2024-09-22T09:15:24.284114+0000","last_fullsized":"2024-09-22T09:15:24.284114+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:15.784939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1016,"num_write":412,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'793","reported_seq":4267,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.375929+0000","last_change":"2024-09-22T08:17:46.353620+0000","last_active":"2024-09-22T09:16:01.375929+0000","last_peered":"2024-09-22T09:16:01.375929+0000","last_clean":"2024-09-22T09:16:01.375929+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:01.375929+0000","last_undegraded":"2024-09-22T09:16:01.375929+0000","last_fullsized":"2024-09-22T09:16:01.375929+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:44.586630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":632,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.416944+0000","last_change":"2024-09-22T08:17:48.368255+0000","last_active":"2024-09-22T09:14:03.416944+0000","last_peered":"2024-09-22T09:14:03.416944+0000","last_clean":"2024-09-22T09:14:03.416944+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:14:03.416944+0000","last_undegraded":"2024-09-22T09:14:03.416944+0000","last_fullsized":"2024-09-22T09:14:03.416944+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:52.505757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'504","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.760231+0000","last_change":"2024-09-22T08:17:40.319745+0000","last_active":"2024-09-22T09:15:22.760231+0000","last_peered":"2024-09-22T09:15:22.760231+0000","last_clean":"2024-09-22T09:15:22.760231+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:15:22.760231+0000","last_undegraded":"2024-09-22T09:15:22.760231+0000","last_fullsized":"2024-09-22T09:15:22.760231+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:24.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'282","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.783706+0000","last_change":"2024-09-22T08:17:38.305115+0000","last_active":"2024-09-22T09:16:02.783706+0000","last_peered":"2024-09-22T09:16:02.783706+0000","last_clean":"2024-09-22T09:16:02.783706+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:02.783706+0000","last_undegraded":"2024-09-22T09:16:02.783706+0000","last_fullsized":"2024-09-22T09:16:02.783706+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:22.303400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247588,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":453,"num_read_kb":25988,"num_write":882,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.357888+0000","last_change":"2024-09-22T08:17:42.319394+0000","last_active":"2024-09-22T09:16:01.357888+0000","last_peered":"2024-09-22T09:16:01.357888+0000","last_clean":"2024-09-22T09:16:01.357888+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:01.357888+0000","last_undegraded":"2024-09-22T09:16:01.357888+0000","last_fullsized":"2024-09-22T09:16:01.357888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:53.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.790388+0000","last_change":"2024-09-22T08:17:44.340629+0000","last_active":"2024-09-22T09:12:16.790388+0000","last_peered":"2024-09-22T09:12:16.790388+0000","last_clean":"2024-09-22T09:12:16.790388+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:12:16.790388+0000","last_undegraded":"2024-09-22T09:12:16.790388+0000","last_fullsized":"2024-09-22T09:12:16.790388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:15.874564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'782","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.376981+0000","last_change":"2024-09-22T08:17:46.356179+0000","last_active":"2024-09-22T09:16:01.376981+0000","last_peered":"2024-09-22T09:16:01.376981+0000","last_clean":"2024-09-22T09:16:01.376981+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:01.376981+0000","last_undegraded":"2024-09-22T09:16:01.376981+0000","last_fullsized":"2024-09-22T09:16:01.376981+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:39.747201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'110","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870751+0000","last_change":"2024-09-22T08:17:48.366352+0000","last_active":"2024-09-22T09:14:02.870751+0000","last_peered":"2024-09-22T09:14:02.870751+0000","last_clean":"2024-09-22T09:14:02.870751+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:14:02.870751+0000","last_undegraded":"2024-09-22T09:14:02.870751+0000","last_fullsized":"2024-09-22T09:14:02.870751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:07.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1178","reported_seq":2758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182228+0000","last_change":"2024-09-22T08:17:40.316192+0000","last_active":"2024-09-22T09:13:23.182228+0000","last_peered":"2024-09-22T09:13:23.182228+0000","last_clean":"2024-09-22T09:13:23.182228+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:13:23.182228+0000","last_undegraded":"2024-09-22T09:13:23.182228+0000","last_fullsized":"2024-09-22T09:13:23.182228+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:48.043270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.777872+0000","last_change":"2024-09-22T08:17:38.308011+0000","last_active":"2024-09-22T09:16:01.777872+0000","last_peered":"2024-09-22T09:16:01.777872+0000","last_clean":"2024-09-22T09:16:01.777872+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:01.777872+0000","last_undegraded":"2024-09-22T09:16:01.777872+0000","last_fullsized":"2024-09-22T09:16:01.777872+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:35.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8829564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":762,"num_read_kb":19795,"num_write":1259,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:42.764797+0000","last_change":"2024-09-22T08:17:42.313230+0000","last_active":"2024-09-22T09:11:42.764797+0000","last_peered":"2024-09-22T09:11:42.764797+0000","last_clean":"2024-09-22T09:11:42.764797+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:11:42.764797+0000","last_undegraded":"2024-09-22T09:11:42.764797+0000","last_fullsized":"2024-09-22T09:11:42.764797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:03.149245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'360","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.470236+0000","last_change":"2024-09-22T08:17:44.340330+0000","last_active":"2024-09-22T09:16:02.470236+0000","last_peered":"2024-09-22T09:16:02.470236+0000","last_clean":"2024-09-22T09:16:02.470236+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:02.470236+0000","last_undegraded":"2024-09-22T09:16:02.470236+0000","last_fullsized":"2024-09-22T09:16:02.470236+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:10.718081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855506+0000","last_change":"2024-09-22T08:17:46.346619+0000","last_active":"2024-09-22T09:11:47.855506+0000","last_peered":"2024-09-22T09:11:47.855506+0000","last_clean":"2024-09-22T09:11:47.855506+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:11:47.855506+0000","last_undegraded":"2024-09-22T09:11:47.855506+0000","last_fullsized":"2024-09-22T09:11:47.855506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:14.109434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'174","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.873297+0000","last_change":"2024-09-22T08:17:48.366379+0000","last_active":"2024-09-22T09:14:02.873297+0000","last_peered":"2024-09-22T09:14:02.873297+0000","last_clean":"2024-09-22T09:14:02.873297+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:14:02.873297+0000","last_undegraded":"2024-09-22T09:14:02.873297+0000","last_fullsized":"2024-09-22T09:14:02.873297+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:38.475121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'895","reported_seq":2544,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.774888+0000","last_change":"2024-09-22T08:17:40.315285+0000","last_active":"2024-09-22T09:12:16.774888+0000","last_peered":"2024-09-22T09:12:16.774888+0000","last_clean":"2024-09-22T09:12:16.774888+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:12:16.774888+0000","last_undegraded":"2024-09-22T09:12:16.774888+0000","last_fullsized":"2024-09-22T09:12:16.774888+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:30.566288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970017+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T09:13:22.970017+0000","last_peered":"2024-09-22T09:13:22.970017+0000","last_clean":"2024-09-22T09:13:22.970017+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:13:22.970017+0000","last_undegraded":"2024-09-22T09:13:22.970017+0000","last_fullsized":"2024-09-22T09:13:22.970017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779151+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T09:13:42.779151+0000","last_peered":"2024-09-22T09:13:42.779151+0000","last_clean":"2024-09-22T09:13:42.779151+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:13:42.779151+0000","last_undegraded":"2024-09-22T09:13:42.779151+0000","last_fullsized":"2024-09-22T09:13:42.779151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'266","reported_seq":920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.748620+0000","last_change":"2024-09-22T08:17:38.310448+0000","last_active":"2024-09-22T09:16:01.748620+0000","last_peered":"2024-09-22T09:16:01.748620+0000","last_clean":"2024-09-22T09:16:01.748620+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:01.748620+0000","last_undegraded":"2024-09-22T09:16:01.748620+0000","last_fullsized":"2024-09-22T09:16:01.748620+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:06.962881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8299814,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":559,"num_read_kb":39972,"num_write":973,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976838+0000","last_change":"2024-09-22T08:17:42.319001+0000","last_active":"2024-09-22T09:13:57.976838+0000","last_peered":"2024-09-22T09:13:57.976838+0000","last_clean":"2024-09-22T09:13:57.976838+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:13:57.976838+0000","last_undegraded":"2024-09-22T09:13:57.976838+0000","last_fullsized":"2024-09-22T09:13:57.976838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'737","reported_seq":1428,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.644538+0000","last_change":"2024-09-22T08:17:44.340548+0000","last_active":"2024-09-22T09:16:02.644538+0000","last_peered":"2024-09-22T09:16:02.644538+0000","last_clean":"2024-09-22T09:16:02.644538+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:02.644538+0000","last_undegraded":"2024-09-22T09:16:02.644538+0000","last_fullsized":"2024-09-22T09:16:02.644538+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:42.555714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136654,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1406,"num_read_kb":3036,"num_write":1368,"num_write_kb":1203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761952+0000","last_change":"2024-09-22T08:17:46.351335+0000","last_active":"2024-09-22T09:11:56.761952+0000","last_peered":"2024-09-22T09:11:56.761952+0000","last_clean":"2024-09-22T09:11:56.761952+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:11:56.761952+0000","last_undegraded":"2024-09-22T09:11:56.761952+0000","last_fullsized":"2024-09-22T09:11:56.761952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'205","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.392952+0000","last_change":"2024-09-22T08:17:48.371345+0000","last_active":"2024-09-22T09:14:05.392952+0000","last_peered":"2024-09-22T09:14:05.392952+0000","last_clean":"2024-09-22T09:14:05.392952+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:14:05.392952+0000","last_undegraded":"2024-09-22T09:14:05.392952+0000","last_fullsized":"2024-09-22T09:14:05.392952+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.861983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697568+0000","last_change":"2024-09-22T08:17:40.318048+0000","last_active":"2024-09-22T09:13:27.697568+0000","last_peered":"2024-09-22T09:13:27.697568+0000","last_clean":"2024-09-22T09:13:27.697568+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:13:27.697568+0000","last_undegraded":"2024-09-22T09:13:27.697568+0000","last_fullsized":"2024-09-22T09:13:27.697568+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:48.343685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779075+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T09:13:42.779075+0000","last_peered":"2024-09-22T09:13:42.779075+0000","last_clean":"2024-09-22T09:13:42.779075+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:13:42.779075+0000","last_undegraded":"2024-09-22T09:13:42.779075+0000","last_fullsized":"2024-09-22T09:13:42.779075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'277","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.791862+0000","last_change":"2024-09-22T08:17:38.309062+0000","last_active":"2024-09-22T09:16:01.791862+0000","last_peered":"2024-09-22T09:16:01.791862+0000","last_clean":"2024-09-22T09:16:01.791862+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:01.791862+0000","last_undegraded":"2024-09-22T09:16:01.791862+0000","last_fullsized":"2024-09-22T09:16:01.791862+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:47.956763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399728,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":494,"num_read_kb":6728,"num_write":1008,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.765977+0000","last_change":"2024-09-22T08:17:42.319964+0000","last_active":"2024-09-22T09:11:52.765977+0000","last_peered":"2024-09-22T09:11:52.765977+0000","last_clean":"2024-09-22T09:11:52.765977+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:11:52.765977+0000","last_undegraded":"2024-09-22T09:11:52.765977+0000","last_fullsized":"2024-09-22T09:11:52.765977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:30.133737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1321","reported_seq":2926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.402301+0000","last_change":"2024-09-22T08:17:44.340574+0000","last_active":"2024-09-22T09:16:01.402301+0000","last_peered":"2024-09-22T09:16:01.402301+0000","last_clean":"2024-09-22T09:16:01.402301+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:01.402301+0000","last_undegraded":"2024-09-22T09:16:01.402301+0000","last_fullsized":"2024-09-22T09:16:01.402301+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:35:13.936560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166762,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3488,"num_write":1152,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:12.768421+0000","last_change":"2024-09-22T08:17:46.355591+0000","last_active":"2024-09-22T09:12:12.768421+0000","last_peered":"2024-09-22T09:12:12.768421+0000","last_clean":"2024-09-22T09:12:12.768421+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:12:12.768421+0000","last_undegraded":"2024-09-22T09:12:12.768421+0000","last_fullsized":"2024-09-22T09:12:12.768421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:16.459442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'121","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.349060+0000","last_change":"2024-09-22T08:17:48.368412+0000","last_active":"2024-09-22T09:14:05.349060+0000","last_peered":"2024-09-22T09:14:05.349060+0000","last_clean":"2024-09-22T09:14:05.349060+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:14:05.349060+0000","last_undegraded":"2024-09-22T09:14:05.349060+0000","last_fullsized":"2024-09-22T09:14:05.349060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'465","reported_seq":2070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755403+0000","last_change":"2024-09-22T08:17:40.310102+0000","last_active":"2024-09-22T09:11:51.755403+0000","last_peered":"2024-09-22T09:11:51.755403+0000","last_clean":"2024-09-22T09:11:51.755403+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:11:51.755403+0000","last_undegraded":"2024-09-22T09:11:51.755403+0000","last_fullsized":"2024-09-22T09:11:51.755403+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:43.429819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778073+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T09:13:41.778073+0000","last_peered":"2024-09-22T09:13:41.778073+0000","last_clean":"2024-09-22T09:13:41.778073+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:13:41.778073+0000","last_undegraded":"2024-09-22T09:13:41.778073+0000","last_fullsized":"2024-09-22T09:13:41.778073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'279","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.761134+0000","last_change":"2024-09-22T08:17:38.321760+0000","last_active":"2024-09-22T09:16:01.761134+0000","last_peered":"2024-09-22T09:16:01.761134+0000","last_clean":"2024-09-22T09:16:01.761134+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:01.761134+0000","last_undegraded":"2024-09-22T09:16:01.761134+0000","last_fullsized":"2024-09-22T09:16:01.761134+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:53.153409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207367,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":482,"num_read_kb":1785,"num_write":1045,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"37'6","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.346566+0000","last_change":"2024-09-22T08:17:42.318777+0000","last_active":"2024-09-22T09:16:01.346566+0000","last_peered":"2024-09-22T09:16:01.346566+0000","last_clean":"2024-09-22T09:16:01.346566+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:01.346566+0000","last_undegraded":"2024-09-22T09:16:01.346566+0000","last_fullsized":"2024-09-22T09:16:01.346566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:08.823340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'259","reported_seq":1485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.651005+0000","last_change":"2024-09-22T08:17:44.340447+0000","last_active":"2024-09-22T09:15:22.651005+0000","last_peered":"2024-09-22T09:15:22.651005+0000","last_clean":"2024-09-22T09:15:22.651005+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:15:22.651005+0000","last_undegraded":"2024-09-22T09:15:22.651005+0000","last_fullsized":"2024-09-22T09:15:22.651005+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:25.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761290+0000","last_change":"2024-09-22T08:17:46.356277+0000","last_active":"2024-09-22T09:11:56.761290+0000","last_peered":"2024-09-22T09:11:56.761290+0000","last_clean":"2024-09-22T09:11:56.761290+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:11:56.761290+0000","last_undegraded":"2024-09-22T09:11:56.761290+0000","last_fullsized":"2024-09-22T09:11:56.761290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:32.511597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'261","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.635821+0000","last_change":"2024-09-22T08:17:48.371579+0000","last_active":"2024-09-22T09:14:05.635821+0000","last_peered":"2024-09-22T09:14:05.635821+0000","last_clean":"2024-09-22T09:14:05.635821+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:14:05.635821+0000","last_undegraded":"2024-09-22T09:14:05.635821+0000","last_fullsized":"2024-09-22T09:14:05.635821+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:45.916159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'775","reported_seq":2205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.773059+0000","last_change":"2024-09-22T08:17:40.310812+0000","last_active":"2024-09-22T09:13:56.773059+0000","last_peered":"2024-09-22T09:13:56.773059+0000","last_clean":"2024-09-22T09:13:56.773059+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:13:56.773059+0000","last_undegraded":"2024-09-22T09:13:56.773059+0000","last_fullsized":"2024-09-22T09:13:56.773059+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:58.245283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779128+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T09:13:42.779128+0000","last_peered":"2024-09-22T09:13:42.779128+0000","last_clean":"2024-09-22T09:13:42.779128+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:13:42.779128+0000","last_undegraded":"2024-09-22T09:13:42.779128+0000","last_fullsized":"2024-09-22T09:13:42.779128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'327","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.751237+0000","last_change":"2024-09-22T08:18:09.819721+0000","last_active":"2024-09-22T09:16:01.751237+0000","last_peered":"2024-09-22T09:16:01.751237+0000","last_clean":"2024-09-22T09:16:01.751237+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:01.751237+0000","last_undegraded":"2024-09-22T09:16:01.751237+0000","last_fullsized":"2024-09-22T09:16:01.751237+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:02.135126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267476,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":547,"num_read_kb":48326,"num_write":1121,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.762146+0000","last_change":"2024-09-22T08:17:42.321314+0000","last_active":"2024-09-22T09:12:01.762146+0000","last_peered":"2024-09-22T09:12:01.762146+0000","last_clean":"2024-09-22T09:12:01.762146+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:12:01.762146+0000","last_undegraded":"2024-09-22T09:12:01.762146+0000","last_fullsized":"2024-09-22T09:12:01.762146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:59.774382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'141","reported_seq":680,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782537+0000","last_change":"2024-09-22T08:17:44.338734+0000","last_active":"2024-09-22T09:14:06.782537+0000","last_peered":"2024-09-22T09:14:06.782537+0000","last_clean":"2024-09-22T09:14:06.782537+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:14:06.782537+0000","last_undegraded":"2024-09-22T09:14:06.782537+0000","last_fullsized":"2024-09-22T09:14:06.782537+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:01.878832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.766574+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:11:57.766574+0000","last_peered":"2024-09-22T09:11:57.766574+0000","last_clean":"2024-09-22T09:11:57.766574+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:11:57.766574+0000","last_undegraded":"2024-09-22T09:11:57.766574+0000","last_fullsized":"2024-09-22T09:11:57.766574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:45.080426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'120","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.960999+0000","last_change":"2024-09-22T08:17:48.366537+0000","last_active":"2024-09-22T09:11:57.960999+0000","last_peered":"2024-09-22T09:11:57.960999+0000","last_clean":"2024-09-22T09:11:57.960999+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:11:57.960999+0000","last_undegraded":"2024-09-22T09:11:57.960999+0000","last_fullsized":"2024-09-22T09:11:57.960999+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:56.129113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'369","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.533414+0000","last_change":"2024-09-22T08:17:40.314415+0000","last_active":"2024-09-22T09:14:04.533414+0000","last_peered":"2024-09-22T09:14:04.533414+0000","last_clean":"2024-09-22T09:14:04.533414+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:14:04.533414+0000","last_undegraded":"2024-09-22T09:14:04.533414+0000","last_fullsized":"2024-09-22T09:14:04.533414+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:51.191984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'357","reported_seq":1054,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.751679+0000","last_change":"2024-09-22T08:17:38.312313+0000","last_active":"2024-09-22T09:16:02.751679+0000","last_peered":"2024-09-22T09:16:02.751679+0000","last_clean":"2024-09-22T09:16:02.751679+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:02.751679+0000","last_undegraded":"2024-09-22T09:16:02.751679+0000","last_fullsized":"2024-09-22T09:16:02.751679+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:50.017512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335217,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":45053,"num_write":1347,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778206+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T09:13:41.778206+0000","last_peered":"2024-09-22T09:13:41.778206+0000","last_clean":"2024-09-22T09:13:41.778206+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:13:41.778206+0000","last_undegraded":"2024-09-22T09:13:41.778206+0000","last_fullsized":"2024-09-22T09:13:41.778206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780582+0000","last_change":"2024-09-22T08:17:42.315400+0000","last_active":"2024-09-22T09:13:56.780582+0000","last_peered":"2024-09-22T09:13:56.780582+0000","last_clean":"2024-09-22T09:13:56.780582+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:13:56.780582+0000","last_undegraded":"2024-09-22T09:13:56.780582+0000","last_fullsized":"2024-09-22T09:13:56.780582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'580","reported_seq":1230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.401286+0000","last_change":"2024-09-22T08:17:44.332038+0000","last_active":"2024-09-22T09:16:01.401286+0000","last_peered":"2024-09-22T09:16:01.401286+0000","last_clean":"2024-09-22T09:16:01.401286+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:01.401286+0000","last_undegraded":"2024-09-22T09:16:01.401286+0000","last_fullsized":"2024-09-22T09:16:01.401286+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:32.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112903,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1655,"num_read_kb":2619,"num_write":2214,"num_write_kb":2044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.856595+0000","last_change":"2024-09-22T08:17:46.353133+0000","last_active":"2024-09-22T09:11:57.856595+0000","last_peered":"2024-09-22T09:11:57.856595+0000","last_clean":"2024-09-22T09:11:57.856595+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:11:57.856595+0000","last_undegraded":"2024-09-22T09:11:57.856595+0000","last_fullsized":"2024-09-22T09:11:57.856595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.262623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'126","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.865467+0000","last_change":"2024-09-22T08:17:48.371983+0000","last_active":"2024-09-22T09:14:02.865467+0000","last_peered":"2024-09-22T09:14:02.865467+0000","last_clean":"2024-09-22T09:14:02.865467+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:14:02.865467+0000","last_undegraded":"2024-09-22T09:14:02.865467+0000","last_fullsized":"2024-09-22T09:14:02.865467+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:17.544287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'437","reported_seq":2050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.530580+0000","last_change":"2024-09-22T08:17:40.310836+0000","last_active":"2024-09-22T09:14:04.530580+0000","last_peered":"2024-09-22T09:14:04.530580+0000","last_clean":"2024-09-22T09:14:04.530580+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:14:04.530580+0000","last_undegraded":"2024-09-22T09:14:04.530580+0000","last_fullsized":"2024-09-22T09:14:04.530580+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:50.194831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'339","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.737328+0000","last_change":"2024-09-22T08:17:38.314470+0000","last_active":"2024-09-22T09:16:01.737328+0000","last_peered":"2024-09-22T09:16:01.737328+0000","last_clean":"2024-09-22T09:16:01.737328+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:01.737328+0000","last_undegraded":"2024-09-22T09:16:01.737328+0000","last_fullsized":"2024-09-22T09:16:01.737328+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:21.168095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13356216,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":630,"num_read_kb":42178,"num_write":1102,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781067+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T09:13:57.781067+0000","last_peered":"2024-09-22T09:13:57.781067+0000","last_clean":"2024-09-22T09:13:57.781067+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:13:57.781067+0000","last_undegraded":"2024-09-22T09:13:57.781067+0000","last_fullsized":"2024-09-22T09:13:57.781067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'3","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.370391+0000","last_change":"2024-09-22T08:17:42.319037+0000","last_active":"2024-09-22T09:16:01.370391+0000","last_peered":"2024-09-22T09:16:01.370391+0000","last_clean":"2024-09-22T09:16:01.370391+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:01.370391+0000","last_undegraded":"2024-09-22T09:16:01.370391+0000","last_fullsized":"2024-09-22T09:16:01.370391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:51.756538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'168","reported_seq":722,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.756076+0000","last_change":"2024-09-22T08:17:44.337754+0000","last_active":"2024-09-22T09:11:56.756076+0000","last_peered":"2024-09-22T09:11:56.756076+0000","last_clean":"2024-09-22T09:11:56.756076+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:11:56.756076+0000","last_undegraded":"2024-09-22T09:11:56.756076+0000","last_fullsized":"2024-09-22T09:11:56.756076+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:07.954994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'782","reported_seq":2597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.373636+0000","last_change":"2024-09-22T08:17:46.353169+0000","last_active":"2024-09-22T09:16:01.373636+0000","last_peered":"2024-09-22T09:16:01.373636+0000","last_clean":"2024-09-22T09:16:01.373636+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:01.373636+0000","last_undegraded":"2024-09-22T09:16:01.373636+0000","last_fullsized":"2024-09-22T09:16:01.373636+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:47.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'124","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783445+0000","last_change":"2024-09-22T08:17:48.370594+0000","last_active":"2024-09-22T09:14:16.783445+0000","last_peered":"2024-09-22T09:14:16.783445+0000","last_clean":"2024-09-22T09:14:16.783445+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:14:16.783445+0000","last_undegraded":"2024-09-22T09:14:16.783445+0000","last_fullsized":"2024-09-22T09:14:16.783445+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:38.200197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'478","reported_seq":2004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779781+0000","last_change":"2024-09-22T08:17:40.314079+0000","last_active":"2024-09-22T09:13:51.779781+0000","last_peered":"2024-09-22T09:13:51.779781+0000","last_clean":"2024-09-22T09:13:51.779781+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:13:51.779781+0000","last_undegraded":"2024-09-22T09:13:51.779781+0000","last_fullsized":"2024-09-22T09:13:51.779781+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:15.539629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'351","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.686371+0000","last_change":"2024-09-22T08:17:38.302210+0000","last_active":"2024-09-22T09:16:01.686371+0000","last_peered":"2024-09-22T09:16:01.686371+0000","last_clean":"2024-09-22T09:16:01.686371+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:01.686371+0000","last_undegraded":"2024-09-22T09:16:01.686371+0000","last_fullsized":"2024-09-22T09:16:01.686371+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:59.512304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190906,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":886,"num_read_kb":43239,"num_write":1228,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779024+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T09:13:46.779024+0000","last_peered":"2024-09-22T09:13:46.779024+0000","last_clean":"2024-09-22T09:13:46.779024+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:13:46.779024+0000","last_undegraded":"2024-09-22T09:13:46.779024+0000","last_fullsized":"2024-09-22T09:13:46.779024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781014+0000","last_change":"2024-09-22T08:17:42.316704+0000","last_active":"2024-09-22T09:13:57.781014+0000","last_peered":"2024-09-22T09:13:57.781014+0000","last_clean":"2024-09-22T09:13:57.781014+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:13:57.781014+0000","last_undegraded":"2024-09-22T09:13:57.781014+0000","last_fullsized":"2024-09-22T09:13:57.781014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:09.379090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'111","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:48.410289+0000","last_change":"2024-09-22T08:17:44.338196+0000","last_active":"2024-09-22T09:12:48.410289+0000","last_peered":"2024-09-22T09:12:48.410289+0000","last_clean":"2024-09-22T09:12:48.410289+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:12:48.410289+0000","last_undegraded":"2024-09-22T09:12:48.410289+0000","last_fullsized":"2024-09-22T09:12:48.410289+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:17.767211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'809","reported_seq":2518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.379031+0000","last_change":"2024-09-22T08:17:46.352328+0000","last_active":"2024-09-22T09:16:01.379031+0000","last_peered":"2024-09-22T09:16:01.379031+0000","last_clean":"2024-09-22T09:16:01.379031+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:01.379031+0000","last_undegraded":"2024-09-22T09:16:01.379031+0000","last_fullsized":"2024-09-22T09:16:01.379031+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:57.228160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'287","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.761107+0000","last_change":"2024-09-22T08:17:48.371281+0000","last_active":"2024-09-22T09:11:51.761107+0000","last_peered":"2024-09-22T09:11:51.761107+0000","last_clean":"2024-09-22T09:11:51.761107+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:11:51.761107+0000","last_undegraded":"2024-09-22T09:11:51.761107+0000","last_fullsized":"2024-09-22T09:11:51.761107+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:03.377587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'782","reported_seq":2368,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214566+0000","last_change":"2024-09-22T08:17:40.316159+0000","last_active":"2024-09-22T09:14:02.214566+0000","last_peered":"2024-09-22T09:14:02.214566+0000","last_clean":"2024-09-22T09:14:02.214566+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:14:02.214566+0000","last_undegraded":"2024-09-22T09:14:02.214566+0000","last_fullsized":"2024-09-22T09:14:02.214566+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:31.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'274","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.766152+0000","last_change":"2024-09-22T08:17:38.300386+0000","last_active":"2024-09-22T09:16:01.766152+0000","last_peered":"2024-09-22T09:16:01.766152+0000","last_clean":"2024-09-22T09:16:01.766152+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:01.766152+0000","last_undegraded":"2024-09-22T09:16:01.766152+0000","last_fullsized":"2024-09-22T09:16:01.766152+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:23.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086766,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":854,"num_read_kb":63309,"num_write":917,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779847+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T09:13:47.779847+0000","last_peered":"2024-09-22T09:13:47.779847+0000","last_clean":"2024-09-22T09:13:47.779847+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:13:47.779847+0000","last_undegraded":"2024-09-22T09:13:47.779847+0000","last_fullsized":"2024-09-22T09:13:47.779847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779817+0000","last_change":"2024-09-22T08:17:42.311097+0000","last_active":"2024-09-22T09:13:51.779817+0000","last_peered":"2024-09-22T09:13:51.779817+0000","last_clean":"2024-09-22T09:13:51.779817+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:13:51.779817+0000","last_undegraded":"2024-09-22T09:13:51.779817+0000","last_fullsized":"2024-09-22T09:13:51.779817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:38.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'738","reported_seq":1444,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.279359+0000","last_change":"2024-09-22T08:17:44.333541+0000","last_active":"2024-09-22T09:16:02.279359+0000","last_peered":"2024-09-22T09:16:02.279359+0000","last_clean":"2024-09-22T09:16:02.279359+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:02.279359+0000","last_undegraded":"2024-09-22T09:16:02.279359+0000","last_fullsized":"2024-09-22T09:16:02.279359+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:02.700362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1323,"num_read_kb":3030,"num_write":1086,"num_write_kb":894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761245+0000","last_change":"2024-09-22T08:17:46.355809+0000","last_active":"2024-09-22T09:11:56.761245+0000","last_peered":"2024-09-22T09:11:56.761245+0000","last_clean":"2024-09-22T09:11:56.761245+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:11:56.761245+0000","last_undegraded":"2024-09-22T09:11:56.761245+0000","last_fullsized":"2024-09-22T09:11:56.761245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:49.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'100","reported_seq":587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.079488+0000","last_change":"2024-09-22T08:17:48.367775+0000","last_active":"2024-09-22T09:14:05.079488+0000","last_peered":"2024-09-22T09:14:05.079488+0000","last_clean":"2024-09-22T09:14:05.079488+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:14:05.079488+0000","last_undegraded":"2024-09-22T09:14:05.079488+0000","last_fullsized":"2024-09-22T09:14:05.079488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:56.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'123","reported_seq":691,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.578802+0000","last_change":"2024-09-22T08:17:48.366489+0000","last_active":"2024-09-22T09:14:05.578802+0000","last_peered":"2024-09-22T09:14:05.578802+0000","last_clean":"2024-09-22T09:14:05.578802+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:14:05.578802+0000","last_undegraded":"2024-09-22T09:14:05.578802+0000","last_fullsized":"2024-09-22T09:14:05.578802+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:50.584912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'412","reported_seq":1973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868497+0000","last_change":"2024-09-22T08:17:40.313136+0000","last_active":"2024-09-22T09:13:42.868497+0000","last_peered":"2024-09-22T09:13:42.868497+0000","last_clean":"2024-09-22T09:13:42.868497+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:13:42.868497+0000","last_undegraded":"2024-09-22T09:13:42.868497+0000","last_fullsized":"2024-09-22T09:13:42.868497+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:06.500375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'283","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.782067+0000","last_change":"2024-09-22T08:18:09.816788+0000","last_active":"2024-09-22T09:16:02.782067+0000","last_peered":"2024-09-22T09:16:02.782067+0000","last_clean":"2024-09-22T09:16:02.782067+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:02.782067+0000","last_undegraded":"2024-09-22T09:16:02.782067+0000","last_fullsized":"2024-09-22T09:16:02.782067+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:13.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25064,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":550,"num_read_kb":48776,"num_write":1041,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.770677+0000","last_change":"2024-09-22T08:17:42.317519+0000","last_active":"2024-09-22T09:13:41.770677+0000","last_peered":"2024-09-22T09:13:41.770677+0000","last_clean":"2024-09-22T09:13:41.770677+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:13:41.770677+0000","last_undegraded":"2024-09-22T09:13:41.770677+0000","last_fullsized":"2024-09-22T09:13:41.770677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:17.290304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'295","reported_seq":852,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.273953+0000","last_change":"2024-09-22T08:17:44.340784+0000","last_active":"2024-09-22T09:15:24.273953+0000","last_peered":"2024-09-22T09:15:24.273953+0000","last_clean":"2024-09-22T09:15:24.273953+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:15:24.273953+0000","last_undegraded":"2024-09-22T09:15:24.273953+0000","last_fullsized":"2024-09-22T09:15:24.273953+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:27.691033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":895,"num_write":374,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755323+0000","last_change":"2024-09-22T08:17:46.357807+0000","last_active":"2024-09-22T09:11:26.755323+0000","last_peered":"2024-09-22T09:11:26.755323+0000","last_clean":"2024-09-22T09:11:26.755323+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:11:26.755323+0000","last_undegraded":"2024-09-22T09:11:26.755323+0000","last_fullsized":"2024-09-22T09:11:26.755323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:34.146262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'156","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781302+0000","last_change":"2024-09-22T08:17:48.370244+0000","last_active":"2024-09-22T09:14:01.781302+0000","last_peered":"2024-09-22T09:14:01.781302+0000","last_clean":"2024-09-22T09:14:01.781302+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:14:01.781302+0000","last_undegraded":"2024-09-22T09:14:01.781302+0000","last_fullsized":"2024-09-22T09:14:01.781302+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:47.163289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'477","reported_seq":2018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214640+0000","last_change":"2024-09-22T08:17:40.313313+0000","last_active":"2024-09-22T09:14:02.214640+0000","last_peered":"2024-09-22T09:14:02.214640+0000","last_clean":"2024-09-22T09:14:02.214640+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:14:02.214640+0000","last_undegraded":"2024-09-22T09:14:02.214640+0000","last_fullsized":"2024-09-22T09:14:02.214640+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:57.603890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'317","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.947408+0000","last_change":"2024-09-22T08:17:38.309041+0000","last_active":"2024-09-22T09:16:02.947408+0000","last_peered":"2024-09-22T09:16:02.947408+0000","last_clean":"2024-09-22T09:16:02.947408+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:02.947408+0000","last_undegraded":"2024-09-22T09:16:02.947408+0000","last_fullsized":"2024-09-22T09:16:02.947408+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.738401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12590450,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":589,"num_read_kb":26096,"num_write":1005,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778236+0000","last_change":"2024-09-22T08:17:42.315462+0000","last_active":"2024-09-22T09:13:41.778236+0000","last_peered":"2024-09-22T09:13:41.778236+0000","last_clean":"2024-09-22T09:13:41.778236+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:13:41.778236+0000","last_undegraded":"2024-09-22T09:13:41.778236+0000","last_fullsized":"2024-09-22T09:13:41.778236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:17.089358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'49","reported_seq":549,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755343+0000","last_change":"2024-09-22T08:17:44.334218+0000","last_active":"2024-09-22T09:11:26.755343+0000","last_peered":"2024-09-22T09:11:26.755343+0000","last_clean":"2024-09-22T09:11:26.755343+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:11:26.755343+0000","last_undegraded":"2024-09-22T09:11:26.755343+0000","last_fullsized":"2024-09-22T09:11:26.755343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:02.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.853295+0000","last_change":"2024-09-22T08:17:46.350484+0000","last_active":"2024-09-22T09:11:27.853295+0000","last_peered":"2024-09-22T09:11:27.853295+0000","last_clean":"2024-09-22T09:11:27.853295+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:11:27.853295+0000","last_undegraded":"2024-09-22T09:11:27.853295+0000","last_fullsized":"2024-09-22T09:11:27.853295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:56.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'168","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.540022+0000","last_change":"2024-09-22T08:17:48.364413+0000","last_active":"2024-09-22T09:14:04.540022+0000","last_peered":"2024-09-22T09:14:04.540022+0000","last_clean":"2024-09-22T09:14:04.540022+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:14:04.540022+0000","last_undegraded":"2024-09-22T09:14:04.540022+0000","last_fullsized":"2024-09-22T09:14:04.540022+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:40:16.567547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1112","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778132+0000","last_change":"2024-09-22T08:17:40.310933+0000","last_active":"2024-09-22T09:13:41.778132+0000","last_peered":"2024-09-22T09:13:41.778132+0000","last_clean":"2024-09-22T09:13:41.778132+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:13:41.778132+0000","last_undegraded":"2024-09-22T09:13:41.778132+0000","last_fullsized":"2024-09-22T09:13:41.778132+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:19.043581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'323","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873805+0000","last_change":"2024-09-22T08:17:38.312709+0000","last_active":"2024-09-22T09:16:02.873805+0000","last_peered":"2024-09-22T09:16:02.873805+0000","last_clean":"2024-09-22T09:16:02.873805+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:02.873805+0000","last_undegraded":"2024-09-22T09:16:02.873805+0000","last_fullsized":"2024-09-22T09:16:02.873805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:06.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":611,"num_read_kb":10746,"num_write":1176,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868449+0000","last_change":"2024-09-22T08:17:42.313569+0000","last_active":"2024-09-22T09:13:42.868449+0000","last_peered":"2024-09-22T09:13:42.868449+0000","last_clean":"2024-09-22T09:13:42.868449+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:13:42.868449+0000","last_undegraded":"2024-09-22T09:13:42.868449+0000","last_fullsized":"2024-09-22T09:13:42.868449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:08.034183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'293","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.770715+0000","last_change":"2024-09-22T08:17:44.330003+0000","last_active":"2024-09-22T09:16:01.770715+0000","last_peered":"2024-09-22T09:16:01.770715+0000","last_clean":"2024-09-22T09:16:01.770715+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:01.770715+0000","last_undegraded":"2024-09-22T09:16:01.770715+0000","last_fullsized":"2024-09-22T09:16:01.770715+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:32.877991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52572,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":989,"num_write":383,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.957514+0000","last_change":"2024-09-22T08:17:46.356371+0000","last_active":"2024-09-22T09:11:27.957514+0000","last_peered":"2024-09-22T09:11:27.957514+0000","last_clean":"2024-09-22T09:11:27.957514+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:11:27.957514+0000","last_undegraded":"2024-09-22T09:11:27.957514+0000","last_fullsized":"2024-09-22T09:11:27.957514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:25.542729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'671","reported_seq":2216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.368365+0000","last_change":"2024-09-22T08:17:40.311434+0000","last_active":"2024-09-22T09:14:05.368365+0000","last_peered":"2024-09-22T09:14:05.368365+0000","last_clean":"2024-09-22T09:14:05.368365+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:14:05.368365+0000","last_undegraded":"2024-09-22T09:14:05.368365+0000","last_fullsized":"2024-09-22T09:14:05.368365+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:05.862018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'340","reported_seq":1050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.778195+0000","last_change":"2024-09-22T08:17:38.311519+0000","last_active":"2024-09-22T09:16:01.778195+0000","last_peered":"2024-09-22T09:16:01.778195+0000","last_clean":"2024-09-22T09:16:01.778195+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:01.778195+0000","last_undegraded":"2024-09-22T09:16:01.778195+0000","last_fullsized":"2024-09-22T09:16:01.778195+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:22.084105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11984519,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":750,"num_read_kb":91878,"num_write":1278,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779094+0000","last_change":"2024-09-22T08:17:42.314653+0000","last_active":"2024-09-22T09:13:42.779094+0000","last_peered":"2024-09-22T09:13:42.779094+0000","last_clean":"2024-09-22T09:13:42.779094+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:13:42.779094+0000","last_undegraded":"2024-09-22T09:13:42.779094+0000","last_fullsized":"2024-09-22T09:13:42.779094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:43.222863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.590092+0000","last_change":"2024-09-22T08:17:44.333516+0000","last_active":"2024-09-22T09:16:01.590092+0000","last_peered":"2024-09-22T09:16:01.590092+0000","last_clean":"2024-09-22T09:16:01.590092+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:01.590092+0000","last_undegraded":"2024-09-22T09:16:01.590092+0000","last_fullsized":"2024-09-22T09:16:01.590092+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:11.332157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755387+0000","last_change":"2024-09-22T08:17:46.353828+0000","last_active":"2024-09-22T09:11:26.755387+0000","last_peered":"2024-09-22T09:11:26.755387+0000","last_clean":"2024-09-22T09:11:26.755387+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:11:26.755387+0000","last_undegraded":"2024-09-22T09:11:26.755387+0000","last_fullsized":"2024-09-22T09:11:26.755387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:01.647431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'811","reported_seq":2471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211752+0000","last_change":"2024-09-22T08:17:40.320765+0000","last_active":"2024-09-22T09:14:02.211752+0000","last_peered":"2024-09-22T09:14:02.211752+0000","last_clean":"2024-09-22T09:14:02.211752+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:14:02.211752+0000","last_undegraded":"2024-09-22T09:14:02.211752+0000","last_fullsized":"2024-09-22T09:14:02.211752+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:32.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'284","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775430+0000","last_change":"2024-09-22T08:17:38.312312+0000","last_active":"2024-09-22T09:16:01.775430+0000","last_peered":"2024-09-22T09:16:01.775430+0000","last_clean":"2024-09-22T09:16:01.775430+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:01.775430+0000","last_undegraded":"2024-09-22T09:16:01.775430+0000","last_fullsized":"2024-09-22T09:16:01.775430+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:42.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5285041,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":504,"num_read_kb":11714,"num_write":1020,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.772343+0000","last_change":"2024-09-22T08:17:42.317020+0000","last_active":"2024-09-22T09:13:51.772343+0000","last_peered":"2024-09-22T09:13:51.772343+0000","last_clean":"2024-09-22T09:13:51.772343+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:13:51.772343+0000","last_undegraded":"2024-09-22T09:13:51.772343+0000","last_fullsized":"2024-09-22T09:13:51.772343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:52.212344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'464","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.492893+0000","last_change":"2024-09-22T08:17:44.328451+0000","last_active":"2024-09-22T09:16:01.492893+0000","last_peered":"2024-09-22T09:16:01.492893+0000","last_clean":"2024-09-22T09:16:01.492893+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:01.492893+0000","last_undegraded":"2024-09-22T09:16:01.492893+0000","last_fullsized":"2024-09-22T09:16:01.492893+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:33.770821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":837,"num_read_kb":1865,"num_write":720,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862398+0000","last_change":"2024-09-22T08:17:46.357073+0000","last_active":"2024-09-22T09:12:47.862398+0000","last_peered":"2024-09-22T09:12:47.862398+0000","last_clean":"2024-09-22T09:12:47.862398+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:12:47.862398+0000","last_undegraded":"2024-09-22T09:12:47.862398+0000","last_fullsized":"2024-09-22T09:12:47.862398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:46.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779894+0000","last_change":"2024-09-22T08:17:48.368356+0000","last_active":"2024-09-22T09:13:51.779894+0000","last_peered":"2024-09-22T09:13:51.779894+0000","last_clean":"2024-09-22T09:13:51.779894+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:13:51.779894+0000","last_undegraded":"2024-09-22T09:13:51.779894+0000","last_fullsized":"2024-09-22T09:13:51.779894+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:13.835369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779952+0000","last_change":"2024-09-22T08:17:40.313468+0000","last_active":"2024-09-22T09:13:51.779952+0000","last_peered":"2024-09-22T09:13:51.779952+0000","last_clean":"2024-09-22T09:13:51.779952+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:13:51.779952+0000","last_undegraded":"2024-09-22T09:13:51.779952+0000","last_fullsized":"2024-09-22T09:13:51.779952+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:48.343824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'338","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.723149+0000","last_change":"2024-09-22T08:17:38.309341+0000","last_active":"2024-09-22T09:16:01.723149+0000","last_peered":"2024-09-22T09:16:01.723149+0000","last_clean":"2024-09-22T09:16:01.723149+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:01.723149+0000","last_undegraded":"2024-09-22T09:16:01.723149+0000","last_fullsized":"2024-09-22T09:16:01.723149+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:09.613574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572103,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":728,"num_read_kb":2506,"num_write":1187,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870282+0000","last_change":"2024-09-22T08:17:42.318772+0000","last_active":"2024-09-22T09:13:57.870282+0000","last_peered":"2024-09-22T09:13:57.870282+0000","last_clean":"2024-09-22T09:13:57.870282+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:13:57.870282+0000","last_undegraded":"2024-09-22T09:13:57.870282+0000","last_fullsized":"2024-09-22T09:13:57.870282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.477954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.680306+0000","last_change":"2024-09-22T08:17:44.337248+0000","last_active":"2024-09-22T09:16:01.680306+0000","last_peered":"2024-09-22T09:16:01.680306+0000","last_clean":"2024-09-22T09:16:01.680306+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:01.680306+0000","last_undegraded":"2024-09-22T09:16:01.680306+0000","last_fullsized":"2024-09-22T09:16:01.680306+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:40.861866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.769839+0000","last_change":"2024-09-22T08:17:46.351080+0000","last_active":"2024-09-22T09:12:46.769839+0000","last_peered":"2024-09-22T09:12:46.769839+0000","last_clean":"2024-09-22T09:12:46.769839+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:12:46.769839+0000","last_undegraded":"2024-09-22T09:12:46.769839+0000","last_fullsized":"2024-09-22T09:12:46.769839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:09.613966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.091115+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:11:52.091115+0000","last_peered":"2024-09-22T09:11:52.091115+0000","last_clean":"2024-09-22T09:11:52.091115+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:11:52.091115+0000","last_undegraded":"2024-09-22T09:11:52.091115+0000","last_fullsized":"2024-09-22T09:11:52.091115+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1248","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.366126+0000","last_change":"2024-09-22T08:17:40.308494+0000","last_active":"2024-09-22T09:14:05.366126+0000","last_peered":"2024-09-22T09:14:05.366126+0000","last_clean":"2024-09-22T09:14:05.366126+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:14:05.366126+0000","last_undegraded":"2024-09-22T09:14:05.366126+0000","last_fullsized":"2024-09-22T09:14:05.366126+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:17.224433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'340","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.941276+0000","last_change":"2024-09-22T08:17:38.301468+0000","last_active":"2024-09-22T09:16:02.941276+0000","last_peered":"2024-09-22T09:16:02.941276+0000","last_clean":"2024-09-22T09:16:02.941276+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:02.941276+0000","last_undegraded":"2024-09-22T09:16:02.941276+0000","last_fullsized":"2024-09-22T09:16:02.941276+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:20.950022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098204,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":677,"num_read_kb":11614,"num_write":1094,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861833+0000","last_change":"2024-09-22T08:17:42.319109+0000","last_active":"2024-09-22T09:12:42.861833+0000","last_peered":"2024-09-22T09:12:42.861833+0000","last_clean":"2024-09-22T09:12:42.861833+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:12:42.861833+0000","last_undegraded":"2024-09-22T09:12:42.861833+0000","last_fullsized":"2024-09-22T09:12:42.861833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.764545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'287","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.278368+0000","last_change":"2024-09-22T08:17:44.329668+0000","last_active":"2024-09-22T09:15:24.278368+0000","last_peered":"2024-09-22T09:15:24.278368+0000","last_clean":"2024-09-22T09:15:24.278368+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:15:24.278368+0000","last_undegraded":"2024-09-22T09:15:24.278368+0000","last_fullsized":"2024-09-22T09:15:24.278368+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:13.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1015,"num_write":402,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780532+0000","last_change":"2024-09-22T08:17:46.357031+0000","last_active":"2024-09-22T09:13:56.780532+0000","last_peered":"2024-09-22T09:13:56.780532+0000","last_clean":"2024-09-22T09:13:56.780532+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:13:56.780532+0000","last_undegraded":"2024-09-22T09:13:56.780532+0000","last_fullsized":"2024-09-22T09:13:56.780532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:29.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":640,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285336+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.285336+0000","last_peered":"2024-09-22T09:15:24.285336+0000","last_clean":"2024-09-22T09:15:24.285336+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.285336+0000","last_undegraded":"2024-09-22T09:15:24.285336+0000","last_fullsized":"2024-09-22T09:15:24.285336+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'667","reported_seq":2093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211947+0000","last_change":"2024-09-22T08:17:40.312070+0000","last_active":"2024-09-22T09:14:02.211947+0000","last_peered":"2024-09-22T09:14:02.211947+0000","last_clean":"2024-09-22T09:14:02.211947+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:14:02.211947+0000","last_undegraded":"2024-09-22T09:14:02.211947+0000","last_fullsized":"2024-09-22T09:14:02.211947+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:59.960810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'246","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.720403+0000","last_change":"2024-09-22T08:17:38.300439+0000","last_active":"2024-09-22T09:16:01.720403+0000","last_peered":"2024-09-22T09:16:01.720403+0000","last_clean":"2024-09-22T09:16:01.720403+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:01.720403+0000","last_undegraded":"2024-09-22T09:16:01.720403+0000","last_fullsized":"2024-09-22T09:16:01.720403+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:30.381994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13761680,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":719,"num_read_kb":50024,"num_write":961,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769245+0000","last_change":"2024-09-22T08:17:42.312738+0000","last_active":"2024-09-22T09:12:41.769245+0000","last_peered":"2024-09-22T09:12:41.769245+0000","last_clean":"2024-09-22T09:12:41.769245+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:12:41.769245+0000","last_undegraded":"2024-09-22T09:12:41.769245+0000","last_fullsized":"2024-09-22T09:12:41.769245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:45.180659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'89","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.795335+0000","last_change":"2024-09-22T08:17:44.336865+0000","last_active":"2024-09-22T09:15:22.795335+0000","last_peered":"2024-09-22T09:15:22.795335+0000","last_clean":"2024-09-22T09:15:22.795335+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:15:22.795335+0000","last_undegraded":"2024-09-22T09:15:22.795335+0000","last_fullsized":"2024-09-22T09:15:22.795335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.810068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'779","reported_seq":2589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.372445+0000","last_change":"2024-09-22T08:17:46.350387+0000","last_active":"2024-09-22T09:16:01.372445+0000","last_peered":"2024-09-22T09:16:01.372445+0000","last_clean":"2024-09-22T09:16:01.372445+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:01.372445+0000","last_undegraded":"2024-09-22T09:16:01.372445+0000","last_fullsized":"2024-09-22T09:16:01.372445+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:22.815286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":681,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.932904+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:17.932904+0000","last_peered":"2024-09-22T09:13:17.932904+0000","last_clean":"2024-09-22T09:13:17.932904+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:17.932904+0000","last_undegraded":"2024-09-22T09:13:17.932904+0000","last_fullsized":"2024-09-22T09:13:17.932904+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'505","reported_seq":2211,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.700019+0000","last_change":"2024-09-22T08:17:40.320955+0000","last_active":"2024-09-22T09:13:27.700019+0000","last_peered":"2024-09-22T09:13:27.700019+0000","last_clean":"2024-09-22T09:13:27.700019+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:13:27.700019+0000","last_undegraded":"2024-09-22T09:13:27.700019+0000","last_fullsized":"2024-09-22T09:13:27.700019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:36.450185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'346","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.956252+0000","last_change":"2024-09-22T08:17:38.297556+0000","last_active":"2024-09-22T09:16:02.956252+0000","last_peered":"2024-09-22T09:16:02.956252+0000","last_clean":"2024-09-22T09:16:02.956252+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:02.956252+0000","last_undegraded":"2024-09-22T09:16:02.956252+0000","last_fullsized":"2024-09-22T09:16:02.956252+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:27.230525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6597524,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":617,"num_read_kb":33739,"num_write":1091,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.965759+0000","last_change":"2024-09-22T08:17:42.321443+0000","last_active":"2024-09-22T09:12:42.965759+0000","last_peered":"2024-09-22T09:12:42.965759+0000","last_clean":"2024-09-22T09:12:42.965759+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:12:42.965759+0000","last_undegraded":"2024-09-22T09:12:42.965759+0000","last_fullsized":"2024-09-22T09:12:42.965759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:41.703609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'295","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.991339+0000","last_change":"2024-09-22T08:17:44.334035+0000","last_active":"2024-09-22T09:15:52.991339+0000","last_peered":"2024-09-22T09:15:52.991339+0000","last_clean":"2024-09-22T09:15:52.991339+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:15:52.991339+0000","last_undegraded":"2024-09-22T09:15:52.991339+0000","last_fullsized":"2024-09-22T09:15:52.991339+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:29.638317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56058,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":937,"num_write":386,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.775383+0000","last_change":"2024-09-22T08:17:46.356892+0000","last_active":"2024-09-22T09:13:21.775383+0000","last_peered":"2024-09-22T09:13:21.775383+0000","last_clean":"2024-09-22T09:13:21.775383+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:13:21.775383+0000","last_undegraded":"2024-09-22T09:13:21.775383+0000","last_fullsized":"2024-09-22T09:13:21.775383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:04.578235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'130","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.528881+0000","last_change":"2024-09-22T08:17:48.366280+0000","last_active":"2024-09-22T09:14:02.528881+0000","last_peered":"2024-09-22T09:14:02.528881+0000","last_clean":"2024-09-22T09:14:02.528881+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:14:02.528881+0000","last_undegraded":"2024-09-22T09:14:02.528881+0000","last_fullsized":"2024-09-22T09:14:02.528881+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:56.027995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1506","reported_seq":3219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183120+0000","last_change":"2024-09-22T08:17:40.310983+0000","last_active":"2024-09-22T09:13:23.183120+0000","last_peered":"2024-09-22T09:13:23.183120+0000","last_clean":"2024-09-22T09:13:23.183120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:13:23.183120+0000","last_undegraded":"2024-09-22T09:13:23.183120+0000","last_fullsized":"2024-09-22T09:13:23.183120+0000","mapping_epoch":27,"log_start":"261'1400","ondisk_log_start":"261'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:35.395564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'291","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.683318+0000","last_change":"2024-09-22T08:17:38.304935+0000","last_active":"2024-09-22T09:16:02.683318+0000","last_peered":"2024-09-22T09:16:02.683318+0000","last_clean":"2024-09-22T09:16:02.683318+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:02.683318+0000","last_undegraded":"2024-09-22T09:16:02.683318+0000","last_fullsized":"2024-09-22T09:16:02.683318+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:21.548021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17850038,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":711,"num_read_kb":31336,"num_write":990,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861818+0000","last_change":"2024-09-22T08:17:42.318147+0000","last_active":"2024-09-22T09:12:42.861818+0000","last_peered":"2024-09-22T09:12:42.861818+0000","last_clean":"2024-09-22T09:12:42.861818+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:12:42.861818+0000","last_undegraded":"2024-09-22T09:12:42.861818+0000","last_fullsized":"2024-09-22T09:12:42.861818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:04.949197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'306","reported_seq":869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796614+0000","last_change":"2024-09-22T08:17:44.332720+0000","last_active":"2024-09-22T09:15:46.796614+0000","last_peered":"2024-09-22T09:15:46.796614+0000","last_clean":"2024-09-22T09:15:46.796614+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:15:46.796614+0000","last_undegraded":"2024-09-22T09:15:46.796614+0000","last_fullsized":"2024-09-22T09:15:46.796614+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:17.326913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158139,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1234,"num_write":414,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'507","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.775921+0000","last_change":"2024-09-22T08:17:40.310131+0000","last_active":"2024-09-22T09:13:26.775921+0000","last_peered":"2024-09-22T09:13:26.775921+0000","last_clean":"2024-09-22T09:13:26.775921+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:13:26.775921+0000","last_undegraded":"2024-09-22T09:13:26.775921+0000","last_fullsized":"2024-09-22T09:13:26.775921+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:45.234169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'325","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.793403+0000","last_change":"2024-09-22T08:17:38.307916+0000","last_active":"2024-09-22T09:16:01.793403+0000","last_peered":"2024-09-22T09:16:01.793403+0000","last_clean":"2024-09-22T09:16:01.793403+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:01.793403+0000","last_undegraded":"2024-09-22T09:16:01.793403+0000","last_fullsized":"2024-09-22T09:16:01.793403+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:54.133795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12264533,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":605,"num_read_kb":50425,"num_write":1146,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.969462+0000","last_change":"2024-09-22T08:17:42.318093+0000","last_active":"2024-09-22T09:13:17.969462+0000","last_peered":"2024-09-22T09:13:17.969462+0000","last_clean":"2024-09-22T09:13:17.969462+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:13:17.969462+0000","last_undegraded":"2024-09-22T09:13:17.969462+0000","last_fullsized":"2024-09-22T09:13:17.969462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:12.353580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'244","reported_seq":782,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.276145+0000","last_change":"2024-09-22T08:17:44.332231+0000","last_active":"2024-09-22T09:15:24.276145+0000","last_peered":"2024-09-22T09:15:24.276145+0000","last_clean":"2024-09-22T09:15:24.276145+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:15:24.276145+0000","last_undegraded":"2024-09-22T09:15:24.276145+0000","last_fullsized":"2024-09-22T09:15:24.276145+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:01.307744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53531,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":409,"num_read_kb":891,"num_write":342,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'430","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.212080+0000","last_change":"2024-09-22T08:17:40.314834+0000","last_active":"2024-09-22T09:13:21.212080+0000","last_peered":"2024-09-22T09:13:21.212080+0000","last_clean":"2024-09-22T09:13:21.212080+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:13:21.212080+0000","last_undegraded":"2024-09-22T09:13:21.212080+0000","last_fullsized":"2024-09-22T09:13:21.212080+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:48.705025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'295","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787004+0000","last_change":"2024-09-22T08:17:38.311548+0000","last_active":"2024-09-22T09:16:01.787004+0000","last_peered":"2024-09-22T09:16:01.787004+0000","last_clean":"2024-09-22T09:16:01.787004+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:01.787004+0000","last_undegraded":"2024-09-22T09:16:01.787004+0000","last_fullsized":"2024-09-22T09:16:01.787004+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:46.517280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19469174,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":553,"num_read_kb":43721,"num_write":1074,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.776027+0000","last_change":"2024-09-22T08:17:42.314063+0000","last_active":"2024-09-22T09:13:26.776027+0000","last_peered":"2024-09-22T09:13:26.776027+0000","last_clean":"2024-09-22T09:13:26.776027+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:13:26.776027+0000","last_undegraded":"2024-09-22T09:13:26.776027+0000","last_fullsized":"2024-09-22T09:13:26.776027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:31.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'310","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.279703+0000","last_change":"2024-09-22T08:17:44.339434+0000","last_active":"2024-09-22T09:15:24.279703+0000","last_peered":"2024-09-22T09:15:24.279703+0000","last_clean":"2024-09-22T09:15:24.279703+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:15:24.279703+0000","last_undegraded":"2024-09-22T09:15:24.279703+0000","last_fullsized":"2024-09-22T09:15:24.279703+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:14.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64909,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":1020,"num_write":414,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.770004+0000","last_change":"2024-09-22T08:17:46.354487+0000","last_active":"2024-09-22T09:12:46.770004+0000","last_peered":"2024-09-22T09:12:46.770004+0000","last_clean":"2024-09-22T09:12:46.770004+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:12:46.770004+0000","last_undegraded":"2024-09-22T09:12:46.770004+0000","last_fullsized":"2024-09-22T09:12:46.770004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:13.119686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'139","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.752829+0000","last_change":"2024-09-22T08:17:48.372094+0000","last_active":"2024-09-22T09:15:22.752829+0000","last_peered":"2024-09-22T09:15:22.752829+0000","last_clean":"2024-09-22T09:15:22.752829+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:15:22.752829+0000","last_undegraded":"2024-09-22T09:15:22.752829+0000","last_fullsized":"2024-09-22T09:15:22.752829+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:49.984539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'514","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:08.228455+0000","last_change":"2024-09-22T08:17:40.316760+0000","last_active":"2024-09-22T09:13:08.228455+0000","last_peered":"2024-09-22T09:13:08.228455+0000","last_clean":"2024-09-22T09:13:08.228455+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:13:08.228455+0000","last_undegraded":"2024-09-22T09:13:08.228455+0000","last_fullsized":"2024-09-22T09:13:08.228455+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:42.550645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'297","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.858092+0000","last_change":"2024-09-22T08:17:38.311771+0000","last_active":"2024-09-22T09:16:02.858092+0000","last_peered":"2024-09-22T09:16:02.858092+0000","last_clean":"2024-09-22T09:16:02.858092+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:02.858092+0000","last_undegraded":"2024-09-22T09:16:02.858092+0000","last_fullsized":"2024-09-22T09:16:02.858092+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:56.381847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325064,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":508,"num_read_kb":33852,"num_write":931,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'417","reported_seq":1875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.760299+0000","last_change":"2024-09-22T08:17:40.313063+0000","last_active":"2024-09-22T09:11:51.760299+0000","last_peered":"2024-09-22T09:11:51.760299+0000","last_clean":"2024-09-22T09:11:51.760299+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:11:51.760299+0000","last_undegraded":"2024-09-22T09:11:51.760299+0000","last_fullsized":"2024-09-22T09:11:51.760299+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:41.064638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'272","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.798028+0000","last_change":"2024-09-22T08:17:38.300470+0000","last_active":"2024-09-22T09:16:01.798028+0000","last_peered":"2024-09-22T09:16:01.798028+0000","last_clean":"2024-09-22T09:16:01.798028+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:01.798028+0000","last_undegraded":"2024-09-22T09:16:01.798028+0000","last_fullsized":"2024-09-22T09:16:01.798028+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:42.767130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906219,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":498,"num_read_kb":87969,"num_write":902,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.766032+0000","last_change":"2024-09-22T08:17:40.312973+0000","last_active":"2024-09-22T09:15:22.766032+0000","last_peered":"2024-09-22T09:15:22.766032+0000","last_clean":"2024-09-22T09:15:22.766032+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:15:22.766032+0000","last_undegraded":"2024-09-22T09:15:22.766032+0000","last_fullsized":"2024-09-22T09:15:22.766032+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:28.486740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'381","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.752833+0000","last_change":"2024-09-22T08:17:38.323059+0000","last_active":"2024-09-22T09:16:02.752833+0000","last_peered":"2024-09-22T09:16:02.752833+0000","last_clean":"2024-09-22T09:16:02.752833+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:02.752833+0000","last_undegraded":"2024-09-22T09:16:02.752833+0000","last_fullsized":"2024-09-22T09:16:02.752833+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:37.193303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329113,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":875,"num_read_kb":34718,"num_write":1245,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'748","reported_seq":2556,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.184911+0000","last_change":"2024-09-22T08:17:40.313093+0000","last_active":"2024-09-22T09:14:02.184911+0000","last_peered":"2024-09-22T09:14:02.184911+0000","last_clean":"2024-09-22T09:14:02.184911+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:14:02.184911+0000","last_undegraded":"2024-09-22T09:14:02.184911+0000","last_fullsized":"2024-09-22T09:14:02.184911+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:35.949195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'312","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.776947+0000","last_change":"2024-09-22T08:17:38.310044+0000","last_active":"2024-09-22T09:16:01.776947+0000","last_peered":"2024-09-22T09:16:01.776947+0000","last_clean":"2024-09-22T09:16:01.776947+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:01.776947+0000","last_undegraded":"2024-09-22T09:16:01.776947+0000","last_fullsized":"2024-09-22T09:16:01.776947+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:59.605789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7970484,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":738,"num_read_kb":20346,"num_write":1086,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'494","reported_seq":2066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:05.245095+0000","last_change":"2024-09-22T08:17:40.314007+0000","last_active":"2024-09-22T09:13:05.245095+0000","last_peered":"2024-09-22T09:13:05.245095+0000","last_clean":"2024-09-22T09:13:05.245095+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:13:05.245095+0000","last_undegraded":"2024-09-22T09:13:05.245095+0000","last_fullsized":"2024-09-22T09:13:05.245095+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:30.609929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'279","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754464+0000","last_change":"2024-09-22T08:17:38.312019+0000","last_active":"2024-09-22T09:16:01.754464+0000","last_peered":"2024-09-22T09:16:01.754464+0000","last_clean":"2024-09-22T09:16:01.754464+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:01.754464+0000","last_undegraded":"2024-09-22T09:16:01.754464+0000","last_fullsized":"2024-09-22T09:16:01.754464+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:06.122619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10784758,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":479,"num_read_kb":26435,"num_write":1006,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'717","reported_seq":2220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.362495+0000","last_change":"2024-09-22T08:17:40.312561+0000","last_active":"2024-09-22T09:14:05.362495+0000","last_peered":"2024-09-22T09:14:05.362495+0000","last_clean":"2024-09-22T09:14:05.362495+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:14:05.362495+0000","last_undegraded":"2024-09-22T09:14:05.362495+0000","last_fullsized":"2024-09-22T09:14:05.362495+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:01.994997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'301","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754398+0000","last_change":"2024-09-22T08:17:38.308183+0000","last_active":"2024-09-22T09:16:01.754398+0000","last_peered":"2024-09-22T09:16:01.754398+0000","last_clean":"2024-09-22T09:16:01.754398+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:01.754398+0000","last_undegraded":"2024-09-22T09:16:01.754398+0000","last_fullsized":"2024-09-22T09:16:01.754398+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:02.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":800538,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":725,"num_read_kb":911,"num_write":1010,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'458","reported_seq":2142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.210418+0000","last_change":"2024-09-22T08:17:40.319770+0000","last_active":"2024-09-22T09:14:02.210418+0000","last_peered":"2024-09-22T09:14:02.210418+0000","last_clean":"2024-09-22T09:14:02.210418+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:14:02.210418+0000","last_undegraded":"2024-09-22T09:14:02.210418+0000","last_fullsized":"2024-09-22T09:14:02.210418+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:00.471168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'402","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.861482+0000","last_change":"2024-09-22T08:17:38.312486+0000","last_active":"2024-09-22T09:16:02.861482+0000","last_peered":"2024-09-22T09:16:02.861482+0000","last_clean":"2024-09-22T09:16:02.861482+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:02.861482+0000","last_undegraded":"2024-09-22T09:16:02.861482+0000","last_fullsized":"2024-09-22T09:16:02.861482+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:17.480840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3209675,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":892,"num_read_kb":31161,"num_write":1620,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'488","reported_seq":2208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.973888+0000","last_change":"2024-09-22T08:17:40.316623+0000","last_active":"2024-09-22T09:13:57.973888+0000","last_peered":"2024-09-22T09:13:57.973888+0000","last_clean":"2024-09-22T09:13:57.973888+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:13:57.973888+0000","last_undegraded":"2024-09-22T09:13:57.973888+0000","last_fullsized":"2024-09-22T09:13:57.973888+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:49.821404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'267","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.693440+0000","last_change":"2024-09-22T08:17:38.311100+0000","last_active":"2024-09-22T09:16:01.693440+0000","last_peered":"2024-09-22T09:16:01.693440+0000","last_clean":"2024-09-22T09:16:01.693440+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:01.693440+0000","last_undegraded":"2024-09-22T09:16:01.693440+0000","last_fullsized":"2024-09-22T09:16:01.693440+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:07.379794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4585808,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":610,"num_read_kb":8116,"num_write":953,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'852","reported_seq":2593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.783462+0000","last_change":"2024-09-22T08:17:40.310815+0000","last_active":"2024-09-22T09:15:22.783462+0000","last_peered":"2024-09-22T09:15:22.783462+0000","last_clean":"2024-09-22T09:15:22.783462+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:15:22.783462+0000","last_undegraded":"2024-09-22T09:15:22.783462+0000","last_fullsized":"2024-09-22T09:15:22.783462+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:55.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'371","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.755728+0000","last_change":"2024-09-22T08:17:38.301015+0000","last_active":"2024-09-22T09:16:02.755728+0000","last_peered":"2024-09-22T09:16:02.755728+0000","last_clean":"2024-09-22T09:16:02.755728+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:02.755728+0000","last_undegraded":"2024-09-22T09:16:02.755728+0000","last_fullsized":"2024-09-22T09:16:02.755728+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:50.406073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246701,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":737,"num_read_kb":152949,"num_write":1281,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'439","reported_seq":2069,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975225+0000","last_change":"2024-09-22T08:17:40.307816+0000","last_active":"2024-09-22T09:13:42.975225+0000","last_peered":"2024-09-22T09:13:42.975225+0000","last_clean":"2024-09-22T09:13:42.975225+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:13:42.975225+0000","last_undegraded":"2024-09-22T09:13:42.975225+0000","last_fullsized":"2024-09-22T09:13:42.975225+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:41.447631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'291","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.644338+0000","last_change":"2024-09-22T08:17:38.309543+0000","last_active":"2024-09-22T09:16:01.644338+0000","last_peered":"2024-09-22T09:16:01.644338+0000","last_clean":"2024-09-22T09:16:01.644338+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:01.644338+0000","last_undegraded":"2024-09-22T09:16:01.644338+0000","last_fullsized":"2024-09-22T09:16:01.644338+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.497443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12739950,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":556,"num_read_kb":9331,"num_write":1137,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'926","reported_seq":2504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182211+0000","last_change":"2024-09-22T08:17:40.318830+0000","last_active":"2024-09-22T09:13:23.182211+0000","last_peered":"2024-09-22T09:13:23.182211+0000","last_clean":"2024-09-22T09:13:23.182211+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:13:23.182211+0000","last_undegraded":"2024-09-22T09:13:23.182211+0000","last_fullsized":"2024-09-22T09:13:23.182211+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:03.450267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'325","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873452+0000","last_change":"2024-09-22T08:17:38.301156+0000","last_active":"2024-09-22T09:16:02.873452+0000","last_peered":"2024-09-22T09:16:02.873452+0000","last_clean":"2024-09-22T09:16:02.873452+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:02.873452+0000","last_undegraded":"2024-09-22T09:16:02.873452+0000","last_fullsized":"2024-09-22T09:16:02.873452+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:49.656421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2515,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":573,"num_read_kb":484,"num_write":1160,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'829","reported_seq":2459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.345949+0000","last_change":"2024-09-22T08:17:40.315626+0000","last_active":"2024-09-22T09:14:05.345949+0000","last_peered":"2024-09-22T09:14:05.345949+0000","last_clean":"2024-09-22T09:14:05.345949+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:14:05.345949+0000","last_undegraded":"2024-09-22T09:14:05.345949+0000","last_fullsized":"2024-09-22T09:14:05.345949+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:29.496843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'389","reported_seq":1108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.759785+0000","last_change":"2024-09-22T08:17:38.311224+0000","last_active":"2024-09-22T09:16:01.759785+0000","last_peered":"2024-09-22T09:16:01.759785+0000","last_clean":"2024-09-22T09:16:01.759785+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:01.759785+0000","last_undegraded":"2024-09-22T09:16:01.759785+0000","last_fullsized":"2024-09-22T09:16:01.759785+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:31.603904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162960,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":816,"num_read_kb":67481,"num_write":1471,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.180874+0000","last_change":"2024-09-22T08:17:40.316250+0000","last_active":"2024-09-22T09:14:02.180874+0000","last_peered":"2024-09-22T09:14:02.180874+0000","last_clean":"2024-09-22T09:14:02.180874+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:14:02.180874+0000","last_undegraded":"2024-09-22T09:14:02.180874+0000","last_fullsized":"2024-09-22T09:14:02.180874+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:06.328790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'292","reported_seq":930,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.899511+0000","last_change":"2024-09-22T08:17:38.310546+0000","last_active":"2024-09-22T09:16:02.899511+0000","last_peered":"2024-09-22T09:16:02.899511+0000","last_clean":"2024-09-22T09:16:02.899511+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:02.899511+0000","last_undegraded":"2024-09-22T09:16:02.899511+0000","last_fullsized":"2024-09-22T09:16:02.899511+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:46.666253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573254,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":613,"num_read_kb":4113,"num_write":1012,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1339","reported_seq":3007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.333630+0000","last_change":"2024-09-22T08:17:40.314448+0000","last_active":"2024-09-22T09:14:05.333630+0000","last_peered":"2024-09-22T09:14:05.333630+0000","last_clean":"2024-09-22T09:14:05.333630+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:14:05.333630+0000","last_undegraded":"2024-09-22T09:14:05.333630+0000","last_fullsized":"2024-09-22T09:14:05.333630+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:14.842589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'298","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772749+0000","last_change":"2024-09-22T08:17:38.320511+0000","last_active":"2024-09-22T09:16:02.772749+0000","last_peered":"2024-09-22T09:16:02.772749+0000","last_clean":"2024-09-22T09:16:02.772749+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:02.772749+0000","last_undegraded":"2024-09-22T09:16:02.772749+0000","last_fullsized":"2024-09-22T09:16:02.772749+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:38.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762897,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":545,"num_read_kb":7532,"num_write":940,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'878","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.768832+0000","last_change":"2024-09-22T08:17:40.320847+0000","last_active":"2024-09-22T09:15:22.768832+0000","last_peered":"2024-09-22T09:15:22.768832+0000","last_clean":"2024-09-22T09:15:22.768832+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:15:22.768832+0000","last_undegraded":"2024-09-22T09:15:22.768832+0000","last_fullsized":"2024-09-22T09:15:22.768832+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:28.338764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'259","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787703+0000","last_change":"2024-09-22T08:18:09.819737+0000","last_active":"2024-09-22T09:16:01.787703+0000","last_peered":"2024-09-22T09:16:01.787703+0000","last_clean":"2024-09-22T09:16:01.787703+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:01.787703+0000","last_undegraded":"2024-09-22T09:16:01.787703+0000","last_fullsized":"2024-09-22T09:16:01.787703+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:16.118674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6224262,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":758,"num_read_kb":1204,"num_write":971,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'587","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.755926+0000","last_change":"2024-09-22T08:17:40.320732+0000","last_active":"2024-09-22T09:15:22.755926+0000","last_peered":"2024-09-22T09:15:22.755926+0000","last_clean":"2024-09-22T09:15:22.755926+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:15:22.755926+0000","last_undegraded":"2024-09-22T09:15:22.755926+0000","last_fullsized":"2024-09-22T09:15:22.755926+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:52.124048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'314","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.719464+0000","last_change":"2024-09-22T08:17:38.316645+0000","last_active":"2024-09-22T09:16:02.719464+0000","last_peered":"2024-09-22T09:16:02.719464+0000","last_clean":"2024-09-22T09:16:02.719464+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:02.719464+0000","last_undegraded":"2024-09-22T09:16:02.719464+0000","last_fullsized":"2024-09-22T09:16:02.719464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:19.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15752910,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":570,"num_read_kb":65830,"num_write":1047,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'269","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614638+0000","last_change":"2024-09-22T08:17:38.316368+0000","last_active":"2024-09-22T09:16:02.614638+0000","last_peered":"2024-09-22T09:16:02.614638+0000","last_clean":"2024-09-22T09:16:02.614638+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:02.614638+0000","last_undegraded":"2024-09-22T09:16:02.614638+0000","last_fullsized":"2024-09-22T09:16:02.614638+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:43.345144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2049610,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":460,"num_read_kb":15571,"num_write":1018,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'501","reported_seq":2189,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.789250+0000","last_change":"2024-09-22T08:17:40.321379+0000","last_active":"2024-09-22T09:15:22.789250+0000","last_peered":"2024-09-22T09:15:22.789250+0000","last_clean":"2024-09-22T09:15:22.789250+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:15:22.789250+0000","last_undegraded":"2024-09-22T09:15:22.789250+0000","last_fullsized":"2024-09-22T09:15:22.789250+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:25.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'276","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775408+0000","last_change":"2024-09-22T08:17:38.303976+0000","last_active":"2024-09-22T09:16:01.775408+0000","last_peered":"2024-09-22T09:16:01.775408+0000","last_clean":"2024-09-22T09:16:01.775408+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:01.775408+0000","last_undegraded":"2024-09-22T09:16:01.775408+0000","last_fullsized":"2024-09-22T09:16:01.775408+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:08.002217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243507,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":503,"num_read_kb":80287,"num_write":990,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'500","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.527398+0000","last_change":"2024-09-22T08:17:40.312319+0000","last_active":"2024-09-22T09:14:04.527398+0000","last_peered":"2024-09-22T09:14:04.527398+0000","last_clean":"2024-09-22T09:14:04.527398+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:14:04.527398+0000","last_undegraded":"2024-09-22T09:14:04.527398+0000","last_fullsized":"2024-09-22T09:14:04.527398+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.277593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1830236,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":17796,"num_read_kb":34953,"num_write":15086,"num_write_kb":11910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2351104,"data_stored":1883519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2138,"ondisk_log_size":2138,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":404827577,"num_objects":2945,"num_object_clones":0,"num_object_copies":11780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2945,"num_whiteouts":0,"num_read":41707,"num_read_kb":2189039,"num_write":70646,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":567025664,"data_stored":567025664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59355078,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":128,"num_read_kb":207543,"num_write":146,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129204224,"data_stored":129195916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":38333099,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":130,"num_read_kb":198277,"num_write":152,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87617536,"data_stored":87616171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510148,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403252,"kb_used_data":169336,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93968588,"statfs":{"total":96636764160,"available":96223834112,"internally_reserved":0,"allocated":173400064,"data_stored":171407867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510148,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250256,"kb_used_data":80160,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":94121584,"statfs":{"total":96636764160,"available":96380502016,"internally_reserved":0,"allocated":82083840,"data_stored":80133463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510151,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449516,"kb_used_data":121236,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93922324,"statfs":{"total":96636764160,"available":96176459776,"internally_reserved":0,"allocated":124145664,"data_stored":122116746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510150,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209644,"kb_used_data":106264,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162196,"statfs":{"total":96636764160,"available":96422088704,"internally_reserved":0,"allocated":108814336,"data_stored":106798896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542853,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368196,"kb_used_data":138548,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94003644,"statfs":{"total":96636764160,"available":96259731456,"internally_reserved":0,"allocated":141873152,"data_stored":139882929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542855,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232716,"kb_used_data":121020,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94139124,"statfs":{"total":96636764160,"available":96398462976,"internally_reserved":0,"allocated":123924480,"data_stored":121898980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542854,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412648,"kb_used_data":146840,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93959192,"statfs":{"total":96636764160,"available":96214212608,"internally_reserved":0,"allocated":150364160,"data_stored":148347559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542852,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335544,"kb_used_data":119784,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94036296,"statfs":{"total":96636764160,"available":96293167104,"internally_reserved":0,"allocated":122658816,"data_stored":120657976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60309504,"data_stored":60309504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46854144,"data_stored":46854144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64987136,"data_stored":64987136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":62046208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89866240,"data_stored":89866240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93360128,"data_stored":93360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63471616,"data_stored":63471616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86130688,"data_stored":86130688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":218276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":206788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":139079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":393967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":338184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":295654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":248307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3198976,"data_stored":3196187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16314368,"data_stored":16313003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:04.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:04.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:04.743 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:04.745 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2017,"stamp":"2024-09-22T09:16:03.851499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504953925,"num_objects":3436,"num_object_clones":0,"num_object_copies":12762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3436,"num_whiteouts":0,"num_read":310723,"num_read_kb":2860000,"num_write":162585,"num_write_kb":2483133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14052,"ondisk_log_size":14052,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2661772,"kb_used_data":1003188,"kb_used_omap":12,"kb_used_meta":1658291,"kb_avail":752312948,"statfs":{"total":773094113280,"available":770368458752,"internally_reserved":0,"allocated":1027264512,"data_stored":1011244416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1698090544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-233044184,"num_objects":-1421,"num_object_clones":0,"num_object_copies":-5652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1421,"num_whiteouts":0,"num_read":1594,"num_read_kb":1405,"num_write":1506,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005293"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962647+0000","last_change":"2024-09-22T08:51:48.551836+0000","last_active":"2024-09-22T09:11:47.962647+0000","last_peered":"2024-09-22T09:11:47.962647+0000","last_clean":"2024-09-22T09:11:47.962647+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:11:47.962647+0000","last_undegraded":"2024-09-22T09:11:47.962647+0000","last_fullsized":"2024-09-22T09:11:47.962647+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:38.864929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972822+0000","last_change":"2024-09-22T08:36:17.554312+0000","last_active":"2024-09-22T09:13:47.972822+0000","last_peered":"2024-09-22T09:13:47.972822+0000","last_clean":"2024-09-22T09:13:47.972822+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:13:47.972822+0000","last_undegraded":"2024-09-22T09:13:47.972822+0000","last_fullsized":"2024-09-22T09:13:47.972822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:29.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753733+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:11:16.753733+0000","last_peered":"2024-09-22T09:11:16.753733+0000","last_clean":"2024-09-22T09:11:16.753733+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:11:16.753733+0000","last_undegraded":"2024-09-22T09:11:16.753733+0000","last_fullsized":"2024-09-22T09:11:16.753733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:58.101135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869100+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:13:47.869100+0000","last_peered":"2024-09-22T09:13:47.869100+0000","last_clean":"2024-09-22T09:13:47.869100+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:13:47.869100+0000","last_undegraded":"2024-09-22T09:13:47.869100+0000","last_fullsized":"2024-09-22T09:13:47.869100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:31.386282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756266+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:11:16.756266+0000","last_peered":"2024-09-22T09:11:16.756266+0000","last_clean":"2024-09-22T09:11:16.756266+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:11:16.756266+0000","last_undegraded":"2024-09-22T09:11:16.756266+0000","last_fullsized":"2024-09-22T09:11:16.756266+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:02.785298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779072+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:13:46.779072+0000","last_peered":"2024-09-22T09:13:46.779072+0000","last_clean":"2024-09-22T09:13:46.779072+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:13:46.779072+0000","last_undegraded":"2024-09-22T09:13:46.779072+0000","last_fullsized":"2024-09-22T09:13:46.779072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784216+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:14:21.784216+0000","last_peered":"2024-09-22T09:14:21.784216+0000","last_clean":"2024-09-22T09:14:21.784216+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:14:21.784216+0000","last_undegraded":"2024-09-22T09:14:21.784216+0000","last_fullsized":"2024-09-22T09:14:21.784216+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:55.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749175+0000","last_change":"2024-09-22T08:33:33.306873+0000","last_active":"2024-09-22T09:11:06.749175+0000","last_peered":"2024-09-22T09:11:06.749175+0000","last_clean":"2024-09-22T09:11:06.749175+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:11:06.749175+0000","last_undegraded":"2024-09-22T09:11:06.749175+0000","last_fullsized":"2024-09-22T09:11:06.749175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:59.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756178+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:11:16.756178+0000","last_peered":"2024-09-22T09:11:16.756178+0000","last_clean":"2024-09-22T09:11:16.756178+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:11:16.756178+0000","last_undegraded":"2024-09-22T09:11:16.756178+0000","last_fullsized":"2024-09-22T09:11:16.756178+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:26.766525+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:12:26.766525+0000","last_peered":"2024-09-22T09:12:26.766525+0000","last_clean":"2024-09-22T09:12:26.766525+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:12:26.766525+0000","last_undegraded":"2024-09-22T09:12:26.766525+0000","last_fullsized":"2024-09-22T09:12:26.766525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:26.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988838+0000","last_change":"2024-09-22T08:36:14.521822+0000","last_active":"2024-09-22T09:15:52.988838+0000","last_peered":"2024-09-22T09:15:52.988838+0000","last_clean":"2024-09-22T09:15:52.988838+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:15:52.988838+0000","last_undegraded":"2024-09-22T09:15:52.988838+0000","last_fullsized":"2024-09-22T09:15:52.988838+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:17.576650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749152+0000","last_change":"2024-09-22T08:33:33.299815+0000","last_active":"2024-09-22T09:11:06.749152+0000","last_peered":"2024-09-22T09:11:06.749152+0000","last_clean":"2024-09-22T09:11:06.749152+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:11:06.749152+0000","last_undegraded":"2024-09-22T09:11:06.749152+0000","last_fullsized":"2024-09-22T09:11:06.749152+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:22.030960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968129+0000","last_change":"2024-09-22T08:36:17.552221+0000","last_active":"2024-09-22T09:12:37.968129+0000","last_peered":"2024-09-22T09:12:37.968129+0000","last_clean":"2024-09-22T09:12:37.968129+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:12:37.968129+0000","last_undegraded":"2024-09-22T09:12:37.968129+0000","last_fullsized":"2024-09-22T09:12:37.968129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:55.269454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:24.487629+0000","last_change":"2024-09-22T08:33:33.312653+0000","last_active":"2024-09-22T09:11:24.487629+0000","last_peered":"2024-09-22T09:11:24.487629+0000","last_clean":"2024-09-22T09:11:24.487629+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:11:24.487629+0000","last_undegraded":"2024-09-22T09:11:24.487629+0000","last_fullsized":"2024-09-22T09:11:24.487629+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:50.718606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772098+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:12:42.772098+0000","last_peered":"2024-09-22T09:12:42.772098+0000","last_clean":"2024-09-22T09:12:42.772098+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:12:42.772098+0000","last_undegraded":"2024-09-22T09:12:42.772098+0000","last_fullsized":"2024-09-22T09:12:42.772098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.867290+0000","last_change":"2024-09-22T08:33:33.314397+0000","last_active":"2024-09-22T09:13:32.867290+0000","last_peered":"2024-09-22T09:13:32.867290+0000","last_clean":"2024-09-22T09:13:32.867290+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:13:32.867290+0000","last_undegraded":"2024-09-22T09:13:32.867290+0000","last_fullsized":"2024-09-22T09:13:32.867290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:17.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855481+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:11:47.855481+0000","last_peered":"2024-09-22T09:11:47.855481+0000","last_clean":"2024-09-22T09:11:47.855481+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:11:47.855481+0000","last_undegraded":"2024-09-22T09:11:47.855481+0000","last_fullsized":"2024-09-22T09:11:47.855481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:01.855409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:17.852152+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:11:17.852152+0000","last_peered":"2024-09-22T09:11:17.852152+0000","last_clean":"2024-09-22T09:11:17.852152+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:11:17.852152+0000","last_undegraded":"2024-09-22T09:11:17.852152+0000","last_fullsized":"2024-09-22T09:11:17.852152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:15.681167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975679+0000","last_change":"2024-09-22T08:36:14.522217+0000","last_active":"2024-09-22T09:13:47.975679+0000","last_peered":"2024-09-22T09:13:47.975679+0000","last_clean":"2024-09-22T09:13:47.975679+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:13:47.975679+0000","last_undegraded":"2024-09-22T09:13:47.975679+0000","last_fullsized":"2024-09-22T09:13:47.975679+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.786028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":747,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765671+0000","last_change":"2024-09-22T08:33:33.306368+0000","last_active":"2024-09-22T09:12:21.765671+0000","last_peered":"2024-09-22T09:12:21.765671+0000","last_clean":"2024-09-22T09:12:21.765671+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:12:21.765671+0000","last_undegraded":"2024-09-22T09:12:21.765671+0000","last_fullsized":"2024-09-22T09:12:21.765671+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:28.062281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962738+0000","last_change":"2024-09-22T08:51:48.550754+0000","last_active":"2024-09-22T09:11:47.962738+0000","last_peered":"2024-09-22T09:11:47.962738+0000","last_clean":"2024-09-22T09:11:47.962738+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:11:47.962738+0000","last_undegraded":"2024-09-22T09:11:47.962738+0000","last_fullsized":"2024-09-22T09:11:47.962738+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:50.620910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753658+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:11:16.753658+0000","last_peered":"2024-09-22T09:11:16.753658+0000","last_clean":"2024-09-22T09:11:16.753658+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:11:16.753658+0000","last_undegraded":"2024-09-22T09:11:16.753658+0000","last_fullsized":"2024-09-22T09:11:16.753658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:47.415229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.750304+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:11:16.750304+0000","last_peered":"2024-09-22T09:11:16.750304+0000","last_clean":"2024-09-22T09:11:16.750304+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:11:16.750304+0000","last_undegraded":"2024-09-22T09:11:16.750304+0000","last_fullsized":"2024-09-22T09:11:16.750304+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:00.150168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758893+0000","last_change":"2024-09-22T08:33:33.303993+0000","last_active":"2024-09-22T09:12:16.758893+0000","last_peered":"2024-09-22T09:12:16.758893+0000","last_clean":"2024-09-22T09:12:16.758893+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:12:16.758893+0000","last_undegraded":"2024-09-22T09:12:16.758893+0000","last_fullsized":"2024-09-22T09:12:16.758893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:11.898143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767414+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:12:31.767414+0000","last_peered":"2024-09-22T09:12:31.767414+0000","last_clean":"2024-09-22T09:12:31.767414+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:12:31.767414+0000","last_undegraded":"2024-09-22T09:12:31.767414+0000","last_fullsized":"2024-09-22T09:12:31.767414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.762920+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:11:27.762920+0000","last_peered":"2024-09-22T09:11:27.762920+0000","last_clean":"2024-09-22T09:11:27.762920+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:11:27.762920+0000","last_undegraded":"2024-09-22T09:11:27.762920+0000","last_fullsized":"2024-09-22T09:11:27.762920+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.757596+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:11:26.757596+0000","last_peered":"2024-09-22T09:11:26.757596+0000","last_clean":"2024-09-22T09:11:26.757596+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:11:26.757596+0000","last_undegraded":"2024-09-22T09:11:26.757596+0000","last_fullsized":"2024-09-22T09:11:26.757596+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984645+0000","last_change":"2024-09-22T08:36:14.525609+0000","last_active":"2024-09-22T09:14:57.984645+0000","last_peered":"2024-09-22T09:14:57.984645+0000","last_clean":"2024-09-22T09:14:57.984645+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:14:57.984645+0000","last_undegraded":"2024-09-22T09:14:57.984645+0000","last_fullsized":"2024-09-22T09:14:57.984645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:03.854966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764817+0000","last_change":"2024-09-22T08:33:33.315166+0000","last_active":"2024-09-22T09:12:16.764817+0000","last_peered":"2024-09-22T09:12:16.764817+0000","last_clean":"2024-09-22T09:12:16.764817+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:12:16.764817+0000","last_undegraded":"2024-09-22T09:12:16.764817+0000","last_fullsized":"2024-09-22T09:12:16.764817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:41.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'7","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767497+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:12:31.767497+0000","last_peered":"2024-09-22T09:12:31.767497+0000","last_clean":"2024-09-22T09:12:31.767497+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:12:31.767497+0000","last_undegraded":"2024-09-22T09:12:31.767497+0000","last_fullsized":"2024-09-22T09:12:31.767497+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767456+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:12:31.767456+0000","last_peered":"2024-09-22T09:12:31.767456+0000","last_clean":"2024-09-22T09:12:31.767456+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:12:31.767456+0000","last_undegraded":"2024-09-22T09:12:31.767456+0000","last_fullsized":"2024-09-22T09:12:31.767456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764788+0000","last_change":"2024-09-22T08:33:33.311367+0000","last_active":"2024-09-22T09:12:16.764788+0000","last_peered":"2024-09-22T09:12:16.764788+0000","last_clean":"2024-09-22T09:12:16.764788+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:12:16.764788+0000","last_undegraded":"2024-09-22T09:12:16.764788+0000","last_fullsized":"2024-09-22T09:12:16.764788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:18.812618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.969239+0000","last_change":"2024-09-22T08:51:48.549838+0000","last_active":"2024-09-22T09:12:47.969239+0000","last_peered":"2024-09-22T09:12:47.969239+0000","last_clean":"2024-09-22T09:12:47.969239+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:12:47.969239+0000","last_undegraded":"2024-09-22T09:12:47.969239+0000","last_fullsized":"2024-09-22T09:12:47.969239+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:35.628007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967550+0000","last_change":"2024-09-22T08:36:17.553737+0000","last_active":"2024-09-22T09:12:32.967550+0000","last_peered":"2024-09-22T09:12:32.967550+0000","last_clean":"2024-09-22T09:12:32.967550+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:12:32.967550+0000","last_undegraded":"2024-09-22T09:12:32.967550+0000","last_fullsized":"2024-09-22T09:12:32.967550+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:21.818626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971629+0000","last_change":"2024-09-22T08:36:14.520890+0000","last_active":"2024-09-22T09:13:37.971629+0000","last_peered":"2024-09-22T09:13:37.971629+0000","last_clean":"2024-09-22T09:13:37.971629+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:13:37.971629+0000","last_undegraded":"2024-09-22T09:13:37.971629+0000","last_fullsized":"2024-09-22T09:13:37.971629+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.858239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774744+0000","last_change":"2024-09-22T08:33:33.310293+0000","last_active":"2024-09-22T09:13:16.774744+0000","last_peered":"2024-09-22T09:13:16.774744+0000","last_clean":"2024-09-22T09:13:16.774744+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:13:16.774744+0000","last_undegraded":"2024-09-22T09:13:16.774744+0000","last_fullsized":"2024-09-22T09:13:16.774744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:23:54.882161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971695+0000","last_change":"2024-09-22T08:36:14.521414+0000","last_active":"2024-09-22T09:13:37.971695+0000","last_peered":"2024-09-22T09:13:37.971695+0000","last_clean":"2024-09-22T09:13:37.971695+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:13:37.971695+0000","last_undegraded":"2024-09-22T09:13:37.971695+0000","last_fullsized":"2024-09-22T09:13:37.971695+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:00.328885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865324+0000","last_change":"2024-09-22T08:33:33.305009+0000","last_active":"2024-09-22T09:13:12.865324+0000","last_peered":"2024-09-22T09:13:12.865324+0000","last_clean":"2024-09-22T09:13:12.865324+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:13:12.865324+0000","last_undegraded":"2024-09-22T09:13:12.865324+0000","last_fullsized":"2024-09-22T09:13:12.865324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:50.446180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'9","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778511+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:13:37.778511+0000","last_peered":"2024-09-22T09:13:37.778511+0000","last_clean":"2024-09-22T09:13:37.778511+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:13:37.778511+0000","last_undegraded":"2024-09-22T09:13:37.778511+0000","last_fullsized":"2024-09-22T09:13:37.778511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":26642,"num_write":14,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971719+0000","last_change":"2024-09-22T08:36:14.515004+0000","last_active":"2024-09-22T09:13:37.971719+0000","last_peered":"2024-09-22T09:13:37.971719+0000","last_clean":"2024-09-22T09:13:37.971719+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:13:37.971719+0000","last_undegraded":"2024-09-22T09:13:37.971719+0000","last_fullsized":"2024-09-22T09:13:37.971719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:07.837552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774690+0000","last_change":"2024-09-22T08:33:33.306842+0000","last_active":"2024-09-22T09:13:16.774690+0000","last_peered":"2024-09-22T09:13:16.774690+0000","last_clean":"2024-09-22T09:13:16.774690+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:13:16.774690+0000","last_undegraded":"2024-09-22T09:13:16.774690+0000","last_fullsized":"2024-09-22T09:13:16.774690+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:03.666172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764814+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:12:16.764814+0000","last_peered":"2024-09-22T09:12:16.764814+0000","last_clean":"2024-09-22T09:12:16.764814+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:12:16.764814+0000","last_undegraded":"2024-09-22T09:12:16.764814+0000","last_fullsized":"2024-09-22T09:12:16.764814+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:23.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.858820+0000","last_change":"2024-09-22T08:36:14.524581+0000","last_active":"2024-09-22T09:12:17.858820+0000","last_peered":"2024-09-22T09:12:17.858820+0000","last_clean":"2024-09-22T09:12:17.858820+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:12:17.858820+0000","last_undegraded":"2024-09-22T09:12:17.858820+0000","last_fullsized":"2024-09-22T09:12:17.858820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:13.432035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":173,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761303+0000","last_change":"2024-09-22T08:33:33.310511+0000","last_active":"2024-09-22T09:11:56.761303+0000","last_peered":"2024-09-22T09:11:56.761303+0000","last_clean":"2024-09-22T09:11:56.761303+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:11:56.761303+0000","last_undegraded":"2024-09-22T09:11:56.761303+0000","last_fullsized":"2024-09-22T09:11:56.761303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:28.111555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.961550+0000","last_change":"2024-09-22T08:51:48.553902+0000","last_active":"2024-09-22T09:12:02.961550+0000","last_peered":"2024-09-22T09:12:02.961550+0000","last_clean":"2024-09-22T09:12:02.961550+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:12:02.961550+0000","last_undegraded":"2024-09-22T09:12:02.961550+0000","last_fullsized":"2024-09-22T09:12:02.961550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:09.641607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764757+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:12:16.764757+0000","last_peered":"2024-09-22T09:12:16.764757+0000","last_clean":"2024-09-22T09:12:16.764757+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:12:16.764757+0000","last_undegraded":"2024-09-22T09:12:16.764757+0000","last_fullsized":"2024-09-22T09:12:16.764757+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:59.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758982+0000","last_change":"2024-09-22T08:36:14.523378+0000","last_active":"2024-09-22T09:12:16.758982+0000","last_peered":"2024-09-22T09:12:16.758982+0000","last_clean":"2024-09-22T09:12:16.758982+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:12:16.758982+0000","last_undegraded":"2024-09-22T09:12:16.758982+0000","last_fullsized":"2024-09-22T09:12:16.758982+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:26.533836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.765353+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:11:47.765353+0000","last_peered":"2024-09-22T09:11:47.765353+0000","last_clean":"2024-09-22T09:11:47.765353+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:11:47.765353+0000","last_undegraded":"2024-09-22T09:11:47.765353+0000","last_fullsized":"2024-09-22T09:11:47.765353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764842+0000","last_change":"2024-09-22T08:36:14.521867+0000","last_active":"2024-09-22T09:12:16.764842+0000","last_peered":"2024-09-22T09:12:16.764842+0000","last_clean":"2024-09-22T09:12:16.764842+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:12:16.764842+0000","last_undegraded":"2024-09-22T09:12:16.764842+0000","last_fullsized":"2024-09-22T09:12:16.764842+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:20.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.959622+0000","last_change":"2024-09-22T08:33:33.301439+0000","last_active":"2024-09-22T09:11:47.959622+0000","last_peered":"2024-09-22T09:11:47.959622+0000","last_clean":"2024-09-22T09:11:47.959622+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:11:47.959622+0000","last_undegraded":"2024-09-22T09:11:47.959622+0000","last_fullsized":"2024-09-22T09:11:47.959622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:31.274044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970549+0000","last_change":"2024-09-22T08:51:48.546986+0000","last_active":"2024-09-22T09:13:27.970549+0000","last_peered":"2024-09-22T09:13:27.970549+0000","last_clean":"2024-09-22T09:13:27.970549+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:13:27.970549+0000","last_undegraded":"2024-09-22T09:13:27.970549+0000","last_fullsized":"2024-09-22T09:13:27.970549+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:43.329879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764990+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:12:16.764990+0000","last_peered":"2024-09-22T09:12:16.764990+0000","last_clean":"2024-09-22T09:12:16.764990+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:12:16.764990+0000","last_undegraded":"2024-09-22T09:12:16.764990+0000","last_fullsized":"2024-09-22T09:12:16.764990+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:47.077061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'1","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765840+0000","last_change":"2024-09-22T08:36:14.525673+0000","last_active":"2024-09-22T09:12:21.765840+0000","last_peered":"2024-09-22T09:12:21.765840+0000","last_clean":"2024-09-22T09:12:21.765840+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:12:21.765840+0000","last_undegraded":"2024-09-22T09:12:21.765840+0000","last_fullsized":"2024-09-22T09:12:21.765840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:00.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755324+0000","last_change":"2024-09-22T08:33:33.306105+0000","last_active":"2024-09-22T09:11:51.755324+0000","last_peered":"2024-09-22T09:11:51.755324+0000","last_clean":"2024-09-22T09:11:51.755324+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:11:51.755324+0000","last_undegraded":"2024-09-22T09:11:51.755324+0000","last_fullsized":"2024-09-22T09:11:51.755324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:07.948747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763478+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:12:06.763478+0000","last_peered":"2024-09-22T09:12:06.763478+0000","last_clean":"2024-09-22T09:12:06.763478+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:12:06.763478+0000","last_undegraded":"2024-09-22T09:12:06.763478+0000","last_fullsized":"2024-09-22T09:12:06.763478+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:21.783822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:06.773227+0000","last_change":"2024-09-22T08:36:14.521057+0000","last_active":"2024-09-22T09:13:06.773227+0000","last_peered":"2024-09-22T09:13:06.773227+0000","last_clean":"2024-09-22T09:13:06.773227+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:13:06.773227+0000","last_undegraded":"2024-09-22T09:13:06.773227+0000","last_fullsized":"2024-09-22T09:13:06.773227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:07.181295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755291+0000","last_change":"2024-09-22T08:33:33.312566+0000","last_active":"2024-09-22T09:11:51.755291+0000","last_peered":"2024-09-22T09:11:51.755291+0000","last_clean":"2024-09-22T09:11:51.755291+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:11:51.755291+0000","last_undegraded":"2024-09-22T09:11:51.755291+0000","last_fullsized":"2024-09-22T09:11:51.755291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:30.177728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.857195+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:12:02.857195+0000","last_peered":"2024-09-22T09:12:02.857195+0000","last_clean":"2024-09-22T09:12:02.857195+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:12:02.857195+0000","last_undegraded":"2024-09-22T09:12:02.857195+0000","last_fullsized":"2024-09-22T09:12:02.857195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:52.143784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.879891+0000","last_change":"2024-09-22T08:36:17.553257+0000","last_active":"2024-09-22T09:15:17.879891+0000","last_peered":"2024-09-22T09:15:17.879891+0000","last_clean":"2024-09-22T09:15:17.879891+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:15:17.879891+0000","last_undegraded":"2024-09-22T09:15:17.879891+0000","last_fullsized":"2024-09-22T09:15:17.879891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:25.217554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'4","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:16.794622+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:15:16.794622+0000","last_peered":"2024-09-22T09:15:16.794622+0000","last_clean":"2024-09-22T09:15:16.794622+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:15:16.794622+0000","last_undegraded":"2024-09-22T09:15:16.794622+0000","last_fullsized":"2024-09-22T09:15:16.794622+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":249,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.861248+0000","last_change":"2024-09-22T08:33:33.306309+0000","last_active":"2024-09-22T09:12:37.861248+0000","last_peered":"2024-09-22T09:12:37.861248+0000","last_clean":"2024-09-22T09:12:37.861248+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:12:37.861248+0000","last_undegraded":"2024-09-22T09:12:37.861248+0000","last_fullsized":"2024-09-22T09:12:37.861248+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:31.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.964588+0000","last_change":"2024-09-22T08:51:48.549815+0000","last_active":"2024-09-22T09:12:02.964588+0000","last_peered":"2024-09-22T09:12:02.964588+0000","last_clean":"2024-09-22T09:12:02.964588+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:12:02.964588+0000","last_undegraded":"2024-09-22T09:12:02.964588+0000","last_fullsized":"2024-09-22T09:12:02.964588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:49.616078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'1","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758941+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:12:16.758941+0000","last_peered":"2024-09-22T09:12:16.758941+0000","last_clean":"2024-09-22T09:12:16.758941+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:12:16.758941+0000","last_undegraded":"2024-09-22T09:12:16.758941+0000","last_fullsized":"2024-09-22T09:12:16.758941+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:15.190970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.773987+0000","last_change":"2024-09-22T08:36:14.520376+0000","last_active":"2024-09-22T09:13:11.773987+0000","last_peered":"2024-09-22T09:13:11.773987+0000","last_clean":"2024-09-22T09:13:11.773987+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:13:11.773987+0000","last_undegraded":"2024-09-22T09:13:11.773987+0000","last_fullsized":"2024-09-22T09:13:11.773987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:17.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763014+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:12:06.763014+0000","last_peered":"2024-09-22T09:12:06.763014+0000","last_clean":"2024-09-22T09:12:06.763014+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:12:06.763014+0000","last_undegraded":"2024-09-22T09:12:06.763014+0000","last_fullsized":"2024-09-22T09:12:06.763014+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:35.688578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.972039+0000","last_change":"2024-09-22T08:36:17.557866+0000","last_active":"2024-09-22T09:13:12.972039+0000","last_peered":"2024-09-22T09:13:12.972039+0000","last_clean":"2024-09-22T09:13:12.972039+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:13:12.972039+0000","last_undegraded":"2024-09-22T09:13:12.972039+0000","last_fullsized":"2024-09-22T09:13:12.972039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:04.889097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.769069+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:12:17.769069+0000","last_peered":"2024-09-22T09:12:17.769069+0000","last_clean":"2024-09-22T09:12:17.769069+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:12:17.769069+0000","last_undegraded":"2024-09-22T09:12:17.769069+0000","last_fullsized":"2024-09-22T09:12:17.769069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:44.749004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967432+0000","last_change":"2024-09-22T08:33:33.314991+0000","last_active":"2024-09-22T09:12:32.967432+0000","last_peered":"2024-09-22T09:12:32.967432+0000","last_clean":"2024-09-22T09:12:32.967432+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:12:32.967432+0000","last_undegraded":"2024-09-22T09:12:32.967432+0000","last_fullsized":"2024-09-22T09:12:32.967432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:02.113618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968162+0000","last_change":"2024-09-22T08:51:48.548861+0000","last_active":"2024-09-22T09:12:37.968162+0000","last_peered":"2024-09-22T09:12:37.968162+0000","last_clean":"2024-09-22T09:12:37.968162+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:12:37.968162+0000","last_undegraded":"2024-09-22T09:12:37.968162+0000","last_fullsized":"2024-09-22T09:12:37.968162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:02.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780808+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:13:56.780808+0000","last_peered":"2024-09-22T09:13:56.780808+0000","last_clean":"2024-09-22T09:13:56.780808+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:13:56.780808+0000","last_undegraded":"2024-09-22T09:13:56.780808+0000","last_fullsized":"2024-09-22T09:13:56.780808+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4198,"num_write":11,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779807+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:13:47.779807+0000","last_peered":"2024-09-22T09:13:47.779807+0000","last_clean":"2024-09-22T09:13:47.779807+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:13:47.779807+0000","last_undegraded":"2024-09-22T09:13:47.779807+0000","last_fullsized":"2024-09-22T09:13:47.779807+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768411+0000","last_change":"2024-09-22T08:33:33.310686+0000","last_active":"2024-09-22T09:12:36.768411+0000","last_peered":"2024-09-22T09:12:36.768411+0000","last_clean":"2024-09-22T09:12:36.768411+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:12:36.768411+0000","last_undegraded":"2024-09-22T09:12:36.768411+0000","last_fullsized":"2024-09-22T09:12:36.768411+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:29.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968185+0000","last_change":"2024-09-22T08:51:48.549659+0000","last_active":"2024-09-22T09:12:37.968185+0000","last_peered":"2024-09-22T09:12:37.968185+0000","last_clean":"2024-09-22T09:12:37.968185+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:12:37.968185+0000","last_undegraded":"2024-09-22T09:12:37.968185+0000","last_fullsized":"2024-09-22T09:12:37.968185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:29.047532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778994+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:13:46.778994+0000","last_peered":"2024-09-22T09:13:46.778994+0000","last_clean":"2024-09-22T09:13:46.778994+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:13:46.778994+0000","last_undegraded":"2024-09-22T09:13:46.778994+0000","last_fullsized":"2024-09-22T09:13:46.778994+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.986858+0000","last_change":"2024-09-22T08:36:17.549474+0000","last_active":"2024-09-22T09:15:17.986858+0000","last_peered":"2024-09-22T09:15:17.986858+0000","last_clean":"2024-09-22T09:15:17.986858+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:15:17.986858+0000","last_undegraded":"2024-09-22T09:15:17.986858+0000","last_fullsized":"2024-09-22T09:15:17.986858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:12.074363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864628+0000","last_change":"2024-09-22T08:36:14.518932+0000","last_active":"2024-09-22T09:13:07.864628+0000","last_peered":"2024-09-22T09:13:07.864628+0000","last_clean":"2024-09-22T09:13:07.864628+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:13:07.864628+0000","last_undegraded":"2024-09-22T09:13:07.864628+0000","last_fullsized":"2024-09-22T09:13:07.864628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:01.574307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865380+0000","last_change":"2024-09-22T08:33:33.310910+0000","last_active":"2024-09-22T09:13:12.865380+0000","last_peered":"2024-09-22T09:13:12.865380+0000","last_clean":"2024-09-22T09:13:12.865380+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:13:12.865380+0000","last_undegraded":"2024-09-22T09:13:12.865380+0000","last_fullsized":"2024-09-22T09:13:12.865380+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:27.693570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.771403+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:12:37.771403+0000","last_peered":"2024-09-22T09:12:37.771403+0000","last_clean":"2024-09-22T09:12:37.771403+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:12:37.771403+0000","last_undegraded":"2024-09-22T09:12:37.771403+0000","last_fullsized":"2024-09-22T09:12:37.771403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:27.349451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774038+0000","last_change":"2024-09-22T08:33:33.309150+0000","last_active":"2024-09-22T09:13:11.774038+0000","last_peered":"2024-09-22T09:13:11.774038+0000","last_clean":"2024-09-22T09:13:11.774038+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:13:11.774038+0000","last_undegraded":"2024-09-22T09:13:11.774038+0000","last_fullsized":"2024-09-22T09:13:11.774038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:51.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778939+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:13:46.778939+0000","last_peered":"2024-09-22T09:13:46.778939+0000","last_clean":"2024-09-22T09:13:46.778939+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:13:46.778939+0000","last_undegraded":"2024-09-22T09:13:46.778939+0000","last_fullsized":"2024-09-22T09:13:46.778939+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12859,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:22.859462+0000","last_change":"2024-09-22T08:36:14.518063+0000","last_active":"2024-09-22T09:12:22.859462+0000","last_peered":"2024-09-22T09:12:22.859462+0000","last_clean":"2024-09-22T09:12:22.859462+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:12:22.859462+0000","last_undegraded":"2024-09-22T09:12:22.859462+0000","last_fullsized":"2024-09-22T09:12:22.859462+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:02.424058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":100,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864566+0000","last_change":"2024-09-22T08:33:33.305508+0000","last_active":"2024-09-22T09:13:07.864566+0000","last_peered":"2024-09-22T09:13:07.864566+0000","last_clean":"2024-09-22T09:13:07.864566+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:13:07.864566+0000","last_undegraded":"2024-09-22T09:13:07.864566+0000","last_fullsized":"2024-09-22T09:13:07.864566+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:55.651981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:27.770184+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:12:27.770184+0000","last_peered":"2024-09-22T09:12:27.770184+0000","last_clean":"2024-09-22T09:12:27.770184+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:12:27.770184+0000","last_undegraded":"2024-09-22T09:12:27.770184+0000","last_fullsized":"2024-09-22T09:12:27.770184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:49.958042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885192+0000","last_change":"2024-09-22T08:36:17.553023+0000","last_active":"2024-09-22T09:15:52.885192+0000","last_peered":"2024-09-22T09:15:52.885192+0000","last_clean":"2024-09-22T09:15:52.885192+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:15:52.885192+0000","last_undegraded":"2024-09-22T09:15:52.885192+0000","last_fullsized":"2024-09-22T09:15:52.885192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:05.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.791107+0000","last_change":"2024-09-22T08:36:14.520504+0000","last_active":"2024-09-22T09:15:51.791107+0000","last_peered":"2024-09-22T09:15:51.791107+0000","last_clean":"2024-09-22T09:15:51.791107+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:15:51.791107+0000","last_undegraded":"2024-09-22T09:15:51.791107+0000","last_fullsized":"2024-09-22T09:15:51.791107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:49.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869033+0000","last_change":"2024-09-22T08:36:17.548527+0000","last_active":"2024-09-22T09:13:47.869033+0000","last_peered":"2024-09-22T09:13:47.869033+0000","last_clean":"2024-09-22T09:13:47.869033+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:13:47.869033+0000","last_undegraded":"2024-09-22T09:13:47.869033+0000","last_fullsized":"2024-09-22T09:13:47.869033+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'4","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988796+0000","last_change":"2024-09-22T08:36:14.524325+0000","last_active":"2024-09-22T09:15:52.988796+0000","last_peered":"2024-09-22T09:15:52.988796+0000","last_clean":"2024-09-22T09:15:52.988796+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:15:52.988796+0000","last_undegraded":"2024-09-22T09:15:52.988796+0000","last_fullsized":"2024-09-22T09:15:52.988796+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:58.736096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":87,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.867830+0000","last_change":"2024-09-22T08:33:33.312962+0000","last_active":"2024-09-22T09:13:37.867830+0000","last_peered":"2024-09-22T09:13:37.867830+0000","last_clean":"2024-09-22T09:13:37.867830+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:13:37.867830+0000","last_undegraded":"2024-09-22T09:13:37.867830+0000","last_fullsized":"2024-09-22T09:13:37.867830+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:56.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'369","reported_seq":1234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.838797+0000","last_change":"2024-09-22T08:17:38.305362+0000","last_active":"2024-09-22T09:16:02.838797+0000","last_peered":"2024-09-22T09:16:02.838797+0000","last_clean":"2024-09-22T09:16:02.838797+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:02.838797+0000","last_undegraded":"2024-09-22T09:16:02.838797+0000","last_fullsized":"2024-09-22T09:16:02.838797+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.646132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397343,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1411,"num_read_kb":46472,"num_write":1250,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'948","reported_seq":2499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.763135+0000","last_change":"2024-09-22T08:17:40.306852+0000","last_active":"2024-09-22T09:15:22.763135+0000","last_peered":"2024-09-22T09:15:22.763135+0000","last_clean":"2024-09-22T09:15:22.763135+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:15:22.763135+0000","last_undegraded":"2024-09-22T09:15:22.763135+0000","last_fullsized":"2024-09-22T09:15:22.763135+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.143716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'348","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787102+0000","last_change":"2024-09-22T08:17:38.302453+0000","last_active":"2024-09-22T09:16:01.787102+0000","last_peered":"2024-09-22T09:16:01.787102+0000","last_clean":"2024-09-22T09:16:01.787102+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:01.787102+0000","last_undegraded":"2024-09-22T09:16:01.787102+0000","last_fullsized":"2024-09-22T09:16:01.787102+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:03.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604406,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":736,"num_read_kb":45729,"num_write":1233,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'767","reported_seq":2185,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.179987+0000","last_change":"2024-09-22T08:17:40.311740+0000","last_active":"2024-09-22T09:13:23.179987+0000","last_peered":"2024-09-22T09:13:23.179987+0000","last_clean":"2024-09-22T09:13:23.179987+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:13:23.179987+0000","last_undegraded":"2024-09-22T09:13:23.179987+0000","last_fullsized":"2024-09-22T09:13:23.179987+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:16.749258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'295","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775013+0000","last_change":"2024-09-22T08:17:38.306945+0000","last_active":"2024-09-22T09:16:01.775013+0000","last_peered":"2024-09-22T09:16:01.775013+0000","last_clean":"2024-09-22T09:16:01.775013+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:01.775013+0000","last_undegraded":"2024-09-22T09:16:01.775013+0000","last_fullsized":"2024-09-22T09:16:01.775013+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:40.207206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16401162,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":571,"num_read_kb":64383,"num_write":1175,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'498","reported_seq":2127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.699167+0000","last_change":"2024-09-22T08:17:40.314265+0000","last_active":"2024-09-22T09:13:27.699167+0000","last_peered":"2024-09-22T09:13:27.699167+0000","last_clean":"2024-09-22T09:13:27.699167+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:13:27.699167+0000","last_undegraded":"2024-09-22T09:13:27.699167+0000","last_fullsized":"2024-09-22T09:13:27.699167+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:49.672590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'359","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.816128+0000","last_change":"2024-09-22T08:17:38.311385+0000","last_active":"2024-09-22T09:16:02.816128+0000","last_peered":"2024-09-22T09:16:02.816128+0000","last_clean":"2024-09-22T09:16:02.816128+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:02.816128+0000","last_undegraded":"2024-09-22T09:16:02.816128+0000","last_fullsized":"2024-09-22T09:16:02.816128+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:11.719876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28432,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":644,"num_read_kb":100162,"num_write":1116,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'533","reported_seq":2199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697914+0000","last_change":"2024-09-22T08:17:40.315145+0000","last_active":"2024-09-22T09:13:27.697914+0000","last_peered":"2024-09-22T09:13:27.697914+0000","last_clean":"2024-09-22T09:13:27.697914+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:13:27.697914+0000","last_undegraded":"2024-09-22T09:13:27.697914+0000","last_fullsized":"2024-09-22T09:13:27.697914+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:28.617427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'342","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.934222+0000","last_change":"2024-09-22T08:17:38.308912+0000","last_active":"2024-09-22T09:16:02.934222+0000","last_peered":"2024-09-22T09:16:02.934222+0000","last_clean":"2024-09-22T09:16:02.934222+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:02.934222+0000","last_undegraded":"2024-09-22T09:16:02.934222+0000","last_fullsized":"2024-09-22T09:16:02.934222+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:46.873844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360779,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":579,"num_read_kb":101850,"num_write":1113,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'577","reported_seq":2234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975730+0000","last_change":"2024-09-22T08:17:40.308097+0000","last_active":"2024-09-22T09:13:47.975730+0000","last_peered":"2024-09-22T09:13:47.975730+0000","last_clean":"2024-09-22T09:13:47.975730+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:13:47.975730+0000","last_undegraded":"2024-09-22T09:13:47.975730+0000","last_fullsized":"2024-09-22T09:13:47.975730+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:54.012368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'367","reported_seq":998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.770862+0000","last_change":"2024-09-22T08:17:38.311987+0000","last_active":"2024-09-22T09:16:02.770862+0000","last_peered":"2024-09-22T09:16:02.770862+0000","last_clean":"2024-09-22T09:16:02.770862+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:02.770862+0000","last_undegraded":"2024-09-22T09:16:02.770862+0000","last_fullsized":"2024-09-22T09:16:02.770862+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:46.139865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805173,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":548,"num_read_kb":20767,"num_write":1074,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1040","reported_seq":2582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976885+0000","last_change":"2024-09-22T08:17:40.316422+0000","last_active":"2024-09-22T09:13:57.976885+0000","last_peered":"2024-09-22T09:13:57.976885+0000","last_clean":"2024-09-22T09:13:57.976885+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:13:57.976885+0000","last_undegraded":"2024-09-22T09:13:57.976885+0000","last_fullsized":"2024-09-22T09:13:57.976885+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:15.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'302","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.977069+0000","last_change":"2024-09-22T08:17:38.301886+0000","last_active":"2024-09-22T09:16:02.977069+0000","last_peered":"2024-09-22T09:16:02.977069+0000","last_clean":"2024-09-22T09:16:02.977069+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:02.977069+0000","last_undegraded":"2024-09-22T09:16:02.977069+0000","last_fullsized":"2024-09-22T09:16:02.977069+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:54.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2287637,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":505,"num_read_kb":9374,"num_write":1002,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'494","reported_seq":2087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870234+0000","last_change":"2024-09-22T08:17:40.318246+0000","last_active":"2024-09-22T09:13:57.870234+0000","last_peered":"2024-09-22T09:13:57.870234+0000","last_clean":"2024-09-22T09:13:57.870234+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:13:57.870234+0000","last_undegraded":"2024-09-22T09:13:57.870234+0000","last_fullsized":"2024-09-22T09:13:57.870234+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:12.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'326","reported_seq":980,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.799765+0000","last_change":"2024-09-22T08:17:38.312231+0000","last_active":"2024-09-22T09:16:01.799765+0000","last_peered":"2024-09-22T09:16:01.799765+0000","last_clean":"2024-09-22T09:16:01.799765+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:01.799765+0000","last_undegraded":"2024-09-22T09:16:01.799765+0000","last_fullsized":"2024-09-22T09:16:01.799765+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:59.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6934894,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":722,"num_read_kb":32987,"num_write":1042,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'638","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780919+0000","last_change":"2024-09-22T08:17:40.319835+0000","last_active":"2024-09-22T09:13:56.780919+0000","last_peered":"2024-09-22T09:13:56.780919+0000","last_clean":"2024-09-22T09:13:56.780919+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:13:56.780919+0000","last_undegraded":"2024-09-22T09:13:56.780919+0000","last_fullsized":"2024-09-22T09:13:56.780919+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:37.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'401","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779056+0000","last_change":"2024-09-22T08:17:40.313776+0000","last_active":"2024-09-22T09:13:42.779056+0000","last_peered":"2024-09-22T09:13:42.779056+0000","last_clean":"2024-09-22T09:13:42.779056+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:13:42.779056+0000","last_undegraded":"2024-09-22T09:13:42.779056+0000","last_fullsized":"2024-09-22T09:13:42.779056+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:46.265677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'272","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614964+0000","last_change":"2024-09-22T08:17:38.304440+0000","last_active":"2024-09-22T09:16:02.614964+0000","last_peered":"2024-09-22T09:16:02.614964+0000","last_clean":"2024-09-22T09:16:02.614964+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:02.614964+0000","last_undegraded":"2024-09-22T09:16:02.614964+0000","last_fullsized":"2024-09-22T09:16:02.614964+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:45.235908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193566,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":483,"num_read_kb":25983,"num_write":949,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'393","reported_seq":1922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975164+0000","last_change":"2024-09-22T08:17:40.314476+0000","last_active":"2024-09-22T09:13:42.975164+0000","last_peered":"2024-09-22T09:13:42.975164+0000","last_clean":"2024-09-22T09:13:42.975164+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:13:42.975164+0000","last_undegraded":"2024-09-22T09:13:42.975164+0000","last_fullsized":"2024-09-22T09:13:42.975164+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.686734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'266","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.811806+0000","last_change":"2024-09-22T08:17:38.308456+0000","last_active":"2024-09-22T09:16:02.811806+0000","last_peered":"2024-09-22T09:16:02.811806+0000","last_clean":"2024-09-22T09:16:02.811806+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:02.811806+0000","last_undegraded":"2024-09-22T09:16:02.811806+0000","last_fullsized":"2024-09-22T09:16:02.811806+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:02.910243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":430,"num_read_kb":1407,"num_write":855,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'765","reported_seq":2317,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:50.660940+0000","last_change":"2024-09-22T08:17:40.313996+0000","last_active":"2024-09-22T09:12:50.660940+0000","last_peered":"2024-09-22T09:12:50.660940+0000","last_clean":"2024-09-22T09:12:50.660940+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:12:50.660940+0000","last_undegraded":"2024-09-22T09:12:50.660940+0000","last_fullsized":"2024-09-22T09:12:50.660940+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:04.332313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'281","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.951343+0000","last_change":"2024-09-22T08:17:38.304225+0000","last_active":"2024-09-22T09:16:02.951343+0000","last_peered":"2024-09-22T09:16:02.951343+0000","last_clean":"2024-09-22T09:16:02.951343+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:02.951343+0000","last_undegraded":"2024-09-22T09:16:02.951343+0000","last_fullsized":"2024-09-22T09:16:02.951343+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:43.663554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1418,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":518,"num_read_kb":31210,"num_write":1004,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'769","reported_seq":2398,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211151+0000","last_change":"2024-09-22T08:17:40.320968+0000","last_active":"2024-09-22T09:14:02.211151+0000","last_peered":"2024-09-22T09:14:02.211151+0000","last_clean":"2024-09-22T09:14:02.211151+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:14:02.211151+0000","last_undegraded":"2024-09-22T09:14:02.211151+0000","last_fullsized":"2024-09-22T09:14:02.211151+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:57.247773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'294","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.790767+0000","last_change":"2024-09-22T08:17:38.303600+0000","last_active":"2024-09-22T09:16:02.790767+0000","last_peered":"2024-09-22T09:16:02.790767+0000","last_clean":"2024-09-22T09:16:02.790767+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:02.790767+0000","last_undegraded":"2024-09-22T09:16:02.790767+0000","last_fullsized":"2024-09-22T09:16:02.790767+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:42.862930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14241026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":607,"num_read_kb":14446,"num_write":1044,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.948204+0000","last_change":"2024-09-22T08:17:40.319549+0000","last_active":"2024-09-22T09:13:17.948204+0000","last_peered":"2024-09-22T09:13:17.948204+0000","last_clean":"2024-09-22T09:13:17.948204+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:13:17.948204+0000","last_undegraded":"2024-09-22T09:13:17.948204+0000","last_fullsized":"2024-09-22T09:13:17.948204+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:41.286507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'303","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.736928+0000","last_change":"2024-09-22T08:17:38.301639+0000","last_active":"2024-09-22T09:16:01.736928+0000","last_peered":"2024-09-22T09:16:01.736928+0000","last_clean":"2024-09-22T09:16:01.736928+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:01.736928+0000","last_undegraded":"2024-09-22T09:16:01.736928+0000","last_fullsized":"2024-09-22T09:16:01.736928+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:54.649295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429564,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":570,"num_read_kb":1523,"num_write":1167,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'580","reported_seq":2198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211841+0000","last_change":"2024-09-22T08:17:40.306201+0000","last_active":"2024-09-22T09:14:02.211841+0000","last_peered":"2024-09-22T09:14:02.211841+0000","last_clean":"2024-09-22T09:14:02.211841+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:14:02.211841+0000","last_undegraded":"2024-09-22T09:14:02.211841+0000","last_fullsized":"2024-09-22T09:14:02.211841+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:03.473601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'355","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.677487+0000","last_change":"2024-09-22T08:17:38.297373+0000","last_active":"2024-09-22T09:16:01.677487+0000","last_peered":"2024-09-22T09:16:01.677487+0000","last_clean":"2024-09-22T09:16:01.677487+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:01.677487+0000","last_undegraded":"2024-09-22T09:16:01.677487+0000","last_fullsized":"2024-09-22T09:16:01.677487+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662425,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":718,"num_read_kb":14779,"num_write":1428,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'120","reported_seq":619,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.502060+0000","last_change":"2024-09-22T08:17:48.369855+0000","last_active":"2024-09-22T09:14:05.502060+0000","last_peered":"2024-09-22T09:14:05.502060+0000","last_clean":"2024-09-22T09:14:05.502060+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:14:05.502060+0000","last_undegraded":"2024-09-22T09:14:05.502060+0000","last_fullsized":"2024-09-22T09:14:05.502060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:27.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'994","reported_seq":2719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.506452+0000","last_change":"2024-09-22T08:17:40.316511+0000","last_active":"2024-09-22T09:14:04.506452+0000","last_peered":"2024-09-22T09:14:04.506452+0000","last_clean":"2024-09-22T09:14:04.506452+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:14:04.506452+0000","last_undegraded":"2024-09-22T09:14:04.506452+0000","last_fullsized":"2024-09-22T09:14:04.506452+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:57.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'335","reported_seq":1205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.764861+0000","last_change":"2024-09-22T08:17:38.318139+0000","last_active":"2024-09-22T09:16:02.764861+0000","last_peered":"2024-09-22T09:16:02.764861+0000","last_clean":"2024-09-22T09:16:02.764861+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:02.764861+0000","last_undegraded":"2024-09-22T09:16:02.764861+0000","last_fullsized":"2024-09-22T09:16:02.764861+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.934545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15176067,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1309,"num_read_kb":67744,"num_write":1219,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776258+0000","last_change":"2024-09-22T08:17:42.313314+0000","last_active":"2024-09-22T09:13:17.776258+0000","last_peered":"2024-09-22T09:13:17.776258+0000","last_clean":"2024-09-22T09:13:17.776258+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:13:17.776258+0000","last_undegraded":"2024-09-22T09:13:17.776258+0000","last_fullsized":"2024-09-22T09:13:17.776258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:45.452672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796727+0000","last_change":"2024-09-22T08:17:44.340362+0000","last_active":"2024-09-22T09:15:46.796727+0000","last_peered":"2024-09-22T09:15:46.796727+0000","last_clean":"2024-09-22T09:15:46.796727+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:15:46.796727+0000","last_undegraded":"2024-09-22T09:15:46.796727+0000","last_fullsized":"2024-09-22T09:15:46.796727+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:24.766194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1054,"num_write":440,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970119+0000","last_change":"2024-09-22T08:17:46.352688+0000","last_active":"2024-09-22T09:13:22.970119+0000","last_peered":"2024-09-22T09:13:22.970119+0000","last_clean":"2024-09-22T09:13:22.970119+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:13:22.970119+0000","last_undegraded":"2024-09-22T09:13:22.970119+0000","last_fullsized":"2024-09-22T09:13:22.970119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:01.237921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'146","reported_seq":654,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970576+0000","last_change":"2024-09-22T08:17:48.369501+0000","last_active":"2024-09-22T09:13:27.970576+0000","last_peered":"2024-09-22T09:13:27.970576+0000","last_clean":"2024-09-22T09:13:27.970576+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:13:27.970576+0000","last_undegraded":"2024-09-22T09:13:27.970576+0000","last_fullsized":"2024-09-22T09:13:27.970576+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:58.815501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'462","reported_seq":2124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.524494+0000","last_change":"2024-09-22T08:17:40.313282+0000","last_active":"2024-09-22T09:14:04.524494+0000","last_peered":"2024-09-22T09:14:04.524494+0000","last_clean":"2024-09-22T09:14:04.524494+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:14:04.524494+0000","last_undegraded":"2024-09-22T09:14:04.524494+0000","last_fullsized":"2024-09-22T09:14:04.524494+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:54.516463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'321","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.780547+0000","last_change":"2024-09-22T08:17:38.302469+0000","last_active":"2024-09-22T09:16:01.780547+0000","last_peered":"2024-09-22T09:16:01.780547+0000","last_clean":"2024-09-22T09:16:01.780547+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:01.780547+0000","last_undegraded":"2024-09-22T09:16:01.780547+0000","last_fullsized":"2024-09-22T09:16:01.780547+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:18.971472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595357,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":11781,"num_write":1181,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:31.756444+0000","last_change":"2024-09-22T08:17:42.314952+0000","last_active":"2024-09-22T09:11:31.756444+0000","last_peered":"2024-09-22T09:11:31.756444+0000","last_clean":"2024-09-22T09:11:31.756444+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:11:31.756444+0000","last_undegraded":"2024-09-22T09:11:31.756444+0000","last_fullsized":"2024-09-22T09:11:31.756444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:23.058529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'89","reported_seq":606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970112+0000","last_change":"2024-09-22T08:17:44.340327+0000","last_active":"2024-09-22T09:13:22.970112+0000","last_peered":"2024-09-22T09:13:22.970112+0000","last_clean":"2024-09-22T09:13:22.970112+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:13:22.970112+0000","last_undegraded":"2024-09-22T09:13:22.970112+0000","last_fullsized":"2024-09-22T09:13:22.970112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:28.780689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970081+0000","last_change":"2024-09-22T08:17:46.352088+0000","last_active":"2024-09-22T09:13:22.970081+0000","last_peered":"2024-09-22T09:13:22.970081+0000","last_clean":"2024-09-22T09:13:22.970081+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:13:22.970081+0000","last_undegraded":"2024-09-22T09:13:22.970081+0000","last_fullsized":"2024-09-22T09:13:22.970081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:40.458281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763658+0000","last_change":"2024-09-22T08:17:48.367697+0000","last_active":"2024-09-22T09:12:51.763658+0000","last_peered":"2024-09-22T09:12:51.763658+0000","last_clean":"2024-09-22T09:12:51.763658+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:12:51.763658+0000","last_undegraded":"2024-09-22T09:12:51.763658+0000","last_fullsized":"2024-09-22T09:12:51.763658+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:46.458711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183074+0000","last_change":"2024-09-22T08:17:40.317797+0000","last_active":"2024-09-22T09:13:23.183074+0000","last_peered":"2024-09-22T09:13:23.183074+0000","last_clean":"2024-09-22T09:13:23.183074+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:13:23.183074+0000","last_undegraded":"2024-09-22T09:13:23.183074+0000","last_fullsized":"2024-09-22T09:13:23.183074+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:17.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'293","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.676943+0000","last_change":"2024-09-22T08:17:38.317777+0000","last_active":"2024-09-22T09:16:02.676943+0000","last_peered":"2024-09-22T09:16:02.676943+0000","last_clean":"2024-09-22T09:16:02.676943+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:02.676943+0000","last_undegraded":"2024-09-22T09:16:02.676943+0000","last_fullsized":"2024-09-22T09:16:02.676943+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:33.381885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98644,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":649,"num_read_kb":483,"num_write":993,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774779+0000","last_change":"2024-09-22T08:17:42.318734+0000","last_active":"2024-09-22T09:13:16.774779+0000","last_peered":"2024-09-22T09:13:16.774779+0000","last_clean":"2024-09-22T09:13:16.774779+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:13:16.774779+0000","last_undegraded":"2024-09-22T09:13:16.774779+0000","last_fullsized":"2024-09-22T09:13:16.774779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:10.711823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'121","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:58.536458+0000","last_change":"2024-09-22T08:17:44.337759+0000","last_active":"2024-09-22T09:12:58.536458+0000","last_peered":"2024-09-22T09:12:58.536458+0000","last_clean":"2024-09-22T09:12:58.536458+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:12:58.536458+0000","last_undegraded":"2024-09-22T09:12:58.536458+0000","last_fullsized":"2024-09-22T09:12:58.536458+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:58.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'792","reported_seq":2565,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.374834+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:01.374834+0000","last_peered":"2024-09-22T09:16:01.374834+0000","last_clean":"2024-09-22T09:16:01.374834+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:01.374834+0000","last_undegraded":"2024-09-22T09:16:01.374834+0000","last_fullsized":"2024-09-22T09:16:01.374834+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'183","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.560177+0000","last_change":"2024-09-22T08:17:48.368241+0000","last_active":"2024-09-22T09:14:05.560177+0000","last_peered":"2024-09-22T09:14:05.560177+0000","last_clean":"2024-09-22T09:14:05.560177+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:14:05.560177+0000","last_undegraded":"2024-09-22T09:14:05.560177+0000","last_fullsized":"2024-09-22T09:14:05.560177+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:32.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'506","reported_seq":2212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.784964+0000","last_change":"2024-09-22T08:17:40.319980+0000","last_active":"2024-09-22T09:15:22.784964+0000","last_peered":"2024-09-22T09:15:22.784964+0000","last_clean":"2024-09-22T09:15:22.784964+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:15:22.784964+0000","last_undegraded":"2024-09-22T09:15:22.784964+0000","last_fullsized":"2024-09-22T09:15:22.784964+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:14.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'381","reported_seq":1042,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.924631+0000","last_change":"2024-09-22T08:17:38.306751+0000","last_active":"2024-09-22T09:16:02.924631+0000","last_peered":"2024-09-22T09:16:02.924631+0000","last_clean":"2024-09-22T09:16:02.924631+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:02.924631+0000","last_undegraded":"2024-09-22T09:16:02.924631+0000","last_fullsized":"2024-09-22T09:16:02.924631+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:13.757965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146123,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":756,"num_read_kb":8421,"num_write":1241,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776278+0000","last_change":"2024-09-22T08:17:42.314890+0000","last_active":"2024-09-22T09:13:17.776278+0000","last_peered":"2024-09-22T09:13:17.776278+0000","last_clean":"2024-09-22T09:13:17.776278+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:13:17.776278+0000","last_undegraded":"2024-09-22T09:13:17.776278+0000","last_fullsized":"2024-09-22T09:13:17.776278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:40.671613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'295","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.928483+0000","last_change":"2024-09-22T08:17:44.330975+0000","last_active":"2024-09-22T09:16:01.928483+0000","last_peered":"2024-09-22T09:16:01.928483+0000","last_clean":"2024-09-22T09:16:01.928483+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:01.928483+0000","last_undegraded":"2024-09-22T09:16:01.928483+0000","last_fullsized":"2024-09-22T09:16:01.928483+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:22.872610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'810","reported_seq":2602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.380266+0000","last_change":"2024-09-22T08:17:46.354277+0000","last_active":"2024-09-22T09:16:01.380266+0000","last_peered":"2024-09-22T09:16:01.380266+0000","last_clean":"2024-09-22T09:16:01.380266+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:01.380266+0000","last_undegraded":"2024-09-22T09:16:01.380266+0000","last_fullsized":"2024-09-22T09:16:01.380266+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:59.717058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'410","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.341702+0000","last_change":"2024-09-22T08:17:40.312740+0000","last_active":"2024-09-22T09:14:05.341702+0000","last_peered":"2024-09-22T09:14:05.341702+0000","last_clean":"2024-09-22T09:14:05.341702+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:14:05.341702+0000","last_undegraded":"2024-09-22T09:14:05.341702+0000","last_fullsized":"2024-09-22T09:14:05.341702+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:15.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'332","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.916653+0000","last_change":"2024-09-22T08:17:38.307222+0000","last_active":"2024-09-22T09:16:02.916653+0000","last_peered":"2024-09-22T09:16:02.916653+0000","last_clean":"2024-09-22T09:16:02.916653+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:02.916653+0000","last_undegraded":"2024-09-22T09:16:02.916653+0000","last_fullsized":"2024-09-22T09:16:02.916653+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:22.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378682,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":559,"num_read_kb":44787,"num_write":1058,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.960306+0000","last_change":"2024-09-22T08:17:42.318610+0000","last_active":"2024-09-22T09:11:52.960306+0000","last_peered":"2024-09-22T09:11:52.960306+0000","last_clean":"2024-09-22T09:11:52.960306+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:11:52.960306+0000","last_undegraded":"2024-09-22T09:11:52.960306+0000","last_fullsized":"2024-09-22T09:11:52.960306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:36.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'352","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.741049+0000","last_change":"2024-09-22T08:17:44.337617+0000","last_active":"2024-09-22T09:16:02.741049+0000","last_peered":"2024-09-22T09:16:02.741049+0000","last_clean":"2024-09-22T09:16:02.741049+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:02.741049+0000","last_undegraded":"2024-09-22T09:16:02.741049+0000","last_fullsized":"2024-09-22T09:16:02.741049+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:07.429989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:46.754597+0000","last_change":"2024-09-22T08:17:46.352678+0000","last_active":"2024-09-22T09:11:46.754597+0000","last_peered":"2024-09-22T09:11:46.754597+0000","last_clean":"2024-09-22T09:11:46.754597+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:11:46.754597+0000","last_undegraded":"2024-09-22T09:11:46.754597+0000","last_fullsized":"2024-09-22T09:11:46.754597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:08.207868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'558","reported_seq":1369,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285872+0000","last_change":"2024-09-22T08:17:48.368074+0000","last_active":"2024-09-22T09:15:24.285872+0000","last_peered":"2024-09-22T09:15:24.285872+0000","last_clean":"2024-09-22T09:15:24.285872+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:15:24.285872+0000","last_undegraded":"2024-09-22T09:15:24.285872+0000","last_fullsized":"2024-09-22T09:15:24.285872+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:24.210621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'822","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.758885+0000","last_change":"2024-09-22T08:17:40.313132+0000","last_active":"2024-09-22T09:15:22.758885+0000","last_peered":"2024-09-22T09:15:22.758885+0000","last_clean":"2024-09-22T09:15:22.758885+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:15:22.758885+0000","last_undegraded":"2024-09-22T09:15:22.758885+0000","last_fullsized":"2024-09-22T09:15:22.758885+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:10.031355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'327","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.863693+0000","last_change":"2024-09-22T08:17:38.312208+0000","last_active":"2024-09-22T09:16:02.863693+0000","last_peered":"2024-09-22T09:16:02.863693+0000","last_clean":"2024-09-22T09:16:02.863693+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:02.863693+0000","last_undegraded":"2024-09-22T09:16:02.863693+0000","last_fullsized":"2024-09-22T09:16:02.863693+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.033575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486432,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":504,"num_read_kb":29046,"num_write":992,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755206+0000","last_change":"2024-09-22T08:17:42.312266+0000","last_active":"2024-09-22T09:11:51.755206+0000","last_peered":"2024-09-22T09:11:51.755206+0000","last_clean":"2024-09-22T09:11:51.755206+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:11:51.755206+0000","last_undegraded":"2024-09-22T09:11:51.755206+0000","last_fullsized":"2024-09-22T09:11:51.755206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:19.806611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'269","reported_seq":833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.246095+0000","last_change":"2024-09-22T08:17:44.341288+0000","last_active":"2024-09-22T09:15:24.246095+0000","last_peered":"2024-09-22T09:15:24.246095+0000","last_clean":"2024-09-22T09:15:24.246095+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:15:24.246095+0000","last_undegraded":"2024-09-22T09:15:24.246095+0000","last_fullsized":"2024-09-22T09:15:24.246095+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:38.968334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":889,"num_write":346,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763009+0000","last_change":"2024-09-22T08:17:46.353515+0000","last_active":"2024-09-22T09:12:06.763009+0000","last_peered":"2024-09-22T09:12:06.763009+0000","last_clean":"2024-09-22T09:12:06.763009+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:12:06.763009+0000","last_undegraded":"2024-09-22T09:12:06.763009+0000","last_fullsized":"2024-09-22T09:12:06.763009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:30.603577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2489","reported_seq":4315,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589709+0000","last_change":"2024-09-22T08:17:48.370106+0000","last_active":"2024-09-22T09:15:22.589709+0000","last_peered":"2024-09-22T09:15:22.589709+0000","last_clean":"2024-09-22T09:15:22.589709+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:15:22.589709+0000","last_undegraded":"2024-09-22T09:15:22.589709+0000","last_fullsized":"2024-09-22T09:15:22.589709+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:41.845103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'408","reported_seq":1953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.767224+0000","last_change":"2024-09-22T08:17:40.318012+0000","last_active":"2024-09-22T09:15:22.767224+0000","last_peered":"2024-09-22T09:15:22.767224+0000","last_clean":"2024-09-22T09:15:22.767224+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:15:22.767224+0000","last_undegraded":"2024-09-22T09:15:22.767224+0000","last_fullsized":"2024-09-22T09:15:22.767224+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:28.192120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772629+0000","last_change":"2024-09-22T08:17:38.308728+0000","last_active":"2024-09-22T09:16:02.772629+0000","last_peered":"2024-09-22T09:16:02.772629+0000","last_clean":"2024-09-22T09:16:02.772629+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:02.772629+0000","last_undegraded":"2024-09-22T09:16:02.772629+0000","last_fullsized":"2024-09-22T09:16:02.772629+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:31.777927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1806494,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":70122,"num_write":1065,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759708+0000","last_change":"2024-09-22T08:17:42.319503+0000","last_active":"2024-09-22T09:11:41.759708+0000","last_peered":"2024-09-22T09:11:41.759708+0000","last_clean":"2024-09-22T09:11:41.759708+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:11:41.759708+0000","last_undegraded":"2024-09-22T09:11:41.759708+0000","last_fullsized":"2024-09-22T09:11:41.759708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:21.120703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'352","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.275090+0000","last_change":"2024-09-22T08:17:44.337630+0000","last_active":"2024-09-22T09:15:24.275090+0000","last_peered":"2024-09-22T09:15:24.275090+0000","last_clean":"2024-09-22T09:15:24.275090+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:15:24.275090+0000","last_undegraded":"2024-09-22T09:15:24.275090+0000","last_fullsized":"2024-09-22T09:15:24.275090+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.579003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":565,"num_read_kb":1137,"num_write":474,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'810","reported_seq":4728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.381488+0000","last_change":"2024-09-22T08:17:46.356930+0000","last_active":"2024-09-22T09:16:01.381488+0000","last_peered":"2024-09-22T09:16:01.381488+0000","last_clean":"2024-09-22T09:16:01.381488+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:01.381488+0000","last_undegraded":"2024-09-22T09:16:01.381488+0000","last_fullsized":"2024-09-22T09:16:01.381488+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:21.225230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'120","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589147+0000","last_change":"2024-09-22T08:17:48.366165+0000","last_active":"2024-09-22T09:15:22.589147+0000","last_peered":"2024-09-22T09:15:22.589147+0000","last_clean":"2024-09-22T09:15:22.589147+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:15:22.589147+0000","last_undegraded":"2024-09-22T09:15:22.589147+0000","last_fullsized":"2024-09-22T09:15:22.589147+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:59.292369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1207","reported_seq":2863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:14.961172+0000","last_change":"2024-09-22T08:17:40.315829+0000","last_active":"2024-09-22T09:12:14.961172+0000","last_peered":"2024-09-22T09:12:14.961172+0000","last_clean":"2024-09-22T09:12:14.961172+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:12:14.961172+0000","last_undegraded":"2024-09-22T09:12:14.961172+0000","last_fullsized":"2024-09-22T09:12:14.961172+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:53.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'330","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.990520+0000","last_change":"2024-09-22T08:17:38.300056+0000","last_active":"2024-09-22T09:16:02.990520+0000","last_peered":"2024-09-22T09:16:02.990520+0000","last_clean":"2024-09-22T09:16:02.990520+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:02.990520+0000","last_undegraded":"2024-09-22T09:16:02.990520+0000","last_fullsized":"2024-09-22T09:16:02.990520+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:30.384600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":614742,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":623,"num_read_kb":2439,"num_write":1133,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.756824+0000","last_change":"2024-09-22T08:17:42.313688+0000","last_active":"2024-09-22T09:12:01.756824+0000","last_peered":"2024-09-22T09:12:01.756824+0000","last_clean":"2024-09-22T09:12:01.756824+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:12:01.756824+0000","last_undegraded":"2024-09-22T09:12:01.756824+0000","last_fullsized":"2024-09-22T09:12:01.756824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:46.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'492","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.391572+0000","last_change":"2024-09-22T08:17:44.340359+0000","last_active":"2024-09-22T09:16:01.391572+0000","last_peered":"2024-09-22T09:16:01.391572+0000","last_clean":"2024-09-22T09:16:01.391572+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:01.391572+0000","last_undegraded":"2024-09-22T09:16:01.391572+0000","last_fullsized":"2024-09-22T09:16:01.391572+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:10.001858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":853,"num_read_kb":1907,"num_write":716,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761810+0000","last_change":"2024-09-22T08:17:46.349859+0000","last_active":"2024-09-22T09:11:56.761810+0000","last_peered":"2024-09-22T09:11:56.761810+0000","last_clean":"2024-09-22T09:11:56.761810+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:11:56.761810+0000","last_undegraded":"2024-09-22T09:11:56.761810+0000","last_fullsized":"2024-09-22T09:11:56.761810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:54.379436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'132","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.496396+0000","last_change":"2024-09-22T08:17:48.368083+0000","last_active":"2024-09-22T09:14:05.496396+0000","last_peered":"2024-09-22T09:14:05.496396+0000","last_clean":"2024-09-22T09:14:05.496396+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:14:05.496396+0000","last_undegraded":"2024-09-22T09:14:05.496396+0000","last_fullsized":"2024-09-22T09:14:05.496396+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:52.729529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.211236+0000","last_change":"2024-09-22T08:17:40.315498+0000","last_active":"2024-09-22T09:13:21.211236+0000","last_peered":"2024-09-22T09:13:21.211236+0000","last_clean":"2024-09-22T09:13:21.211236+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:13:21.211236+0000","last_undegraded":"2024-09-22T09:13:21.211236+0000","last_fullsized":"2024-09-22T09:13:21.211236+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:32.268795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'341","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.746703+0000","last_change":"2024-09-22T08:17:38.301804+0000","last_active":"2024-09-22T09:16:01.746703+0000","last_peered":"2024-09-22T09:16:01.746703+0000","last_clean":"2024-09-22T09:16:01.746703+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:01.746703+0000","last_undegraded":"2024-09-22T09:16:01.746703+0000","last_fullsized":"2024-09-22T09:16:01.746703+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:48.176948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633961,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":524,"num_read_kb":12203,"num_write":1212,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.758407+0000","last_change":"2024-09-22T08:17:42.317745+0000","last_active":"2024-09-22T09:11:41.758407+0000","last_peered":"2024-09-22T09:11:41.758407+0000","last_clean":"2024-09-22T09:11:41.758407+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:11:41.758407+0000","last_undegraded":"2024-09-22T09:11:41.758407+0000","last_fullsized":"2024-09-22T09:11:41.758407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:55.976576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'298","reported_seq":862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.252674+0000","last_change":"2024-09-22T08:17:44.340384+0000","last_active":"2024-09-22T09:15:24.252674+0000","last_peered":"2024-09-22T09:15:24.252674+0000","last_clean":"2024-09-22T09:15:24.252674+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:15:24.252674+0000","last_undegraded":"2024-09-22T09:15:24.252674+0000","last_fullsized":"2024-09-22T09:15:24.252674+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:51.178814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58980,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1020,"num_write":460,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761329+0000","last_change":"2024-09-22T08:17:46.357757+0000","last_active":"2024-09-22T09:11:56.761329+0000","last_peered":"2024-09-22T09:11:56.761329+0000","last_clean":"2024-09-22T09:11:56.761329+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:11:56.761329+0000","last_undegraded":"2024-09-22T09:11:56.761329+0000","last_fullsized":"2024-09-22T09:11:56.761329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.170661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'175","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:12.994093+0000","last_change":"2024-09-22T08:17:48.369209+0000","last_active":"2024-09-22T09:15:12.994093+0000","last_peered":"2024-09-22T09:15:12.994093+0000","last_clean":"2024-09-22T09:15:12.994093+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:15:12.994093+0000","last_undegraded":"2024-09-22T09:15:12.994093+0000","last_fullsized":"2024-09-22T09:15:12.994093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:22.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'371","reported_seq":1863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183818+0000","last_change":"2024-09-22T08:17:40.318025+0000","last_active":"2024-09-22T09:13:23.183818+0000","last_peered":"2024-09-22T09:13:23.183818+0000","last_clean":"2024-09-22T09:13:23.183818+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:13:23.183818+0000","last_undegraded":"2024-09-22T09:13:23.183818+0000","last_fullsized":"2024-09-22T09:13:23.183818+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'441","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.623110+0000","last_change":"2024-09-22T08:17:38.322735+0000","last_active":"2024-09-22T09:16:02.623110+0000","last_peered":"2024-09-22T09:16:02.623110+0000","last_clean":"2024-09-22T09:16:02.623110+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:02.623110+0000","last_undegraded":"2024-09-22T09:16:02.623110+0000","last_fullsized":"2024-09-22T09:16:02.623110+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:20.868798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9152989,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1020,"num_read_kb":33703,"num_write":1375,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759746+0000","last_change":"2024-09-22T08:17:42.317557+0000","last_active":"2024-09-22T09:11:41.759746+0000","last_peered":"2024-09-22T09:11:41.759746+0000","last_clean":"2024-09-22T09:11:41.759746+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:11:41.759746+0000","last_undegraded":"2024-09-22T09:11:41.759746+0000","last_fullsized":"2024-09-22T09:11:41.759746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:12.874066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'314","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.284114+0000","last_change":"2024-09-22T08:17:44.331471+0000","last_active":"2024-09-22T09:15:24.284114+0000","last_peered":"2024-09-22T09:15:24.284114+0000","last_clean":"2024-09-22T09:15:24.284114+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:15:24.284114+0000","last_undegraded":"2024-09-22T09:15:24.284114+0000","last_fullsized":"2024-09-22T09:15:24.284114+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:15.784939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1016,"num_write":412,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'793","reported_seq":4267,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.375929+0000","last_change":"2024-09-22T08:17:46.353620+0000","last_active":"2024-09-22T09:16:01.375929+0000","last_peered":"2024-09-22T09:16:01.375929+0000","last_clean":"2024-09-22T09:16:01.375929+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:01.375929+0000","last_undegraded":"2024-09-22T09:16:01.375929+0000","last_fullsized":"2024-09-22T09:16:01.375929+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:44.586630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":632,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.416944+0000","last_change":"2024-09-22T08:17:48.368255+0000","last_active":"2024-09-22T09:14:03.416944+0000","last_peered":"2024-09-22T09:14:03.416944+0000","last_clean":"2024-09-22T09:14:03.416944+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:14:03.416944+0000","last_undegraded":"2024-09-22T09:14:03.416944+0000","last_fullsized":"2024-09-22T09:14:03.416944+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:52.505757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'504","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.760231+0000","last_change":"2024-09-22T08:17:40.319745+0000","last_active":"2024-09-22T09:15:22.760231+0000","last_peered":"2024-09-22T09:15:22.760231+0000","last_clean":"2024-09-22T09:15:22.760231+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:15:22.760231+0000","last_undegraded":"2024-09-22T09:15:22.760231+0000","last_fullsized":"2024-09-22T09:15:22.760231+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:24.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'282","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.783706+0000","last_change":"2024-09-22T08:17:38.305115+0000","last_active":"2024-09-22T09:16:02.783706+0000","last_peered":"2024-09-22T09:16:02.783706+0000","last_clean":"2024-09-22T09:16:02.783706+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:02.783706+0000","last_undegraded":"2024-09-22T09:16:02.783706+0000","last_fullsized":"2024-09-22T09:16:02.783706+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:22.303400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247588,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":453,"num_read_kb":25988,"num_write":882,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.357888+0000","last_change":"2024-09-22T08:17:42.319394+0000","last_active":"2024-09-22T09:16:01.357888+0000","last_peered":"2024-09-22T09:16:01.357888+0000","last_clean":"2024-09-22T09:16:01.357888+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:01.357888+0000","last_undegraded":"2024-09-22T09:16:01.357888+0000","last_fullsized":"2024-09-22T09:16:01.357888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:53.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.790388+0000","last_change":"2024-09-22T08:17:44.340629+0000","last_active":"2024-09-22T09:12:16.790388+0000","last_peered":"2024-09-22T09:12:16.790388+0000","last_clean":"2024-09-22T09:12:16.790388+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:12:16.790388+0000","last_undegraded":"2024-09-22T09:12:16.790388+0000","last_fullsized":"2024-09-22T09:12:16.790388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:15.874564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'782","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.376981+0000","last_change":"2024-09-22T08:17:46.356179+0000","last_active":"2024-09-22T09:16:01.376981+0000","last_peered":"2024-09-22T09:16:01.376981+0000","last_clean":"2024-09-22T09:16:01.376981+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:01.376981+0000","last_undegraded":"2024-09-22T09:16:01.376981+0000","last_fullsized":"2024-09-22T09:16:01.376981+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:39.747201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'110","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870751+0000","last_change":"2024-09-22T08:17:48.366352+0000","last_active":"2024-09-22T09:14:02.870751+0000","last_peered":"2024-09-22T09:14:02.870751+0000","last_clean":"2024-09-22T09:14:02.870751+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:14:02.870751+0000","last_undegraded":"2024-09-22T09:14:02.870751+0000","last_fullsized":"2024-09-22T09:14:02.870751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:07.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1178","reported_seq":2758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182228+0000","last_change":"2024-09-22T08:17:40.316192+0000","last_active":"2024-09-22T09:13:23.182228+0000","last_peered":"2024-09-22T09:13:23.182228+0000","last_clean":"2024-09-22T09:13:23.182228+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:13:23.182228+0000","last_undegraded":"2024-09-22T09:13:23.182228+0000","last_fullsized":"2024-09-22T09:13:23.182228+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:48.043270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.777872+0000","last_change":"2024-09-22T08:17:38.308011+0000","last_active":"2024-09-22T09:16:01.777872+0000","last_peered":"2024-09-22T09:16:01.777872+0000","last_clean":"2024-09-22T09:16:01.777872+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:01.777872+0000","last_undegraded":"2024-09-22T09:16:01.777872+0000","last_fullsized":"2024-09-22T09:16:01.777872+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:35.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8829564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":762,"num_read_kb":19795,"num_write":1259,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:42.764797+0000","last_change":"2024-09-22T08:17:42.313230+0000","last_active":"2024-09-22T09:11:42.764797+0000","last_peered":"2024-09-22T09:11:42.764797+0000","last_clean":"2024-09-22T09:11:42.764797+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:11:42.764797+0000","last_undegraded":"2024-09-22T09:11:42.764797+0000","last_fullsized":"2024-09-22T09:11:42.764797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:03.149245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'360","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.470236+0000","last_change":"2024-09-22T08:17:44.340330+0000","last_active":"2024-09-22T09:16:02.470236+0000","last_peered":"2024-09-22T09:16:02.470236+0000","last_clean":"2024-09-22T09:16:02.470236+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:02.470236+0000","last_undegraded":"2024-09-22T09:16:02.470236+0000","last_fullsized":"2024-09-22T09:16:02.470236+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:10.718081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855506+0000","last_change":"2024-09-22T08:17:46.346619+0000","last_active":"2024-09-22T09:11:47.855506+0000","last_peered":"2024-09-22T09:11:47.855506+0000","last_clean":"2024-09-22T09:11:47.855506+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:11:47.855506+0000","last_undegraded":"2024-09-22T09:11:47.855506+0000","last_fullsized":"2024-09-22T09:11:47.855506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:14.109434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'174","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.873297+0000","last_change":"2024-09-22T08:17:48.366379+0000","last_active":"2024-09-22T09:14:02.873297+0000","last_peered":"2024-09-22T09:14:02.873297+0000","last_clean":"2024-09-22T09:14:02.873297+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:14:02.873297+0000","last_undegraded":"2024-09-22T09:14:02.873297+0000","last_fullsized":"2024-09-22T09:14:02.873297+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:38.475121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'895","reported_seq":2544,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.774888+0000","last_change":"2024-09-22T08:17:40.315285+0000","last_active":"2024-09-22T09:12:16.774888+0000","last_peered":"2024-09-22T09:12:16.774888+0000","last_clean":"2024-09-22T09:12:16.774888+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:12:16.774888+0000","last_undegraded":"2024-09-22T09:12:16.774888+0000","last_fullsized":"2024-09-22T09:12:16.774888+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:30.566288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970017+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T09:13:22.970017+0000","last_peered":"2024-09-22T09:13:22.970017+0000","last_clean":"2024-09-22T09:13:22.970017+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:13:22.970017+0000","last_undegraded":"2024-09-22T09:13:22.970017+0000","last_fullsized":"2024-09-22T09:13:22.970017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779151+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T09:13:42.779151+0000","last_peered":"2024-09-22T09:13:42.779151+0000","last_clean":"2024-09-22T09:13:42.779151+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:13:42.779151+0000","last_undegraded":"2024-09-22T09:13:42.779151+0000","last_fullsized":"2024-09-22T09:13:42.779151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'266","reported_seq":920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.748620+0000","last_change":"2024-09-22T08:17:38.310448+0000","last_active":"2024-09-22T09:16:01.748620+0000","last_peered":"2024-09-22T09:16:01.748620+0000","last_clean":"2024-09-22T09:16:01.748620+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:01.748620+0000","last_undegraded":"2024-09-22T09:16:01.748620+0000","last_fullsized":"2024-09-22T09:16:01.748620+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:06.962881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8299814,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":559,"num_read_kb":39972,"num_write":973,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976838+0000","last_change":"2024-09-22T08:17:42.319001+0000","last_active":"2024-09-22T09:13:57.976838+0000","last_peered":"2024-09-22T09:13:57.976838+0000","last_clean":"2024-09-22T09:13:57.976838+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:13:57.976838+0000","last_undegraded":"2024-09-22T09:13:57.976838+0000","last_fullsized":"2024-09-22T09:13:57.976838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'737","reported_seq":1428,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.644538+0000","last_change":"2024-09-22T08:17:44.340548+0000","last_active":"2024-09-22T09:16:02.644538+0000","last_peered":"2024-09-22T09:16:02.644538+0000","last_clean":"2024-09-22T09:16:02.644538+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:02.644538+0000","last_undegraded":"2024-09-22T09:16:02.644538+0000","last_fullsized":"2024-09-22T09:16:02.644538+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:42.555714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136654,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1406,"num_read_kb":3036,"num_write":1368,"num_write_kb":1203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761952+0000","last_change":"2024-09-22T08:17:46.351335+0000","last_active":"2024-09-22T09:11:56.761952+0000","last_peered":"2024-09-22T09:11:56.761952+0000","last_clean":"2024-09-22T09:11:56.761952+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:11:56.761952+0000","last_undegraded":"2024-09-22T09:11:56.761952+0000","last_fullsized":"2024-09-22T09:11:56.761952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'205","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.392952+0000","last_change":"2024-09-22T08:17:48.371345+0000","last_active":"2024-09-22T09:14:05.392952+0000","last_peered":"2024-09-22T09:14:05.392952+0000","last_clean":"2024-09-22T09:14:05.392952+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:14:05.392952+0000","last_undegraded":"2024-09-22T09:14:05.392952+0000","last_fullsized":"2024-09-22T09:14:05.392952+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.861983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697568+0000","last_change":"2024-09-22T08:17:40.318048+0000","last_active":"2024-09-22T09:13:27.697568+0000","last_peered":"2024-09-22T09:13:27.697568+0000","last_clean":"2024-09-22T09:13:27.697568+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:13:27.697568+0000","last_undegraded":"2024-09-22T09:13:27.697568+0000","last_fullsized":"2024-09-22T09:13:27.697568+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:48.343685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779075+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T09:13:42.779075+0000","last_peered":"2024-09-22T09:13:42.779075+0000","last_clean":"2024-09-22T09:13:42.779075+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:13:42.779075+0000","last_undegraded":"2024-09-22T09:13:42.779075+0000","last_fullsized":"2024-09-22T09:13:42.779075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'277","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.791862+0000","last_change":"2024-09-22T08:17:38.309062+0000","last_active":"2024-09-22T09:16:01.791862+0000","last_peered":"2024-09-22T09:16:01.791862+0000","last_clean":"2024-09-22T09:16:01.791862+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:01.791862+0000","last_undegraded":"2024-09-22T09:16:01.791862+0000","last_fullsized":"2024-09-22T09:16:01.791862+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:47.956763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399728,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":494,"num_read_kb":6728,"num_write":1008,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.765977+0000","last_change":"2024-09-22T08:17:42.319964+0000","last_active":"2024-09-22T09:11:52.765977+0000","last_peered":"2024-09-22T09:11:52.765977+0000","last_clean":"2024-09-22T09:11:52.765977+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:11:52.765977+0000","last_undegraded":"2024-09-22T09:11:52.765977+0000","last_fullsized":"2024-09-22T09:11:52.765977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:30.133737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1321","reported_seq":2926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.402301+0000","last_change":"2024-09-22T08:17:44.340574+0000","last_active":"2024-09-22T09:16:01.402301+0000","last_peered":"2024-09-22T09:16:01.402301+0000","last_clean":"2024-09-22T09:16:01.402301+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:01.402301+0000","last_undegraded":"2024-09-22T09:16:01.402301+0000","last_fullsized":"2024-09-22T09:16:01.402301+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:35:13.936560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166762,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3488,"num_write":1152,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:12.768421+0000","last_change":"2024-09-22T08:17:46.355591+0000","last_active":"2024-09-22T09:12:12.768421+0000","last_peered":"2024-09-22T09:12:12.768421+0000","last_clean":"2024-09-22T09:12:12.768421+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:12:12.768421+0000","last_undegraded":"2024-09-22T09:12:12.768421+0000","last_fullsized":"2024-09-22T09:12:12.768421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:16.459442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'121","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.349060+0000","last_change":"2024-09-22T08:17:48.368412+0000","last_active":"2024-09-22T09:14:05.349060+0000","last_peered":"2024-09-22T09:14:05.349060+0000","last_clean":"2024-09-22T09:14:05.349060+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:14:05.349060+0000","last_undegraded":"2024-09-22T09:14:05.349060+0000","last_fullsized":"2024-09-22T09:14:05.349060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'465","reported_seq":2070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755403+0000","last_change":"2024-09-22T08:17:40.310102+0000","last_active":"2024-09-22T09:11:51.755403+0000","last_peered":"2024-09-22T09:11:51.755403+0000","last_clean":"2024-09-22T09:11:51.755403+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:11:51.755403+0000","last_undegraded":"2024-09-22T09:11:51.755403+0000","last_fullsized":"2024-09-22T09:11:51.755403+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:43.429819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778073+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T09:13:41.778073+0000","last_peered":"2024-09-22T09:13:41.778073+0000","last_clean":"2024-09-22T09:13:41.778073+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:13:41.778073+0000","last_undegraded":"2024-09-22T09:13:41.778073+0000","last_fullsized":"2024-09-22T09:13:41.778073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'279","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.761134+0000","last_change":"2024-09-22T08:17:38.321760+0000","last_active":"2024-09-22T09:16:01.761134+0000","last_peered":"2024-09-22T09:16:01.761134+0000","last_clean":"2024-09-22T09:16:01.761134+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:01.761134+0000","last_undegraded":"2024-09-22T09:16:01.761134+0000","last_fullsized":"2024-09-22T09:16:01.761134+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:53.153409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207367,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":482,"num_read_kb":1785,"num_write":1045,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"37'6","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.346566+0000","last_change":"2024-09-22T08:17:42.318777+0000","last_active":"2024-09-22T09:16:01.346566+0000","last_peered":"2024-09-22T09:16:01.346566+0000","last_clean":"2024-09-22T09:16:01.346566+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:01.346566+0000","last_undegraded":"2024-09-22T09:16:01.346566+0000","last_fullsized":"2024-09-22T09:16:01.346566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:08.823340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'259","reported_seq":1485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.651005+0000","last_change":"2024-09-22T08:17:44.340447+0000","last_active":"2024-09-22T09:15:22.651005+0000","last_peered":"2024-09-22T09:15:22.651005+0000","last_clean":"2024-09-22T09:15:22.651005+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:15:22.651005+0000","last_undegraded":"2024-09-22T09:15:22.651005+0000","last_fullsized":"2024-09-22T09:15:22.651005+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:25.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761290+0000","last_change":"2024-09-22T08:17:46.356277+0000","last_active":"2024-09-22T09:11:56.761290+0000","last_peered":"2024-09-22T09:11:56.761290+0000","last_clean":"2024-09-22T09:11:56.761290+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:11:56.761290+0000","last_undegraded":"2024-09-22T09:11:56.761290+0000","last_fullsized":"2024-09-22T09:11:56.761290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:32.511597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'261","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.635821+0000","last_change":"2024-09-22T08:17:48.371579+0000","last_active":"2024-09-22T09:14:05.635821+0000","last_peered":"2024-09-22T09:14:05.635821+0000","last_clean":"2024-09-22T09:14:05.635821+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:14:05.635821+0000","last_undegraded":"2024-09-22T09:14:05.635821+0000","last_fullsized":"2024-09-22T09:14:05.635821+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:45.916159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'775","reported_seq":2205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.773059+0000","last_change":"2024-09-22T08:17:40.310812+0000","last_active":"2024-09-22T09:13:56.773059+0000","last_peered":"2024-09-22T09:13:56.773059+0000","last_clean":"2024-09-22T09:13:56.773059+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:13:56.773059+0000","last_undegraded":"2024-09-22T09:13:56.773059+0000","last_fullsized":"2024-09-22T09:13:56.773059+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:58.245283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779128+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T09:13:42.779128+0000","last_peered":"2024-09-22T09:13:42.779128+0000","last_clean":"2024-09-22T09:13:42.779128+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:13:42.779128+0000","last_undegraded":"2024-09-22T09:13:42.779128+0000","last_fullsized":"2024-09-22T09:13:42.779128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'327","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.751237+0000","last_change":"2024-09-22T08:18:09.819721+0000","last_active":"2024-09-22T09:16:01.751237+0000","last_peered":"2024-09-22T09:16:01.751237+0000","last_clean":"2024-09-22T09:16:01.751237+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:01.751237+0000","last_undegraded":"2024-09-22T09:16:01.751237+0000","last_fullsized":"2024-09-22T09:16:01.751237+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:02.135126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267476,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":547,"num_read_kb":48326,"num_write":1121,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.762146+0000","last_change":"2024-09-22T08:17:42.321314+0000","last_active":"2024-09-22T09:12:01.762146+0000","last_peered":"2024-09-22T09:12:01.762146+0000","last_clean":"2024-09-22T09:12:01.762146+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:12:01.762146+0000","last_undegraded":"2024-09-22T09:12:01.762146+0000","last_fullsized":"2024-09-22T09:12:01.762146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:59.774382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'141","reported_seq":680,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782537+0000","last_change":"2024-09-22T08:17:44.338734+0000","last_active":"2024-09-22T09:14:06.782537+0000","last_peered":"2024-09-22T09:14:06.782537+0000","last_clean":"2024-09-22T09:14:06.782537+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:14:06.782537+0000","last_undegraded":"2024-09-22T09:14:06.782537+0000","last_fullsized":"2024-09-22T09:14:06.782537+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:01.878832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.766574+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:11:57.766574+0000","last_peered":"2024-09-22T09:11:57.766574+0000","last_clean":"2024-09-22T09:11:57.766574+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:11:57.766574+0000","last_undegraded":"2024-09-22T09:11:57.766574+0000","last_fullsized":"2024-09-22T09:11:57.766574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:45.080426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'120","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.960999+0000","last_change":"2024-09-22T08:17:48.366537+0000","last_active":"2024-09-22T09:11:57.960999+0000","last_peered":"2024-09-22T09:11:57.960999+0000","last_clean":"2024-09-22T09:11:57.960999+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:11:57.960999+0000","last_undegraded":"2024-09-22T09:11:57.960999+0000","last_fullsized":"2024-09-22T09:11:57.960999+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:56.129113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'369","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.533414+0000","last_change":"2024-09-22T08:17:40.314415+0000","last_active":"2024-09-22T09:14:04.533414+0000","last_peered":"2024-09-22T09:14:04.533414+0000","last_clean":"2024-09-22T09:14:04.533414+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:14:04.533414+0000","last_undegraded":"2024-09-22T09:14:04.533414+0000","last_fullsized":"2024-09-22T09:14:04.533414+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:51.191984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'357","reported_seq":1054,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.751679+0000","last_change":"2024-09-22T08:17:38.312313+0000","last_active":"2024-09-22T09:16:02.751679+0000","last_peered":"2024-09-22T09:16:02.751679+0000","last_clean":"2024-09-22T09:16:02.751679+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:02.751679+0000","last_undegraded":"2024-09-22T09:16:02.751679+0000","last_fullsized":"2024-09-22T09:16:02.751679+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:50.017512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335217,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":45053,"num_write":1347,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778206+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T09:13:41.778206+0000","last_peered":"2024-09-22T09:13:41.778206+0000","last_clean":"2024-09-22T09:13:41.778206+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:13:41.778206+0000","last_undegraded":"2024-09-22T09:13:41.778206+0000","last_fullsized":"2024-09-22T09:13:41.778206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780582+0000","last_change":"2024-09-22T08:17:42.315400+0000","last_active":"2024-09-22T09:13:56.780582+0000","last_peered":"2024-09-22T09:13:56.780582+0000","last_clean":"2024-09-22T09:13:56.780582+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:13:56.780582+0000","last_undegraded":"2024-09-22T09:13:56.780582+0000","last_fullsized":"2024-09-22T09:13:56.780582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'580","reported_seq":1230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.401286+0000","last_change":"2024-09-22T08:17:44.332038+0000","last_active":"2024-09-22T09:16:01.401286+0000","last_peered":"2024-09-22T09:16:01.401286+0000","last_clean":"2024-09-22T09:16:01.401286+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:01.401286+0000","last_undegraded":"2024-09-22T09:16:01.401286+0000","last_fullsized":"2024-09-22T09:16:01.401286+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:32.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112903,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1655,"num_read_kb":2619,"num_write":2214,"num_write_kb":2044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.856595+0000","last_change":"2024-09-22T08:17:46.353133+0000","last_active":"2024-09-22T09:11:57.856595+0000","last_peered":"2024-09-22T09:11:57.856595+0000","last_clean":"2024-09-22T09:11:57.856595+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:11:57.856595+0000","last_undegraded":"2024-09-22T09:11:57.856595+0000","last_fullsized":"2024-09-22T09:11:57.856595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.262623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'126","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.865467+0000","last_change":"2024-09-22T08:17:48.371983+0000","last_active":"2024-09-22T09:14:02.865467+0000","last_peered":"2024-09-22T09:14:02.865467+0000","last_clean":"2024-09-22T09:14:02.865467+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:14:02.865467+0000","last_undegraded":"2024-09-22T09:14:02.865467+0000","last_fullsized":"2024-09-22T09:14:02.865467+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:17.544287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'437","reported_seq":2050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.530580+0000","last_change":"2024-09-22T08:17:40.310836+0000","last_active":"2024-09-22T09:14:04.530580+0000","last_peered":"2024-09-22T09:14:04.530580+0000","last_clean":"2024-09-22T09:14:04.530580+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:14:04.530580+0000","last_undegraded":"2024-09-22T09:14:04.530580+0000","last_fullsized":"2024-09-22T09:14:04.530580+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:50.194831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'339","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.737328+0000","last_change":"2024-09-22T08:17:38.314470+0000","last_active":"2024-09-22T09:16:01.737328+0000","last_peered":"2024-09-22T09:16:01.737328+0000","last_clean":"2024-09-22T09:16:01.737328+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:01.737328+0000","last_undegraded":"2024-09-22T09:16:01.737328+0000","last_fullsized":"2024-09-22T09:16:01.737328+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:21.168095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13356216,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":630,"num_read_kb":42178,"num_write":1102,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781067+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T09:13:57.781067+0000","last_peered":"2024-09-22T09:13:57.781067+0000","last_clean":"2024-09-22T09:13:57.781067+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:13:57.781067+0000","last_undegraded":"2024-09-22T09:13:57.781067+0000","last_fullsized":"2024-09-22T09:13:57.781067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'3","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.370391+0000","last_change":"2024-09-22T08:17:42.319037+0000","last_active":"2024-09-22T09:16:01.370391+0000","last_peered":"2024-09-22T09:16:01.370391+0000","last_clean":"2024-09-22T09:16:01.370391+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:01.370391+0000","last_undegraded":"2024-09-22T09:16:01.370391+0000","last_fullsized":"2024-09-22T09:16:01.370391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:51.756538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'168","reported_seq":722,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.756076+0000","last_change":"2024-09-22T08:17:44.337754+0000","last_active":"2024-09-22T09:11:56.756076+0000","last_peered":"2024-09-22T09:11:56.756076+0000","last_clean":"2024-09-22T09:11:56.756076+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:11:56.756076+0000","last_undegraded":"2024-09-22T09:11:56.756076+0000","last_fullsized":"2024-09-22T09:11:56.756076+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:07.954994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'782","reported_seq":2597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.373636+0000","last_change":"2024-09-22T08:17:46.353169+0000","last_active":"2024-09-22T09:16:01.373636+0000","last_peered":"2024-09-22T09:16:01.373636+0000","last_clean":"2024-09-22T09:16:01.373636+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:01.373636+0000","last_undegraded":"2024-09-22T09:16:01.373636+0000","last_fullsized":"2024-09-22T09:16:01.373636+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:47.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'124","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783445+0000","last_change":"2024-09-22T08:17:48.370594+0000","last_active":"2024-09-22T09:14:16.783445+0000","last_peered":"2024-09-22T09:14:16.783445+0000","last_clean":"2024-09-22T09:14:16.783445+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:14:16.783445+0000","last_undegraded":"2024-09-22T09:14:16.783445+0000","last_fullsized":"2024-09-22T09:14:16.783445+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:38.200197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'478","reported_seq":2004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779781+0000","last_change":"2024-09-22T08:17:40.314079+0000","last_active":"2024-09-22T09:13:51.779781+0000","last_peered":"2024-09-22T09:13:51.779781+0000","last_clean":"2024-09-22T09:13:51.779781+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:13:51.779781+0000","last_undegraded":"2024-09-22T09:13:51.779781+0000","last_fullsized":"2024-09-22T09:13:51.779781+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:15.539629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'351","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.686371+0000","last_change":"2024-09-22T08:17:38.302210+0000","last_active":"2024-09-22T09:16:01.686371+0000","last_peered":"2024-09-22T09:16:01.686371+0000","last_clean":"2024-09-22T09:16:01.686371+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:01.686371+0000","last_undegraded":"2024-09-22T09:16:01.686371+0000","last_fullsized":"2024-09-22T09:16:01.686371+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:59.512304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190906,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":886,"num_read_kb":43239,"num_write":1228,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779024+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T09:13:46.779024+0000","last_peered":"2024-09-22T09:13:46.779024+0000","last_clean":"2024-09-22T09:13:46.779024+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:13:46.779024+0000","last_undegraded":"2024-09-22T09:13:46.779024+0000","last_fullsized":"2024-09-22T09:13:46.779024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781014+0000","last_change":"2024-09-22T08:17:42.316704+0000","last_active":"2024-09-22T09:13:57.781014+0000","last_peered":"2024-09-22T09:13:57.781014+0000","last_clean":"2024-09-22T09:13:57.781014+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:13:57.781014+0000","last_undegraded":"2024-09-22T09:13:57.781014+0000","last_fullsized":"2024-09-22T09:13:57.781014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:09.379090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'111","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:48.410289+0000","last_change":"2024-09-22T08:17:44.338196+0000","last_active":"2024-09-22T09:12:48.410289+0000","last_peered":"2024-09-22T09:12:48.410289+0000","last_clean":"2024-09-22T09:12:48.410289+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:12:48.410289+0000","last_undegraded":"2024-09-22T09:12:48.410289+0000","last_fullsized":"2024-09-22T09:12:48.410289+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:17.767211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'809","reported_seq":2518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.379031+0000","last_change":"2024-09-22T08:17:46.352328+0000","last_active":"2024-09-22T09:16:01.379031+0000","last_peered":"2024-09-22T09:16:01.379031+0000","last_clean":"2024-09-22T09:16:01.379031+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:01.379031+0000","last_undegraded":"2024-09-22T09:16:01.379031+0000","last_fullsized":"2024-09-22T09:16:01.379031+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:57.228160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'287","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.761107+0000","last_change":"2024-09-22T08:17:48.371281+0000","last_active":"2024-09-22T09:11:51.761107+0000","last_peered":"2024-09-22T09:11:51.761107+0000","last_clean":"2024-09-22T09:11:51.761107+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:11:51.761107+0000","last_undegraded":"2024-09-22T09:11:51.761107+0000","last_fullsized":"2024-09-22T09:11:51.761107+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:03.377587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'782","reported_seq":2368,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214566+0000","last_change":"2024-09-22T08:17:40.316159+0000","last_active":"2024-09-22T09:14:02.214566+0000","last_peered":"2024-09-22T09:14:02.214566+0000","last_clean":"2024-09-22T09:14:02.214566+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:14:02.214566+0000","last_undegraded":"2024-09-22T09:14:02.214566+0000","last_fullsized":"2024-09-22T09:14:02.214566+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:31.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'274","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.766152+0000","last_change":"2024-09-22T08:17:38.300386+0000","last_active":"2024-09-22T09:16:01.766152+0000","last_peered":"2024-09-22T09:16:01.766152+0000","last_clean":"2024-09-22T09:16:01.766152+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:01.766152+0000","last_undegraded":"2024-09-22T09:16:01.766152+0000","last_fullsized":"2024-09-22T09:16:01.766152+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:23.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086766,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":854,"num_read_kb":63309,"num_write":917,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779847+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T09:13:47.779847+0000","last_peered":"2024-09-22T09:13:47.779847+0000","last_clean":"2024-09-22T09:13:47.779847+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:13:47.779847+0000","last_undegraded":"2024-09-22T09:13:47.779847+0000","last_fullsized":"2024-09-22T09:13:47.779847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779817+0000","last_change":"2024-09-22T08:17:42.311097+0000","last_active":"2024-09-22T09:13:51.779817+0000","last_peered":"2024-09-22T09:13:51.779817+0000","last_clean":"2024-09-22T09:13:51.779817+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:13:51.779817+0000","last_undegraded":"2024-09-22T09:13:51.779817+0000","last_fullsized":"2024-09-22T09:13:51.779817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:38.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'738","reported_seq":1444,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.279359+0000","last_change":"2024-09-22T08:17:44.333541+0000","last_active":"2024-09-22T09:16:02.279359+0000","last_peered":"2024-09-22T09:16:02.279359+0000","last_clean":"2024-09-22T09:16:02.279359+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:02.279359+0000","last_undegraded":"2024-09-22T09:16:02.279359+0000","last_fullsized":"2024-09-22T09:16:02.279359+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:02.700362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1323,"num_read_kb":3030,"num_write":1086,"num_write_kb":894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761245+0000","last_change":"2024-09-22T08:17:46.355809+0000","last_active":"2024-09-22T09:11:56.761245+0000","last_peered":"2024-09-22T09:11:56.761245+0000","last_clean":"2024-09-22T09:11:56.761245+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:11:56.761245+0000","last_undegraded":"2024-09-22T09:11:56.761245+0000","last_fullsized":"2024-09-22T09:11:56.761245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:49.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'100","reported_seq":587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.079488+0000","last_change":"2024-09-22T08:17:48.367775+0000","last_active":"2024-09-22T09:14:05.079488+0000","last_peered":"2024-09-22T09:14:05.079488+0000","last_clean":"2024-09-22T09:14:05.079488+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:14:05.079488+0000","last_undegraded":"2024-09-22T09:14:05.079488+0000","last_fullsized":"2024-09-22T09:14:05.079488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:56.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'123","reported_seq":691,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.578802+0000","last_change":"2024-09-22T08:17:48.366489+0000","last_active":"2024-09-22T09:14:05.578802+0000","last_peered":"2024-09-22T09:14:05.578802+0000","last_clean":"2024-09-22T09:14:05.578802+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:14:05.578802+0000","last_undegraded":"2024-09-22T09:14:05.578802+0000","last_fullsized":"2024-09-22T09:14:05.578802+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:50.584912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'412","reported_seq":1973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868497+0000","last_change":"2024-09-22T08:17:40.313136+0000","last_active":"2024-09-22T09:13:42.868497+0000","last_peered":"2024-09-22T09:13:42.868497+0000","last_clean":"2024-09-22T09:13:42.868497+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:13:42.868497+0000","last_undegraded":"2024-09-22T09:13:42.868497+0000","last_fullsized":"2024-09-22T09:13:42.868497+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:06.500375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'283","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.782067+0000","last_change":"2024-09-22T08:18:09.816788+0000","last_active":"2024-09-22T09:16:02.782067+0000","last_peered":"2024-09-22T09:16:02.782067+0000","last_clean":"2024-09-22T09:16:02.782067+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:02.782067+0000","last_undegraded":"2024-09-22T09:16:02.782067+0000","last_fullsized":"2024-09-22T09:16:02.782067+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:13.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25064,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":550,"num_read_kb":48776,"num_write":1041,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.770677+0000","last_change":"2024-09-22T08:17:42.317519+0000","last_active":"2024-09-22T09:13:41.770677+0000","last_peered":"2024-09-22T09:13:41.770677+0000","last_clean":"2024-09-22T09:13:41.770677+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:13:41.770677+0000","last_undegraded":"2024-09-22T09:13:41.770677+0000","last_fullsized":"2024-09-22T09:13:41.770677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:17.290304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'295","reported_seq":852,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.273953+0000","last_change":"2024-09-22T08:17:44.340784+0000","last_active":"2024-09-22T09:15:24.273953+0000","last_peered":"2024-09-22T09:15:24.273953+0000","last_clean":"2024-09-22T09:15:24.273953+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:15:24.273953+0000","last_undegraded":"2024-09-22T09:15:24.273953+0000","last_fullsized":"2024-09-22T09:15:24.273953+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:27.691033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":895,"num_write":374,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755323+0000","last_change":"2024-09-22T08:17:46.357807+0000","last_active":"2024-09-22T09:11:26.755323+0000","last_peered":"2024-09-22T09:11:26.755323+0000","last_clean":"2024-09-22T09:11:26.755323+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:11:26.755323+0000","last_undegraded":"2024-09-22T09:11:26.755323+0000","last_fullsized":"2024-09-22T09:11:26.755323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:34.146262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'156","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781302+0000","last_change":"2024-09-22T08:17:48.370244+0000","last_active":"2024-09-22T09:14:01.781302+0000","last_peered":"2024-09-22T09:14:01.781302+0000","last_clean":"2024-09-22T09:14:01.781302+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:14:01.781302+0000","last_undegraded":"2024-09-22T09:14:01.781302+0000","last_fullsized":"2024-09-22T09:14:01.781302+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:47.163289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'477","reported_seq":2018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214640+0000","last_change":"2024-09-22T08:17:40.313313+0000","last_active":"2024-09-22T09:14:02.214640+0000","last_peered":"2024-09-22T09:14:02.214640+0000","last_clean":"2024-09-22T09:14:02.214640+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:14:02.214640+0000","last_undegraded":"2024-09-22T09:14:02.214640+0000","last_fullsized":"2024-09-22T09:14:02.214640+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:57.603890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'317","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.947408+0000","last_change":"2024-09-22T08:17:38.309041+0000","last_active":"2024-09-22T09:16:02.947408+0000","last_peered":"2024-09-22T09:16:02.947408+0000","last_clean":"2024-09-22T09:16:02.947408+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:02.947408+0000","last_undegraded":"2024-09-22T09:16:02.947408+0000","last_fullsized":"2024-09-22T09:16:02.947408+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.738401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12590450,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":589,"num_read_kb":26096,"num_write":1005,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778236+0000","last_change":"2024-09-22T08:17:42.315462+0000","last_active":"2024-09-22T09:13:41.778236+0000","last_peered":"2024-09-22T09:13:41.778236+0000","last_clean":"2024-09-22T09:13:41.778236+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:13:41.778236+0000","last_undegraded":"2024-09-22T09:13:41.778236+0000","last_fullsized":"2024-09-22T09:13:41.778236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:17.089358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'49","reported_seq":549,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755343+0000","last_change":"2024-09-22T08:17:44.334218+0000","last_active":"2024-09-22T09:11:26.755343+0000","last_peered":"2024-09-22T09:11:26.755343+0000","last_clean":"2024-09-22T09:11:26.755343+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:11:26.755343+0000","last_undegraded":"2024-09-22T09:11:26.755343+0000","last_fullsized":"2024-09-22T09:11:26.755343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:02.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.853295+0000","last_change":"2024-09-22T08:17:46.350484+0000","last_active":"2024-09-22T09:11:27.853295+0000","last_peered":"2024-09-22T09:11:27.853295+0000","last_clean":"2024-09-22T09:11:27.853295+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:11:27.853295+0000","last_undegraded":"2024-09-22T09:11:27.853295+0000","last_fullsized":"2024-09-22T09:11:27.853295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:56.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'168","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.540022+0000","last_change":"2024-09-22T08:17:48.364413+0000","last_active":"2024-09-22T09:14:04.540022+0000","last_peered":"2024-09-22T09:14:04.540022+0000","last_clean":"2024-09-22T09:14:04.540022+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:14:04.540022+0000","last_undegraded":"2024-09-22T09:14:04.540022+0000","last_fullsized":"2024-09-22T09:14:04.540022+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:40:16.567547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1112","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778132+0000","last_change":"2024-09-22T08:17:40.310933+0000","last_active":"2024-09-22T09:13:41.778132+0000","last_peered":"2024-09-22T09:13:41.778132+0000","last_clean":"2024-09-22T09:13:41.778132+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:13:41.778132+0000","last_undegraded":"2024-09-22T09:13:41.778132+0000","last_fullsized":"2024-09-22T09:13:41.778132+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:19.043581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'323","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873805+0000","last_change":"2024-09-22T08:17:38.312709+0000","last_active":"2024-09-22T09:16:02.873805+0000","last_peered":"2024-09-22T09:16:02.873805+0000","last_clean":"2024-09-22T09:16:02.873805+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:02.873805+0000","last_undegraded":"2024-09-22T09:16:02.873805+0000","last_fullsized":"2024-09-22T09:16:02.873805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:06.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":611,"num_read_kb":10746,"num_write":1176,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868449+0000","last_change":"2024-09-22T08:17:42.313569+0000","last_active":"2024-09-22T09:13:42.868449+0000","last_peered":"2024-09-22T09:13:42.868449+0000","last_clean":"2024-09-22T09:13:42.868449+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:13:42.868449+0000","last_undegraded":"2024-09-22T09:13:42.868449+0000","last_fullsized":"2024-09-22T09:13:42.868449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:08.034183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'293","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.770715+0000","last_change":"2024-09-22T08:17:44.330003+0000","last_active":"2024-09-22T09:16:01.770715+0000","last_peered":"2024-09-22T09:16:01.770715+0000","last_clean":"2024-09-22T09:16:01.770715+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:01.770715+0000","last_undegraded":"2024-09-22T09:16:01.770715+0000","last_fullsized":"2024-09-22T09:16:01.770715+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:32.877991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52572,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":989,"num_write":383,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.957514+0000","last_change":"2024-09-22T08:17:46.356371+0000","last_active":"2024-09-22T09:11:27.957514+0000","last_peered":"2024-09-22T09:11:27.957514+0000","last_clean":"2024-09-22T09:11:27.957514+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:11:27.957514+0000","last_undegraded":"2024-09-22T09:11:27.957514+0000","last_fullsized":"2024-09-22T09:11:27.957514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:25.542729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'671","reported_seq":2216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.368365+0000","last_change":"2024-09-22T08:17:40.311434+0000","last_active":"2024-09-22T09:14:05.368365+0000","last_peered":"2024-09-22T09:14:05.368365+0000","last_clean":"2024-09-22T09:14:05.368365+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:14:05.368365+0000","last_undegraded":"2024-09-22T09:14:05.368365+0000","last_fullsized":"2024-09-22T09:14:05.368365+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:05.862018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'340","reported_seq":1050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.778195+0000","last_change":"2024-09-22T08:17:38.311519+0000","last_active":"2024-09-22T09:16:01.778195+0000","last_peered":"2024-09-22T09:16:01.778195+0000","last_clean":"2024-09-22T09:16:01.778195+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:01.778195+0000","last_undegraded":"2024-09-22T09:16:01.778195+0000","last_fullsized":"2024-09-22T09:16:01.778195+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:22.084105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11984519,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":750,"num_read_kb":91878,"num_write":1278,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779094+0000","last_change":"2024-09-22T08:17:42.314653+0000","last_active":"2024-09-22T09:13:42.779094+0000","last_peered":"2024-09-22T09:13:42.779094+0000","last_clean":"2024-09-22T09:13:42.779094+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:13:42.779094+0000","last_undegraded":"2024-09-22T09:13:42.779094+0000","last_fullsized":"2024-09-22T09:13:42.779094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:43.222863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.590092+0000","last_change":"2024-09-22T08:17:44.333516+0000","last_active":"2024-09-22T09:16:01.590092+0000","last_peered":"2024-09-22T09:16:01.590092+0000","last_clean":"2024-09-22T09:16:01.590092+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:01.590092+0000","last_undegraded":"2024-09-22T09:16:01.590092+0000","last_fullsized":"2024-09-22T09:16:01.590092+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:11.332157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755387+0000","last_change":"2024-09-22T08:17:46.353828+0000","last_active":"2024-09-22T09:11:26.755387+0000","last_peered":"2024-09-22T09:11:26.755387+0000","last_clean":"2024-09-22T09:11:26.755387+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:11:26.755387+0000","last_undegraded":"2024-09-22T09:11:26.755387+0000","last_fullsized":"2024-09-22T09:11:26.755387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:01.647431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'811","reported_seq":2471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211752+0000","last_change":"2024-09-22T08:17:40.320765+0000","last_active":"2024-09-22T09:14:02.211752+0000","last_peered":"2024-09-22T09:14:02.211752+0000","last_clean":"2024-09-22T09:14:02.211752+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:14:02.211752+0000","last_undegraded":"2024-09-22T09:14:02.211752+0000","last_fullsized":"2024-09-22T09:14:02.211752+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:32.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'284","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775430+0000","last_change":"2024-09-22T08:17:38.312312+0000","last_active":"2024-09-22T09:16:01.775430+0000","last_peered":"2024-09-22T09:16:01.775430+0000","last_clean":"2024-09-22T09:16:01.775430+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:01.775430+0000","last_undegraded":"2024-09-22T09:16:01.775430+0000","last_fullsized":"2024-09-22T09:16:01.775430+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:42.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5285041,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":504,"num_read_kb":11714,"num_write":1020,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.772343+0000","last_change":"2024-09-22T08:17:42.317020+0000","last_active":"2024-09-22T09:13:51.772343+0000","last_peered":"2024-09-22T09:13:51.772343+0000","last_clean":"2024-09-22T09:13:51.772343+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:13:51.772343+0000","last_undegraded":"2024-09-22T09:13:51.772343+0000","last_fullsized":"2024-09-22T09:13:51.772343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:52.212344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'464","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.492893+0000","last_change":"2024-09-22T08:17:44.328451+0000","last_active":"2024-09-22T09:16:01.492893+0000","last_peered":"2024-09-22T09:16:01.492893+0000","last_clean":"2024-09-22T09:16:01.492893+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:01.492893+0000","last_undegraded":"2024-09-22T09:16:01.492893+0000","last_fullsized":"2024-09-22T09:16:01.492893+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:33.770821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":837,"num_read_kb":1865,"num_write":720,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862398+0000","last_change":"2024-09-22T08:17:46.357073+0000","last_active":"2024-09-22T09:12:47.862398+0000","last_peered":"2024-09-22T09:12:47.862398+0000","last_clean":"2024-09-22T09:12:47.862398+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:12:47.862398+0000","last_undegraded":"2024-09-22T09:12:47.862398+0000","last_fullsized":"2024-09-22T09:12:47.862398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:46.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779894+0000","last_change":"2024-09-22T08:17:48.368356+0000","last_active":"2024-09-22T09:13:51.779894+0000","last_peered":"2024-09-22T09:13:51.779894+0000","last_clean":"2024-09-22T09:13:51.779894+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:13:51.779894+0000","last_undegraded":"2024-09-22T09:13:51.779894+0000","last_fullsized":"2024-09-22T09:13:51.779894+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:13.835369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779952+0000","last_change":"2024-09-22T08:17:40.313468+0000","last_active":"2024-09-22T09:13:51.779952+0000","last_peered":"2024-09-22T09:13:51.779952+0000","last_clean":"2024-09-22T09:13:51.779952+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:13:51.779952+0000","last_undegraded":"2024-09-22T09:13:51.779952+0000","last_fullsized":"2024-09-22T09:13:51.779952+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:48.343824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'338","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.723149+0000","last_change":"2024-09-22T08:17:38.309341+0000","last_active":"2024-09-22T09:16:01.723149+0000","last_peered":"2024-09-22T09:16:01.723149+0000","last_clean":"2024-09-22T09:16:01.723149+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:01.723149+0000","last_undegraded":"2024-09-22T09:16:01.723149+0000","last_fullsized":"2024-09-22T09:16:01.723149+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:09.613574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572103,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":728,"num_read_kb":2506,"num_write":1187,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870282+0000","last_change":"2024-09-22T08:17:42.318772+0000","last_active":"2024-09-22T09:13:57.870282+0000","last_peered":"2024-09-22T09:13:57.870282+0000","last_clean":"2024-09-22T09:13:57.870282+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:13:57.870282+0000","last_undegraded":"2024-09-22T09:13:57.870282+0000","last_fullsized":"2024-09-22T09:13:57.870282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.477954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.680306+0000","last_change":"2024-09-22T08:17:44.337248+0000","last_active":"2024-09-22T09:16:01.680306+0000","last_peered":"2024-09-22T09:16:01.680306+0000","last_clean":"2024-09-22T09:16:01.680306+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:01.680306+0000","last_undegraded":"2024-09-22T09:16:01.680306+0000","last_fullsized":"2024-09-22T09:16:01.680306+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:40.861866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.769839+0000","last_change":"2024-09-22T08:17:46.351080+0000","last_active":"2024-09-22T09:12:46.769839+0000","last_peered":"2024-09-22T09:12:46.769839+0000","last_clean":"2024-09-22T09:12:46.769839+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:12:46.769839+0000","last_undegraded":"2024-09-22T09:12:46.769839+0000","last_fullsized":"2024-09-22T09:12:46.769839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:09.613966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.091115+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:11:52.091115+0000","last_peered":"2024-09-22T09:11:52.091115+0000","last_clean":"2024-09-22T09:11:52.091115+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:11:52.091115+0000","last_undegraded":"2024-09-22T09:11:52.091115+0000","last_fullsized":"2024-09-22T09:11:52.091115+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1248","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.366126+0000","last_change":"2024-09-22T08:17:40.308494+0000","last_active":"2024-09-22T09:14:05.366126+0000","last_peered":"2024-09-22T09:14:05.366126+0000","last_clean":"2024-09-22T09:14:05.366126+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:14:05.366126+0000","last_undegraded":"2024-09-22T09:14:05.366126+0000","last_fullsized":"2024-09-22T09:14:05.366126+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:17.224433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'340","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.941276+0000","last_change":"2024-09-22T08:17:38.301468+0000","last_active":"2024-09-22T09:16:02.941276+0000","last_peered":"2024-09-22T09:16:02.941276+0000","last_clean":"2024-09-22T09:16:02.941276+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:02.941276+0000","last_undegraded":"2024-09-22T09:16:02.941276+0000","last_fullsized":"2024-09-22T09:16:02.941276+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:20.950022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098204,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":677,"num_read_kb":11614,"num_write":1094,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861833+0000","last_change":"2024-09-22T08:17:42.319109+0000","last_active":"2024-09-22T09:12:42.861833+0000","last_peered":"2024-09-22T09:12:42.861833+0000","last_clean":"2024-09-22T09:12:42.861833+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:12:42.861833+0000","last_undegraded":"2024-09-22T09:12:42.861833+0000","last_fullsized":"2024-09-22T09:12:42.861833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.764545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'287","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.278368+0000","last_change":"2024-09-22T08:17:44.329668+0000","last_active":"2024-09-22T09:15:24.278368+0000","last_peered":"2024-09-22T09:15:24.278368+0000","last_clean":"2024-09-22T09:15:24.278368+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:15:24.278368+0000","last_undegraded":"2024-09-22T09:15:24.278368+0000","last_fullsized":"2024-09-22T09:15:24.278368+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:13.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1015,"num_write":402,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780532+0000","last_change":"2024-09-22T08:17:46.357031+0000","last_active":"2024-09-22T09:13:56.780532+0000","last_peered":"2024-09-22T09:13:56.780532+0000","last_clean":"2024-09-22T09:13:56.780532+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:13:56.780532+0000","last_undegraded":"2024-09-22T09:13:56.780532+0000","last_fullsized":"2024-09-22T09:13:56.780532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:29.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":640,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285336+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.285336+0000","last_peered":"2024-09-22T09:15:24.285336+0000","last_clean":"2024-09-22T09:15:24.285336+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.285336+0000","last_undegraded":"2024-09-22T09:15:24.285336+0000","last_fullsized":"2024-09-22T09:15:24.285336+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'667","reported_seq":2093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211947+0000","last_change":"2024-09-22T08:17:40.312070+0000","last_active":"2024-09-22T09:14:02.211947+0000","last_peered":"2024-09-22T09:14:02.211947+0000","last_clean":"2024-09-22T09:14:02.211947+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:14:02.211947+0000","last_undegraded":"2024-09-22T09:14:02.211947+0000","last_fullsized":"2024-09-22T09:14:02.211947+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:59.960810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'246","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.720403+0000","last_change":"2024-09-22T08:17:38.300439+0000","last_active":"2024-09-22T09:16:01.720403+0000","last_peered":"2024-09-22T09:16:01.720403+0000","last_clean":"2024-09-22T09:16:01.720403+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:01.720403+0000","last_undegraded":"2024-09-22T09:16:01.720403+0000","last_fullsized":"2024-09-22T09:16:01.720403+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:30.381994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13761680,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":719,"num_read_kb":50024,"num_write":961,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769245+0000","last_change":"2024-09-22T08:17:42.312738+0000","last_active":"2024-09-22T09:12:41.769245+0000","last_peered":"2024-09-22T09:12:41.769245+0000","last_clean":"2024-09-22T09:12:41.769245+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:12:41.769245+0000","last_undegraded":"2024-09-22T09:12:41.769245+0000","last_fullsized":"2024-09-22T09:12:41.769245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:45.180659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'89","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.795335+0000","last_change":"2024-09-22T08:17:44.336865+0000","last_active":"2024-09-22T09:15:22.795335+0000","last_peered":"2024-09-22T09:15:22.795335+0000","last_clean":"2024-09-22T09:15:22.795335+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:15:22.795335+0000","last_undegraded":"2024-09-22T09:15:22.795335+0000","last_fullsized":"2024-09-22T09:15:22.795335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.810068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'779","reported_seq":2589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.372445+0000","last_change":"2024-09-22T08:17:46.350387+0000","last_active":"2024-09-22T09:16:01.372445+0000","last_peered":"2024-09-22T09:16:01.372445+0000","last_clean":"2024-09-22T09:16:01.372445+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:01.372445+0000","last_undegraded":"2024-09-22T09:16:01.372445+0000","last_fullsized":"2024-09-22T09:16:01.372445+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:22.815286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":681,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.932904+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:17.932904+0000","last_peered":"2024-09-22T09:13:17.932904+0000","last_clean":"2024-09-22T09:13:17.932904+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:17.932904+0000","last_undegraded":"2024-09-22T09:13:17.932904+0000","last_fullsized":"2024-09-22T09:13:17.932904+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'505","reported_seq":2211,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.700019+0000","last_change":"2024-09-22T08:17:40.320955+0000","last_active":"2024-09-22T09:13:27.700019+0000","last_peered":"2024-09-22T09:13:27.700019+0000","last_clean":"2024-09-22T09:13:27.700019+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:13:27.700019+0000","last_undegraded":"2024-09-22T09:13:27.700019+0000","last_fullsized":"2024-09-22T09:13:27.700019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:36.450185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'346","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.956252+0000","last_change":"2024-09-22T08:17:38.297556+0000","last_active":"2024-09-22T09:16:02.956252+0000","last_peered":"2024-09-22T09:16:02.956252+0000","last_clean":"2024-09-22T09:16:02.956252+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:02.956252+0000","last_undegraded":"2024-09-22T09:16:02.956252+0000","last_fullsized":"2024-09-22T09:16:02.956252+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:27.230525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6597524,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":617,"num_read_kb":33739,"num_write":1091,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.965759+0000","last_change":"2024-09-22T08:17:42.321443+0000","last_active":"2024-09-22T09:12:42.965759+0000","last_peered":"2024-09-22T09:12:42.965759+0000","last_clean":"2024-09-22T09:12:42.965759+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:12:42.965759+0000","last_undegraded":"2024-09-22T09:12:42.965759+0000","last_fullsized":"2024-09-22T09:12:42.965759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:41.703609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'295","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.991339+0000","last_change":"2024-09-22T08:17:44.334035+0000","last_active":"2024-09-22T09:15:52.991339+0000","last_peered":"2024-09-22T09:15:52.991339+0000","last_clean":"2024-09-22T09:15:52.991339+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:15:52.991339+0000","last_undegraded":"2024-09-22T09:15:52.991339+0000","last_fullsized":"2024-09-22T09:15:52.991339+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:29.638317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56058,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":937,"num_write":386,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.775383+0000","last_change":"2024-09-22T08:17:46.356892+0000","last_active":"2024-09-22T09:13:21.775383+0000","last_peered":"2024-09-22T09:13:21.775383+0000","last_clean":"2024-09-22T09:13:21.775383+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:13:21.775383+0000","last_undegraded":"2024-09-22T09:13:21.775383+0000","last_fullsized":"2024-09-22T09:13:21.775383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:04.578235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'130","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.528881+0000","last_change":"2024-09-22T08:17:48.366280+0000","last_active":"2024-09-22T09:14:02.528881+0000","last_peered":"2024-09-22T09:14:02.528881+0000","last_clean":"2024-09-22T09:14:02.528881+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:14:02.528881+0000","last_undegraded":"2024-09-22T09:14:02.528881+0000","last_fullsized":"2024-09-22T09:14:02.528881+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:56.027995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1506","reported_seq":3219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183120+0000","last_change":"2024-09-22T08:17:40.310983+0000","last_active":"2024-09-22T09:13:23.183120+0000","last_peered":"2024-09-22T09:13:23.183120+0000","last_clean":"2024-09-22T09:13:23.183120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:13:23.183120+0000","last_undegraded":"2024-09-22T09:13:23.183120+0000","last_fullsized":"2024-09-22T09:13:23.183120+0000","mapping_epoch":27,"log_start":"261'1400","ondisk_log_start":"261'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:35.395564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'291","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.683318+0000","last_change":"2024-09-22T08:17:38.304935+0000","last_active":"2024-09-22T09:16:02.683318+0000","last_peered":"2024-09-22T09:16:02.683318+0000","last_clean":"2024-09-22T09:16:02.683318+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:02.683318+0000","last_undegraded":"2024-09-22T09:16:02.683318+0000","last_fullsized":"2024-09-22T09:16:02.683318+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:21.548021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17850038,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":711,"num_read_kb":31336,"num_write":990,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861818+0000","last_change":"2024-09-22T08:17:42.318147+0000","last_active":"2024-09-22T09:12:42.861818+0000","last_peered":"2024-09-22T09:12:42.861818+0000","last_clean":"2024-09-22T09:12:42.861818+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:12:42.861818+0000","last_undegraded":"2024-09-22T09:12:42.861818+0000","last_fullsized":"2024-09-22T09:12:42.861818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:04.949197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'306","reported_seq":869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796614+0000","last_change":"2024-09-22T08:17:44.332720+0000","last_active":"2024-09-22T09:15:46.796614+0000","last_peered":"2024-09-22T09:15:46.796614+0000","last_clean":"2024-09-22T09:15:46.796614+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:15:46.796614+0000","last_undegraded":"2024-09-22T09:15:46.796614+0000","last_fullsized":"2024-09-22T09:15:46.796614+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:17.326913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158139,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1234,"num_write":414,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'507","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.775921+0000","last_change":"2024-09-22T08:17:40.310131+0000","last_active":"2024-09-22T09:13:26.775921+0000","last_peered":"2024-09-22T09:13:26.775921+0000","last_clean":"2024-09-22T09:13:26.775921+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:13:26.775921+0000","last_undegraded":"2024-09-22T09:13:26.775921+0000","last_fullsized":"2024-09-22T09:13:26.775921+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:45.234169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'325","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.793403+0000","last_change":"2024-09-22T08:17:38.307916+0000","last_active":"2024-09-22T09:16:01.793403+0000","last_peered":"2024-09-22T09:16:01.793403+0000","last_clean":"2024-09-22T09:16:01.793403+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:01.793403+0000","last_undegraded":"2024-09-22T09:16:01.793403+0000","last_fullsized":"2024-09-22T09:16:01.793403+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:54.133795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12264533,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":605,"num_read_kb":50425,"num_write":1146,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.969462+0000","last_change":"2024-09-22T08:17:42.318093+0000","last_active":"2024-09-22T09:13:17.969462+0000","last_peered":"2024-09-22T09:13:17.969462+0000","last_clean":"2024-09-22T09:13:17.969462+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:13:17.969462+0000","last_undegraded":"2024-09-22T09:13:17.969462+0000","last_fullsized":"2024-09-22T09:13:17.969462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:12.353580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'244","reported_seq":782,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.276145+0000","last_change":"2024-09-22T08:17:44.332231+0000","last_active":"2024-09-22T09:15:24.276145+0000","last_peered":"2024-09-22T09:15:24.276145+0000","last_clean":"2024-09-22T09:15:24.276145+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:15:24.276145+0000","last_undegraded":"2024-09-22T09:15:24.276145+0000","last_fullsized":"2024-09-22T09:15:24.276145+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:01.307744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53531,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":409,"num_read_kb":891,"num_write":342,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'430","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.212080+0000","last_change":"2024-09-22T08:17:40.314834+0000","last_active":"2024-09-22T09:13:21.212080+0000","last_peered":"2024-09-22T09:13:21.212080+0000","last_clean":"2024-09-22T09:13:21.212080+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:13:21.212080+0000","last_undegraded":"2024-09-22T09:13:21.212080+0000","last_fullsized":"2024-09-22T09:13:21.212080+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:48.705025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'295","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787004+0000","last_change":"2024-09-22T08:17:38.311548+0000","last_active":"2024-09-22T09:16:01.787004+0000","last_peered":"2024-09-22T09:16:01.787004+0000","last_clean":"2024-09-22T09:16:01.787004+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:01.787004+0000","last_undegraded":"2024-09-22T09:16:01.787004+0000","last_fullsized":"2024-09-22T09:16:01.787004+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:46.517280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19469174,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":553,"num_read_kb":43721,"num_write":1074,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.776027+0000","last_change":"2024-09-22T08:17:42.314063+0000","last_active":"2024-09-22T09:13:26.776027+0000","last_peered":"2024-09-22T09:13:26.776027+0000","last_clean":"2024-09-22T09:13:26.776027+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:13:26.776027+0000","last_undegraded":"2024-09-22T09:13:26.776027+0000","last_fullsized":"2024-09-22T09:13:26.776027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:31.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'310","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.279703+0000","last_change":"2024-09-22T08:17:44.339434+0000","last_active":"2024-09-22T09:15:24.279703+0000","last_peered":"2024-09-22T09:15:24.279703+0000","last_clean":"2024-09-22T09:15:24.279703+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:15:24.279703+0000","last_undegraded":"2024-09-22T09:15:24.279703+0000","last_fullsized":"2024-09-22T09:15:24.279703+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:14.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64909,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":1020,"num_write":414,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.770004+0000","last_change":"2024-09-22T08:17:46.354487+0000","last_active":"2024-09-22T09:12:46.770004+0000","last_peered":"2024-09-22T09:12:46.770004+0000","last_clean":"2024-09-22T09:12:46.770004+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:12:46.770004+0000","last_undegraded":"2024-09-22T09:12:46.770004+0000","last_fullsized":"2024-09-22T09:12:46.770004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:13.119686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'139","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.752829+0000","last_change":"2024-09-22T08:17:48.372094+0000","last_active":"2024-09-22T09:15:22.752829+0000","last_peered":"2024-09-22T09:15:22.752829+0000","last_clean":"2024-09-22T09:15:22.752829+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:15:22.752829+0000","last_undegraded":"2024-09-22T09:15:22.752829+0000","last_fullsized":"2024-09-22T09:15:22.752829+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:49.984539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'514","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:08.228455+0000","last_change":"2024-09-22T08:17:40.316760+0000","last_active":"2024-09-22T09:13:08.228455+0000","last_peered":"2024-09-22T09:13:08.228455+0000","last_clean":"2024-09-22T09:13:08.228455+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:13:08.228455+0000","last_undegraded":"2024-09-22T09:13:08.228455+0000","last_fullsized":"2024-09-22T09:13:08.228455+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:42.550645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'297","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.858092+0000","last_change":"2024-09-22T08:17:38.311771+0000","last_active":"2024-09-22T09:16:02.858092+0000","last_peered":"2024-09-22T09:16:02.858092+0000","last_clean":"2024-09-22T09:16:02.858092+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:02.858092+0000","last_undegraded":"2024-09-22T09:16:02.858092+0000","last_fullsized":"2024-09-22T09:16:02.858092+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:56.381847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325064,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":508,"num_read_kb":33852,"num_write":931,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'417","reported_seq":1875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.760299+0000","last_change":"2024-09-22T08:17:40.313063+0000","last_active":"2024-09-22T09:11:51.760299+0000","last_peered":"2024-09-22T09:11:51.760299+0000","last_clean":"2024-09-22T09:11:51.760299+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:11:51.760299+0000","last_undegraded":"2024-09-22T09:11:51.760299+0000","last_fullsized":"2024-09-22T09:11:51.760299+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:41.064638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'272","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.798028+0000","last_change":"2024-09-22T08:17:38.300470+0000","last_active":"2024-09-22T09:16:01.798028+0000","last_peered":"2024-09-22T09:16:01.798028+0000","last_clean":"2024-09-22T09:16:01.798028+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:01.798028+0000","last_undegraded":"2024-09-22T09:16:01.798028+0000","last_fullsized":"2024-09-22T09:16:01.798028+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:42.767130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906219,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":498,"num_read_kb":87969,"num_write":902,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.766032+0000","last_change":"2024-09-22T08:17:40.312973+0000","last_active":"2024-09-22T09:15:22.766032+0000","last_peered":"2024-09-22T09:15:22.766032+0000","last_clean":"2024-09-22T09:15:22.766032+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:15:22.766032+0000","last_undegraded":"2024-09-22T09:15:22.766032+0000","last_fullsized":"2024-09-22T09:15:22.766032+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:28.486740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'381","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.752833+0000","last_change":"2024-09-22T08:17:38.323059+0000","last_active":"2024-09-22T09:16:02.752833+0000","last_peered":"2024-09-22T09:16:02.752833+0000","last_clean":"2024-09-22T09:16:02.752833+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:02.752833+0000","last_undegraded":"2024-09-22T09:16:02.752833+0000","last_fullsized":"2024-09-22T09:16:02.752833+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:37.193303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329113,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":875,"num_read_kb":34718,"num_write":1245,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'748","reported_seq":2556,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.184911+0000","last_change":"2024-09-22T08:17:40.313093+0000","last_active":"2024-09-22T09:14:02.184911+0000","last_peered":"2024-09-22T09:14:02.184911+0000","last_clean":"2024-09-22T09:14:02.184911+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:14:02.184911+0000","last_undegraded":"2024-09-22T09:14:02.184911+0000","last_fullsized":"2024-09-22T09:14:02.184911+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:35.949195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'312","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.776947+0000","last_change":"2024-09-22T08:17:38.310044+0000","last_active":"2024-09-22T09:16:01.776947+0000","last_peered":"2024-09-22T09:16:01.776947+0000","last_clean":"2024-09-22T09:16:01.776947+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:01.776947+0000","last_undegraded":"2024-09-22T09:16:01.776947+0000","last_fullsized":"2024-09-22T09:16:01.776947+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:59.605789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7970484,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":738,"num_read_kb":20346,"num_write":1086,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'494","reported_seq":2066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:05.245095+0000","last_change":"2024-09-22T08:17:40.314007+0000","last_active":"2024-09-22T09:13:05.245095+0000","last_peered":"2024-09-22T09:13:05.245095+0000","last_clean":"2024-09-22T09:13:05.245095+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:13:05.245095+0000","last_undegraded":"2024-09-22T09:13:05.245095+0000","last_fullsized":"2024-09-22T09:13:05.245095+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:30.609929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'279","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754464+0000","last_change":"2024-09-22T08:17:38.312019+0000","last_active":"2024-09-22T09:16:01.754464+0000","last_peered":"2024-09-22T09:16:01.754464+0000","last_clean":"2024-09-22T09:16:01.754464+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:01.754464+0000","last_undegraded":"2024-09-22T09:16:01.754464+0000","last_fullsized":"2024-09-22T09:16:01.754464+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:06.122619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10784758,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":479,"num_read_kb":26435,"num_write":1006,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'717","reported_seq":2220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.362495+0000","last_change":"2024-09-22T08:17:40.312561+0000","last_active":"2024-09-22T09:14:05.362495+0000","last_peered":"2024-09-22T09:14:05.362495+0000","last_clean":"2024-09-22T09:14:05.362495+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:14:05.362495+0000","last_undegraded":"2024-09-22T09:14:05.362495+0000","last_fullsized":"2024-09-22T09:14:05.362495+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:01.994997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'301","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754398+0000","last_change":"2024-09-22T08:17:38.308183+0000","last_active":"2024-09-22T09:16:01.754398+0000","last_peered":"2024-09-22T09:16:01.754398+0000","last_clean":"2024-09-22T09:16:01.754398+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:01.754398+0000","last_undegraded":"2024-09-22T09:16:01.754398+0000","last_fullsized":"2024-09-22T09:16:01.754398+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:02.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":800538,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":725,"num_read_kb":911,"num_write":1010,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'458","reported_seq":2142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.210418+0000","last_change":"2024-09-22T08:17:40.319770+0000","last_active":"2024-09-22T09:14:02.210418+0000","last_peered":"2024-09-22T09:14:02.210418+0000","last_clean":"2024-09-22T09:14:02.210418+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:14:02.210418+0000","last_undegraded":"2024-09-22T09:14:02.210418+0000","last_fullsized":"2024-09-22T09:14:02.210418+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:00.471168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'402","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.861482+0000","last_change":"2024-09-22T08:17:38.312486+0000","last_active":"2024-09-22T09:16:02.861482+0000","last_peered":"2024-09-22T09:16:02.861482+0000","last_clean":"2024-09-22T09:16:02.861482+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:02.861482+0000","last_undegraded":"2024-09-22T09:16:02.861482+0000","last_fullsized":"2024-09-22T09:16:02.861482+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:17.480840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3209675,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":892,"num_read_kb":31161,"num_write":1620,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'488","reported_seq":2208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.973888+0000","last_change":"2024-09-22T08:17:40.316623+0000","last_active":"2024-09-22T09:13:57.973888+0000","last_peered":"2024-09-22T09:13:57.973888+0000","last_clean":"2024-09-22T09:13:57.973888+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:13:57.973888+0000","last_undegraded":"2024-09-22T09:13:57.973888+0000","last_fullsized":"2024-09-22T09:13:57.973888+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:49.821404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'267","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.693440+0000","last_change":"2024-09-22T08:17:38.311100+0000","last_active":"2024-09-22T09:16:01.693440+0000","last_peered":"2024-09-22T09:16:01.693440+0000","last_clean":"2024-09-22T09:16:01.693440+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:01.693440+0000","last_undegraded":"2024-09-22T09:16:01.693440+0000","last_fullsized":"2024-09-22T09:16:01.693440+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:07.379794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4585808,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":610,"num_read_kb":8116,"num_write":953,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'852","reported_seq":2593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.783462+0000","last_change":"2024-09-22T08:17:40.310815+0000","last_active":"2024-09-22T09:15:22.783462+0000","last_peered":"2024-09-22T09:15:22.783462+0000","last_clean":"2024-09-22T09:15:22.783462+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:15:22.783462+0000","last_undegraded":"2024-09-22T09:15:22.783462+0000","last_fullsized":"2024-09-22T09:15:22.783462+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:55.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'371","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.755728+0000","last_change":"2024-09-22T08:17:38.301015+0000","last_active":"2024-09-22T09:16:02.755728+0000","last_peered":"2024-09-22T09:16:02.755728+0000","last_clean":"2024-09-22T09:16:02.755728+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:02.755728+0000","last_undegraded":"2024-09-22T09:16:02.755728+0000","last_fullsized":"2024-09-22T09:16:02.755728+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:50.406073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246701,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":737,"num_read_kb":152949,"num_write":1281,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'439","reported_seq":2069,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975225+0000","last_change":"2024-09-22T08:17:40.307816+0000","last_active":"2024-09-22T09:13:42.975225+0000","last_peered":"2024-09-22T09:13:42.975225+0000","last_clean":"2024-09-22T09:13:42.975225+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:13:42.975225+0000","last_undegraded":"2024-09-22T09:13:42.975225+0000","last_fullsized":"2024-09-22T09:13:42.975225+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:41.447631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'291","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.644338+0000","last_change":"2024-09-22T08:17:38.309543+0000","last_active":"2024-09-22T09:16:01.644338+0000","last_peered":"2024-09-22T09:16:01.644338+0000","last_clean":"2024-09-22T09:16:01.644338+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:01.644338+0000","last_undegraded":"2024-09-22T09:16:01.644338+0000","last_fullsized":"2024-09-22T09:16:01.644338+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.497443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12739950,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":556,"num_read_kb":9331,"num_write":1137,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'926","reported_seq":2504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182211+0000","last_change":"2024-09-22T08:17:40.318830+0000","last_active":"2024-09-22T09:13:23.182211+0000","last_peered":"2024-09-22T09:13:23.182211+0000","last_clean":"2024-09-22T09:13:23.182211+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:13:23.182211+0000","last_undegraded":"2024-09-22T09:13:23.182211+0000","last_fullsized":"2024-09-22T09:13:23.182211+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:03.450267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'325","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873452+0000","last_change":"2024-09-22T08:17:38.301156+0000","last_active":"2024-09-22T09:16:02.873452+0000","last_peered":"2024-09-22T09:16:02.873452+0000","last_clean":"2024-09-22T09:16:02.873452+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:02.873452+0000","last_undegraded":"2024-09-22T09:16:02.873452+0000","last_fullsized":"2024-09-22T09:16:02.873452+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:49.656421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2515,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":573,"num_read_kb":484,"num_write":1160,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'829","reported_seq":2459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.345949+0000","last_change":"2024-09-22T08:17:40.315626+0000","last_active":"2024-09-22T09:14:05.345949+0000","last_peered":"2024-09-22T09:14:05.345949+0000","last_clean":"2024-09-22T09:14:05.345949+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:14:05.345949+0000","last_undegraded":"2024-09-22T09:14:05.345949+0000","last_fullsized":"2024-09-22T09:14:05.345949+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:29.496843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'389","reported_seq":1108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.759785+0000","last_change":"2024-09-22T08:17:38.311224+0000","last_active":"2024-09-22T09:16:01.759785+0000","last_peered":"2024-09-22T09:16:01.759785+0000","last_clean":"2024-09-22T09:16:01.759785+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:01.759785+0000","last_undegraded":"2024-09-22T09:16:01.759785+0000","last_fullsized":"2024-09-22T09:16:01.759785+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:31.603904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162960,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":816,"num_read_kb":67481,"num_write":1471,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.180874+0000","last_change":"2024-09-22T08:17:40.316250+0000","last_active":"2024-09-22T09:14:02.180874+0000","last_peered":"2024-09-22T09:14:02.180874+0000","last_clean":"2024-09-22T09:14:02.180874+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:14:02.180874+0000","last_undegraded":"2024-09-22T09:14:02.180874+0000","last_fullsized":"2024-09-22T09:14:02.180874+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:06.328790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'292","reported_seq":930,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.899511+0000","last_change":"2024-09-22T08:17:38.310546+0000","last_active":"2024-09-22T09:16:02.899511+0000","last_peered":"2024-09-22T09:16:02.899511+0000","last_clean":"2024-09-22T09:16:02.899511+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:02.899511+0000","last_undegraded":"2024-09-22T09:16:02.899511+0000","last_fullsized":"2024-09-22T09:16:02.899511+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:46.666253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573254,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":613,"num_read_kb":4113,"num_write":1012,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1339","reported_seq":3007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.333630+0000","last_change":"2024-09-22T08:17:40.314448+0000","last_active":"2024-09-22T09:14:05.333630+0000","last_peered":"2024-09-22T09:14:05.333630+0000","last_clean":"2024-09-22T09:14:05.333630+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:14:05.333630+0000","last_undegraded":"2024-09-22T09:14:05.333630+0000","last_fullsized":"2024-09-22T09:14:05.333630+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:14.842589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'298","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772749+0000","last_change":"2024-09-22T08:17:38.320511+0000","last_active":"2024-09-22T09:16:02.772749+0000","last_peered":"2024-09-22T09:16:02.772749+0000","last_clean":"2024-09-22T09:16:02.772749+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:02.772749+0000","last_undegraded":"2024-09-22T09:16:02.772749+0000","last_fullsized":"2024-09-22T09:16:02.772749+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:38.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762897,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":545,"num_read_kb":7532,"num_write":940,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'878","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.768832+0000","last_change":"2024-09-22T08:17:40.320847+0000","last_active":"2024-09-22T09:15:22.768832+0000","last_peered":"2024-09-22T09:15:22.768832+0000","last_clean":"2024-09-22T09:15:22.768832+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:15:22.768832+0000","last_undegraded":"2024-09-22T09:15:22.768832+0000","last_fullsized":"2024-09-22T09:15:22.768832+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:28.338764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'259","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787703+0000","last_change":"2024-09-22T08:18:09.819737+0000","last_active":"2024-09-22T09:16:01.787703+0000","last_peered":"2024-09-22T09:16:01.787703+0000","last_clean":"2024-09-22T09:16:01.787703+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:01.787703+0000","last_undegraded":"2024-09-22T09:16:01.787703+0000","last_fullsized":"2024-09-22T09:16:01.787703+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:16.118674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6224262,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":758,"num_read_kb":1204,"num_write":971,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'587","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.755926+0000","last_change":"2024-09-22T08:17:40.320732+0000","last_active":"2024-09-22T09:15:22.755926+0000","last_peered":"2024-09-22T09:15:22.755926+0000","last_clean":"2024-09-22T09:15:22.755926+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:15:22.755926+0000","last_undegraded":"2024-09-22T09:15:22.755926+0000","last_fullsized":"2024-09-22T09:15:22.755926+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:52.124048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'314","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.719464+0000","last_change":"2024-09-22T08:17:38.316645+0000","last_active":"2024-09-22T09:16:02.719464+0000","last_peered":"2024-09-22T09:16:02.719464+0000","last_clean":"2024-09-22T09:16:02.719464+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:02.719464+0000","last_undegraded":"2024-09-22T09:16:02.719464+0000","last_fullsized":"2024-09-22T09:16:02.719464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:19.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15752910,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":570,"num_read_kb":65830,"num_write":1047,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'269","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614638+0000","last_change":"2024-09-22T08:17:38.316368+0000","last_active":"2024-09-22T09:16:02.614638+0000","last_peered":"2024-09-22T09:16:02.614638+0000","last_clean":"2024-09-22T09:16:02.614638+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:02.614638+0000","last_undegraded":"2024-09-22T09:16:02.614638+0000","last_fullsized":"2024-09-22T09:16:02.614638+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:43.345144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2049610,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":460,"num_read_kb":15571,"num_write":1018,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'501","reported_seq":2189,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.789250+0000","last_change":"2024-09-22T08:17:40.321379+0000","last_active":"2024-09-22T09:15:22.789250+0000","last_peered":"2024-09-22T09:15:22.789250+0000","last_clean":"2024-09-22T09:15:22.789250+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:15:22.789250+0000","last_undegraded":"2024-09-22T09:15:22.789250+0000","last_fullsized":"2024-09-22T09:15:22.789250+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:25.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'276","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775408+0000","last_change":"2024-09-22T08:17:38.303976+0000","last_active":"2024-09-22T09:16:01.775408+0000","last_peered":"2024-09-22T09:16:01.775408+0000","last_clean":"2024-09-22T09:16:01.775408+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:01.775408+0000","last_undegraded":"2024-09-22T09:16:01.775408+0000","last_fullsized":"2024-09-22T09:16:01.775408+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:08.002217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243507,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":503,"num_read_kb":80287,"num_write":990,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'500","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.527398+0000","last_change":"2024-09-22T08:17:40.312319+0000","last_active":"2024-09-22T09:14:04.527398+0000","last_peered":"2024-09-22T09:14:04.527398+0000","last_clean":"2024-09-22T09:14:04.527398+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:14:04.527398+0000","last_undegraded":"2024-09-22T09:14:04.527398+0000","last_fullsized":"2024-09-22T09:14:04.527398+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.277593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1830236,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":17796,"num_read_kb":34953,"num_write":15086,"num_write_kb":11910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2351104,"data_stored":1883519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2138,"ondisk_log_size":2138,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":404827577,"num_objects":2945,"num_object_clones":0,"num_object_copies":11780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2945,"num_whiteouts":0,"num_read":41707,"num_read_kb":2189039,"num_write":70646,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":567025664,"data_stored":567025664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59355078,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":128,"num_read_kb":207543,"num_write":146,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129204224,"data_stored":129195916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":38333099,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":130,"num_read_kb":198277,"num_write":152,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87617536,"data_stored":87616171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510148,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403252,"kb_used_data":169336,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93968588,"statfs":{"total":96636764160,"available":96223834112,"internally_reserved":0,"allocated":173400064,"data_stored":171407867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510148,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250256,"kb_used_data":80160,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":94121584,"statfs":{"total":96636764160,"available":96380502016,"internally_reserved":0,"allocated":82083840,"data_stored":80133463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510151,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449516,"kb_used_data":121236,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93922324,"statfs":{"total":96636764160,"available":96176459776,"internally_reserved":0,"allocated":124145664,"data_stored":122116746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510150,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209644,"kb_used_data":106264,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162196,"statfs":{"total":96636764160,"available":96422088704,"internally_reserved":0,"allocated":108814336,"data_stored":106798896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542853,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368196,"kb_used_data":138548,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94003644,"statfs":{"total":96636764160,"available":96259731456,"internally_reserved":0,"allocated":141873152,"data_stored":139882929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542855,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232716,"kb_used_data":121020,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94139124,"statfs":{"total":96636764160,"available":96398462976,"internally_reserved":0,"allocated":123924480,"data_stored":121898980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542854,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412648,"kb_used_data":146840,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93959192,"statfs":{"total":96636764160,"available":96214212608,"internally_reserved":0,"allocated":150364160,"data_stored":148347559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542852,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335544,"kb_used_data":119784,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94036296,"statfs":{"total":96636764160,"available":96293167104,"internally_reserved":0,"allocated":122658816,"data_stored":120657976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60309504,"data_stored":60309504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46854144,"data_stored":46854144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64987136,"data_stored":64987136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":62046208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89866240,"data_stored":89866240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93360128,"data_stored":93360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63471616,"data_stored":63471616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86130688,"data_stored":86130688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":218276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":206788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":139079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":393967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":338184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":295654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":248307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3198976,"data_stored":3196187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16314368,"data_stored":16313003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:04.758 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T09:16:04.758 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:05.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:05.112 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:05.114 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2017,"stamp":"2024-09-22T09:16:03.851499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504953925,"num_objects":3436,"num_object_clones":0,"num_object_copies":12762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3436,"num_whiteouts":0,"num_read":310723,"num_read_kb":2860000,"num_write":162585,"num_write_kb":2483133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14052,"ondisk_log_size":14052,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2661772,"kb_used_data":1003188,"kb_used_omap":12,"kb_used_meta":1658291,"kb_avail":752312948,"statfs":{"total":773094113280,"available":770368458752,"internally_reserved":0,"allocated":1027264512,"data_stored":1011244416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1698090544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-233044184,"num_objects":-1421,"num_object_clones":0,"num_object_copies":-5652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1421,"num_whiteouts":0,"num_read":1594,"num_read_kb":1405,"num_write":1506,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005293"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962647+0000","last_change":"2024-09-22T08:51:48.551836+0000","last_active":"2024-09-22T09:11:47.962647+0000","last_peered":"2024-09-22T09:11:47.962647+0000","last_clean":"2024-09-22T09:11:47.962647+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:11:47.962647+0000","last_undegraded":"2024-09-22T09:11:47.962647+0000","last_fullsized":"2024-09-22T09:11:47.962647+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:38.864929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972822+0000","last_change":"2024-09-22T08:36:17.554312+0000","last_active":"2024-09-22T09:13:47.972822+0000","last_peered":"2024-09-22T09:13:47.972822+0000","last_clean":"2024-09-22T09:13:47.972822+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:13:47.972822+0000","last_undegraded":"2024-09-22T09:13:47.972822+0000","last_fullsized":"2024-09-22T09:13:47.972822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:29.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753733+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:11:16.753733+0000","last_peered":"2024-09-22T09:11:16.753733+0000","last_clean":"2024-09-22T09:11:16.753733+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:11:16.753733+0000","last_undegraded":"2024-09-22T09:11:16.753733+0000","last_fullsized":"2024-09-22T09:11:16.753733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:58.101135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869100+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:13:47.869100+0000","last_peered":"2024-09-22T09:13:47.869100+0000","last_clean":"2024-09-22T09:13:47.869100+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:13:47.869100+0000","last_undegraded":"2024-09-22T09:13:47.869100+0000","last_fullsized":"2024-09-22T09:13:47.869100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:31.386282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756266+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:11:16.756266+0000","last_peered":"2024-09-22T09:11:16.756266+0000","last_clean":"2024-09-22T09:11:16.756266+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:11:16.756266+0000","last_undegraded":"2024-09-22T09:11:16.756266+0000","last_fullsized":"2024-09-22T09:11:16.756266+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:02.785298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779072+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:13:46.779072+0000","last_peered":"2024-09-22T09:13:46.779072+0000","last_clean":"2024-09-22T09:13:46.779072+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:13:46.779072+0000","last_undegraded":"2024-09-22T09:13:46.779072+0000","last_fullsized":"2024-09-22T09:13:46.779072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784216+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:14:21.784216+0000","last_peered":"2024-09-22T09:14:21.784216+0000","last_clean":"2024-09-22T09:14:21.784216+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:14:21.784216+0000","last_undegraded":"2024-09-22T09:14:21.784216+0000","last_fullsized":"2024-09-22T09:14:21.784216+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:55.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749175+0000","last_change":"2024-09-22T08:33:33.306873+0000","last_active":"2024-09-22T09:11:06.749175+0000","last_peered":"2024-09-22T09:11:06.749175+0000","last_clean":"2024-09-22T09:11:06.749175+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:11:06.749175+0000","last_undegraded":"2024-09-22T09:11:06.749175+0000","last_fullsized":"2024-09-22T09:11:06.749175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:59.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756178+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:11:16.756178+0000","last_peered":"2024-09-22T09:11:16.756178+0000","last_clean":"2024-09-22T09:11:16.756178+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:11:16.756178+0000","last_undegraded":"2024-09-22T09:11:16.756178+0000","last_fullsized":"2024-09-22T09:11:16.756178+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:26.766525+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:12:26.766525+0000","last_peered":"2024-09-22T09:12:26.766525+0000","last_clean":"2024-09-22T09:12:26.766525+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:12:26.766525+0000","last_undegraded":"2024-09-22T09:12:26.766525+0000","last_fullsized":"2024-09-22T09:12:26.766525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:26.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988838+0000","last_change":"2024-09-22T08:36:14.521822+0000","last_active":"2024-09-22T09:15:52.988838+0000","last_peered":"2024-09-22T09:15:52.988838+0000","last_clean":"2024-09-22T09:15:52.988838+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:15:52.988838+0000","last_undegraded":"2024-09-22T09:15:52.988838+0000","last_fullsized":"2024-09-22T09:15:52.988838+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:17.576650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:06.749152+0000","last_change":"2024-09-22T08:33:33.299815+0000","last_active":"2024-09-22T09:11:06.749152+0000","last_peered":"2024-09-22T09:11:06.749152+0000","last_clean":"2024-09-22T09:11:06.749152+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:11:06.749152+0000","last_undegraded":"2024-09-22T09:11:06.749152+0000","last_fullsized":"2024-09-22T09:11:06.749152+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:22.030960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968129+0000","last_change":"2024-09-22T08:36:17.552221+0000","last_active":"2024-09-22T09:12:37.968129+0000","last_peered":"2024-09-22T09:12:37.968129+0000","last_clean":"2024-09-22T09:12:37.968129+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:12:37.968129+0000","last_undegraded":"2024-09-22T09:12:37.968129+0000","last_fullsized":"2024-09-22T09:12:37.968129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:55.269454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:24.487629+0000","last_change":"2024-09-22T08:33:33.312653+0000","last_active":"2024-09-22T09:11:24.487629+0000","last_peered":"2024-09-22T09:11:24.487629+0000","last_clean":"2024-09-22T09:11:24.487629+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:11:24.487629+0000","last_undegraded":"2024-09-22T09:11:24.487629+0000","last_fullsized":"2024-09-22T09:11:24.487629+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:50.718606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772098+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:12:42.772098+0000","last_peered":"2024-09-22T09:12:42.772098+0000","last_clean":"2024-09-22T09:12:42.772098+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:12:42.772098+0000","last_undegraded":"2024-09-22T09:12:42.772098+0000","last_fullsized":"2024-09-22T09:12:42.772098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.867290+0000","last_change":"2024-09-22T08:33:33.314397+0000","last_active":"2024-09-22T09:13:32.867290+0000","last_peered":"2024-09-22T09:13:32.867290+0000","last_clean":"2024-09-22T09:13:32.867290+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:13:32.867290+0000","last_undegraded":"2024-09-22T09:13:32.867290+0000","last_fullsized":"2024-09-22T09:13:32.867290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:17.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855481+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:11:47.855481+0000","last_peered":"2024-09-22T09:11:47.855481+0000","last_clean":"2024-09-22T09:11:47.855481+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:11:47.855481+0000","last_undegraded":"2024-09-22T09:11:47.855481+0000","last_fullsized":"2024-09-22T09:11:47.855481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:01.855409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:17.852152+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:11:17.852152+0000","last_peered":"2024-09-22T09:11:17.852152+0000","last_clean":"2024-09-22T09:11:17.852152+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:11:17.852152+0000","last_undegraded":"2024-09-22T09:11:17.852152+0000","last_fullsized":"2024-09-22T09:11:17.852152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:15.681167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975679+0000","last_change":"2024-09-22T08:36:14.522217+0000","last_active":"2024-09-22T09:13:47.975679+0000","last_peered":"2024-09-22T09:13:47.975679+0000","last_clean":"2024-09-22T09:13:47.975679+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:13:47.975679+0000","last_undegraded":"2024-09-22T09:13:47.975679+0000","last_fullsized":"2024-09-22T09:13:47.975679+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.786028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":747,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765671+0000","last_change":"2024-09-22T08:33:33.306368+0000","last_active":"2024-09-22T09:12:21.765671+0000","last_peered":"2024-09-22T09:12:21.765671+0000","last_clean":"2024-09-22T09:12:21.765671+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:12:21.765671+0000","last_undegraded":"2024-09-22T09:12:21.765671+0000","last_fullsized":"2024-09-22T09:12:21.765671+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:28.062281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962738+0000","last_change":"2024-09-22T08:51:48.550754+0000","last_active":"2024-09-22T09:11:47.962738+0000","last_peered":"2024-09-22T09:11:47.962738+0000","last_clean":"2024-09-22T09:11:47.962738+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:11:47.962738+0000","last_undegraded":"2024-09-22T09:11:47.962738+0000","last_fullsized":"2024-09-22T09:11:47.962738+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:50.620910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753658+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:11:16.753658+0000","last_peered":"2024-09-22T09:11:16.753658+0000","last_clean":"2024-09-22T09:11:16.753658+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:11:16.753658+0000","last_undegraded":"2024-09-22T09:11:16.753658+0000","last_fullsized":"2024-09-22T09:11:16.753658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:47.415229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.750304+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:11:16.750304+0000","last_peered":"2024-09-22T09:11:16.750304+0000","last_clean":"2024-09-22T09:11:16.750304+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:11:16.750304+0000","last_undegraded":"2024-09-22T09:11:16.750304+0000","last_fullsized":"2024-09-22T09:11:16.750304+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:00.150168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758893+0000","last_change":"2024-09-22T08:33:33.303993+0000","last_active":"2024-09-22T09:12:16.758893+0000","last_peered":"2024-09-22T09:12:16.758893+0000","last_clean":"2024-09-22T09:12:16.758893+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:12:16.758893+0000","last_undegraded":"2024-09-22T09:12:16.758893+0000","last_fullsized":"2024-09-22T09:12:16.758893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:11.898143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767414+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:12:31.767414+0000","last_peered":"2024-09-22T09:12:31.767414+0000","last_clean":"2024-09-22T09:12:31.767414+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:12:31.767414+0000","last_undegraded":"2024-09-22T09:12:31.767414+0000","last_fullsized":"2024-09-22T09:12:31.767414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.762920+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:11:27.762920+0000","last_peered":"2024-09-22T09:11:27.762920+0000","last_clean":"2024-09-22T09:11:27.762920+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:11:27.762920+0000","last_undegraded":"2024-09-22T09:11:27.762920+0000","last_fullsized":"2024-09-22T09:11:27.762920+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.757596+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:11:26.757596+0000","last_peered":"2024-09-22T09:11:26.757596+0000","last_clean":"2024-09-22T09:11:26.757596+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:11:26.757596+0000","last_undegraded":"2024-09-22T09:11:26.757596+0000","last_fullsized":"2024-09-22T09:11:26.757596+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984645+0000","last_change":"2024-09-22T08:36:14.525609+0000","last_active":"2024-09-22T09:14:57.984645+0000","last_peered":"2024-09-22T09:14:57.984645+0000","last_clean":"2024-09-22T09:14:57.984645+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:14:57.984645+0000","last_undegraded":"2024-09-22T09:14:57.984645+0000","last_fullsized":"2024-09-22T09:14:57.984645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:03.854966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764817+0000","last_change":"2024-09-22T08:33:33.315166+0000","last_active":"2024-09-22T09:12:16.764817+0000","last_peered":"2024-09-22T09:12:16.764817+0000","last_clean":"2024-09-22T09:12:16.764817+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:12:16.764817+0000","last_undegraded":"2024-09-22T09:12:16.764817+0000","last_fullsized":"2024-09-22T09:12:16.764817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:41.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'7","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767497+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:12:31.767497+0000","last_peered":"2024-09-22T09:12:31.767497+0000","last_clean":"2024-09-22T09:12:31.767497+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:12:31.767497+0000","last_undegraded":"2024-09-22T09:12:31.767497+0000","last_fullsized":"2024-09-22T09:12:31.767497+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:31.767456+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:12:31.767456+0000","last_peered":"2024-09-22T09:12:31.767456+0000","last_clean":"2024-09-22T09:12:31.767456+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:12:31.767456+0000","last_undegraded":"2024-09-22T09:12:31.767456+0000","last_fullsized":"2024-09-22T09:12:31.767456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764788+0000","last_change":"2024-09-22T08:33:33.311367+0000","last_active":"2024-09-22T09:12:16.764788+0000","last_peered":"2024-09-22T09:12:16.764788+0000","last_clean":"2024-09-22T09:12:16.764788+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:12:16.764788+0000","last_undegraded":"2024-09-22T09:12:16.764788+0000","last_fullsized":"2024-09-22T09:12:16.764788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:18.812618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.969239+0000","last_change":"2024-09-22T08:51:48.549838+0000","last_active":"2024-09-22T09:12:47.969239+0000","last_peered":"2024-09-22T09:12:47.969239+0000","last_clean":"2024-09-22T09:12:47.969239+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:12:47.969239+0000","last_undegraded":"2024-09-22T09:12:47.969239+0000","last_fullsized":"2024-09-22T09:12:47.969239+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:35.628007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967550+0000","last_change":"2024-09-22T08:36:17.553737+0000","last_active":"2024-09-22T09:12:32.967550+0000","last_peered":"2024-09-22T09:12:32.967550+0000","last_clean":"2024-09-22T09:12:32.967550+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:12:32.967550+0000","last_undegraded":"2024-09-22T09:12:32.967550+0000","last_fullsized":"2024-09-22T09:12:32.967550+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:21.818626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971629+0000","last_change":"2024-09-22T08:36:14.520890+0000","last_active":"2024-09-22T09:13:37.971629+0000","last_peered":"2024-09-22T09:13:37.971629+0000","last_clean":"2024-09-22T09:13:37.971629+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:13:37.971629+0000","last_undegraded":"2024-09-22T09:13:37.971629+0000","last_fullsized":"2024-09-22T09:13:37.971629+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.858239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774744+0000","last_change":"2024-09-22T08:33:33.310293+0000","last_active":"2024-09-22T09:13:16.774744+0000","last_peered":"2024-09-22T09:13:16.774744+0000","last_clean":"2024-09-22T09:13:16.774744+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:13:16.774744+0000","last_undegraded":"2024-09-22T09:13:16.774744+0000","last_fullsized":"2024-09-22T09:13:16.774744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:23:54.882161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971695+0000","last_change":"2024-09-22T08:36:14.521414+0000","last_active":"2024-09-22T09:13:37.971695+0000","last_peered":"2024-09-22T09:13:37.971695+0000","last_clean":"2024-09-22T09:13:37.971695+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:13:37.971695+0000","last_undegraded":"2024-09-22T09:13:37.971695+0000","last_fullsized":"2024-09-22T09:13:37.971695+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:00.328885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865324+0000","last_change":"2024-09-22T08:33:33.305009+0000","last_active":"2024-09-22T09:13:12.865324+0000","last_peered":"2024-09-22T09:13:12.865324+0000","last_clean":"2024-09-22T09:13:12.865324+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:13:12.865324+0000","last_undegraded":"2024-09-22T09:13:12.865324+0000","last_fullsized":"2024-09-22T09:13:12.865324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:50.446180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'9","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778511+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:13:37.778511+0000","last_peered":"2024-09-22T09:13:37.778511+0000","last_clean":"2024-09-22T09:13:37.778511+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:13:37.778511+0000","last_undegraded":"2024-09-22T09:13:37.778511+0000","last_fullsized":"2024-09-22T09:13:37.778511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":26642,"num_write":14,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971719+0000","last_change":"2024-09-22T08:36:14.515004+0000","last_active":"2024-09-22T09:13:37.971719+0000","last_peered":"2024-09-22T09:13:37.971719+0000","last_clean":"2024-09-22T09:13:37.971719+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:13:37.971719+0000","last_undegraded":"2024-09-22T09:13:37.971719+0000","last_fullsized":"2024-09-22T09:13:37.971719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:07.837552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774690+0000","last_change":"2024-09-22T08:33:33.306842+0000","last_active":"2024-09-22T09:13:16.774690+0000","last_peered":"2024-09-22T09:13:16.774690+0000","last_clean":"2024-09-22T09:13:16.774690+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:13:16.774690+0000","last_undegraded":"2024-09-22T09:13:16.774690+0000","last_fullsized":"2024-09-22T09:13:16.774690+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:03.666172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764814+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:12:16.764814+0000","last_peered":"2024-09-22T09:12:16.764814+0000","last_clean":"2024-09-22T09:12:16.764814+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:12:16.764814+0000","last_undegraded":"2024-09-22T09:12:16.764814+0000","last_fullsized":"2024-09-22T09:12:16.764814+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:23.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.858820+0000","last_change":"2024-09-22T08:36:14.524581+0000","last_active":"2024-09-22T09:12:17.858820+0000","last_peered":"2024-09-22T09:12:17.858820+0000","last_clean":"2024-09-22T09:12:17.858820+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:12:17.858820+0000","last_undegraded":"2024-09-22T09:12:17.858820+0000","last_fullsized":"2024-09-22T09:12:17.858820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:13.432035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":173,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761303+0000","last_change":"2024-09-22T08:33:33.310511+0000","last_active":"2024-09-22T09:11:56.761303+0000","last_peered":"2024-09-22T09:11:56.761303+0000","last_clean":"2024-09-22T09:11:56.761303+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:11:56.761303+0000","last_undegraded":"2024-09-22T09:11:56.761303+0000","last_fullsized":"2024-09-22T09:11:56.761303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:28.111555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.961550+0000","last_change":"2024-09-22T08:51:48.553902+0000","last_active":"2024-09-22T09:12:02.961550+0000","last_peered":"2024-09-22T09:12:02.961550+0000","last_clean":"2024-09-22T09:12:02.961550+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:12:02.961550+0000","last_undegraded":"2024-09-22T09:12:02.961550+0000","last_fullsized":"2024-09-22T09:12:02.961550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:09.641607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764757+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:12:16.764757+0000","last_peered":"2024-09-22T09:12:16.764757+0000","last_clean":"2024-09-22T09:12:16.764757+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:12:16.764757+0000","last_undegraded":"2024-09-22T09:12:16.764757+0000","last_fullsized":"2024-09-22T09:12:16.764757+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:59.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758982+0000","last_change":"2024-09-22T08:36:14.523378+0000","last_active":"2024-09-22T09:12:16.758982+0000","last_peered":"2024-09-22T09:12:16.758982+0000","last_clean":"2024-09-22T09:12:16.758982+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:12:16.758982+0000","last_undegraded":"2024-09-22T09:12:16.758982+0000","last_fullsized":"2024-09-22T09:12:16.758982+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:26.533836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.765353+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:11:47.765353+0000","last_peered":"2024-09-22T09:11:47.765353+0000","last_clean":"2024-09-22T09:11:47.765353+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:11:47.765353+0000","last_undegraded":"2024-09-22T09:11:47.765353+0000","last_fullsized":"2024-09-22T09:11:47.765353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764842+0000","last_change":"2024-09-22T08:36:14.521867+0000","last_active":"2024-09-22T09:12:16.764842+0000","last_peered":"2024-09-22T09:12:16.764842+0000","last_clean":"2024-09-22T09:12:16.764842+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:12:16.764842+0000","last_undegraded":"2024-09-22T09:12:16.764842+0000","last_fullsized":"2024-09-22T09:12:16.764842+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:20.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.959622+0000","last_change":"2024-09-22T08:33:33.301439+0000","last_active":"2024-09-22T09:11:47.959622+0000","last_peered":"2024-09-22T09:11:47.959622+0000","last_clean":"2024-09-22T09:11:47.959622+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:11:47.959622+0000","last_undegraded":"2024-09-22T09:11:47.959622+0000","last_fullsized":"2024-09-22T09:11:47.959622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:31.274044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970549+0000","last_change":"2024-09-22T08:51:48.546986+0000","last_active":"2024-09-22T09:13:27.970549+0000","last_peered":"2024-09-22T09:13:27.970549+0000","last_clean":"2024-09-22T09:13:27.970549+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:13:27.970549+0000","last_undegraded":"2024-09-22T09:13:27.970549+0000","last_fullsized":"2024-09-22T09:13:27.970549+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:43.329879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764990+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:12:16.764990+0000","last_peered":"2024-09-22T09:12:16.764990+0000","last_clean":"2024-09-22T09:12:16.764990+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:12:16.764990+0000","last_undegraded":"2024-09-22T09:12:16.764990+0000","last_fullsized":"2024-09-22T09:12:16.764990+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:47.077061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'1","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765840+0000","last_change":"2024-09-22T08:36:14.525673+0000","last_active":"2024-09-22T09:12:21.765840+0000","last_peered":"2024-09-22T09:12:21.765840+0000","last_clean":"2024-09-22T09:12:21.765840+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:12:21.765840+0000","last_undegraded":"2024-09-22T09:12:21.765840+0000","last_fullsized":"2024-09-22T09:12:21.765840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:00.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755324+0000","last_change":"2024-09-22T08:33:33.306105+0000","last_active":"2024-09-22T09:11:51.755324+0000","last_peered":"2024-09-22T09:11:51.755324+0000","last_clean":"2024-09-22T09:11:51.755324+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:11:51.755324+0000","last_undegraded":"2024-09-22T09:11:51.755324+0000","last_fullsized":"2024-09-22T09:11:51.755324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:07.948747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763478+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:12:06.763478+0000","last_peered":"2024-09-22T09:12:06.763478+0000","last_clean":"2024-09-22T09:12:06.763478+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:12:06.763478+0000","last_undegraded":"2024-09-22T09:12:06.763478+0000","last_fullsized":"2024-09-22T09:12:06.763478+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:21.783822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:06.773227+0000","last_change":"2024-09-22T08:36:14.521057+0000","last_active":"2024-09-22T09:13:06.773227+0000","last_peered":"2024-09-22T09:13:06.773227+0000","last_clean":"2024-09-22T09:13:06.773227+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:13:06.773227+0000","last_undegraded":"2024-09-22T09:13:06.773227+0000","last_fullsized":"2024-09-22T09:13:06.773227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:07.181295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755291+0000","last_change":"2024-09-22T08:33:33.312566+0000","last_active":"2024-09-22T09:11:51.755291+0000","last_peered":"2024-09-22T09:11:51.755291+0000","last_clean":"2024-09-22T09:11:51.755291+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:11:51.755291+0000","last_undegraded":"2024-09-22T09:11:51.755291+0000","last_fullsized":"2024-09-22T09:11:51.755291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:30.177728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.857195+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:12:02.857195+0000","last_peered":"2024-09-22T09:12:02.857195+0000","last_clean":"2024-09-22T09:12:02.857195+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:12:02.857195+0000","last_undegraded":"2024-09-22T09:12:02.857195+0000","last_fullsized":"2024-09-22T09:12:02.857195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:52.143784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.879891+0000","last_change":"2024-09-22T08:36:17.553257+0000","last_active":"2024-09-22T09:15:17.879891+0000","last_peered":"2024-09-22T09:15:17.879891+0000","last_clean":"2024-09-22T09:15:17.879891+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:15:17.879891+0000","last_undegraded":"2024-09-22T09:15:17.879891+0000","last_fullsized":"2024-09-22T09:15:17.879891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:25.217554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'4","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:16.794622+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:15:16.794622+0000","last_peered":"2024-09-22T09:15:16.794622+0000","last_clean":"2024-09-22T09:15:16.794622+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:15:16.794622+0000","last_undegraded":"2024-09-22T09:15:16.794622+0000","last_fullsized":"2024-09-22T09:15:16.794622+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":249,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.861248+0000","last_change":"2024-09-22T08:33:33.306309+0000","last_active":"2024-09-22T09:12:37.861248+0000","last_peered":"2024-09-22T09:12:37.861248+0000","last_clean":"2024-09-22T09:12:37.861248+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:12:37.861248+0000","last_undegraded":"2024-09-22T09:12:37.861248+0000","last_fullsized":"2024-09-22T09:12:37.861248+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:31.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.964588+0000","last_change":"2024-09-22T08:51:48.549815+0000","last_active":"2024-09-22T09:12:02.964588+0000","last_peered":"2024-09-22T09:12:02.964588+0000","last_clean":"2024-09-22T09:12:02.964588+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:12:02.964588+0000","last_undegraded":"2024-09-22T09:12:02.964588+0000","last_fullsized":"2024-09-22T09:12:02.964588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:49.616078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'1","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758941+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:12:16.758941+0000","last_peered":"2024-09-22T09:12:16.758941+0000","last_clean":"2024-09-22T09:12:16.758941+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:12:16.758941+0000","last_undegraded":"2024-09-22T09:12:16.758941+0000","last_fullsized":"2024-09-22T09:12:16.758941+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:15.190970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.773987+0000","last_change":"2024-09-22T08:36:14.520376+0000","last_active":"2024-09-22T09:13:11.773987+0000","last_peered":"2024-09-22T09:13:11.773987+0000","last_clean":"2024-09-22T09:13:11.773987+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:13:11.773987+0000","last_undegraded":"2024-09-22T09:13:11.773987+0000","last_fullsized":"2024-09-22T09:13:11.773987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:17.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763014+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:12:06.763014+0000","last_peered":"2024-09-22T09:12:06.763014+0000","last_clean":"2024-09-22T09:12:06.763014+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:12:06.763014+0000","last_undegraded":"2024-09-22T09:12:06.763014+0000","last_fullsized":"2024-09-22T09:12:06.763014+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:35.688578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.972039+0000","last_change":"2024-09-22T08:36:17.557866+0000","last_active":"2024-09-22T09:13:12.972039+0000","last_peered":"2024-09-22T09:13:12.972039+0000","last_clean":"2024-09-22T09:13:12.972039+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:13:12.972039+0000","last_undegraded":"2024-09-22T09:13:12.972039+0000","last_fullsized":"2024-09-22T09:13:12.972039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:04.889097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.769069+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:12:17.769069+0000","last_peered":"2024-09-22T09:12:17.769069+0000","last_clean":"2024-09-22T09:12:17.769069+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:12:17.769069+0000","last_undegraded":"2024-09-22T09:12:17.769069+0000","last_fullsized":"2024-09-22T09:12:17.769069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:44.749004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967432+0000","last_change":"2024-09-22T08:33:33.314991+0000","last_active":"2024-09-22T09:12:32.967432+0000","last_peered":"2024-09-22T09:12:32.967432+0000","last_clean":"2024-09-22T09:12:32.967432+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:12:32.967432+0000","last_undegraded":"2024-09-22T09:12:32.967432+0000","last_fullsized":"2024-09-22T09:12:32.967432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:02.113618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968162+0000","last_change":"2024-09-22T08:51:48.548861+0000","last_active":"2024-09-22T09:12:37.968162+0000","last_peered":"2024-09-22T09:12:37.968162+0000","last_clean":"2024-09-22T09:12:37.968162+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:12:37.968162+0000","last_undegraded":"2024-09-22T09:12:37.968162+0000","last_fullsized":"2024-09-22T09:12:37.968162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:02.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780808+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:13:56.780808+0000","last_peered":"2024-09-22T09:13:56.780808+0000","last_clean":"2024-09-22T09:13:56.780808+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:13:56.780808+0000","last_undegraded":"2024-09-22T09:13:56.780808+0000","last_fullsized":"2024-09-22T09:13:56.780808+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4198,"num_write":11,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779807+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:13:47.779807+0000","last_peered":"2024-09-22T09:13:47.779807+0000","last_clean":"2024-09-22T09:13:47.779807+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:13:47.779807+0000","last_undegraded":"2024-09-22T09:13:47.779807+0000","last_fullsized":"2024-09-22T09:13:47.779807+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768411+0000","last_change":"2024-09-22T08:33:33.310686+0000","last_active":"2024-09-22T09:12:36.768411+0000","last_peered":"2024-09-22T09:12:36.768411+0000","last_clean":"2024-09-22T09:12:36.768411+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:12:36.768411+0000","last_undegraded":"2024-09-22T09:12:36.768411+0000","last_fullsized":"2024-09-22T09:12:36.768411+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:29.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968185+0000","last_change":"2024-09-22T08:51:48.549659+0000","last_active":"2024-09-22T09:12:37.968185+0000","last_peered":"2024-09-22T09:12:37.968185+0000","last_clean":"2024-09-22T09:12:37.968185+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:12:37.968185+0000","last_undegraded":"2024-09-22T09:12:37.968185+0000","last_fullsized":"2024-09-22T09:12:37.968185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:29.047532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778994+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:13:46.778994+0000","last_peered":"2024-09-22T09:13:46.778994+0000","last_clean":"2024-09-22T09:13:46.778994+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:13:46.778994+0000","last_undegraded":"2024-09-22T09:13:46.778994+0000","last_fullsized":"2024-09-22T09:13:46.778994+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.986858+0000","last_change":"2024-09-22T08:36:17.549474+0000","last_active":"2024-09-22T09:15:17.986858+0000","last_peered":"2024-09-22T09:15:17.986858+0000","last_clean":"2024-09-22T09:15:17.986858+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:15:17.986858+0000","last_undegraded":"2024-09-22T09:15:17.986858+0000","last_fullsized":"2024-09-22T09:15:17.986858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:12.074363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864628+0000","last_change":"2024-09-22T08:36:14.518932+0000","last_active":"2024-09-22T09:13:07.864628+0000","last_peered":"2024-09-22T09:13:07.864628+0000","last_clean":"2024-09-22T09:13:07.864628+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:13:07.864628+0000","last_undegraded":"2024-09-22T09:13:07.864628+0000","last_fullsized":"2024-09-22T09:13:07.864628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:01.574307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865380+0000","last_change":"2024-09-22T08:33:33.310910+0000","last_active":"2024-09-22T09:13:12.865380+0000","last_peered":"2024-09-22T09:13:12.865380+0000","last_clean":"2024-09-22T09:13:12.865380+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:13:12.865380+0000","last_undegraded":"2024-09-22T09:13:12.865380+0000","last_fullsized":"2024-09-22T09:13:12.865380+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:27.693570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.771403+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:12:37.771403+0000","last_peered":"2024-09-22T09:12:37.771403+0000","last_clean":"2024-09-22T09:12:37.771403+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:12:37.771403+0000","last_undegraded":"2024-09-22T09:12:37.771403+0000","last_fullsized":"2024-09-22T09:12:37.771403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:27.349451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774038+0000","last_change":"2024-09-22T08:33:33.309150+0000","last_active":"2024-09-22T09:13:11.774038+0000","last_peered":"2024-09-22T09:13:11.774038+0000","last_clean":"2024-09-22T09:13:11.774038+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:13:11.774038+0000","last_undegraded":"2024-09-22T09:13:11.774038+0000","last_fullsized":"2024-09-22T09:13:11.774038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:51.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778939+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:13:46.778939+0000","last_peered":"2024-09-22T09:13:46.778939+0000","last_clean":"2024-09-22T09:13:46.778939+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:13:46.778939+0000","last_undegraded":"2024-09-22T09:13:46.778939+0000","last_fullsized":"2024-09-22T09:13:46.778939+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12859,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:22.859462+0000","last_change":"2024-09-22T08:36:14.518063+0000","last_active":"2024-09-22T09:12:22.859462+0000","last_peered":"2024-09-22T09:12:22.859462+0000","last_clean":"2024-09-22T09:12:22.859462+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:12:22.859462+0000","last_undegraded":"2024-09-22T09:12:22.859462+0000","last_fullsized":"2024-09-22T09:12:22.859462+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:02.424058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":100,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864566+0000","last_change":"2024-09-22T08:33:33.305508+0000","last_active":"2024-09-22T09:13:07.864566+0000","last_peered":"2024-09-22T09:13:07.864566+0000","last_clean":"2024-09-22T09:13:07.864566+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:13:07.864566+0000","last_undegraded":"2024-09-22T09:13:07.864566+0000","last_fullsized":"2024-09-22T09:13:07.864566+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:55.651981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:27.770184+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:12:27.770184+0000","last_peered":"2024-09-22T09:12:27.770184+0000","last_clean":"2024-09-22T09:12:27.770184+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:12:27.770184+0000","last_undegraded":"2024-09-22T09:12:27.770184+0000","last_fullsized":"2024-09-22T09:12:27.770184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:49.958042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885192+0000","last_change":"2024-09-22T08:36:17.553023+0000","last_active":"2024-09-22T09:15:52.885192+0000","last_peered":"2024-09-22T09:15:52.885192+0000","last_clean":"2024-09-22T09:15:52.885192+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:15:52.885192+0000","last_undegraded":"2024-09-22T09:15:52.885192+0000","last_fullsized":"2024-09-22T09:15:52.885192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:05.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.791107+0000","last_change":"2024-09-22T08:36:14.520504+0000","last_active":"2024-09-22T09:15:51.791107+0000","last_peered":"2024-09-22T09:15:51.791107+0000","last_clean":"2024-09-22T09:15:51.791107+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:15:51.791107+0000","last_undegraded":"2024-09-22T09:15:51.791107+0000","last_fullsized":"2024-09-22T09:15:51.791107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:49.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869033+0000","last_change":"2024-09-22T08:36:17.548527+0000","last_active":"2024-09-22T09:13:47.869033+0000","last_peered":"2024-09-22T09:13:47.869033+0000","last_clean":"2024-09-22T09:13:47.869033+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:13:47.869033+0000","last_undegraded":"2024-09-22T09:13:47.869033+0000","last_fullsized":"2024-09-22T09:13:47.869033+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'4","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988796+0000","last_change":"2024-09-22T08:36:14.524325+0000","last_active":"2024-09-22T09:15:52.988796+0000","last_peered":"2024-09-22T09:15:52.988796+0000","last_clean":"2024-09-22T09:15:52.988796+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:15:52.988796+0000","last_undegraded":"2024-09-22T09:15:52.988796+0000","last_fullsized":"2024-09-22T09:15:52.988796+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:58.736096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":87,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.867830+0000","last_change":"2024-09-22T08:33:33.312962+0000","last_active":"2024-09-22T09:13:37.867830+0000","last_peered":"2024-09-22T09:13:37.867830+0000","last_clean":"2024-09-22T09:13:37.867830+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:13:37.867830+0000","last_undegraded":"2024-09-22T09:13:37.867830+0000","last_fullsized":"2024-09-22T09:13:37.867830+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:56.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'369","reported_seq":1234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.838797+0000","last_change":"2024-09-22T08:17:38.305362+0000","last_active":"2024-09-22T09:16:02.838797+0000","last_peered":"2024-09-22T09:16:02.838797+0000","last_clean":"2024-09-22T09:16:02.838797+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:02.838797+0000","last_undegraded":"2024-09-22T09:16:02.838797+0000","last_fullsized":"2024-09-22T09:16:02.838797+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.646132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397343,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1411,"num_read_kb":46472,"num_write":1250,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'948","reported_seq":2499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.763135+0000","last_change":"2024-09-22T08:17:40.306852+0000","last_active":"2024-09-22T09:15:22.763135+0000","last_peered":"2024-09-22T09:15:22.763135+0000","last_clean":"2024-09-22T09:15:22.763135+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:15:22.763135+0000","last_undegraded":"2024-09-22T09:15:22.763135+0000","last_fullsized":"2024-09-22T09:15:22.763135+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.143716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'348","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787102+0000","last_change":"2024-09-22T08:17:38.302453+0000","last_active":"2024-09-22T09:16:01.787102+0000","last_peered":"2024-09-22T09:16:01.787102+0000","last_clean":"2024-09-22T09:16:01.787102+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:01.787102+0000","last_undegraded":"2024-09-22T09:16:01.787102+0000","last_fullsized":"2024-09-22T09:16:01.787102+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:03.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604406,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":736,"num_read_kb":45729,"num_write":1233,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'767","reported_seq":2185,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.179987+0000","last_change":"2024-09-22T08:17:40.311740+0000","last_active":"2024-09-22T09:13:23.179987+0000","last_peered":"2024-09-22T09:13:23.179987+0000","last_clean":"2024-09-22T09:13:23.179987+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:13:23.179987+0000","last_undegraded":"2024-09-22T09:13:23.179987+0000","last_fullsized":"2024-09-22T09:13:23.179987+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:16.749258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'295","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775013+0000","last_change":"2024-09-22T08:17:38.306945+0000","last_active":"2024-09-22T09:16:01.775013+0000","last_peered":"2024-09-22T09:16:01.775013+0000","last_clean":"2024-09-22T09:16:01.775013+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:01.775013+0000","last_undegraded":"2024-09-22T09:16:01.775013+0000","last_fullsized":"2024-09-22T09:16:01.775013+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:40.207206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16401162,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":571,"num_read_kb":64383,"num_write":1175,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'498","reported_seq":2127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.699167+0000","last_change":"2024-09-22T08:17:40.314265+0000","last_active":"2024-09-22T09:13:27.699167+0000","last_peered":"2024-09-22T09:13:27.699167+0000","last_clean":"2024-09-22T09:13:27.699167+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:13:27.699167+0000","last_undegraded":"2024-09-22T09:13:27.699167+0000","last_fullsized":"2024-09-22T09:13:27.699167+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:49.672590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'359","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.816128+0000","last_change":"2024-09-22T08:17:38.311385+0000","last_active":"2024-09-22T09:16:02.816128+0000","last_peered":"2024-09-22T09:16:02.816128+0000","last_clean":"2024-09-22T09:16:02.816128+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:02.816128+0000","last_undegraded":"2024-09-22T09:16:02.816128+0000","last_fullsized":"2024-09-22T09:16:02.816128+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:11.719876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28432,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":644,"num_read_kb":100162,"num_write":1116,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'533","reported_seq":2199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697914+0000","last_change":"2024-09-22T08:17:40.315145+0000","last_active":"2024-09-22T09:13:27.697914+0000","last_peered":"2024-09-22T09:13:27.697914+0000","last_clean":"2024-09-22T09:13:27.697914+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:13:27.697914+0000","last_undegraded":"2024-09-22T09:13:27.697914+0000","last_fullsized":"2024-09-22T09:13:27.697914+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:28.617427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'342","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.934222+0000","last_change":"2024-09-22T08:17:38.308912+0000","last_active":"2024-09-22T09:16:02.934222+0000","last_peered":"2024-09-22T09:16:02.934222+0000","last_clean":"2024-09-22T09:16:02.934222+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:02.934222+0000","last_undegraded":"2024-09-22T09:16:02.934222+0000","last_fullsized":"2024-09-22T09:16:02.934222+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:46.873844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360779,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":579,"num_read_kb":101850,"num_write":1113,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'577","reported_seq":2234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975730+0000","last_change":"2024-09-22T08:17:40.308097+0000","last_active":"2024-09-22T09:13:47.975730+0000","last_peered":"2024-09-22T09:13:47.975730+0000","last_clean":"2024-09-22T09:13:47.975730+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:13:47.975730+0000","last_undegraded":"2024-09-22T09:13:47.975730+0000","last_fullsized":"2024-09-22T09:13:47.975730+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:54.012368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'367","reported_seq":998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.770862+0000","last_change":"2024-09-22T08:17:38.311987+0000","last_active":"2024-09-22T09:16:02.770862+0000","last_peered":"2024-09-22T09:16:02.770862+0000","last_clean":"2024-09-22T09:16:02.770862+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:02.770862+0000","last_undegraded":"2024-09-22T09:16:02.770862+0000","last_fullsized":"2024-09-22T09:16:02.770862+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:46.139865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6805173,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":548,"num_read_kb":20767,"num_write":1074,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1040","reported_seq":2582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976885+0000","last_change":"2024-09-22T08:17:40.316422+0000","last_active":"2024-09-22T09:13:57.976885+0000","last_peered":"2024-09-22T09:13:57.976885+0000","last_clean":"2024-09-22T09:13:57.976885+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:13:57.976885+0000","last_undegraded":"2024-09-22T09:13:57.976885+0000","last_fullsized":"2024-09-22T09:13:57.976885+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:15.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'302","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.977069+0000","last_change":"2024-09-22T08:17:38.301886+0000","last_active":"2024-09-22T09:16:02.977069+0000","last_peered":"2024-09-22T09:16:02.977069+0000","last_clean":"2024-09-22T09:16:02.977069+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:02.977069+0000","last_undegraded":"2024-09-22T09:16:02.977069+0000","last_fullsized":"2024-09-22T09:16:02.977069+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:54.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2287637,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":505,"num_read_kb":9374,"num_write":1002,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'494","reported_seq":2087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870234+0000","last_change":"2024-09-22T08:17:40.318246+0000","last_active":"2024-09-22T09:13:57.870234+0000","last_peered":"2024-09-22T09:13:57.870234+0000","last_clean":"2024-09-22T09:13:57.870234+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:13:57.870234+0000","last_undegraded":"2024-09-22T09:13:57.870234+0000","last_fullsized":"2024-09-22T09:13:57.870234+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:12.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'326","reported_seq":980,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.799765+0000","last_change":"2024-09-22T08:17:38.312231+0000","last_active":"2024-09-22T09:16:01.799765+0000","last_peered":"2024-09-22T09:16:01.799765+0000","last_clean":"2024-09-22T09:16:01.799765+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:01.799765+0000","last_undegraded":"2024-09-22T09:16:01.799765+0000","last_fullsized":"2024-09-22T09:16:01.799765+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:59.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6934894,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":722,"num_read_kb":32987,"num_write":1042,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'638","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780919+0000","last_change":"2024-09-22T08:17:40.319835+0000","last_active":"2024-09-22T09:13:56.780919+0000","last_peered":"2024-09-22T09:13:56.780919+0000","last_clean":"2024-09-22T09:13:56.780919+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:13:56.780919+0000","last_undegraded":"2024-09-22T09:13:56.780919+0000","last_fullsized":"2024-09-22T09:13:56.780919+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:37.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'401","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779056+0000","last_change":"2024-09-22T08:17:40.313776+0000","last_active":"2024-09-22T09:13:42.779056+0000","last_peered":"2024-09-22T09:13:42.779056+0000","last_clean":"2024-09-22T09:13:42.779056+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:13:42.779056+0000","last_undegraded":"2024-09-22T09:13:42.779056+0000","last_fullsized":"2024-09-22T09:13:42.779056+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:46.265677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'272","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614964+0000","last_change":"2024-09-22T08:17:38.304440+0000","last_active":"2024-09-22T09:16:02.614964+0000","last_peered":"2024-09-22T09:16:02.614964+0000","last_clean":"2024-09-22T09:16:02.614964+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:02.614964+0000","last_undegraded":"2024-09-22T09:16:02.614964+0000","last_fullsized":"2024-09-22T09:16:02.614964+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:45.235908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193566,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":483,"num_read_kb":25983,"num_write":949,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'393","reported_seq":1922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975164+0000","last_change":"2024-09-22T08:17:40.314476+0000","last_active":"2024-09-22T09:13:42.975164+0000","last_peered":"2024-09-22T09:13:42.975164+0000","last_clean":"2024-09-22T09:13:42.975164+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:13:42.975164+0000","last_undegraded":"2024-09-22T09:13:42.975164+0000","last_fullsized":"2024-09-22T09:13:42.975164+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.686734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'266","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.811806+0000","last_change":"2024-09-22T08:17:38.308456+0000","last_active":"2024-09-22T09:16:02.811806+0000","last_peered":"2024-09-22T09:16:02.811806+0000","last_clean":"2024-09-22T09:16:02.811806+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:02.811806+0000","last_undegraded":"2024-09-22T09:16:02.811806+0000","last_fullsized":"2024-09-22T09:16:02.811806+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:02.910243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":430,"num_read_kb":1407,"num_write":855,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'765","reported_seq":2317,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:50.660940+0000","last_change":"2024-09-22T08:17:40.313996+0000","last_active":"2024-09-22T09:12:50.660940+0000","last_peered":"2024-09-22T09:12:50.660940+0000","last_clean":"2024-09-22T09:12:50.660940+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:12:50.660940+0000","last_undegraded":"2024-09-22T09:12:50.660940+0000","last_fullsized":"2024-09-22T09:12:50.660940+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:04.332313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'281","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.951343+0000","last_change":"2024-09-22T08:17:38.304225+0000","last_active":"2024-09-22T09:16:02.951343+0000","last_peered":"2024-09-22T09:16:02.951343+0000","last_clean":"2024-09-22T09:16:02.951343+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:02.951343+0000","last_undegraded":"2024-09-22T09:16:02.951343+0000","last_fullsized":"2024-09-22T09:16:02.951343+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:43.663554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1418,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":518,"num_read_kb":31210,"num_write":1004,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'769","reported_seq":2398,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211151+0000","last_change":"2024-09-22T08:17:40.320968+0000","last_active":"2024-09-22T09:14:02.211151+0000","last_peered":"2024-09-22T09:14:02.211151+0000","last_clean":"2024-09-22T09:14:02.211151+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:14:02.211151+0000","last_undegraded":"2024-09-22T09:14:02.211151+0000","last_fullsized":"2024-09-22T09:14:02.211151+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:57.247773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'294","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.790767+0000","last_change":"2024-09-22T08:17:38.303600+0000","last_active":"2024-09-22T09:16:02.790767+0000","last_peered":"2024-09-22T09:16:02.790767+0000","last_clean":"2024-09-22T09:16:02.790767+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:02.790767+0000","last_undegraded":"2024-09-22T09:16:02.790767+0000","last_fullsized":"2024-09-22T09:16:02.790767+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:42.862930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14241026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":607,"num_read_kb":14446,"num_write":1044,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.948204+0000","last_change":"2024-09-22T08:17:40.319549+0000","last_active":"2024-09-22T09:13:17.948204+0000","last_peered":"2024-09-22T09:13:17.948204+0000","last_clean":"2024-09-22T09:13:17.948204+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:13:17.948204+0000","last_undegraded":"2024-09-22T09:13:17.948204+0000","last_fullsized":"2024-09-22T09:13:17.948204+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:41.286507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'303","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.736928+0000","last_change":"2024-09-22T08:17:38.301639+0000","last_active":"2024-09-22T09:16:01.736928+0000","last_peered":"2024-09-22T09:16:01.736928+0000","last_clean":"2024-09-22T09:16:01.736928+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:01.736928+0000","last_undegraded":"2024-09-22T09:16:01.736928+0000","last_fullsized":"2024-09-22T09:16:01.736928+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:54.649295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429564,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":570,"num_read_kb":1523,"num_write":1167,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'580","reported_seq":2198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211841+0000","last_change":"2024-09-22T08:17:40.306201+0000","last_active":"2024-09-22T09:14:02.211841+0000","last_peered":"2024-09-22T09:14:02.211841+0000","last_clean":"2024-09-22T09:14:02.211841+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:14:02.211841+0000","last_undegraded":"2024-09-22T09:14:02.211841+0000","last_fullsized":"2024-09-22T09:14:02.211841+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:03.473601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'355","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.677487+0000","last_change":"2024-09-22T08:17:38.297373+0000","last_active":"2024-09-22T09:16:01.677487+0000","last_peered":"2024-09-22T09:16:01.677487+0000","last_clean":"2024-09-22T09:16:01.677487+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:01.677487+0000","last_undegraded":"2024-09-22T09:16:01.677487+0000","last_fullsized":"2024-09-22T09:16:01.677487+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662425,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":718,"num_read_kb":14779,"num_write":1428,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'120","reported_seq":619,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.502060+0000","last_change":"2024-09-22T08:17:48.369855+0000","last_active":"2024-09-22T09:14:05.502060+0000","last_peered":"2024-09-22T09:14:05.502060+0000","last_clean":"2024-09-22T09:14:05.502060+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:14:05.502060+0000","last_undegraded":"2024-09-22T09:14:05.502060+0000","last_fullsized":"2024-09-22T09:14:05.502060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:27.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'994","reported_seq":2719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.506452+0000","last_change":"2024-09-22T08:17:40.316511+0000","last_active":"2024-09-22T09:14:04.506452+0000","last_peered":"2024-09-22T09:14:04.506452+0000","last_clean":"2024-09-22T09:14:04.506452+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:14:04.506452+0000","last_undegraded":"2024-09-22T09:14:04.506452+0000","last_fullsized":"2024-09-22T09:14:04.506452+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:57.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'335","reported_seq":1205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.764861+0000","last_change":"2024-09-22T08:17:38.318139+0000","last_active":"2024-09-22T09:16:02.764861+0000","last_peered":"2024-09-22T09:16:02.764861+0000","last_clean":"2024-09-22T09:16:02.764861+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:02.764861+0000","last_undegraded":"2024-09-22T09:16:02.764861+0000","last_fullsized":"2024-09-22T09:16:02.764861+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.934545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15176067,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1309,"num_read_kb":67744,"num_write":1219,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776258+0000","last_change":"2024-09-22T08:17:42.313314+0000","last_active":"2024-09-22T09:13:17.776258+0000","last_peered":"2024-09-22T09:13:17.776258+0000","last_clean":"2024-09-22T09:13:17.776258+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:13:17.776258+0000","last_undegraded":"2024-09-22T09:13:17.776258+0000","last_fullsized":"2024-09-22T09:13:17.776258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:45.452672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796727+0000","last_change":"2024-09-22T08:17:44.340362+0000","last_active":"2024-09-22T09:15:46.796727+0000","last_peered":"2024-09-22T09:15:46.796727+0000","last_clean":"2024-09-22T09:15:46.796727+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:15:46.796727+0000","last_undegraded":"2024-09-22T09:15:46.796727+0000","last_fullsized":"2024-09-22T09:15:46.796727+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:24.766194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60213,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1054,"num_write":440,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970119+0000","last_change":"2024-09-22T08:17:46.352688+0000","last_active":"2024-09-22T09:13:22.970119+0000","last_peered":"2024-09-22T09:13:22.970119+0000","last_clean":"2024-09-22T09:13:22.970119+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:13:22.970119+0000","last_undegraded":"2024-09-22T09:13:22.970119+0000","last_fullsized":"2024-09-22T09:13:22.970119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:01.237921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'146","reported_seq":654,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970576+0000","last_change":"2024-09-22T08:17:48.369501+0000","last_active":"2024-09-22T09:13:27.970576+0000","last_peered":"2024-09-22T09:13:27.970576+0000","last_clean":"2024-09-22T09:13:27.970576+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:13:27.970576+0000","last_undegraded":"2024-09-22T09:13:27.970576+0000","last_fullsized":"2024-09-22T09:13:27.970576+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:58.815501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'462","reported_seq":2124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.524494+0000","last_change":"2024-09-22T08:17:40.313282+0000","last_active":"2024-09-22T09:14:04.524494+0000","last_peered":"2024-09-22T09:14:04.524494+0000","last_clean":"2024-09-22T09:14:04.524494+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:14:04.524494+0000","last_undegraded":"2024-09-22T09:14:04.524494+0000","last_fullsized":"2024-09-22T09:14:04.524494+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:54.516463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'321","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.780547+0000","last_change":"2024-09-22T08:17:38.302469+0000","last_active":"2024-09-22T09:16:01.780547+0000","last_peered":"2024-09-22T09:16:01.780547+0000","last_clean":"2024-09-22T09:16:01.780547+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:01.780547+0000","last_undegraded":"2024-09-22T09:16:01.780547+0000","last_fullsized":"2024-09-22T09:16:01.780547+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:18.971472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595357,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":594,"num_read_kb":11781,"num_write":1181,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:31.756444+0000","last_change":"2024-09-22T08:17:42.314952+0000","last_active":"2024-09-22T09:11:31.756444+0000","last_peered":"2024-09-22T09:11:31.756444+0000","last_clean":"2024-09-22T09:11:31.756444+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:11:31.756444+0000","last_undegraded":"2024-09-22T09:11:31.756444+0000","last_fullsized":"2024-09-22T09:11:31.756444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:23.058529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'89","reported_seq":606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970112+0000","last_change":"2024-09-22T08:17:44.340327+0000","last_active":"2024-09-22T09:13:22.970112+0000","last_peered":"2024-09-22T09:13:22.970112+0000","last_clean":"2024-09-22T09:13:22.970112+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:13:22.970112+0000","last_undegraded":"2024-09-22T09:13:22.970112+0000","last_fullsized":"2024-09-22T09:13:22.970112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:28.780689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970081+0000","last_change":"2024-09-22T08:17:46.352088+0000","last_active":"2024-09-22T09:13:22.970081+0000","last_peered":"2024-09-22T09:13:22.970081+0000","last_clean":"2024-09-22T09:13:22.970081+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:13:22.970081+0000","last_undegraded":"2024-09-22T09:13:22.970081+0000","last_fullsized":"2024-09-22T09:13:22.970081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:40.458281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763658+0000","last_change":"2024-09-22T08:17:48.367697+0000","last_active":"2024-09-22T09:12:51.763658+0000","last_peered":"2024-09-22T09:12:51.763658+0000","last_clean":"2024-09-22T09:12:51.763658+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:12:51.763658+0000","last_undegraded":"2024-09-22T09:12:51.763658+0000","last_fullsized":"2024-09-22T09:12:51.763658+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:46.458711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183074+0000","last_change":"2024-09-22T08:17:40.317797+0000","last_active":"2024-09-22T09:13:23.183074+0000","last_peered":"2024-09-22T09:13:23.183074+0000","last_clean":"2024-09-22T09:13:23.183074+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:13:23.183074+0000","last_undegraded":"2024-09-22T09:13:23.183074+0000","last_fullsized":"2024-09-22T09:13:23.183074+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:17.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'293","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.676943+0000","last_change":"2024-09-22T08:17:38.317777+0000","last_active":"2024-09-22T09:16:02.676943+0000","last_peered":"2024-09-22T09:16:02.676943+0000","last_clean":"2024-09-22T09:16:02.676943+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:02.676943+0000","last_undegraded":"2024-09-22T09:16:02.676943+0000","last_fullsized":"2024-09-22T09:16:02.676943+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:33.381885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98644,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":649,"num_read_kb":483,"num_write":993,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774779+0000","last_change":"2024-09-22T08:17:42.318734+0000","last_active":"2024-09-22T09:13:16.774779+0000","last_peered":"2024-09-22T09:13:16.774779+0000","last_clean":"2024-09-22T09:13:16.774779+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:13:16.774779+0000","last_undegraded":"2024-09-22T09:13:16.774779+0000","last_fullsized":"2024-09-22T09:13:16.774779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:10.711823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'121","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:58.536458+0000","last_change":"2024-09-22T08:17:44.337759+0000","last_active":"2024-09-22T09:12:58.536458+0000","last_peered":"2024-09-22T09:12:58.536458+0000","last_clean":"2024-09-22T09:12:58.536458+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:12:58.536458+0000","last_undegraded":"2024-09-22T09:12:58.536458+0000","last_fullsized":"2024-09-22T09:12:58.536458+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:58.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'792","reported_seq":2565,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.374834+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:01.374834+0000","last_peered":"2024-09-22T09:16:01.374834+0000","last_clean":"2024-09-22T09:16:01.374834+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:01.374834+0000","last_undegraded":"2024-09-22T09:16:01.374834+0000","last_fullsized":"2024-09-22T09:16:01.374834+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'183","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.560177+0000","last_change":"2024-09-22T08:17:48.368241+0000","last_active":"2024-09-22T09:14:05.560177+0000","last_peered":"2024-09-22T09:14:05.560177+0000","last_clean":"2024-09-22T09:14:05.560177+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:14:05.560177+0000","last_undegraded":"2024-09-22T09:14:05.560177+0000","last_fullsized":"2024-09-22T09:14:05.560177+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:32.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'506","reported_seq":2212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.784964+0000","last_change":"2024-09-22T08:17:40.319980+0000","last_active":"2024-09-22T09:15:22.784964+0000","last_peered":"2024-09-22T09:15:22.784964+0000","last_clean":"2024-09-22T09:15:22.784964+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:15:22.784964+0000","last_undegraded":"2024-09-22T09:15:22.784964+0000","last_fullsized":"2024-09-22T09:15:22.784964+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:14.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'381","reported_seq":1042,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.924631+0000","last_change":"2024-09-22T08:17:38.306751+0000","last_active":"2024-09-22T09:16:02.924631+0000","last_peered":"2024-09-22T09:16:02.924631+0000","last_clean":"2024-09-22T09:16:02.924631+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:02.924631+0000","last_undegraded":"2024-09-22T09:16:02.924631+0000","last_fullsized":"2024-09-22T09:16:02.924631+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:13.757965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146123,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":756,"num_read_kb":8421,"num_write":1241,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776278+0000","last_change":"2024-09-22T08:17:42.314890+0000","last_active":"2024-09-22T09:13:17.776278+0000","last_peered":"2024-09-22T09:13:17.776278+0000","last_clean":"2024-09-22T09:13:17.776278+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:13:17.776278+0000","last_undegraded":"2024-09-22T09:13:17.776278+0000","last_fullsized":"2024-09-22T09:13:17.776278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:40.671613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'295","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.928483+0000","last_change":"2024-09-22T08:17:44.330975+0000","last_active":"2024-09-22T09:16:01.928483+0000","last_peered":"2024-09-22T09:16:01.928483+0000","last_clean":"2024-09-22T09:16:01.928483+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:01.928483+0000","last_undegraded":"2024-09-22T09:16:01.928483+0000","last_fullsized":"2024-09-22T09:16:01.928483+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:22.872610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'810","reported_seq":2602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.380266+0000","last_change":"2024-09-22T08:17:46.354277+0000","last_active":"2024-09-22T09:16:01.380266+0000","last_peered":"2024-09-22T09:16:01.380266+0000","last_clean":"2024-09-22T09:16:01.380266+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:01.380266+0000","last_undegraded":"2024-09-22T09:16:01.380266+0000","last_fullsized":"2024-09-22T09:16:01.380266+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:59.717058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'410","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.341702+0000","last_change":"2024-09-22T08:17:40.312740+0000","last_active":"2024-09-22T09:14:05.341702+0000","last_peered":"2024-09-22T09:14:05.341702+0000","last_clean":"2024-09-22T09:14:05.341702+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:14:05.341702+0000","last_undegraded":"2024-09-22T09:14:05.341702+0000","last_fullsized":"2024-09-22T09:14:05.341702+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:15.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'332","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.916653+0000","last_change":"2024-09-22T08:17:38.307222+0000","last_active":"2024-09-22T09:16:02.916653+0000","last_peered":"2024-09-22T09:16:02.916653+0000","last_clean":"2024-09-22T09:16:02.916653+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:02.916653+0000","last_undegraded":"2024-09-22T09:16:02.916653+0000","last_fullsized":"2024-09-22T09:16:02.916653+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:22.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378682,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":559,"num_read_kb":44787,"num_write":1058,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.960306+0000","last_change":"2024-09-22T08:17:42.318610+0000","last_active":"2024-09-22T09:11:52.960306+0000","last_peered":"2024-09-22T09:11:52.960306+0000","last_clean":"2024-09-22T09:11:52.960306+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:11:52.960306+0000","last_undegraded":"2024-09-22T09:11:52.960306+0000","last_fullsized":"2024-09-22T09:11:52.960306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:36.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'352","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.741049+0000","last_change":"2024-09-22T08:17:44.337617+0000","last_active":"2024-09-22T09:16:02.741049+0000","last_peered":"2024-09-22T09:16:02.741049+0000","last_clean":"2024-09-22T09:16:02.741049+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:02.741049+0000","last_undegraded":"2024-09-22T09:16:02.741049+0000","last_fullsized":"2024-09-22T09:16:02.741049+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:07.429989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:46.754597+0000","last_change":"2024-09-22T08:17:46.352678+0000","last_active":"2024-09-22T09:11:46.754597+0000","last_peered":"2024-09-22T09:11:46.754597+0000","last_clean":"2024-09-22T09:11:46.754597+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:11:46.754597+0000","last_undegraded":"2024-09-22T09:11:46.754597+0000","last_fullsized":"2024-09-22T09:11:46.754597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:08.207868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'558","reported_seq":1369,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285872+0000","last_change":"2024-09-22T08:17:48.368074+0000","last_active":"2024-09-22T09:15:24.285872+0000","last_peered":"2024-09-22T09:15:24.285872+0000","last_clean":"2024-09-22T09:15:24.285872+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:15:24.285872+0000","last_undegraded":"2024-09-22T09:15:24.285872+0000","last_fullsized":"2024-09-22T09:15:24.285872+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:24.210621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'822","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.758885+0000","last_change":"2024-09-22T08:17:40.313132+0000","last_active":"2024-09-22T09:15:22.758885+0000","last_peered":"2024-09-22T09:15:22.758885+0000","last_clean":"2024-09-22T09:15:22.758885+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:15:22.758885+0000","last_undegraded":"2024-09-22T09:15:22.758885+0000","last_fullsized":"2024-09-22T09:15:22.758885+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:10.031355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'327","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.863693+0000","last_change":"2024-09-22T08:17:38.312208+0000","last_active":"2024-09-22T09:16:02.863693+0000","last_peered":"2024-09-22T09:16:02.863693+0000","last_clean":"2024-09-22T09:16:02.863693+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:02.863693+0000","last_undegraded":"2024-09-22T09:16:02.863693+0000","last_fullsized":"2024-09-22T09:16:02.863693+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.033575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486432,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":504,"num_read_kb":29046,"num_write":992,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755206+0000","last_change":"2024-09-22T08:17:42.312266+0000","last_active":"2024-09-22T09:11:51.755206+0000","last_peered":"2024-09-22T09:11:51.755206+0000","last_clean":"2024-09-22T09:11:51.755206+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:11:51.755206+0000","last_undegraded":"2024-09-22T09:11:51.755206+0000","last_fullsized":"2024-09-22T09:11:51.755206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:19.806611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'269","reported_seq":833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.246095+0000","last_change":"2024-09-22T08:17:44.341288+0000","last_active":"2024-09-22T09:15:24.246095+0000","last_peered":"2024-09-22T09:15:24.246095+0000","last_clean":"2024-09-22T09:15:24.246095+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:15:24.246095+0000","last_undegraded":"2024-09-22T09:15:24.246095+0000","last_fullsized":"2024-09-22T09:15:24.246095+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:38.968334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":889,"num_write":346,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763009+0000","last_change":"2024-09-22T08:17:46.353515+0000","last_active":"2024-09-22T09:12:06.763009+0000","last_peered":"2024-09-22T09:12:06.763009+0000","last_clean":"2024-09-22T09:12:06.763009+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:12:06.763009+0000","last_undegraded":"2024-09-22T09:12:06.763009+0000","last_fullsized":"2024-09-22T09:12:06.763009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:30.603577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2489","reported_seq":4315,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589709+0000","last_change":"2024-09-22T08:17:48.370106+0000","last_active":"2024-09-22T09:15:22.589709+0000","last_peered":"2024-09-22T09:15:22.589709+0000","last_clean":"2024-09-22T09:15:22.589709+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:15:22.589709+0000","last_undegraded":"2024-09-22T09:15:22.589709+0000","last_fullsized":"2024-09-22T09:15:22.589709+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:41.845103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'408","reported_seq":1953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.767224+0000","last_change":"2024-09-22T08:17:40.318012+0000","last_active":"2024-09-22T09:15:22.767224+0000","last_peered":"2024-09-22T09:15:22.767224+0000","last_clean":"2024-09-22T09:15:22.767224+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:15:22.767224+0000","last_undegraded":"2024-09-22T09:15:22.767224+0000","last_fullsized":"2024-09-22T09:15:22.767224+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:28.192120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772629+0000","last_change":"2024-09-22T08:17:38.308728+0000","last_active":"2024-09-22T09:16:02.772629+0000","last_peered":"2024-09-22T09:16:02.772629+0000","last_clean":"2024-09-22T09:16:02.772629+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:02.772629+0000","last_undegraded":"2024-09-22T09:16:02.772629+0000","last_fullsized":"2024-09-22T09:16:02.772629+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:31.777927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1806494,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":599,"num_read_kb":70122,"num_write":1065,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759708+0000","last_change":"2024-09-22T08:17:42.319503+0000","last_active":"2024-09-22T09:11:41.759708+0000","last_peered":"2024-09-22T09:11:41.759708+0000","last_clean":"2024-09-22T09:11:41.759708+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:11:41.759708+0000","last_undegraded":"2024-09-22T09:11:41.759708+0000","last_fullsized":"2024-09-22T09:11:41.759708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:21.120703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'352","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.275090+0000","last_change":"2024-09-22T08:17:44.337630+0000","last_active":"2024-09-22T09:15:24.275090+0000","last_peered":"2024-09-22T09:15:24.275090+0000","last_clean":"2024-09-22T09:15:24.275090+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:15:24.275090+0000","last_undegraded":"2024-09-22T09:15:24.275090+0000","last_fullsized":"2024-09-22T09:15:24.275090+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.579003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":565,"num_read_kb":1137,"num_write":474,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'810","reported_seq":4728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.381488+0000","last_change":"2024-09-22T08:17:46.356930+0000","last_active":"2024-09-22T09:16:01.381488+0000","last_peered":"2024-09-22T09:16:01.381488+0000","last_clean":"2024-09-22T09:16:01.381488+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:01.381488+0000","last_undegraded":"2024-09-22T09:16:01.381488+0000","last_fullsized":"2024-09-22T09:16:01.381488+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:21.225230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'120","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589147+0000","last_change":"2024-09-22T08:17:48.366165+0000","last_active":"2024-09-22T09:15:22.589147+0000","last_peered":"2024-09-22T09:15:22.589147+0000","last_clean":"2024-09-22T09:15:22.589147+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:15:22.589147+0000","last_undegraded":"2024-09-22T09:15:22.589147+0000","last_fullsized":"2024-09-22T09:15:22.589147+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:59.292369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1207","reported_seq":2863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:14.961172+0000","last_change":"2024-09-22T08:17:40.315829+0000","last_active":"2024-09-22T09:12:14.961172+0000","last_peered":"2024-09-22T09:12:14.961172+0000","last_clean":"2024-09-22T09:12:14.961172+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:12:14.961172+0000","last_undegraded":"2024-09-22T09:12:14.961172+0000","last_fullsized":"2024-09-22T09:12:14.961172+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:53.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'330","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.990520+0000","last_change":"2024-09-22T08:17:38.300056+0000","last_active":"2024-09-22T09:16:02.990520+0000","last_peered":"2024-09-22T09:16:02.990520+0000","last_clean":"2024-09-22T09:16:02.990520+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:02.990520+0000","last_undegraded":"2024-09-22T09:16:02.990520+0000","last_fullsized":"2024-09-22T09:16:02.990520+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:30.384600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":614742,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":623,"num_read_kb":2439,"num_write":1133,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.756824+0000","last_change":"2024-09-22T08:17:42.313688+0000","last_active":"2024-09-22T09:12:01.756824+0000","last_peered":"2024-09-22T09:12:01.756824+0000","last_clean":"2024-09-22T09:12:01.756824+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:12:01.756824+0000","last_undegraded":"2024-09-22T09:12:01.756824+0000","last_fullsized":"2024-09-22T09:12:01.756824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:46.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'492","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.391572+0000","last_change":"2024-09-22T08:17:44.340359+0000","last_active":"2024-09-22T09:16:01.391572+0000","last_peered":"2024-09-22T09:16:01.391572+0000","last_clean":"2024-09-22T09:16:01.391572+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:01.391572+0000","last_undegraded":"2024-09-22T09:16:01.391572+0000","last_fullsized":"2024-09-22T09:16:01.391572+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:10.001858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":853,"num_read_kb":1907,"num_write":716,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761810+0000","last_change":"2024-09-22T08:17:46.349859+0000","last_active":"2024-09-22T09:11:56.761810+0000","last_peered":"2024-09-22T09:11:56.761810+0000","last_clean":"2024-09-22T09:11:56.761810+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:11:56.761810+0000","last_undegraded":"2024-09-22T09:11:56.761810+0000","last_fullsized":"2024-09-22T09:11:56.761810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:54.379436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'132","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.496396+0000","last_change":"2024-09-22T08:17:48.368083+0000","last_active":"2024-09-22T09:14:05.496396+0000","last_peered":"2024-09-22T09:14:05.496396+0000","last_clean":"2024-09-22T09:14:05.496396+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:14:05.496396+0000","last_undegraded":"2024-09-22T09:14:05.496396+0000","last_fullsized":"2024-09-22T09:14:05.496396+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:52.729529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.211236+0000","last_change":"2024-09-22T08:17:40.315498+0000","last_active":"2024-09-22T09:13:21.211236+0000","last_peered":"2024-09-22T09:13:21.211236+0000","last_clean":"2024-09-22T09:13:21.211236+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:13:21.211236+0000","last_undegraded":"2024-09-22T09:13:21.211236+0000","last_fullsized":"2024-09-22T09:13:21.211236+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:32.268795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'341","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.746703+0000","last_change":"2024-09-22T08:17:38.301804+0000","last_active":"2024-09-22T09:16:01.746703+0000","last_peered":"2024-09-22T09:16:01.746703+0000","last_clean":"2024-09-22T09:16:01.746703+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:01.746703+0000","last_undegraded":"2024-09-22T09:16:01.746703+0000","last_fullsized":"2024-09-22T09:16:01.746703+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:48.176948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633961,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":524,"num_read_kb":12203,"num_write":1212,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.758407+0000","last_change":"2024-09-22T08:17:42.317745+0000","last_active":"2024-09-22T09:11:41.758407+0000","last_peered":"2024-09-22T09:11:41.758407+0000","last_clean":"2024-09-22T09:11:41.758407+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:11:41.758407+0000","last_undegraded":"2024-09-22T09:11:41.758407+0000","last_fullsized":"2024-09-22T09:11:41.758407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:55.976576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'298","reported_seq":862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.252674+0000","last_change":"2024-09-22T08:17:44.340384+0000","last_active":"2024-09-22T09:15:24.252674+0000","last_peered":"2024-09-22T09:15:24.252674+0000","last_clean":"2024-09-22T09:15:24.252674+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:15:24.252674+0000","last_undegraded":"2024-09-22T09:15:24.252674+0000","last_fullsized":"2024-09-22T09:15:24.252674+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:51.178814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58980,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1020,"num_write":460,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761329+0000","last_change":"2024-09-22T08:17:46.357757+0000","last_active":"2024-09-22T09:11:56.761329+0000","last_peered":"2024-09-22T09:11:56.761329+0000","last_clean":"2024-09-22T09:11:56.761329+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:11:56.761329+0000","last_undegraded":"2024-09-22T09:11:56.761329+0000","last_fullsized":"2024-09-22T09:11:56.761329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.170661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'175","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:12.994093+0000","last_change":"2024-09-22T08:17:48.369209+0000","last_active":"2024-09-22T09:15:12.994093+0000","last_peered":"2024-09-22T09:15:12.994093+0000","last_clean":"2024-09-22T09:15:12.994093+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:15:12.994093+0000","last_undegraded":"2024-09-22T09:15:12.994093+0000","last_fullsized":"2024-09-22T09:15:12.994093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:22.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'371","reported_seq":1863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183818+0000","last_change":"2024-09-22T08:17:40.318025+0000","last_active":"2024-09-22T09:13:23.183818+0000","last_peered":"2024-09-22T09:13:23.183818+0000","last_clean":"2024-09-22T09:13:23.183818+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:13:23.183818+0000","last_undegraded":"2024-09-22T09:13:23.183818+0000","last_fullsized":"2024-09-22T09:13:23.183818+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'441","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.623110+0000","last_change":"2024-09-22T08:17:38.322735+0000","last_active":"2024-09-22T09:16:02.623110+0000","last_peered":"2024-09-22T09:16:02.623110+0000","last_clean":"2024-09-22T09:16:02.623110+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:02.623110+0000","last_undegraded":"2024-09-22T09:16:02.623110+0000","last_fullsized":"2024-09-22T09:16:02.623110+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:20.868798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9152989,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":1020,"num_read_kb":33703,"num_write":1375,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759746+0000","last_change":"2024-09-22T08:17:42.317557+0000","last_active":"2024-09-22T09:11:41.759746+0000","last_peered":"2024-09-22T09:11:41.759746+0000","last_clean":"2024-09-22T09:11:41.759746+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:11:41.759746+0000","last_undegraded":"2024-09-22T09:11:41.759746+0000","last_fullsized":"2024-09-22T09:11:41.759746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:12.874066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'314","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.284114+0000","last_change":"2024-09-22T08:17:44.331471+0000","last_active":"2024-09-22T09:15:24.284114+0000","last_peered":"2024-09-22T09:15:24.284114+0000","last_clean":"2024-09-22T09:15:24.284114+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:15:24.284114+0000","last_undegraded":"2024-09-22T09:15:24.284114+0000","last_fullsized":"2024-09-22T09:15:24.284114+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:15.784939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1016,"num_write":412,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'793","reported_seq":4267,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.375929+0000","last_change":"2024-09-22T08:17:46.353620+0000","last_active":"2024-09-22T09:16:01.375929+0000","last_peered":"2024-09-22T09:16:01.375929+0000","last_clean":"2024-09-22T09:16:01.375929+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:01.375929+0000","last_undegraded":"2024-09-22T09:16:01.375929+0000","last_fullsized":"2024-09-22T09:16:01.375929+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:44.586630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":632,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.416944+0000","last_change":"2024-09-22T08:17:48.368255+0000","last_active":"2024-09-22T09:14:03.416944+0000","last_peered":"2024-09-22T09:14:03.416944+0000","last_clean":"2024-09-22T09:14:03.416944+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:14:03.416944+0000","last_undegraded":"2024-09-22T09:14:03.416944+0000","last_fullsized":"2024-09-22T09:14:03.416944+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:52.505757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'504","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.760231+0000","last_change":"2024-09-22T08:17:40.319745+0000","last_active":"2024-09-22T09:15:22.760231+0000","last_peered":"2024-09-22T09:15:22.760231+0000","last_clean":"2024-09-22T09:15:22.760231+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:15:22.760231+0000","last_undegraded":"2024-09-22T09:15:22.760231+0000","last_fullsized":"2024-09-22T09:15:22.760231+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:24.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'282","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.783706+0000","last_change":"2024-09-22T08:17:38.305115+0000","last_active":"2024-09-22T09:16:02.783706+0000","last_peered":"2024-09-22T09:16:02.783706+0000","last_clean":"2024-09-22T09:16:02.783706+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:02.783706+0000","last_undegraded":"2024-09-22T09:16:02.783706+0000","last_fullsized":"2024-09-22T09:16:02.783706+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:22.303400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247588,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":453,"num_read_kb":25988,"num_write":882,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.357888+0000","last_change":"2024-09-22T08:17:42.319394+0000","last_active":"2024-09-22T09:16:01.357888+0000","last_peered":"2024-09-22T09:16:01.357888+0000","last_clean":"2024-09-22T09:16:01.357888+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:01.357888+0000","last_undegraded":"2024-09-22T09:16:01.357888+0000","last_fullsized":"2024-09-22T09:16:01.357888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:53.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.790388+0000","last_change":"2024-09-22T08:17:44.340629+0000","last_active":"2024-09-22T09:12:16.790388+0000","last_peered":"2024-09-22T09:12:16.790388+0000","last_clean":"2024-09-22T09:12:16.790388+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:12:16.790388+0000","last_undegraded":"2024-09-22T09:12:16.790388+0000","last_fullsized":"2024-09-22T09:12:16.790388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:15.874564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'782","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.376981+0000","last_change":"2024-09-22T08:17:46.356179+0000","last_active":"2024-09-22T09:16:01.376981+0000","last_peered":"2024-09-22T09:16:01.376981+0000","last_clean":"2024-09-22T09:16:01.376981+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:01.376981+0000","last_undegraded":"2024-09-22T09:16:01.376981+0000","last_fullsized":"2024-09-22T09:16:01.376981+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:39.747201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'110","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870751+0000","last_change":"2024-09-22T08:17:48.366352+0000","last_active":"2024-09-22T09:14:02.870751+0000","last_peered":"2024-09-22T09:14:02.870751+0000","last_clean":"2024-09-22T09:14:02.870751+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:14:02.870751+0000","last_undegraded":"2024-09-22T09:14:02.870751+0000","last_fullsized":"2024-09-22T09:14:02.870751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:07.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1178","reported_seq":2758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182228+0000","last_change":"2024-09-22T08:17:40.316192+0000","last_active":"2024-09-22T09:13:23.182228+0000","last_peered":"2024-09-22T09:13:23.182228+0000","last_clean":"2024-09-22T09:13:23.182228+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:13:23.182228+0000","last_undegraded":"2024-09-22T09:13:23.182228+0000","last_fullsized":"2024-09-22T09:13:23.182228+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:48.043270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.777872+0000","last_change":"2024-09-22T08:17:38.308011+0000","last_active":"2024-09-22T09:16:01.777872+0000","last_peered":"2024-09-22T09:16:01.777872+0000","last_clean":"2024-09-22T09:16:01.777872+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:01.777872+0000","last_undegraded":"2024-09-22T09:16:01.777872+0000","last_fullsized":"2024-09-22T09:16:01.777872+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:35.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8829564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":762,"num_read_kb":19795,"num_write":1259,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:42.764797+0000","last_change":"2024-09-22T08:17:42.313230+0000","last_active":"2024-09-22T09:11:42.764797+0000","last_peered":"2024-09-22T09:11:42.764797+0000","last_clean":"2024-09-22T09:11:42.764797+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:11:42.764797+0000","last_undegraded":"2024-09-22T09:11:42.764797+0000","last_fullsized":"2024-09-22T09:11:42.764797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:03.149245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'360","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.470236+0000","last_change":"2024-09-22T08:17:44.340330+0000","last_active":"2024-09-22T09:16:02.470236+0000","last_peered":"2024-09-22T09:16:02.470236+0000","last_clean":"2024-09-22T09:16:02.470236+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:02.470236+0000","last_undegraded":"2024-09-22T09:16:02.470236+0000","last_fullsized":"2024-09-22T09:16:02.470236+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:10.718081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855506+0000","last_change":"2024-09-22T08:17:46.346619+0000","last_active":"2024-09-22T09:11:47.855506+0000","last_peered":"2024-09-22T09:11:47.855506+0000","last_clean":"2024-09-22T09:11:47.855506+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:11:47.855506+0000","last_undegraded":"2024-09-22T09:11:47.855506+0000","last_fullsized":"2024-09-22T09:11:47.855506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:14.109434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'174","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.873297+0000","last_change":"2024-09-22T08:17:48.366379+0000","last_active":"2024-09-22T09:14:02.873297+0000","last_peered":"2024-09-22T09:14:02.873297+0000","last_clean":"2024-09-22T09:14:02.873297+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:14:02.873297+0000","last_undegraded":"2024-09-22T09:14:02.873297+0000","last_fullsized":"2024-09-22T09:14:02.873297+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:38.475121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'895","reported_seq":2544,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.774888+0000","last_change":"2024-09-22T08:17:40.315285+0000","last_active":"2024-09-22T09:12:16.774888+0000","last_peered":"2024-09-22T09:12:16.774888+0000","last_clean":"2024-09-22T09:12:16.774888+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:12:16.774888+0000","last_undegraded":"2024-09-22T09:12:16.774888+0000","last_fullsized":"2024-09-22T09:12:16.774888+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:30.566288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970017+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T09:13:22.970017+0000","last_peered":"2024-09-22T09:13:22.970017+0000","last_clean":"2024-09-22T09:13:22.970017+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:13:22.970017+0000","last_undegraded":"2024-09-22T09:13:22.970017+0000","last_fullsized":"2024-09-22T09:13:22.970017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779151+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T09:13:42.779151+0000","last_peered":"2024-09-22T09:13:42.779151+0000","last_clean":"2024-09-22T09:13:42.779151+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:13:42.779151+0000","last_undegraded":"2024-09-22T09:13:42.779151+0000","last_fullsized":"2024-09-22T09:13:42.779151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'266","reported_seq":920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.748620+0000","last_change":"2024-09-22T08:17:38.310448+0000","last_active":"2024-09-22T09:16:01.748620+0000","last_peered":"2024-09-22T09:16:01.748620+0000","last_clean":"2024-09-22T09:16:01.748620+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:01.748620+0000","last_undegraded":"2024-09-22T09:16:01.748620+0000","last_fullsized":"2024-09-22T09:16:01.748620+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:06.962881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8299814,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":559,"num_read_kb":39972,"num_write":973,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976838+0000","last_change":"2024-09-22T08:17:42.319001+0000","last_active":"2024-09-22T09:13:57.976838+0000","last_peered":"2024-09-22T09:13:57.976838+0000","last_clean":"2024-09-22T09:13:57.976838+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:13:57.976838+0000","last_undegraded":"2024-09-22T09:13:57.976838+0000","last_fullsized":"2024-09-22T09:13:57.976838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'737","reported_seq":1428,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.644538+0000","last_change":"2024-09-22T08:17:44.340548+0000","last_active":"2024-09-22T09:16:02.644538+0000","last_peered":"2024-09-22T09:16:02.644538+0000","last_clean":"2024-09-22T09:16:02.644538+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:02.644538+0000","last_undegraded":"2024-09-22T09:16:02.644538+0000","last_fullsized":"2024-09-22T09:16:02.644538+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:42.555714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136654,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1406,"num_read_kb":3036,"num_write":1368,"num_write_kb":1203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761952+0000","last_change":"2024-09-22T08:17:46.351335+0000","last_active":"2024-09-22T09:11:56.761952+0000","last_peered":"2024-09-22T09:11:56.761952+0000","last_clean":"2024-09-22T09:11:56.761952+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:11:56.761952+0000","last_undegraded":"2024-09-22T09:11:56.761952+0000","last_fullsized":"2024-09-22T09:11:56.761952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'205","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.392952+0000","last_change":"2024-09-22T08:17:48.371345+0000","last_active":"2024-09-22T09:14:05.392952+0000","last_peered":"2024-09-22T09:14:05.392952+0000","last_clean":"2024-09-22T09:14:05.392952+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:14:05.392952+0000","last_undegraded":"2024-09-22T09:14:05.392952+0000","last_fullsized":"2024-09-22T09:14:05.392952+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.861983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697568+0000","last_change":"2024-09-22T08:17:40.318048+0000","last_active":"2024-09-22T09:13:27.697568+0000","last_peered":"2024-09-22T09:13:27.697568+0000","last_clean":"2024-09-22T09:13:27.697568+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:13:27.697568+0000","last_undegraded":"2024-09-22T09:13:27.697568+0000","last_fullsized":"2024-09-22T09:13:27.697568+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:48.343685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779075+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T09:13:42.779075+0000","last_peered":"2024-09-22T09:13:42.779075+0000","last_clean":"2024-09-22T09:13:42.779075+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:13:42.779075+0000","last_undegraded":"2024-09-22T09:13:42.779075+0000","last_fullsized":"2024-09-22T09:13:42.779075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'277","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.791862+0000","last_change":"2024-09-22T08:17:38.309062+0000","last_active":"2024-09-22T09:16:01.791862+0000","last_peered":"2024-09-22T09:16:01.791862+0000","last_clean":"2024-09-22T09:16:01.791862+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:01.791862+0000","last_undegraded":"2024-09-22T09:16:01.791862+0000","last_fullsized":"2024-09-22T09:16:01.791862+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:47.956763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399728,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":494,"num_read_kb":6728,"num_write":1008,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.765977+0000","last_change":"2024-09-22T08:17:42.319964+0000","last_active":"2024-09-22T09:11:52.765977+0000","last_peered":"2024-09-22T09:11:52.765977+0000","last_clean":"2024-09-22T09:11:52.765977+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:11:52.765977+0000","last_undegraded":"2024-09-22T09:11:52.765977+0000","last_fullsized":"2024-09-22T09:11:52.765977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:30.133737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1321","reported_seq":2926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.402301+0000","last_change":"2024-09-22T08:17:44.340574+0000","last_active":"2024-09-22T09:16:01.402301+0000","last_peered":"2024-09-22T09:16:01.402301+0000","last_clean":"2024-09-22T09:16:01.402301+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:01.402301+0000","last_undegraded":"2024-09-22T09:16:01.402301+0000","last_fullsized":"2024-09-22T09:16:01.402301+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:35:13.936560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166762,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3488,"num_write":1152,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:12.768421+0000","last_change":"2024-09-22T08:17:46.355591+0000","last_active":"2024-09-22T09:12:12.768421+0000","last_peered":"2024-09-22T09:12:12.768421+0000","last_clean":"2024-09-22T09:12:12.768421+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:12:12.768421+0000","last_undegraded":"2024-09-22T09:12:12.768421+0000","last_fullsized":"2024-09-22T09:12:12.768421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:16.459442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'121","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.349060+0000","last_change":"2024-09-22T08:17:48.368412+0000","last_active":"2024-09-22T09:14:05.349060+0000","last_peered":"2024-09-22T09:14:05.349060+0000","last_clean":"2024-09-22T09:14:05.349060+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:14:05.349060+0000","last_undegraded":"2024-09-22T09:14:05.349060+0000","last_fullsized":"2024-09-22T09:14:05.349060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'465","reported_seq":2070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755403+0000","last_change":"2024-09-22T08:17:40.310102+0000","last_active":"2024-09-22T09:11:51.755403+0000","last_peered":"2024-09-22T09:11:51.755403+0000","last_clean":"2024-09-22T09:11:51.755403+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:11:51.755403+0000","last_undegraded":"2024-09-22T09:11:51.755403+0000","last_fullsized":"2024-09-22T09:11:51.755403+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:43.429819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778073+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T09:13:41.778073+0000","last_peered":"2024-09-22T09:13:41.778073+0000","last_clean":"2024-09-22T09:13:41.778073+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:13:41.778073+0000","last_undegraded":"2024-09-22T09:13:41.778073+0000","last_fullsized":"2024-09-22T09:13:41.778073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'279","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.761134+0000","last_change":"2024-09-22T08:17:38.321760+0000","last_active":"2024-09-22T09:16:01.761134+0000","last_peered":"2024-09-22T09:16:01.761134+0000","last_clean":"2024-09-22T09:16:01.761134+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:01.761134+0000","last_undegraded":"2024-09-22T09:16:01.761134+0000","last_fullsized":"2024-09-22T09:16:01.761134+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:53.153409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207367,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":482,"num_read_kb":1785,"num_write":1045,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"37'6","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.346566+0000","last_change":"2024-09-22T08:17:42.318777+0000","last_active":"2024-09-22T09:16:01.346566+0000","last_peered":"2024-09-22T09:16:01.346566+0000","last_clean":"2024-09-22T09:16:01.346566+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:01.346566+0000","last_undegraded":"2024-09-22T09:16:01.346566+0000","last_fullsized":"2024-09-22T09:16:01.346566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:08.823340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'259","reported_seq":1485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.651005+0000","last_change":"2024-09-22T08:17:44.340447+0000","last_active":"2024-09-22T09:15:22.651005+0000","last_peered":"2024-09-22T09:15:22.651005+0000","last_clean":"2024-09-22T09:15:22.651005+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:15:22.651005+0000","last_undegraded":"2024-09-22T09:15:22.651005+0000","last_fullsized":"2024-09-22T09:15:22.651005+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:25.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761290+0000","last_change":"2024-09-22T08:17:46.356277+0000","last_active":"2024-09-22T09:11:56.761290+0000","last_peered":"2024-09-22T09:11:56.761290+0000","last_clean":"2024-09-22T09:11:56.761290+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:11:56.761290+0000","last_undegraded":"2024-09-22T09:11:56.761290+0000","last_fullsized":"2024-09-22T09:11:56.761290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:32.511597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'261","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.635821+0000","last_change":"2024-09-22T08:17:48.371579+0000","last_active":"2024-09-22T09:14:05.635821+0000","last_peered":"2024-09-22T09:14:05.635821+0000","last_clean":"2024-09-22T09:14:05.635821+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:14:05.635821+0000","last_undegraded":"2024-09-22T09:14:05.635821+0000","last_fullsized":"2024-09-22T09:14:05.635821+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:45.916159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'775","reported_seq":2205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.773059+0000","last_change":"2024-09-22T08:17:40.310812+0000","last_active":"2024-09-22T09:13:56.773059+0000","last_peered":"2024-09-22T09:13:56.773059+0000","last_clean":"2024-09-22T09:13:56.773059+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:13:56.773059+0000","last_undegraded":"2024-09-22T09:13:56.773059+0000","last_fullsized":"2024-09-22T09:13:56.773059+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:58.245283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779128+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T09:13:42.779128+0000","last_peered":"2024-09-22T09:13:42.779128+0000","last_clean":"2024-09-22T09:13:42.779128+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:13:42.779128+0000","last_undegraded":"2024-09-22T09:13:42.779128+0000","last_fullsized":"2024-09-22T09:13:42.779128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'327","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.751237+0000","last_change":"2024-09-22T08:18:09.819721+0000","last_active":"2024-09-22T09:16:01.751237+0000","last_peered":"2024-09-22T09:16:01.751237+0000","last_clean":"2024-09-22T09:16:01.751237+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:01.751237+0000","last_undegraded":"2024-09-22T09:16:01.751237+0000","last_fullsized":"2024-09-22T09:16:01.751237+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:02.135126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267476,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":547,"num_read_kb":48326,"num_write":1121,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.762146+0000","last_change":"2024-09-22T08:17:42.321314+0000","last_active":"2024-09-22T09:12:01.762146+0000","last_peered":"2024-09-22T09:12:01.762146+0000","last_clean":"2024-09-22T09:12:01.762146+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:12:01.762146+0000","last_undegraded":"2024-09-22T09:12:01.762146+0000","last_fullsized":"2024-09-22T09:12:01.762146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:59.774382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'141","reported_seq":680,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782537+0000","last_change":"2024-09-22T08:17:44.338734+0000","last_active":"2024-09-22T09:14:06.782537+0000","last_peered":"2024-09-22T09:14:06.782537+0000","last_clean":"2024-09-22T09:14:06.782537+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:14:06.782537+0000","last_undegraded":"2024-09-22T09:14:06.782537+0000","last_fullsized":"2024-09-22T09:14:06.782537+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:01.878832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.766574+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:11:57.766574+0000","last_peered":"2024-09-22T09:11:57.766574+0000","last_clean":"2024-09-22T09:11:57.766574+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:11:57.766574+0000","last_undegraded":"2024-09-22T09:11:57.766574+0000","last_fullsized":"2024-09-22T09:11:57.766574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:45.080426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'120","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.960999+0000","last_change":"2024-09-22T08:17:48.366537+0000","last_active":"2024-09-22T09:11:57.960999+0000","last_peered":"2024-09-22T09:11:57.960999+0000","last_clean":"2024-09-22T09:11:57.960999+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:11:57.960999+0000","last_undegraded":"2024-09-22T09:11:57.960999+0000","last_fullsized":"2024-09-22T09:11:57.960999+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:56.129113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'369","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.533414+0000","last_change":"2024-09-22T08:17:40.314415+0000","last_active":"2024-09-22T09:14:04.533414+0000","last_peered":"2024-09-22T09:14:04.533414+0000","last_clean":"2024-09-22T09:14:04.533414+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:14:04.533414+0000","last_undegraded":"2024-09-22T09:14:04.533414+0000","last_fullsized":"2024-09-22T09:14:04.533414+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:51.191984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'357","reported_seq":1054,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.751679+0000","last_change":"2024-09-22T08:17:38.312313+0000","last_active":"2024-09-22T09:16:02.751679+0000","last_peered":"2024-09-22T09:16:02.751679+0000","last_clean":"2024-09-22T09:16:02.751679+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:02.751679+0000","last_undegraded":"2024-09-22T09:16:02.751679+0000","last_fullsized":"2024-09-22T09:16:02.751679+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:50.017512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335217,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":45053,"num_write":1347,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778206+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T09:13:41.778206+0000","last_peered":"2024-09-22T09:13:41.778206+0000","last_clean":"2024-09-22T09:13:41.778206+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:13:41.778206+0000","last_undegraded":"2024-09-22T09:13:41.778206+0000","last_fullsized":"2024-09-22T09:13:41.778206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780582+0000","last_change":"2024-09-22T08:17:42.315400+0000","last_active":"2024-09-22T09:13:56.780582+0000","last_peered":"2024-09-22T09:13:56.780582+0000","last_clean":"2024-09-22T09:13:56.780582+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:13:56.780582+0000","last_undegraded":"2024-09-22T09:13:56.780582+0000","last_fullsized":"2024-09-22T09:13:56.780582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'580","reported_seq":1230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.401286+0000","last_change":"2024-09-22T08:17:44.332038+0000","last_active":"2024-09-22T09:16:01.401286+0000","last_peered":"2024-09-22T09:16:01.401286+0000","last_clean":"2024-09-22T09:16:01.401286+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:01.401286+0000","last_undegraded":"2024-09-22T09:16:01.401286+0000","last_fullsized":"2024-09-22T09:16:01.401286+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:32.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112903,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1655,"num_read_kb":2619,"num_write":2214,"num_write_kb":2044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.856595+0000","last_change":"2024-09-22T08:17:46.353133+0000","last_active":"2024-09-22T09:11:57.856595+0000","last_peered":"2024-09-22T09:11:57.856595+0000","last_clean":"2024-09-22T09:11:57.856595+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:11:57.856595+0000","last_undegraded":"2024-09-22T09:11:57.856595+0000","last_fullsized":"2024-09-22T09:11:57.856595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:30.262623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'126","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.865467+0000","last_change":"2024-09-22T08:17:48.371983+0000","last_active":"2024-09-22T09:14:02.865467+0000","last_peered":"2024-09-22T09:14:02.865467+0000","last_clean":"2024-09-22T09:14:02.865467+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:14:02.865467+0000","last_undegraded":"2024-09-22T09:14:02.865467+0000","last_fullsized":"2024-09-22T09:14:02.865467+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:17.544287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'437","reported_seq":2050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.530580+0000","last_change":"2024-09-22T08:17:40.310836+0000","last_active":"2024-09-22T09:14:04.530580+0000","last_peered":"2024-09-22T09:14:04.530580+0000","last_clean":"2024-09-22T09:14:04.530580+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:14:04.530580+0000","last_undegraded":"2024-09-22T09:14:04.530580+0000","last_fullsized":"2024-09-22T09:14:04.530580+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:50.194831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'339","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.737328+0000","last_change":"2024-09-22T08:17:38.314470+0000","last_active":"2024-09-22T09:16:01.737328+0000","last_peered":"2024-09-22T09:16:01.737328+0000","last_clean":"2024-09-22T09:16:01.737328+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:01.737328+0000","last_undegraded":"2024-09-22T09:16:01.737328+0000","last_fullsized":"2024-09-22T09:16:01.737328+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:21.168095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13356216,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":630,"num_read_kb":42178,"num_write":1102,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781067+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T09:13:57.781067+0000","last_peered":"2024-09-22T09:13:57.781067+0000","last_clean":"2024-09-22T09:13:57.781067+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:13:57.781067+0000","last_undegraded":"2024-09-22T09:13:57.781067+0000","last_fullsized":"2024-09-22T09:13:57.781067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'3","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.370391+0000","last_change":"2024-09-22T08:17:42.319037+0000","last_active":"2024-09-22T09:16:01.370391+0000","last_peered":"2024-09-22T09:16:01.370391+0000","last_clean":"2024-09-22T09:16:01.370391+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:01.370391+0000","last_undegraded":"2024-09-22T09:16:01.370391+0000","last_fullsized":"2024-09-22T09:16:01.370391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:51.756538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'168","reported_seq":722,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.756076+0000","last_change":"2024-09-22T08:17:44.337754+0000","last_active":"2024-09-22T09:11:56.756076+0000","last_peered":"2024-09-22T09:11:56.756076+0000","last_clean":"2024-09-22T09:11:56.756076+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:11:56.756076+0000","last_undegraded":"2024-09-22T09:11:56.756076+0000","last_fullsized":"2024-09-22T09:11:56.756076+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:07.954994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'782","reported_seq":2597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.373636+0000","last_change":"2024-09-22T08:17:46.353169+0000","last_active":"2024-09-22T09:16:01.373636+0000","last_peered":"2024-09-22T09:16:01.373636+0000","last_clean":"2024-09-22T09:16:01.373636+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:01.373636+0000","last_undegraded":"2024-09-22T09:16:01.373636+0000","last_fullsized":"2024-09-22T09:16:01.373636+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:47.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'124","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783445+0000","last_change":"2024-09-22T08:17:48.370594+0000","last_active":"2024-09-22T09:14:16.783445+0000","last_peered":"2024-09-22T09:14:16.783445+0000","last_clean":"2024-09-22T09:14:16.783445+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:14:16.783445+0000","last_undegraded":"2024-09-22T09:14:16.783445+0000","last_fullsized":"2024-09-22T09:14:16.783445+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:38.200197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'478","reported_seq":2004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779781+0000","last_change":"2024-09-22T08:17:40.314079+0000","last_active":"2024-09-22T09:13:51.779781+0000","last_peered":"2024-09-22T09:13:51.779781+0000","last_clean":"2024-09-22T09:13:51.779781+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:13:51.779781+0000","last_undegraded":"2024-09-22T09:13:51.779781+0000","last_fullsized":"2024-09-22T09:13:51.779781+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:15.539629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'351","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.686371+0000","last_change":"2024-09-22T08:17:38.302210+0000","last_active":"2024-09-22T09:16:01.686371+0000","last_peered":"2024-09-22T09:16:01.686371+0000","last_clean":"2024-09-22T09:16:01.686371+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:01.686371+0000","last_undegraded":"2024-09-22T09:16:01.686371+0000","last_fullsized":"2024-09-22T09:16:01.686371+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:59.512304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190906,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":886,"num_read_kb":43239,"num_write":1228,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779024+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T09:13:46.779024+0000","last_peered":"2024-09-22T09:13:46.779024+0000","last_clean":"2024-09-22T09:13:46.779024+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:13:46.779024+0000","last_undegraded":"2024-09-22T09:13:46.779024+0000","last_fullsized":"2024-09-22T09:13:46.779024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781014+0000","last_change":"2024-09-22T08:17:42.316704+0000","last_active":"2024-09-22T09:13:57.781014+0000","last_peered":"2024-09-22T09:13:57.781014+0000","last_clean":"2024-09-22T09:13:57.781014+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:13:57.781014+0000","last_undegraded":"2024-09-22T09:13:57.781014+0000","last_fullsized":"2024-09-22T09:13:57.781014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:09.379090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'111","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:48.410289+0000","last_change":"2024-09-22T08:17:44.338196+0000","last_active":"2024-09-22T09:12:48.410289+0000","last_peered":"2024-09-22T09:12:48.410289+0000","last_clean":"2024-09-22T09:12:48.410289+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:12:48.410289+0000","last_undegraded":"2024-09-22T09:12:48.410289+0000","last_fullsized":"2024-09-22T09:12:48.410289+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:17.767211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'809","reported_seq":2518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.379031+0000","last_change":"2024-09-22T08:17:46.352328+0000","last_active":"2024-09-22T09:16:01.379031+0000","last_peered":"2024-09-22T09:16:01.379031+0000","last_clean":"2024-09-22T09:16:01.379031+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:01.379031+0000","last_undegraded":"2024-09-22T09:16:01.379031+0000","last_fullsized":"2024-09-22T09:16:01.379031+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:57.228160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'287","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.761107+0000","last_change":"2024-09-22T08:17:48.371281+0000","last_active":"2024-09-22T09:11:51.761107+0000","last_peered":"2024-09-22T09:11:51.761107+0000","last_clean":"2024-09-22T09:11:51.761107+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:11:51.761107+0000","last_undegraded":"2024-09-22T09:11:51.761107+0000","last_fullsized":"2024-09-22T09:11:51.761107+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:03.377587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'782","reported_seq":2368,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214566+0000","last_change":"2024-09-22T08:17:40.316159+0000","last_active":"2024-09-22T09:14:02.214566+0000","last_peered":"2024-09-22T09:14:02.214566+0000","last_clean":"2024-09-22T09:14:02.214566+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:14:02.214566+0000","last_undegraded":"2024-09-22T09:14:02.214566+0000","last_fullsized":"2024-09-22T09:14:02.214566+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:31.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'274","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.766152+0000","last_change":"2024-09-22T08:17:38.300386+0000","last_active":"2024-09-22T09:16:01.766152+0000","last_peered":"2024-09-22T09:16:01.766152+0000","last_clean":"2024-09-22T09:16:01.766152+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:01.766152+0000","last_undegraded":"2024-09-22T09:16:01.766152+0000","last_fullsized":"2024-09-22T09:16:01.766152+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:23.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086766,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":854,"num_read_kb":63309,"num_write":917,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779847+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T09:13:47.779847+0000","last_peered":"2024-09-22T09:13:47.779847+0000","last_clean":"2024-09-22T09:13:47.779847+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:13:47.779847+0000","last_undegraded":"2024-09-22T09:13:47.779847+0000","last_fullsized":"2024-09-22T09:13:47.779847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779817+0000","last_change":"2024-09-22T08:17:42.311097+0000","last_active":"2024-09-22T09:13:51.779817+0000","last_peered":"2024-09-22T09:13:51.779817+0000","last_clean":"2024-09-22T09:13:51.779817+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:13:51.779817+0000","last_undegraded":"2024-09-22T09:13:51.779817+0000","last_fullsized":"2024-09-22T09:13:51.779817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:38.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'738","reported_seq":1444,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.279359+0000","last_change":"2024-09-22T08:17:44.333541+0000","last_active":"2024-09-22T09:16:02.279359+0000","last_peered":"2024-09-22T09:16:02.279359+0000","last_clean":"2024-09-22T09:16:02.279359+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:02.279359+0000","last_undegraded":"2024-09-22T09:16:02.279359+0000","last_fullsized":"2024-09-22T09:16:02.279359+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:02.700362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1323,"num_read_kb":3030,"num_write":1086,"num_write_kb":894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761245+0000","last_change":"2024-09-22T08:17:46.355809+0000","last_active":"2024-09-22T09:11:56.761245+0000","last_peered":"2024-09-22T09:11:56.761245+0000","last_clean":"2024-09-22T09:11:56.761245+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:11:56.761245+0000","last_undegraded":"2024-09-22T09:11:56.761245+0000","last_fullsized":"2024-09-22T09:11:56.761245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:49.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'100","reported_seq":587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.079488+0000","last_change":"2024-09-22T08:17:48.367775+0000","last_active":"2024-09-22T09:14:05.079488+0000","last_peered":"2024-09-22T09:14:05.079488+0000","last_clean":"2024-09-22T09:14:05.079488+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:14:05.079488+0000","last_undegraded":"2024-09-22T09:14:05.079488+0000","last_fullsized":"2024-09-22T09:14:05.079488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:56.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'123","reported_seq":691,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.578802+0000","last_change":"2024-09-22T08:17:48.366489+0000","last_active":"2024-09-22T09:14:05.578802+0000","last_peered":"2024-09-22T09:14:05.578802+0000","last_clean":"2024-09-22T09:14:05.578802+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:14:05.578802+0000","last_undegraded":"2024-09-22T09:14:05.578802+0000","last_fullsized":"2024-09-22T09:14:05.578802+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:50.584912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'412","reported_seq":1973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868497+0000","last_change":"2024-09-22T08:17:40.313136+0000","last_active":"2024-09-22T09:13:42.868497+0000","last_peered":"2024-09-22T09:13:42.868497+0000","last_clean":"2024-09-22T09:13:42.868497+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:13:42.868497+0000","last_undegraded":"2024-09-22T09:13:42.868497+0000","last_fullsized":"2024-09-22T09:13:42.868497+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:06.500375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'283","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.782067+0000","last_change":"2024-09-22T08:18:09.816788+0000","last_active":"2024-09-22T09:16:02.782067+0000","last_peered":"2024-09-22T09:16:02.782067+0000","last_clean":"2024-09-22T09:16:02.782067+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:02.782067+0000","last_undegraded":"2024-09-22T09:16:02.782067+0000","last_fullsized":"2024-09-22T09:16:02.782067+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:13.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25064,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":550,"num_read_kb":48776,"num_write":1041,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.770677+0000","last_change":"2024-09-22T08:17:42.317519+0000","last_active":"2024-09-22T09:13:41.770677+0000","last_peered":"2024-09-22T09:13:41.770677+0000","last_clean":"2024-09-22T09:13:41.770677+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:13:41.770677+0000","last_undegraded":"2024-09-22T09:13:41.770677+0000","last_fullsized":"2024-09-22T09:13:41.770677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:17.290304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'295","reported_seq":852,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.273953+0000","last_change":"2024-09-22T08:17:44.340784+0000","last_active":"2024-09-22T09:15:24.273953+0000","last_peered":"2024-09-22T09:15:24.273953+0000","last_clean":"2024-09-22T09:15:24.273953+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:15:24.273953+0000","last_undegraded":"2024-09-22T09:15:24.273953+0000","last_fullsized":"2024-09-22T09:15:24.273953+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:27.691033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":895,"num_write":374,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755323+0000","last_change":"2024-09-22T08:17:46.357807+0000","last_active":"2024-09-22T09:11:26.755323+0000","last_peered":"2024-09-22T09:11:26.755323+0000","last_clean":"2024-09-22T09:11:26.755323+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:11:26.755323+0000","last_undegraded":"2024-09-22T09:11:26.755323+0000","last_fullsized":"2024-09-22T09:11:26.755323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:34.146262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'156","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781302+0000","last_change":"2024-09-22T08:17:48.370244+0000","last_active":"2024-09-22T09:14:01.781302+0000","last_peered":"2024-09-22T09:14:01.781302+0000","last_clean":"2024-09-22T09:14:01.781302+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:14:01.781302+0000","last_undegraded":"2024-09-22T09:14:01.781302+0000","last_fullsized":"2024-09-22T09:14:01.781302+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:47.163289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'477","reported_seq":2018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214640+0000","last_change":"2024-09-22T08:17:40.313313+0000","last_active":"2024-09-22T09:14:02.214640+0000","last_peered":"2024-09-22T09:14:02.214640+0000","last_clean":"2024-09-22T09:14:02.214640+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:14:02.214640+0000","last_undegraded":"2024-09-22T09:14:02.214640+0000","last_fullsized":"2024-09-22T09:14:02.214640+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:57.603890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'317","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.947408+0000","last_change":"2024-09-22T08:17:38.309041+0000","last_active":"2024-09-22T09:16:02.947408+0000","last_peered":"2024-09-22T09:16:02.947408+0000","last_clean":"2024-09-22T09:16:02.947408+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:02.947408+0000","last_undegraded":"2024-09-22T09:16:02.947408+0000","last_fullsized":"2024-09-22T09:16:02.947408+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.738401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12590450,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":589,"num_read_kb":26096,"num_write":1005,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778236+0000","last_change":"2024-09-22T08:17:42.315462+0000","last_active":"2024-09-22T09:13:41.778236+0000","last_peered":"2024-09-22T09:13:41.778236+0000","last_clean":"2024-09-22T09:13:41.778236+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:13:41.778236+0000","last_undegraded":"2024-09-22T09:13:41.778236+0000","last_fullsized":"2024-09-22T09:13:41.778236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:17.089358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'49","reported_seq":549,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755343+0000","last_change":"2024-09-22T08:17:44.334218+0000","last_active":"2024-09-22T09:11:26.755343+0000","last_peered":"2024-09-22T09:11:26.755343+0000","last_clean":"2024-09-22T09:11:26.755343+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:11:26.755343+0000","last_undegraded":"2024-09-22T09:11:26.755343+0000","last_fullsized":"2024-09-22T09:11:26.755343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:02.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.853295+0000","last_change":"2024-09-22T08:17:46.350484+0000","last_active":"2024-09-22T09:11:27.853295+0000","last_peered":"2024-09-22T09:11:27.853295+0000","last_clean":"2024-09-22T09:11:27.853295+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:11:27.853295+0000","last_undegraded":"2024-09-22T09:11:27.853295+0000","last_fullsized":"2024-09-22T09:11:27.853295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:56.012280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'168","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.540022+0000","last_change":"2024-09-22T08:17:48.364413+0000","last_active":"2024-09-22T09:14:04.540022+0000","last_peered":"2024-09-22T09:14:04.540022+0000","last_clean":"2024-09-22T09:14:04.540022+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:14:04.540022+0000","last_undegraded":"2024-09-22T09:14:04.540022+0000","last_fullsized":"2024-09-22T09:14:04.540022+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:40:16.567547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1112","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778132+0000","last_change":"2024-09-22T08:17:40.310933+0000","last_active":"2024-09-22T09:13:41.778132+0000","last_peered":"2024-09-22T09:13:41.778132+0000","last_clean":"2024-09-22T09:13:41.778132+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:13:41.778132+0000","last_undegraded":"2024-09-22T09:13:41.778132+0000","last_fullsized":"2024-09-22T09:13:41.778132+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:19.043581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'323","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873805+0000","last_change":"2024-09-22T08:17:38.312709+0000","last_active":"2024-09-22T09:16:02.873805+0000","last_peered":"2024-09-22T09:16:02.873805+0000","last_clean":"2024-09-22T09:16:02.873805+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:02.873805+0000","last_undegraded":"2024-09-22T09:16:02.873805+0000","last_fullsized":"2024-09-22T09:16:02.873805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:06.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":611,"num_read_kb":10746,"num_write":1176,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868449+0000","last_change":"2024-09-22T08:17:42.313569+0000","last_active":"2024-09-22T09:13:42.868449+0000","last_peered":"2024-09-22T09:13:42.868449+0000","last_clean":"2024-09-22T09:13:42.868449+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:13:42.868449+0000","last_undegraded":"2024-09-22T09:13:42.868449+0000","last_fullsized":"2024-09-22T09:13:42.868449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:08.034183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'293","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.770715+0000","last_change":"2024-09-22T08:17:44.330003+0000","last_active":"2024-09-22T09:16:01.770715+0000","last_peered":"2024-09-22T09:16:01.770715+0000","last_clean":"2024-09-22T09:16:01.770715+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:01.770715+0000","last_undegraded":"2024-09-22T09:16:01.770715+0000","last_fullsized":"2024-09-22T09:16:01.770715+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:32.877991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52572,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":989,"num_write":383,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:27.957514+0000","last_change":"2024-09-22T08:17:46.356371+0000","last_active":"2024-09-22T09:11:27.957514+0000","last_peered":"2024-09-22T09:11:27.957514+0000","last_clean":"2024-09-22T09:11:27.957514+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:11:27.957514+0000","last_undegraded":"2024-09-22T09:11:27.957514+0000","last_fullsized":"2024-09-22T09:11:27.957514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:25.542729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'671","reported_seq":2216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.368365+0000","last_change":"2024-09-22T08:17:40.311434+0000","last_active":"2024-09-22T09:14:05.368365+0000","last_peered":"2024-09-22T09:14:05.368365+0000","last_clean":"2024-09-22T09:14:05.368365+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:14:05.368365+0000","last_undegraded":"2024-09-22T09:14:05.368365+0000","last_fullsized":"2024-09-22T09:14:05.368365+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:05.862018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'340","reported_seq":1050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.778195+0000","last_change":"2024-09-22T08:17:38.311519+0000","last_active":"2024-09-22T09:16:01.778195+0000","last_peered":"2024-09-22T09:16:01.778195+0000","last_clean":"2024-09-22T09:16:01.778195+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:01.778195+0000","last_undegraded":"2024-09-22T09:16:01.778195+0000","last_fullsized":"2024-09-22T09:16:01.778195+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:22.084105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11984519,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":750,"num_read_kb":91878,"num_write":1278,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779094+0000","last_change":"2024-09-22T08:17:42.314653+0000","last_active":"2024-09-22T09:13:42.779094+0000","last_peered":"2024-09-22T09:13:42.779094+0000","last_clean":"2024-09-22T09:13:42.779094+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:13:42.779094+0000","last_undegraded":"2024-09-22T09:13:42.779094+0000","last_fullsized":"2024-09-22T09:13:42.779094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:43.222863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.590092+0000","last_change":"2024-09-22T08:17:44.333516+0000","last_active":"2024-09-22T09:16:01.590092+0000","last_peered":"2024-09-22T09:16:01.590092+0000","last_clean":"2024-09-22T09:16:01.590092+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:01.590092+0000","last_undegraded":"2024-09-22T09:16:01.590092+0000","last_fullsized":"2024-09-22T09:16:01.590092+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:11.332157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:26.755387+0000","last_change":"2024-09-22T08:17:46.353828+0000","last_active":"2024-09-22T09:11:26.755387+0000","last_peered":"2024-09-22T09:11:26.755387+0000","last_clean":"2024-09-22T09:11:26.755387+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:11:26.755387+0000","last_undegraded":"2024-09-22T09:11:26.755387+0000","last_fullsized":"2024-09-22T09:11:26.755387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:01.647431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'811","reported_seq":2471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211752+0000","last_change":"2024-09-22T08:17:40.320765+0000","last_active":"2024-09-22T09:14:02.211752+0000","last_peered":"2024-09-22T09:14:02.211752+0000","last_clean":"2024-09-22T09:14:02.211752+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:14:02.211752+0000","last_undegraded":"2024-09-22T09:14:02.211752+0000","last_fullsized":"2024-09-22T09:14:02.211752+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:32.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'284","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775430+0000","last_change":"2024-09-22T08:17:38.312312+0000","last_active":"2024-09-22T09:16:01.775430+0000","last_peered":"2024-09-22T09:16:01.775430+0000","last_clean":"2024-09-22T09:16:01.775430+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:01.775430+0000","last_undegraded":"2024-09-22T09:16:01.775430+0000","last_fullsized":"2024-09-22T09:16:01.775430+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:42.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5285041,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":504,"num_read_kb":11714,"num_write":1020,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.772343+0000","last_change":"2024-09-22T08:17:42.317020+0000","last_active":"2024-09-22T09:13:51.772343+0000","last_peered":"2024-09-22T09:13:51.772343+0000","last_clean":"2024-09-22T09:13:51.772343+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:13:51.772343+0000","last_undegraded":"2024-09-22T09:13:51.772343+0000","last_fullsized":"2024-09-22T09:13:51.772343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:52.212344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'464","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.492893+0000","last_change":"2024-09-22T08:17:44.328451+0000","last_active":"2024-09-22T09:16:01.492893+0000","last_peered":"2024-09-22T09:16:01.492893+0000","last_clean":"2024-09-22T09:16:01.492893+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:01.492893+0000","last_undegraded":"2024-09-22T09:16:01.492893+0000","last_fullsized":"2024-09-22T09:16:01.492893+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:33.770821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":837,"num_read_kb":1865,"num_write":720,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862398+0000","last_change":"2024-09-22T08:17:46.357073+0000","last_active":"2024-09-22T09:12:47.862398+0000","last_peered":"2024-09-22T09:12:47.862398+0000","last_clean":"2024-09-22T09:12:47.862398+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:12:47.862398+0000","last_undegraded":"2024-09-22T09:12:47.862398+0000","last_fullsized":"2024-09-22T09:12:47.862398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:46.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779894+0000","last_change":"2024-09-22T08:17:48.368356+0000","last_active":"2024-09-22T09:13:51.779894+0000","last_peered":"2024-09-22T09:13:51.779894+0000","last_clean":"2024-09-22T09:13:51.779894+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:13:51.779894+0000","last_undegraded":"2024-09-22T09:13:51.779894+0000","last_fullsized":"2024-09-22T09:13:51.779894+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:13.835369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779952+0000","last_change":"2024-09-22T08:17:40.313468+0000","last_active":"2024-09-22T09:13:51.779952+0000","last_peered":"2024-09-22T09:13:51.779952+0000","last_clean":"2024-09-22T09:13:51.779952+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:13:51.779952+0000","last_undegraded":"2024-09-22T09:13:51.779952+0000","last_fullsized":"2024-09-22T09:13:51.779952+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:48.343824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'338","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.723149+0000","last_change":"2024-09-22T08:17:38.309341+0000","last_active":"2024-09-22T09:16:01.723149+0000","last_peered":"2024-09-22T09:16:01.723149+0000","last_clean":"2024-09-22T09:16:01.723149+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:01.723149+0000","last_undegraded":"2024-09-22T09:16:01.723149+0000","last_fullsized":"2024-09-22T09:16:01.723149+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:09.613574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572103,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":728,"num_read_kb":2506,"num_write":1187,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870282+0000","last_change":"2024-09-22T08:17:42.318772+0000","last_active":"2024-09-22T09:13:57.870282+0000","last_peered":"2024-09-22T09:13:57.870282+0000","last_clean":"2024-09-22T09:13:57.870282+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:13:57.870282+0000","last_undegraded":"2024-09-22T09:13:57.870282+0000","last_fullsized":"2024-09-22T09:13:57.870282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.477954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.680306+0000","last_change":"2024-09-22T08:17:44.337248+0000","last_active":"2024-09-22T09:16:01.680306+0000","last_peered":"2024-09-22T09:16:01.680306+0000","last_clean":"2024-09-22T09:16:01.680306+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:01.680306+0000","last_undegraded":"2024-09-22T09:16:01.680306+0000","last_fullsized":"2024-09-22T09:16:01.680306+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:40.861866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.769839+0000","last_change":"2024-09-22T08:17:46.351080+0000","last_active":"2024-09-22T09:12:46.769839+0000","last_peered":"2024-09-22T09:12:46.769839+0000","last_clean":"2024-09-22T09:12:46.769839+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:12:46.769839+0000","last_undegraded":"2024-09-22T09:12:46.769839+0000","last_fullsized":"2024-09-22T09:12:46.769839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:09.613966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.091115+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:11:52.091115+0000","last_peered":"2024-09-22T09:11:52.091115+0000","last_clean":"2024-09-22T09:11:52.091115+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:11:52.091115+0000","last_undegraded":"2024-09-22T09:11:52.091115+0000","last_fullsized":"2024-09-22T09:11:52.091115+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1248","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.366126+0000","last_change":"2024-09-22T08:17:40.308494+0000","last_active":"2024-09-22T09:14:05.366126+0000","last_peered":"2024-09-22T09:14:05.366126+0000","last_clean":"2024-09-22T09:14:05.366126+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:14:05.366126+0000","last_undegraded":"2024-09-22T09:14:05.366126+0000","last_fullsized":"2024-09-22T09:14:05.366126+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:17.224433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'340","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.941276+0000","last_change":"2024-09-22T08:17:38.301468+0000","last_active":"2024-09-22T09:16:02.941276+0000","last_peered":"2024-09-22T09:16:02.941276+0000","last_clean":"2024-09-22T09:16:02.941276+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:02.941276+0000","last_undegraded":"2024-09-22T09:16:02.941276+0000","last_fullsized":"2024-09-22T09:16:02.941276+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:20.950022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098204,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":677,"num_read_kb":11614,"num_write":1094,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861833+0000","last_change":"2024-09-22T08:17:42.319109+0000","last_active":"2024-09-22T09:12:42.861833+0000","last_peered":"2024-09-22T09:12:42.861833+0000","last_clean":"2024-09-22T09:12:42.861833+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:12:42.861833+0000","last_undegraded":"2024-09-22T09:12:42.861833+0000","last_fullsized":"2024-09-22T09:12:42.861833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.764545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'287","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.278368+0000","last_change":"2024-09-22T08:17:44.329668+0000","last_active":"2024-09-22T09:15:24.278368+0000","last_peered":"2024-09-22T09:15:24.278368+0000","last_clean":"2024-09-22T09:15:24.278368+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:15:24.278368+0000","last_undegraded":"2024-09-22T09:15:24.278368+0000","last_fullsized":"2024-09-22T09:15:24.278368+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:13.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":1015,"num_write":402,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780532+0000","last_change":"2024-09-22T08:17:46.357031+0000","last_active":"2024-09-22T09:13:56.780532+0000","last_peered":"2024-09-22T09:13:56.780532+0000","last_clean":"2024-09-22T09:13:56.780532+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:13:56.780532+0000","last_undegraded":"2024-09-22T09:13:56.780532+0000","last_fullsized":"2024-09-22T09:13:56.780532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:29.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":640,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.285336+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.285336+0000","last_peered":"2024-09-22T09:15:24.285336+0000","last_clean":"2024-09-22T09:15:24.285336+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.285336+0000","last_undegraded":"2024-09-22T09:15:24.285336+0000","last_fullsized":"2024-09-22T09:15:24.285336+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'667","reported_seq":2093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211947+0000","last_change":"2024-09-22T08:17:40.312070+0000","last_active":"2024-09-22T09:14:02.211947+0000","last_peered":"2024-09-22T09:14:02.211947+0000","last_clean":"2024-09-22T09:14:02.211947+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:14:02.211947+0000","last_undegraded":"2024-09-22T09:14:02.211947+0000","last_fullsized":"2024-09-22T09:14:02.211947+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:59.960810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'246","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.720403+0000","last_change":"2024-09-22T08:17:38.300439+0000","last_active":"2024-09-22T09:16:01.720403+0000","last_peered":"2024-09-22T09:16:01.720403+0000","last_clean":"2024-09-22T09:16:01.720403+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:01.720403+0000","last_undegraded":"2024-09-22T09:16:01.720403+0000","last_fullsized":"2024-09-22T09:16:01.720403+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:30.381994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13761680,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":719,"num_read_kb":50024,"num_write":961,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769245+0000","last_change":"2024-09-22T08:17:42.312738+0000","last_active":"2024-09-22T09:12:41.769245+0000","last_peered":"2024-09-22T09:12:41.769245+0000","last_clean":"2024-09-22T09:12:41.769245+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:12:41.769245+0000","last_undegraded":"2024-09-22T09:12:41.769245+0000","last_fullsized":"2024-09-22T09:12:41.769245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:45.180659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'89","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.795335+0000","last_change":"2024-09-22T08:17:44.336865+0000","last_active":"2024-09-22T09:15:22.795335+0000","last_peered":"2024-09-22T09:15:22.795335+0000","last_clean":"2024-09-22T09:15:22.795335+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:15:22.795335+0000","last_undegraded":"2024-09-22T09:15:22.795335+0000","last_fullsized":"2024-09-22T09:15:22.795335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.810068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'779","reported_seq":2589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.372445+0000","last_change":"2024-09-22T08:17:46.350387+0000","last_active":"2024-09-22T09:16:01.372445+0000","last_peered":"2024-09-22T09:16:01.372445+0000","last_clean":"2024-09-22T09:16:01.372445+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:01.372445+0000","last_undegraded":"2024-09-22T09:16:01.372445+0000","last_fullsized":"2024-09-22T09:16:01.372445+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:22.815286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":681,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.932904+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:17.932904+0000","last_peered":"2024-09-22T09:13:17.932904+0000","last_clean":"2024-09-22T09:13:17.932904+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:17.932904+0000","last_undegraded":"2024-09-22T09:13:17.932904+0000","last_fullsized":"2024-09-22T09:13:17.932904+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'505","reported_seq":2211,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.700019+0000","last_change":"2024-09-22T08:17:40.320955+0000","last_active":"2024-09-22T09:13:27.700019+0000","last_peered":"2024-09-22T09:13:27.700019+0000","last_clean":"2024-09-22T09:13:27.700019+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:13:27.700019+0000","last_undegraded":"2024-09-22T09:13:27.700019+0000","last_fullsized":"2024-09-22T09:13:27.700019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:36.450185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'346","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.956252+0000","last_change":"2024-09-22T08:17:38.297556+0000","last_active":"2024-09-22T09:16:02.956252+0000","last_peered":"2024-09-22T09:16:02.956252+0000","last_clean":"2024-09-22T09:16:02.956252+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:02.956252+0000","last_undegraded":"2024-09-22T09:16:02.956252+0000","last_fullsized":"2024-09-22T09:16:02.956252+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:27.230525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6597524,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":617,"num_read_kb":33739,"num_write":1091,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.965759+0000","last_change":"2024-09-22T08:17:42.321443+0000","last_active":"2024-09-22T09:12:42.965759+0000","last_peered":"2024-09-22T09:12:42.965759+0000","last_clean":"2024-09-22T09:12:42.965759+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:12:42.965759+0000","last_undegraded":"2024-09-22T09:12:42.965759+0000","last_fullsized":"2024-09-22T09:12:42.965759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:41.703609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'295","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.991339+0000","last_change":"2024-09-22T08:17:44.334035+0000","last_active":"2024-09-22T09:15:52.991339+0000","last_peered":"2024-09-22T09:15:52.991339+0000","last_clean":"2024-09-22T09:15:52.991339+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:15:52.991339+0000","last_undegraded":"2024-09-22T09:15:52.991339+0000","last_fullsized":"2024-09-22T09:15:52.991339+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:29.638317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56058,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":937,"num_write":386,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.775383+0000","last_change":"2024-09-22T08:17:46.356892+0000","last_active":"2024-09-22T09:13:21.775383+0000","last_peered":"2024-09-22T09:13:21.775383+0000","last_clean":"2024-09-22T09:13:21.775383+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:13:21.775383+0000","last_undegraded":"2024-09-22T09:13:21.775383+0000","last_fullsized":"2024-09-22T09:13:21.775383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:04.578235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'130","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.528881+0000","last_change":"2024-09-22T08:17:48.366280+0000","last_active":"2024-09-22T09:14:02.528881+0000","last_peered":"2024-09-22T09:14:02.528881+0000","last_clean":"2024-09-22T09:14:02.528881+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:14:02.528881+0000","last_undegraded":"2024-09-22T09:14:02.528881+0000","last_fullsized":"2024-09-22T09:14:02.528881+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:56.027995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1506","reported_seq":3219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183120+0000","last_change":"2024-09-22T08:17:40.310983+0000","last_active":"2024-09-22T09:13:23.183120+0000","last_peered":"2024-09-22T09:13:23.183120+0000","last_clean":"2024-09-22T09:13:23.183120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:13:23.183120+0000","last_undegraded":"2024-09-22T09:13:23.183120+0000","last_fullsized":"2024-09-22T09:13:23.183120+0000","mapping_epoch":27,"log_start":"261'1400","ondisk_log_start":"261'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:35.395564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'291","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.683318+0000","last_change":"2024-09-22T08:17:38.304935+0000","last_active":"2024-09-22T09:16:02.683318+0000","last_peered":"2024-09-22T09:16:02.683318+0000","last_clean":"2024-09-22T09:16:02.683318+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:02.683318+0000","last_undegraded":"2024-09-22T09:16:02.683318+0000","last_fullsized":"2024-09-22T09:16:02.683318+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:21.548021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17850038,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":711,"num_read_kb":31336,"num_write":990,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861818+0000","last_change":"2024-09-22T08:17:42.318147+0000","last_active":"2024-09-22T09:12:42.861818+0000","last_peered":"2024-09-22T09:12:42.861818+0000","last_clean":"2024-09-22T09:12:42.861818+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:12:42.861818+0000","last_undegraded":"2024-09-22T09:12:42.861818+0000","last_fullsized":"2024-09-22T09:12:42.861818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:04.949197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'306","reported_seq":869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:46.796614+0000","last_change":"2024-09-22T08:17:44.332720+0000","last_active":"2024-09-22T09:15:46.796614+0000","last_peered":"2024-09-22T09:15:46.796614+0000","last_clean":"2024-09-22T09:15:46.796614+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:15:46.796614+0000","last_undegraded":"2024-09-22T09:15:46.796614+0000","last_fullsized":"2024-09-22T09:15:46.796614+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:17.326913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158139,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1234,"num_write":414,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'507","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.775921+0000","last_change":"2024-09-22T08:17:40.310131+0000","last_active":"2024-09-22T09:13:26.775921+0000","last_peered":"2024-09-22T09:13:26.775921+0000","last_clean":"2024-09-22T09:13:26.775921+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:13:26.775921+0000","last_undegraded":"2024-09-22T09:13:26.775921+0000","last_fullsized":"2024-09-22T09:13:26.775921+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:45.234169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'325","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.793403+0000","last_change":"2024-09-22T08:17:38.307916+0000","last_active":"2024-09-22T09:16:01.793403+0000","last_peered":"2024-09-22T09:16:01.793403+0000","last_clean":"2024-09-22T09:16:01.793403+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:01.793403+0000","last_undegraded":"2024-09-22T09:16:01.793403+0000","last_fullsized":"2024-09-22T09:16:01.793403+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:54.133795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12264533,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":605,"num_read_kb":50425,"num_write":1146,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.969462+0000","last_change":"2024-09-22T08:17:42.318093+0000","last_active":"2024-09-22T09:13:17.969462+0000","last_peered":"2024-09-22T09:13:17.969462+0000","last_clean":"2024-09-22T09:13:17.969462+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:13:17.969462+0000","last_undegraded":"2024-09-22T09:13:17.969462+0000","last_fullsized":"2024-09-22T09:13:17.969462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:12.353580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'244","reported_seq":782,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.276145+0000","last_change":"2024-09-22T08:17:44.332231+0000","last_active":"2024-09-22T09:15:24.276145+0000","last_peered":"2024-09-22T09:15:24.276145+0000","last_clean":"2024-09-22T09:15:24.276145+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:15:24.276145+0000","last_undegraded":"2024-09-22T09:15:24.276145+0000","last_fullsized":"2024-09-22T09:15:24.276145+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:01.307744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53531,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":409,"num_read_kb":891,"num_write":342,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'430","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.212080+0000","last_change":"2024-09-22T08:17:40.314834+0000","last_active":"2024-09-22T09:13:21.212080+0000","last_peered":"2024-09-22T09:13:21.212080+0000","last_clean":"2024-09-22T09:13:21.212080+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:13:21.212080+0000","last_undegraded":"2024-09-22T09:13:21.212080+0000","last_fullsized":"2024-09-22T09:13:21.212080+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:48.705025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'295","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787004+0000","last_change":"2024-09-22T08:17:38.311548+0000","last_active":"2024-09-22T09:16:01.787004+0000","last_peered":"2024-09-22T09:16:01.787004+0000","last_clean":"2024-09-22T09:16:01.787004+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:01.787004+0000","last_undegraded":"2024-09-22T09:16:01.787004+0000","last_fullsized":"2024-09-22T09:16:01.787004+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:46.517280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19469174,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":553,"num_read_kb":43721,"num_write":1074,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.776027+0000","last_change":"2024-09-22T08:17:42.314063+0000","last_active":"2024-09-22T09:13:26.776027+0000","last_peered":"2024-09-22T09:13:26.776027+0000","last_clean":"2024-09-22T09:13:26.776027+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:13:26.776027+0000","last_undegraded":"2024-09-22T09:13:26.776027+0000","last_fullsized":"2024-09-22T09:13:26.776027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:31.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'310","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.279703+0000","last_change":"2024-09-22T08:17:44.339434+0000","last_active":"2024-09-22T09:15:24.279703+0000","last_peered":"2024-09-22T09:15:24.279703+0000","last_clean":"2024-09-22T09:15:24.279703+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:15:24.279703+0000","last_undegraded":"2024-09-22T09:15:24.279703+0000","last_fullsized":"2024-09-22T09:15:24.279703+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:14.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64909,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":1020,"num_write":414,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.770004+0000","last_change":"2024-09-22T08:17:46.354487+0000","last_active":"2024-09-22T09:12:46.770004+0000","last_peered":"2024-09-22T09:12:46.770004+0000","last_clean":"2024-09-22T09:12:46.770004+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:12:46.770004+0000","last_undegraded":"2024-09-22T09:12:46.770004+0000","last_fullsized":"2024-09-22T09:12:46.770004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:13.119686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'139","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.752829+0000","last_change":"2024-09-22T08:17:48.372094+0000","last_active":"2024-09-22T09:15:22.752829+0000","last_peered":"2024-09-22T09:15:22.752829+0000","last_clean":"2024-09-22T09:15:22.752829+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:15:22.752829+0000","last_undegraded":"2024-09-22T09:15:22.752829+0000","last_fullsized":"2024-09-22T09:15:22.752829+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:49.984539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'514","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:08.228455+0000","last_change":"2024-09-22T08:17:40.316760+0000","last_active":"2024-09-22T09:13:08.228455+0000","last_peered":"2024-09-22T09:13:08.228455+0000","last_clean":"2024-09-22T09:13:08.228455+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:13:08.228455+0000","last_undegraded":"2024-09-22T09:13:08.228455+0000","last_fullsized":"2024-09-22T09:13:08.228455+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:42.550645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'297","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.858092+0000","last_change":"2024-09-22T08:17:38.311771+0000","last_active":"2024-09-22T09:16:02.858092+0000","last_peered":"2024-09-22T09:16:02.858092+0000","last_clean":"2024-09-22T09:16:02.858092+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:02.858092+0000","last_undegraded":"2024-09-22T09:16:02.858092+0000","last_fullsized":"2024-09-22T09:16:02.858092+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:56.381847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325064,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":508,"num_read_kb":33852,"num_write":931,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'417","reported_seq":1875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.760299+0000","last_change":"2024-09-22T08:17:40.313063+0000","last_active":"2024-09-22T09:11:51.760299+0000","last_peered":"2024-09-22T09:11:51.760299+0000","last_clean":"2024-09-22T09:11:51.760299+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:11:51.760299+0000","last_undegraded":"2024-09-22T09:11:51.760299+0000","last_fullsized":"2024-09-22T09:11:51.760299+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:41.064638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'272","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.798028+0000","last_change":"2024-09-22T08:17:38.300470+0000","last_active":"2024-09-22T09:16:01.798028+0000","last_peered":"2024-09-22T09:16:01.798028+0000","last_clean":"2024-09-22T09:16:01.798028+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:01.798028+0000","last_undegraded":"2024-09-22T09:16:01.798028+0000","last_fullsized":"2024-09-22T09:16:01.798028+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:42.767130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906219,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":498,"num_read_kb":87969,"num_write":902,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.766032+0000","last_change":"2024-09-22T08:17:40.312973+0000","last_active":"2024-09-22T09:15:22.766032+0000","last_peered":"2024-09-22T09:15:22.766032+0000","last_clean":"2024-09-22T09:15:22.766032+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:15:22.766032+0000","last_undegraded":"2024-09-22T09:15:22.766032+0000","last_fullsized":"2024-09-22T09:15:22.766032+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:28.486740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'381","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.752833+0000","last_change":"2024-09-22T08:17:38.323059+0000","last_active":"2024-09-22T09:16:02.752833+0000","last_peered":"2024-09-22T09:16:02.752833+0000","last_clean":"2024-09-22T09:16:02.752833+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:02.752833+0000","last_undegraded":"2024-09-22T09:16:02.752833+0000","last_fullsized":"2024-09-22T09:16:02.752833+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:37.193303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329113,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":875,"num_read_kb":34718,"num_write":1245,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'748","reported_seq":2556,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.184911+0000","last_change":"2024-09-22T08:17:40.313093+0000","last_active":"2024-09-22T09:14:02.184911+0000","last_peered":"2024-09-22T09:14:02.184911+0000","last_clean":"2024-09-22T09:14:02.184911+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:14:02.184911+0000","last_undegraded":"2024-09-22T09:14:02.184911+0000","last_fullsized":"2024-09-22T09:14:02.184911+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:35.949195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'312","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.776947+0000","last_change":"2024-09-22T08:17:38.310044+0000","last_active":"2024-09-22T09:16:01.776947+0000","last_peered":"2024-09-22T09:16:01.776947+0000","last_clean":"2024-09-22T09:16:01.776947+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:01.776947+0000","last_undegraded":"2024-09-22T09:16:01.776947+0000","last_fullsized":"2024-09-22T09:16:01.776947+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:59.605789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7970484,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":738,"num_read_kb":20346,"num_write":1086,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'494","reported_seq":2066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:05.245095+0000","last_change":"2024-09-22T08:17:40.314007+0000","last_active":"2024-09-22T09:13:05.245095+0000","last_peered":"2024-09-22T09:13:05.245095+0000","last_clean":"2024-09-22T09:13:05.245095+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:13:05.245095+0000","last_undegraded":"2024-09-22T09:13:05.245095+0000","last_fullsized":"2024-09-22T09:13:05.245095+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:30.609929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'279","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754464+0000","last_change":"2024-09-22T08:17:38.312019+0000","last_active":"2024-09-22T09:16:01.754464+0000","last_peered":"2024-09-22T09:16:01.754464+0000","last_clean":"2024-09-22T09:16:01.754464+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:01.754464+0000","last_undegraded":"2024-09-22T09:16:01.754464+0000","last_fullsized":"2024-09-22T09:16:01.754464+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:06.122619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10784758,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":479,"num_read_kb":26435,"num_write":1006,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'717","reported_seq":2220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.362495+0000","last_change":"2024-09-22T08:17:40.312561+0000","last_active":"2024-09-22T09:14:05.362495+0000","last_peered":"2024-09-22T09:14:05.362495+0000","last_clean":"2024-09-22T09:14:05.362495+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:14:05.362495+0000","last_undegraded":"2024-09-22T09:14:05.362495+0000","last_fullsized":"2024-09-22T09:14:05.362495+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:01.994997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'301","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.754398+0000","last_change":"2024-09-22T08:17:38.308183+0000","last_active":"2024-09-22T09:16:01.754398+0000","last_peered":"2024-09-22T09:16:01.754398+0000","last_clean":"2024-09-22T09:16:01.754398+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:01.754398+0000","last_undegraded":"2024-09-22T09:16:01.754398+0000","last_fullsized":"2024-09-22T09:16:01.754398+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:02.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":800538,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":725,"num_read_kb":911,"num_write":1010,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'458","reported_seq":2142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.210418+0000","last_change":"2024-09-22T08:17:40.319770+0000","last_active":"2024-09-22T09:14:02.210418+0000","last_peered":"2024-09-22T09:14:02.210418+0000","last_clean":"2024-09-22T09:14:02.210418+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:14:02.210418+0000","last_undegraded":"2024-09-22T09:14:02.210418+0000","last_fullsized":"2024-09-22T09:14:02.210418+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:00.471168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'402","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.861482+0000","last_change":"2024-09-22T08:17:38.312486+0000","last_active":"2024-09-22T09:16:02.861482+0000","last_peered":"2024-09-22T09:16:02.861482+0000","last_clean":"2024-09-22T09:16:02.861482+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:02.861482+0000","last_undegraded":"2024-09-22T09:16:02.861482+0000","last_fullsized":"2024-09-22T09:16:02.861482+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:17.480840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3209675,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":892,"num_read_kb":31161,"num_write":1620,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'488","reported_seq":2208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.973888+0000","last_change":"2024-09-22T08:17:40.316623+0000","last_active":"2024-09-22T09:13:57.973888+0000","last_peered":"2024-09-22T09:13:57.973888+0000","last_clean":"2024-09-22T09:13:57.973888+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:13:57.973888+0000","last_undegraded":"2024-09-22T09:13:57.973888+0000","last_fullsized":"2024-09-22T09:13:57.973888+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:49.821404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'267","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.693440+0000","last_change":"2024-09-22T08:17:38.311100+0000","last_active":"2024-09-22T09:16:01.693440+0000","last_peered":"2024-09-22T09:16:01.693440+0000","last_clean":"2024-09-22T09:16:01.693440+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:01.693440+0000","last_undegraded":"2024-09-22T09:16:01.693440+0000","last_fullsized":"2024-09-22T09:16:01.693440+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:07.379794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4585808,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":610,"num_read_kb":8116,"num_write":953,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'852","reported_seq":2593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.783462+0000","last_change":"2024-09-22T08:17:40.310815+0000","last_active":"2024-09-22T09:15:22.783462+0000","last_peered":"2024-09-22T09:15:22.783462+0000","last_clean":"2024-09-22T09:15:22.783462+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:15:22.783462+0000","last_undegraded":"2024-09-22T09:15:22.783462+0000","last_fullsized":"2024-09-22T09:15:22.783462+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:55.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'371","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.755728+0000","last_change":"2024-09-22T08:17:38.301015+0000","last_active":"2024-09-22T09:16:02.755728+0000","last_peered":"2024-09-22T09:16:02.755728+0000","last_clean":"2024-09-22T09:16:02.755728+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:02.755728+0000","last_undegraded":"2024-09-22T09:16:02.755728+0000","last_fullsized":"2024-09-22T09:16:02.755728+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:50.406073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246701,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":737,"num_read_kb":152949,"num_write":1281,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'439","reported_seq":2069,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975225+0000","last_change":"2024-09-22T08:17:40.307816+0000","last_active":"2024-09-22T09:13:42.975225+0000","last_peered":"2024-09-22T09:13:42.975225+0000","last_clean":"2024-09-22T09:13:42.975225+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:13:42.975225+0000","last_undegraded":"2024-09-22T09:13:42.975225+0000","last_fullsized":"2024-09-22T09:13:42.975225+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:41.447631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'291","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.644338+0000","last_change":"2024-09-22T08:17:38.309543+0000","last_active":"2024-09-22T09:16:01.644338+0000","last_peered":"2024-09-22T09:16:01.644338+0000","last_clean":"2024-09-22T09:16:01.644338+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:01.644338+0000","last_undegraded":"2024-09-22T09:16:01.644338+0000","last_fullsized":"2024-09-22T09:16:01.644338+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.497443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12739950,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":556,"num_read_kb":9331,"num_write":1137,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'926","reported_seq":2504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182211+0000","last_change":"2024-09-22T08:17:40.318830+0000","last_active":"2024-09-22T09:13:23.182211+0000","last_peered":"2024-09-22T09:13:23.182211+0000","last_clean":"2024-09-22T09:13:23.182211+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:13:23.182211+0000","last_undegraded":"2024-09-22T09:13:23.182211+0000","last_fullsized":"2024-09-22T09:13:23.182211+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:03.450267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'325","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.873452+0000","last_change":"2024-09-22T08:17:38.301156+0000","last_active":"2024-09-22T09:16:02.873452+0000","last_peered":"2024-09-22T09:16:02.873452+0000","last_clean":"2024-09-22T09:16:02.873452+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:02.873452+0000","last_undegraded":"2024-09-22T09:16:02.873452+0000","last_fullsized":"2024-09-22T09:16:02.873452+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:49.656421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2515,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":573,"num_read_kb":484,"num_write":1160,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'829","reported_seq":2459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.345949+0000","last_change":"2024-09-22T08:17:40.315626+0000","last_active":"2024-09-22T09:14:05.345949+0000","last_peered":"2024-09-22T09:14:05.345949+0000","last_clean":"2024-09-22T09:14:05.345949+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:14:05.345949+0000","last_undegraded":"2024-09-22T09:14:05.345949+0000","last_fullsized":"2024-09-22T09:14:05.345949+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:29.496843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'389","reported_seq":1108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.759785+0000","last_change":"2024-09-22T08:17:38.311224+0000","last_active":"2024-09-22T09:16:01.759785+0000","last_peered":"2024-09-22T09:16:01.759785+0000","last_clean":"2024-09-22T09:16:01.759785+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:01.759785+0000","last_undegraded":"2024-09-22T09:16:01.759785+0000","last_fullsized":"2024-09-22T09:16:01.759785+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:31.603904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11162960,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":816,"num_read_kb":67481,"num_write":1471,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.180874+0000","last_change":"2024-09-22T08:17:40.316250+0000","last_active":"2024-09-22T09:14:02.180874+0000","last_peered":"2024-09-22T09:14:02.180874+0000","last_clean":"2024-09-22T09:14:02.180874+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:14:02.180874+0000","last_undegraded":"2024-09-22T09:14:02.180874+0000","last_fullsized":"2024-09-22T09:14:02.180874+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:06.328790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'292","reported_seq":930,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.899511+0000","last_change":"2024-09-22T08:17:38.310546+0000","last_active":"2024-09-22T09:16:02.899511+0000","last_peered":"2024-09-22T09:16:02.899511+0000","last_clean":"2024-09-22T09:16:02.899511+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:02.899511+0000","last_undegraded":"2024-09-22T09:16:02.899511+0000","last_fullsized":"2024-09-22T09:16:02.899511+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:46.666253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573254,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":613,"num_read_kb":4113,"num_write":1012,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1339","reported_seq":3007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.333630+0000","last_change":"2024-09-22T08:17:40.314448+0000","last_active":"2024-09-22T09:14:05.333630+0000","last_peered":"2024-09-22T09:14:05.333630+0000","last_clean":"2024-09-22T09:14:05.333630+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:14:05.333630+0000","last_undegraded":"2024-09-22T09:14:05.333630+0000","last_fullsized":"2024-09-22T09:14:05.333630+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:14.842589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'298","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.772749+0000","last_change":"2024-09-22T08:17:38.320511+0000","last_active":"2024-09-22T09:16:02.772749+0000","last_peered":"2024-09-22T09:16:02.772749+0000","last_clean":"2024-09-22T09:16:02.772749+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:02.772749+0000","last_undegraded":"2024-09-22T09:16:02.772749+0000","last_fullsized":"2024-09-22T09:16:02.772749+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:38.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762897,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":545,"num_read_kb":7532,"num_write":940,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'878","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.768832+0000","last_change":"2024-09-22T08:17:40.320847+0000","last_active":"2024-09-22T09:15:22.768832+0000","last_peered":"2024-09-22T09:15:22.768832+0000","last_clean":"2024-09-22T09:15:22.768832+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:15:22.768832+0000","last_undegraded":"2024-09-22T09:15:22.768832+0000","last_fullsized":"2024-09-22T09:15:22.768832+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:28.338764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'259","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.787703+0000","last_change":"2024-09-22T08:18:09.819737+0000","last_active":"2024-09-22T09:16:01.787703+0000","last_peered":"2024-09-22T09:16:01.787703+0000","last_clean":"2024-09-22T09:16:01.787703+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:01.787703+0000","last_undegraded":"2024-09-22T09:16:01.787703+0000","last_fullsized":"2024-09-22T09:16:01.787703+0000","mapping_epoch":38,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:16.118674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6224262,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":758,"num_read_kb":1204,"num_write":971,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'587","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.755926+0000","last_change":"2024-09-22T08:17:40.320732+0000","last_active":"2024-09-22T09:15:22.755926+0000","last_peered":"2024-09-22T09:15:22.755926+0000","last_clean":"2024-09-22T09:15:22.755926+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:15:22.755926+0000","last_undegraded":"2024-09-22T09:15:22.755926+0000","last_fullsized":"2024-09-22T09:15:22.755926+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:52.124048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'314","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.719464+0000","last_change":"2024-09-22T08:17:38.316645+0000","last_active":"2024-09-22T09:16:02.719464+0000","last_peered":"2024-09-22T09:16:02.719464+0000","last_clean":"2024-09-22T09:16:02.719464+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:02.719464+0000","last_undegraded":"2024-09-22T09:16:02.719464+0000","last_fullsized":"2024-09-22T09:16:02.719464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:19.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15752910,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":570,"num_read_kb":65830,"num_write":1047,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'269","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.614638+0000","last_change":"2024-09-22T08:17:38.316368+0000","last_active":"2024-09-22T09:16:02.614638+0000","last_peered":"2024-09-22T09:16:02.614638+0000","last_clean":"2024-09-22T09:16:02.614638+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:02.614638+0000","last_undegraded":"2024-09-22T09:16:02.614638+0000","last_fullsized":"2024-09-22T09:16:02.614638+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:43.345144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2049610,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":460,"num_read_kb":15571,"num_write":1018,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'501","reported_seq":2189,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.789250+0000","last_change":"2024-09-22T08:17:40.321379+0000","last_active":"2024-09-22T09:15:22.789250+0000","last_peered":"2024-09-22T09:15:22.789250+0000","last_clean":"2024-09-22T09:15:22.789250+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:15:22.789250+0000","last_undegraded":"2024-09-22T09:15:22.789250+0000","last_fullsized":"2024-09-22T09:15:22.789250+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:25.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'276","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775408+0000","last_change":"2024-09-22T08:17:38.303976+0000","last_active":"2024-09-22T09:16:01.775408+0000","last_peered":"2024-09-22T09:16:01.775408+0000","last_clean":"2024-09-22T09:16:01.775408+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:01.775408+0000","last_undegraded":"2024-09-22T09:16:01.775408+0000","last_fullsized":"2024-09-22T09:16:01.775408+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:08.002217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243507,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":503,"num_read_kb":80287,"num_write":990,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'500","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.527398+0000","last_change":"2024-09-22T08:17:40.312319+0000","last_active":"2024-09-22T09:14:04.527398+0000","last_peered":"2024-09-22T09:14:04.527398+0000","last_clean":"2024-09-22T09:14:04.527398+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:14:04.527398+0000","last_undegraded":"2024-09-22T09:14:04.527398+0000","last_fullsized":"2024-09-22T09:14:04.527398+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.277593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1830236,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":17796,"num_read_kb":34953,"num_write":15086,"num_write_kb":11910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2351104,"data_stored":1883519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2138,"ondisk_log_size":2138,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":404827577,"num_objects":2945,"num_object_clones":0,"num_object_copies":11780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2945,"num_whiteouts":0,"num_read":41707,"num_read_kb":2189039,"num_write":70646,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":567025664,"data_stored":567025664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3961,"ondisk_log_size":3961,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59355078,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":128,"num_read_kb":207543,"num_write":146,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129204224,"data_stored":129195916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":38333099,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":130,"num_read_kb":198277,"num_write":152,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87617536,"data_stored":87616171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510148,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403252,"kb_used_data":169336,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93968588,"statfs":{"total":96636764160,"available":96223834112,"internally_reserved":0,"allocated":173400064,"data_stored":171407867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510148,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250256,"kb_used_data":80160,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":94121584,"statfs":{"total":96636764160,"available":96380502016,"internally_reserved":0,"allocated":82083840,"data_stored":80133463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510151,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449516,"kb_used_data":121236,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93922324,"statfs":{"total":96636764160,"available":96176459776,"internally_reserved":0,"allocated":124145664,"data_stored":122116746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510150,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209644,"kb_used_data":106264,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162196,"statfs":{"total":96636764160,"available":96422088704,"internally_reserved":0,"allocated":108814336,"data_stored":106798896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542853,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368196,"kb_used_data":138548,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94003644,"statfs":{"total":96636764160,"available":96259731456,"internally_reserved":0,"allocated":141873152,"data_stored":139882929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542855,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232716,"kb_used_data":121020,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94139124,"statfs":{"total":96636764160,"available":96398462976,"internally_reserved":0,"allocated":123924480,"data_stored":121898980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542854,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412648,"kb_used_data":146840,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93959192,"statfs":{"total":96636764160,"available":96214212608,"internally_reserved":0,"allocated":150364160,"data_stored":148347559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542852,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335544,"kb_used_data":119784,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94036296,"statfs":{"total":96636764160,"available":96293167104,"internally_reserved":0,"allocated":122658816,"data_stored":120657976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60309504,"data_stored":60309504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46854144,"data_stored":46854144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64987136,"data_stored":64987136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62046208,"data_stored":62046208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":89866240,"data_stored":89866240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93360128,"data_stored":93360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63471616,"data_stored":63471616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86130688,"data_stored":86130688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":218276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":206788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":139079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":393967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":338184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":295654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":248307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3198976,"data_stored":3196187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16314368,"data_stored":16313003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:05.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T09:16:05.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:05.455 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":261,"fsid":"fb7d2a29-3bc5-40a0-aeb1-20c2144e6fc8","created":"2024-09-22T08:17:04.314792+0000","modified":"2024-09-22T08:51:49.541206+0000","last_up_change":"2024-09-22T08:17:17.179098+0000","last_in_change":"2024-09-22T08:17:07.489855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:17:16.610776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:17:23.342577+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-22T08:17:36.263885+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-22T08:17:38.631775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-22T08:17:40.464955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-22T08:17:42.370292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-22T08:17:44.342406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-22T08:17:46.411430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-22T08:33:31.278612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-22T08:36:13.412226+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-22T08:36:16.200723+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-22T08:51:46.634332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"75c980d6-b21d-4979-af3a-698d775e8476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6803","nonce":670624169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6805","nonce":670624169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6809","nonce":670624169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":670624169},{"type":"v1","addr":"172.21.15.78:6807","nonce":670624169}]},"public_addr":"172.21.15.78:6803/670624169","cluster_addr":"172.21.15.78:6805/670624169","heartbeat_back_addr":"172.21.15.78:6809/670624169","heartbeat_front_addr":"172.21.15.78:6807/670624169","state":["exists","up"]},{"osd":1,"uuid":"150179c9-39f6-4fbf-bf9f-9addaf887ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6811","nonce":3985180551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6813","nonce":3985180551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6817","nonce":3985180551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3985180551},{"type":"v1","addr":"172.21.15.78:6815","nonce":3985180551}]},"public_addr":"172.21.15.78:6811/3985180551","cluster_addr":"172.21.15.78:6813/3985180551","heartbeat_back_addr":"172.21.15.78:6817/3985180551","heartbeat_front_addr":"172.21.15.78:6815/3985180551","state":["exists","up"]},{"osd":2,"uuid":"2e18cce0-0331-4aa9-94b2-d4e666438542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6819","nonce":3367866564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6821","nonce":3367866564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6825","nonce":3367866564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3367866564},{"type":"v1","addr":"172.21.15.78:6823","nonce":3367866564}]},"public_addr":"172.21.15.78:6819/3367866564","cluster_addr":"172.21.15.78:6821/3367866564","heartbeat_back_addr":"172.21.15.78:6825/3367866564","heartbeat_front_addr":"172.21.15.78:6823/3367866564","state":["exists","up"]},{"osd":3,"uuid":"ef1fcc1f-90fb-4115-94ca-1aa88f9e0385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6827","nonce":1196772508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6829","nonce":1196772508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6833","nonce":1196772508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":1196772508},{"type":"v1","addr":"172.21.15.78:6831","nonce":1196772508}]},"public_addr":"172.21.15.78:6827/1196772508","cluster_addr":"172.21.15.78:6829/1196772508","heartbeat_back_addr":"172.21.15.78:6833/1196772508","heartbeat_front_addr":"172.21.15.78:6831/1196772508","state":["exists","up"]},{"osd":4,"uuid":"b79fbab0-55ef-4583-997c-89d7bac6c38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6801","nonce":1364473755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6803","nonce":1364473755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6807","nonce":1364473755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1364473755},{"type":"v1","addr":"172.21.15.171:6805","nonce":1364473755}]},"public_addr":"172.21.15.171:6801/1364473755","cluster_addr":"172.21.15.171:6803/1364473755","heartbeat_back_addr":"172.21.15.171:6807/1364473755","heartbeat_front_addr":"172.21.15.171:6805/1364473755","state":["exists","up"]},{"osd":5,"uuid":"90c93999-3519-4548-8d11-ba9fc05593ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6817","nonce":959803971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6819","nonce":959803971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6823","nonce":959803971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":959803971},{"type":"v1","addr":"172.21.15.171:6821","nonce":959803971}]},"public_addr":"172.21.15.171:6817/959803971","cluster_addr":"172.21.15.171:6819/959803971","heartbeat_back_addr":"172.21.15.171:6823/959803971","heartbeat_front_addr":"172.21.15.171:6821/959803971","state":["exists","up"]},{"osd":6,"uuid":"02f18f4d-b281-436b-a28f-c8262ecb719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6825","nonce":2960376290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6827","nonce":2960376290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6831","nonce":2960376290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2960376290},{"type":"v1","addr":"172.21.15.171:6829","nonce":2960376290}]},"public_addr":"172.21.15.171:6825/2960376290","cluster_addr":"172.21.15.171:6827/2960376290","heartbeat_back_addr":"172.21.15.171:6831/2960376290","heartbeat_front_addr":"172.21.15.171:6829/2960376290","state":["exists","up"]},{"osd":7,"uuid":"0a5b9fda-9fa6-4f69-92d5-8c29b339fd35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6809","nonce":3588151379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6811","nonce":3588151379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6815","nonce":3588151379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3588151379},{"type":"v1","addr":"172.21.15.171:6813","nonce":3588151379}]},"public_addr":"172.21.15.171:6809/3588151379","cluster_addr":"172.21.15.171:6811/3588151379","heartbeat_back_addr":"172.21.15.171:6815/3588151379","heartbeat_front_addr":"172.21.15.171:6813/3588151379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.992913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.834461+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.092051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:14.070162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.623614+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.969541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.792169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:17:13.662319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":5}]},{"pgid":"3.14","mappings":[{"from":2,"to":6}]},{"pgid":"3.2e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T09:16:06.469 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T09:16:06.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:06.620 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:06.620 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:06.620 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:06.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T09:16:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T09:16:06.945 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T09:16:06.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:07.081 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:07.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T09:16:07.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-22T09:16:07.390 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T09:16:07.404 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T09:16:07.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:07.540 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:07.540 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:07.540 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:07.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T09:16:07.857 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T09:16:07.870 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T09:16:07.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:08.008 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:08.008 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:08.008 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:08.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T09:16:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T09:16:08.334 INFO:tasks.ceph:Scrubbing osd.4 2024-09-22T09:16:08.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:08.472 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:08.472 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:08.472 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:08.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-22T09:16:08.785 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-09-22T09:16:08.798 INFO:tasks.ceph:Scrubbing osd.5 2024-09-22T09:16:08.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:08.937 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:08.937 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:08.937 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:08.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-22T09:16:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-09-22T09:16:09.262 INFO:tasks.ceph:Scrubbing osd.6 2024-09-22T09:16:09.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:09.398 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:09.398 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:09.398 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:09.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-22T09:16:09.715 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-09-22T09:16:09.728 INFO:tasks.ceph:Scrubbing osd.7 2024-09-22T09:16:09.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:16:09.866 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-22T09:16:09.867 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:16:09.867 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-22T09:16:09.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-22T09:16:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-09-22T09:16:10.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:10.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:10.531 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:10.533 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2020,"stamp":"2024-09-22T09:16:09.853835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53921399,"num_objects":751,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":313725,"num_read_kb":2862731,"num_write":165438,"num_write_kb":2483177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13685,"ondisk_log_size":13685,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1798984,"kb_used_data":102872,"kb_used_omap":12,"kb_used_meta":1694387,"kb_avail":753175736,"statfs":{"total":773094113280,"available":771251953664,"internally_reserved":0,"allocated":105340928,"data_stored":89574178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1735052848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-684076710,"num_objects":-4106,"num_object_clones":0,"num_object_copies":-16344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4106,"num_whiteouts":0,"num_read":4596,"num_read_kb":4136,"num_write":4359,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005382"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962647+0000","last_change":"2024-09-22T08:51:48.551836+0000","last_active":"2024-09-22T09:11:47.962647+0000","last_peered":"2024-09-22T09:11:47.962647+0000","last_clean":"2024-09-22T09:11:47.962647+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:11:47.962647+0000","last_undegraded":"2024-09-22T09:11:47.962647+0000","last_fullsized":"2024-09-22T09:11:47.962647+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:38.864929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972822+0000","last_change":"2024-09-22T08:36:17.554312+0000","last_active":"2024-09-22T09:13:47.972822+0000","last_peered":"2024-09-22T09:13:47.972822+0000","last_clean":"2024-09-22T09:13:47.972822+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:13:47.972822+0000","last_undegraded":"2024-09-22T09:13:47.972822+0000","last_fullsized":"2024-09-22T09:13:47.972822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:29.531915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.753733+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:11:16.753733+0000","last_peered":"2024-09-22T09:11:16.753733+0000","last_clean":"2024-09-22T09:11:16.753733+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:11:16.753733+0000","last_undegraded":"2024-09-22T09:11:16.753733+0000","last_fullsized":"2024-09-22T09:11:16.753733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:58.101135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869100+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:13:47.869100+0000","last_peered":"2024-09-22T09:13:47.869100+0000","last_clean":"2024-09-22T09:13:47.869100+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:13:47.869100+0000","last_undegraded":"2024-09-22T09:13:47.869100+0000","last_fullsized":"2024-09-22T09:13:47.869100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:31.386282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:16.756266+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:11:16.756266+0000","last_peered":"2024-09-22T09:11:16.756266+0000","last_clean":"2024-09-22T09:11:16.756266+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:11:16.756266+0000","last_undegraded":"2024-09-22T09:11:16.756266+0000","last_fullsized":"2024-09-22T09:11:16.756266+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:02.785298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799341+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:15:51.799341+0000","last_peered":"2024-09-22T09:15:51.799341+0000","last_clean":"2024-09-22T09:15:51.799341+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:15:51.799341+0000","last_undegraded":"2024-09-22T09:15:51.799341+0000","last_fullsized":"2024-09-22T09:15:51.799341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784216+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:14:21.784216+0000","last_peered":"2024-09-22T09:14:21.784216+0000","last_clean":"2024-09-22T09:14:21.784216+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:14:21.784216+0000","last_undegraded":"2024-09-22T09:14:21.784216+0000","last_fullsized":"2024-09-22T09:14:21.784216+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:55.375345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769938+0000","last_change":"2024-09-22T08:33:33.306873+0000","last_active":"2024-09-22T09:13:36.769938+0000","last_peered":"2024-09-22T09:13:36.769938+0000","last_clean":"2024-09-22T09:13:36.769938+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:13:36.769938+0000","last_undegraded":"2024-09-22T09:13:36.769938+0000","last_fullsized":"2024-09-22T09:13:36.769938+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:59.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778131+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:13:41.778131+0000","last_peered":"2024-09-22T09:13:41.778131+0000","last_clean":"2024-09-22T09:13:41.778131+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:13:41.778131+0000","last_undegraded":"2024-09-22T09:13:41.778131+0000","last_fullsized":"2024-09-22T09:13:41.778131+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:26.766525+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:12:26.766525+0000","last_peered":"2024-09-22T09:12:26.766525+0000","last_clean":"2024-09-22T09:12:26.766525+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:12:26.766525+0000","last_undegraded":"2024-09-22T09:12:26.766525+0000","last_fullsized":"2024-09-22T09:12:26.766525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:26.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988838+0000","last_change":"2024-09-22T08:36:14.521822+0000","last_active":"2024-09-22T09:15:52.988838+0000","last_peered":"2024-09-22T09:15:52.988838+0000","last_clean":"2024-09-22T09:15:52.988838+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:15:52.988838+0000","last_undegraded":"2024-09-22T09:15:52.988838+0000","last_fullsized":"2024-09-22T09:15:52.988838+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:17.576650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769870+0000","last_change":"2024-09-22T08:33:33.299815+0000","last_active":"2024-09-22T09:13:36.769870+0000","last_peered":"2024-09-22T09:13:36.769870+0000","last_clean":"2024-09-22T09:13:36.769870+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:13:36.769870+0000","last_undegraded":"2024-09-22T09:13:36.769870+0000","last_fullsized":"2024-09-22T09:13:36.769870+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:22.030960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968129+0000","last_change":"2024-09-22T08:36:17.552221+0000","last_active":"2024-09-22T09:12:37.968129+0000","last_peered":"2024-09-22T09:12:37.968129+0000","last_clean":"2024-09-22T09:12:37.968129+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:12:37.968129+0000","last_undegraded":"2024-09-22T09:12:37.968129+0000","last_fullsized":"2024-09-22T09:12:37.968129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:55.269454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769825+0000","last_change":"2024-09-22T08:33:33.312653+0000","last_active":"2024-09-22T09:13:36.769825+0000","last_peered":"2024-09-22T09:13:36.769825+0000","last_clean":"2024-09-22T09:13:36.769825+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:13:36.769825+0000","last_undegraded":"2024-09-22T09:13:36.769825+0000","last_fullsized":"2024-09-22T09:13:36.769825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:50.718606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:07.790972+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:15:07.790972+0000","last_peered":"2024-09-22T09:15:07.790972+0000","last_clean":"2024-09-22T09:15:07.790972+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:15:07.790972+0000","last_undegraded":"2024-09-22T09:15:07.790972+0000","last_fullsized":"2024-09-22T09:15:07.790972+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.867290+0000","last_change":"2024-09-22T08:33:33.314397+0000","last_active":"2024-09-22T09:13:32.867290+0000","last_peered":"2024-09-22T09:13:32.867290+0000","last_clean":"2024-09-22T09:13:32.867290+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:13:32.867290+0000","last_undegraded":"2024-09-22T09:13:32.867290+0000","last_fullsized":"2024-09-22T09:13:32.867290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:17.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855481+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:11:47.855481+0000","last_peered":"2024-09-22T09:11:47.855481+0000","last_clean":"2024-09-22T09:11:47.855481+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:11:47.855481+0000","last_undegraded":"2024-09-22T09:11:47.855481+0000","last_fullsized":"2024-09-22T09:11:47.855481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:01.855409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:17.852152+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:11:17.852152+0000","last_peered":"2024-09-22T09:11:17.852152+0000","last_clean":"2024-09-22T09:11:17.852152+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:11:17.852152+0000","last_undegraded":"2024-09-22T09:11:17.852152+0000","last_fullsized":"2024-09-22T09:11:17.852152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:15.681167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975679+0000","last_change":"2024-09-22T08:36:14.522217+0000","last_active":"2024-09-22T09:13:47.975679+0000","last_peered":"2024-09-22T09:13:47.975679+0000","last_clean":"2024-09-22T09:13:47.975679+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:13:47.975679+0000","last_undegraded":"2024-09-22T09:13:47.975679+0000","last_fullsized":"2024-09-22T09:13:47.975679+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.786028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":747,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765671+0000","last_change":"2024-09-22T08:33:33.306368+0000","last_active":"2024-09-22T09:12:21.765671+0000","last_peered":"2024-09-22T09:12:21.765671+0000","last_clean":"2024-09-22T09:12:21.765671+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:12:21.765671+0000","last_undegraded":"2024-09-22T09:12:21.765671+0000","last_fullsized":"2024-09-22T09:12:21.765671+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:28.062281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962738+0000","last_change":"2024-09-22T08:51:48.550754+0000","last_active":"2024-09-22T09:11:47.962738+0000","last_peered":"2024-09-22T09:11:47.962738+0000","last_clean":"2024-09-22T09:11:47.962738+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:11:47.962738+0000","last_undegraded":"2024-09-22T09:11:47.962738+0000","last_fullsized":"2024-09-22T09:11:47.962738+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:50.620910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778844+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:13:46.778844+0000","last_peered":"2024-09-22T09:13:46.778844+0000","last_clean":"2024-09-22T09:13:46.778844+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:13:46.778844+0000","last_undegraded":"2024-09-22T09:13:46.778844+0000","last_fullsized":"2024-09-22T09:13:46.778844+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:47.415229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.771410+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:13:46.771410+0000","last_peered":"2024-09-22T09:13:46.771410+0000","last_clean":"2024-09-22T09:13:46.771410+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:13:46.771410+0000","last_undegraded":"2024-09-22T09:13:46.771410+0000","last_fullsized":"2024-09-22T09:13:46.771410+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:00.150168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758893+0000","last_change":"2024-09-22T08:33:33.303993+0000","last_active":"2024-09-22T09:12:16.758893+0000","last_peered":"2024-09-22T09:12:16.758893+0000","last_clean":"2024-09-22T09:12:16.758893+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:12:16.758893+0000","last_undegraded":"2024-09-22T09:12:16.758893+0000","last_fullsized":"2024-09-22T09:12:16.758893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:11.898143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789167+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:14:56.789167+0000","last_peered":"2024-09-22T09:14:56.789167+0000","last_clean":"2024-09-22T09:14:56.789167+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:14:56.789167+0000","last_undegraded":"2024-09-22T09:14:56.789167+0000","last_fullsized":"2024-09-22T09:14:56.789167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'5","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.501257+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:16:03.501257+0000","last_peered":"2024-09-22T09:16:03.501257+0000","last_clean":"2024-09-22T09:16:03.501257+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:16:03.501257+0000","last_undegraded":"2024-09-22T09:16:03.501257+0000","last_fullsized":"2024-09-22T09:16:03.501257+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778956+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:13:46.778956+0000","last_peered":"2024-09-22T09:13:46.778956+0000","last_clean":"2024-09-22T09:13:46.778956+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:13:46.778956+0000","last_undegraded":"2024-09-22T09:13:46.778956+0000","last_fullsized":"2024-09-22T09:13:46.778956+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984645+0000","last_change":"2024-09-22T08:36:14.525609+0000","last_active":"2024-09-22T09:14:57.984645+0000","last_peered":"2024-09-22T09:14:57.984645+0000","last_clean":"2024-09-22T09:14:57.984645+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:14:57.984645+0000","last_undegraded":"2024-09-22T09:14:57.984645+0000","last_fullsized":"2024-09-22T09:14:57.984645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:03.854966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764817+0000","last_change":"2024-09-22T08:33:33.315166+0000","last_active":"2024-09-22T09:12:16.764817+0000","last_peered":"2024-09-22T09:12:16.764817+0000","last_clean":"2024-09-22T09:12:16.764817+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:12:16.764817+0000","last_undegraded":"2024-09-22T09:12:16.764817+0000","last_fullsized":"2024-09-22T09:12:16.764817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:41.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'8","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789232+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:14:56.789232+0000","last_peered":"2024-09-22T09:14:56.789232+0000","last_clean":"2024-09-22T09:14:56.789232+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:14:56.789232+0000","last_undegraded":"2024-09-22T09:14:56.789232+0000","last_fullsized":"2024-09-22T09:14:56.789232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789203+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:14:56.789203+0000","last_peered":"2024-09-22T09:14:56.789203+0000","last_clean":"2024-09-22T09:14:56.789203+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:14:56.789203+0000","last_undegraded":"2024-09-22T09:14:56.789203+0000","last_fullsized":"2024-09-22T09:14:56.789203+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764788+0000","last_change":"2024-09-22T08:33:33.311367+0000","last_active":"2024-09-22T09:12:16.764788+0000","last_peered":"2024-09-22T09:12:16.764788+0000","last_clean":"2024-09-22T09:12:16.764788+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:12:16.764788+0000","last_undegraded":"2024-09-22T09:12:16.764788+0000","last_fullsized":"2024-09-22T09:12:16.764788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:18.812618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.969239+0000","last_change":"2024-09-22T08:51:48.549838+0000","last_active":"2024-09-22T09:12:47.969239+0000","last_peered":"2024-09-22T09:12:47.969239+0000","last_clean":"2024-09-22T09:12:47.969239+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:12:47.969239+0000","last_undegraded":"2024-09-22T09:12:47.969239+0000","last_fullsized":"2024-09-22T09:12:47.969239+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:35.628007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984688+0000","last_change":"2024-09-22T08:36:17.553737+0000","last_active":"2024-09-22T09:14:57.984688+0000","last_peered":"2024-09-22T09:14:57.984688+0000","last_clean":"2024-09-22T09:14:57.984688+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:14:57.984688+0000","last_undegraded":"2024-09-22T09:14:57.984688+0000","last_fullsized":"2024-09-22T09:14:57.984688+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:21.818626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971629+0000","last_change":"2024-09-22T08:36:14.520890+0000","last_active":"2024-09-22T09:13:37.971629+0000","last_peered":"2024-09-22T09:13:37.971629+0000","last_clean":"2024-09-22T09:13:37.971629+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:13:37.971629+0000","last_undegraded":"2024-09-22T09:13:37.971629+0000","last_fullsized":"2024-09-22T09:13:37.971629+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.858239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774744+0000","last_change":"2024-09-22T08:33:33.310293+0000","last_active":"2024-09-22T09:13:16.774744+0000","last_peered":"2024-09-22T09:13:16.774744+0000","last_clean":"2024-09-22T09:13:16.774744+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:13:16.774744+0000","last_undegraded":"2024-09-22T09:13:16.774744+0000","last_fullsized":"2024-09-22T09:13:16.774744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:23:54.882161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971695+0000","last_change":"2024-09-22T08:36:14.521414+0000","last_active":"2024-09-22T09:13:37.971695+0000","last_peered":"2024-09-22T09:13:37.971695+0000","last_clean":"2024-09-22T09:13:37.971695+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:13:37.971695+0000","last_undegraded":"2024-09-22T09:13:37.971695+0000","last_fullsized":"2024-09-22T09:13:37.971695+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:00.328885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865324+0000","last_change":"2024-09-22T08:33:33.305009+0000","last_active":"2024-09-22T09:13:12.865324+0000","last_peered":"2024-09-22T09:13:12.865324+0000","last_clean":"2024-09-22T09:13:12.865324+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:13:12.865324+0000","last_undegraded":"2024-09-22T09:13:12.865324+0000","last_fullsized":"2024-09-22T09:13:12.865324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:50.446180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:57.798094+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:15:57.798094+0000","last_peered":"2024-09-22T09:15:57.798094+0000","last_clean":"2024-09-22T09:15:57.798094+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:15:57.798094+0000","last_undegraded":"2024-09-22T09:15:57.798094+0000","last_fullsized":"2024-09-22T09:15:57.798094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":26642,"num_write":15,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971719+0000","last_change":"2024-09-22T08:36:14.515004+0000","last_active":"2024-09-22T09:13:37.971719+0000","last_peered":"2024-09-22T09:13:37.971719+0000","last_clean":"2024-09-22T09:13:37.971719+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:13:37.971719+0000","last_undegraded":"2024-09-22T09:13:37.971719+0000","last_fullsized":"2024-09-22T09:13:37.971719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:07.837552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774690+0000","last_change":"2024-09-22T08:33:33.306842+0000","last_active":"2024-09-22T09:13:16.774690+0000","last_peered":"2024-09-22T09:13:16.774690+0000","last_clean":"2024-09-22T09:13:16.774690+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:13:16.774690+0000","last_undegraded":"2024-09-22T09:13:16.774690+0000","last_fullsized":"2024-09-22T09:13:16.774690+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:03.666172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764814+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:12:16.764814+0000","last_peered":"2024-09-22T09:12:16.764814+0000","last_clean":"2024-09-22T09:12:16.764814+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:12:16.764814+0000","last_undegraded":"2024-09-22T09:12:16.764814+0000","last_fullsized":"2024-09-22T09:12:16.764814+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:23.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.858820+0000","last_change":"2024-09-22T08:36:14.524581+0000","last_active":"2024-09-22T09:12:17.858820+0000","last_peered":"2024-09-22T09:12:17.858820+0000","last_clean":"2024-09-22T09:12:17.858820+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:12:17.858820+0000","last_undegraded":"2024-09-22T09:12:17.858820+0000","last_fullsized":"2024-09-22T09:12:17.858820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:13.432035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":173,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761303+0000","last_change":"2024-09-22T08:33:33.310511+0000","last_active":"2024-09-22T09:11:56.761303+0000","last_peered":"2024-09-22T09:11:56.761303+0000","last_clean":"2024-09-22T09:11:56.761303+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:11:56.761303+0000","last_undegraded":"2024-09-22T09:11:56.761303+0000","last_fullsized":"2024-09-22T09:11:56.761303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:28.111555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.961550+0000","last_change":"2024-09-22T08:51:48.553902+0000","last_active":"2024-09-22T09:12:02.961550+0000","last_peered":"2024-09-22T09:12:02.961550+0000","last_clean":"2024-09-22T09:12:02.961550+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:12:02.961550+0000","last_undegraded":"2024-09-22T09:12:02.961550+0000","last_fullsized":"2024-09-22T09:12:02.961550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:09.641607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:31.785482+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:14:31.785482+0000","last_peered":"2024-09-22T09:14:31.785482+0000","last_clean":"2024-09-22T09:14:31.785482+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:14:31.785482+0000","last_undegraded":"2024-09-22T09:14:31.785482+0000","last_fullsized":"2024-09-22T09:14:31.785482+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:59.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758982+0000","last_change":"2024-09-22T08:36:14.523378+0000","last_active":"2024-09-22T09:12:16.758982+0000","last_peered":"2024-09-22T09:12:16.758982+0000","last_clean":"2024-09-22T09:12:16.758982+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:12:16.758982+0000","last_undegraded":"2024-09-22T09:12:16.758982+0000","last_fullsized":"2024-09-22T09:12:16.758982+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:26.533836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.765353+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:11:47.765353+0000","last_peered":"2024-09-22T09:11:47.765353+0000","last_clean":"2024-09-22T09:11:47.765353+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:11:47.765353+0000","last_undegraded":"2024-09-22T09:11:47.765353+0000","last_fullsized":"2024-09-22T09:11:47.765353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:30.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764842+0000","last_change":"2024-09-22T08:36:14.521867+0000","last_active":"2024-09-22T09:12:16.764842+0000","last_peered":"2024-09-22T09:12:16.764842+0000","last_clean":"2024-09-22T09:12:16.764842+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:12:16.764842+0000","last_undegraded":"2024-09-22T09:12:16.764842+0000","last_fullsized":"2024-09-22T09:12:16.764842+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:20.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.959622+0000","last_change":"2024-09-22T08:33:33.301439+0000","last_active":"2024-09-22T09:11:47.959622+0000","last_peered":"2024-09-22T09:11:47.959622+0000","last_clean":"2024-09-22T09:11:47.959622+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:11:47.959622+0000","last_undegraded":"2024-09-22T09:11:47.959622+0000","last_fullsized":"2024-09-22T09:11:47.959622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:31.274044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970549+0000","last_change":"2024-09-22T08:51:48.546986+0000","last_active":"2024-09-22T09:13:27.970549+0000","last_peered":"2024-09-22T09:13:27.970549+0000","last_clean":"2024-09-22T09:13:27.970549+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:13:27.970549+0000","last_undegraded":"2024-09-22T09:13:27.970549+0000","last_fullsized":"2024-09-22T09:13:27.970549+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:43.329879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.142118+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:16:03.142118+0000","last_peered":"2024-09-22T09:16:03.142118+0000","last_clean":"2024-09-22T09:16:03.142118+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:16:03.142118+0000","last_undegraded":"2024-09-22T09:16:03.142118+0000","last_fullsized":"2024-09-22T09:16:03.142118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:47.077061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:36.786233+0000","last_change":"2024-09-22T08:36:14.525673+0000","last_active":"2024-09-22T09:14:36.786233+0000","last_peered":"2024-09-22T09:14:36.786233+0000","last_clean":"2024-09-22T09:14:36.786233+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:14:36.786233+0000","last_undegraded":"2024-09-22T09:14:36.786233+0000","last_fullsized":"2024-09-22T09:14:36.786233+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:00.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755324+0000","last_change":"2024-09-22T08:33:33.306105+0000","last_active":"2024-09-22T09:11:51.755324+0000","last_peered":"2024-09-22T09:11:51.755324+0000","last_clean":"2024-09-22T09:11:51.755324+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:11:51.755324+0000","last_undegraded":"2024-09-22T09:11:51.755324+0000","last_fullsized":"2024-09-22T09:11:51.755324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:07.948747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763478+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:12:06.763478+0000","last_peered":"2024-09-22T09:12:06.763478+0000","last_clean":"2024-09-22T09:12:06.763478+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:12:06.763478+0000","last_undegraded":"2024-09-22T09:12:06.763478+0000","last_fullsized":"2024-09-22T09:12:06.763478+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:21.783822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:06.773227+0000","last_change":"2024-09-22T08:36:14.521057+0000","last_active":"2024-09-22T09:13:06.773227+0000","last_peered":"2024-09-22T09:13:06.773227+0000","last_clean":"2024-09-22T09:13:06.773227+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:13:06.773227+0000","last_undegraded":"2024-09-22T09:13:06.773227+0000","last_fullsized":"2024-09-22T09:13:06.773227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:07.181295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755291+0000","last_change":"2024-09-22T08:33:33.312566+0000","last_active":"2024-09-22T09:11:51.755291+0000","last_peered":"2024-09-22T09:11:51.755291+0000","last_clean":"2024-09-22T09:11:51.755291+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:11:51.755291+0000","last_undegraded":"2024-09-22T09:11:51.755291+0000","last_fullsized":"2024-09-22T09:11:51.755291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:30.177728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.857195+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:12:02.857195+0000","last_peered":"2024-09-22T09:12:02.857195+0000","last_clean":"2024-09-22T09:12:02.857195+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:12:02.857195+0000","last_undegraded":"2024-09-22T09:12:02.857195+0000","last_fullsized":"2024-09-22T09:12:02.857195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:52.143784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.879891+0000","last_change":"2024-09-22T08:36:17.553257+0000","last_active":"2024-09-22T09:15:17.879891+0000","last_peered":"2024-09-22T09:15:17.879891+0000","last_clean":"2024-09-22T09:15:17.879891+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:15:17.879891+0000","last_undegraded":"2024-09-22T09:15:17.879891+0000","last_fullsized":"2024-09-22T09:15:17.879891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:25.217554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.427984+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:16:01.427984+0000","last_peered":"2024-09-22T09:16:01.427984+0000","last_clean":"2024-09-22T09:16:01.427984+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:16:01.427984+0000","last_undegraded":"2024-09-22T09:16:01.427984+0000","last_fullsized":"2024-09-22T09:16:01.427984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":249,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.861248+0000","last_change":"2024-09-22T08:33:33.306309+0000","last_active":"2024-09-22T09:12:37.861248+0000","last_peered":"2024-09-22T09:12:37.861248+0000","last_clean":"2024-09-22T09:12:37.861248+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:12:37.861248+0000","last_undegraded":"2024-09-22T09:12:37.861248+0000","last_fullsized":"2024-09-22T09:12:37.861248+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:31.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.964588+0000","last_change":"2024-09-22T08:51:48.549815+0000","last_active":"2024-09-22T09:12:02.964588+0000","last_peered":"2024-09-22T09:12:02.964588+0000","last_clean":"2024-09-22T09:12:02.964588+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:12:02.964588+0000","last_undegraded":"2024-09-22T09:12:02.964588+0000","last_fullsized":"2024-09-22T09:12:02.964588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:49.616078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:31.777735+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:14:31.777735+0000","last_peered":"2024-09-22T09:14:31.777735+0000","last_clean":"2024-09-22T09:14:31.777735+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:14:31.777735+0000","last_undegraded":"2024-09-22T09:14:31.777735+0000","last_fullsized":"2024-09-22T09:14:31.777735+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:15.190970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.773987+0000","last_change":"2024-09-22T08:36:14.520376+0000","last_active":"2024-09-22T09:13:11.773987+0000","last_peered":"2024-09-22T09:13:11.773987+0000","last_clean":"2024-09-22T09:13:11.773987+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:13:11.773987+0000","last_undegraded":"2024-09-22T09:13:11.773987+0000","last_fullsized":"2024-09-22T09:13:11.773987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:17.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763014+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:12:06.763014+0000","last_peered":"2024-09-22T09:12:06.763014+0000","last_clean":"2024-09-22T09:12:06.763014+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:12:06.763014+0000","last_undegraded":"2024-09-22T09:12:06.763014+0000","last_fullsized":"2024-09-22T09:12:06.763014+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:35.688578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.972039+0000","last_change":"2024-09-22T08:36:17.557866+0000","last_active":"2024-09-22T09:13:12.972039+0000","last_peered":"2024-09-22T09:13:12.972039+0000","last_clean":"2024-09-22T09:13:12.972039+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:13:12.972039+0000","last_undegraded":"2024-09-22T09:13:12.972039+0000","last_fullsized":"2024-09-22T09:13:12.972039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:04.889097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.769069+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:12:17.769069+0000","last_peered":"2024-09-22T09:12:17.769069+0000","last_clean":"2024-09-22T09:12:17.769069+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:12:17.769069+0000","last_undegraded":"2024-09-22T09:12:17.769069+0000","last_fullsized":"2024-09-22T09:12:17.769069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:44.749004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967432+0000","last_change":"2024-09-22T08:33:33.314991+0000","last_active":"2024-09-22T09:12:32.967432+0000","last_peered":"2024-09-22T09:12:32.967432+0000","last_clean":"2024-09-22T09:12:32.967432+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:12:32.967432+0000","last_undegraded":"2024-09-22T09:12:32.967432+0000","last_fullsized":"2024-09-22T09:12:32.967432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:02.113618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968162+0000","last_change":"2024-09-22T08:51:48.548861+0000","last_active":"2024-09-22T09:12:37.968162+0000","last_peered":"2024-09-22T09:12:37.968162+0000","last_clean":"2024-09-22T09:12:37.968162+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:12:37.968162+0000","last_undegraded":"2024-09-22T09:12:37.968162+0000","last_fullsized":"2024-09-22T09:12:37.968162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:02.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'7","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.802669+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:16:01.802669+0000","last_peered":"2024-09-22T09:16:01.802669+0000","last_clean":"2024-09-22T09:16:01.802669+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:16:01.802669+0000","last_undegraded":"2024-09-22T09:16:01.802669+0000","last_fullsized":"2024-09-22T09:16:01.802669+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4198,"num_write":12,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797384+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:15:52.797384+0000","last_peered":"2024-09-22T09:15:52.797384+0000","last_clean":"2024-09-22T09:15:52.797384+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:15:52.797384+0000","last_undegraded":"2024-09-22T09:15:52.797384+0000","last_fullsized":"2024-09-22T09:15:52.797384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768411+0000","last_change":"2024-09-22T08:33:33.310686+0000","last_active":"2024-09-22T09:12:36.768411+0000","last_peered":"2024-09-22T09:12:36.768411+0000","last_clean":"2024-09-22T09:12:36.768411+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:12:36.768411+0000","last_undegraded":"2024-09-22T09:12:36.768411+0000","last_fullsized":"2024-09-22T09:12:36.768411+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:29.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968185+0000","last_change":"2024-09-22T08:51:48.549659+0000","last_active":"2024-09-22T09:12:37.968185+0000","last_peered":"2024-09-22T09:12:37.968185+0000","last_clean":"2024-09-22T09:12:37.968185+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:12:37.968185+0000","last_undegraded":"2024-09-22T09:12:37.968185+0000","last_fullsized":"2024-09-22T09:12:37.968185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:29.047532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799271+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:15:51.799271+0000","last_peered":"2024-09-22T09:15:51.799271+0000","last_clean":"2024-09-22T09:15:51.799271+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:15:51.799271+0000","last_undegraded":"2024-09-22T09:15:51.799271+0000","last_fullsized":"2024-09-22T09:15:51.799271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.986858+0000","last_change":"2024-09-22T08:36:17.549474+0000","last_active":"2024-09-22T09:15:17.986858+0000","last_peered":"2024-09-22T09:15:17.986858+0000","last_clean":"2024-09-22T09:15:17.986858+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:15:17.986858+0000","last_undegraded":"2024-09-22T09:15:17.986858+0000","last_fullsized":"2024-09-22T09:15:17.986858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:12.074363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864628+0000","last_change":"2024-09-22T08:36:14.518932+0000","last_active":"2024-09-22T09:13:07.864628+0000","last_peered":"2024-09-22T09:13:07.864628+0000","last_clean":"2024-09-22T09:13:07.864628+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:13:07.864628+0000","last_undegraded":"2024-09-22T09:13:07.864628+0000","last_fullsized":"2024-09-22T09:13:07.864628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:01.574307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865380+0000","last_change":"2024-09-22T08:33:33.310910+0000","last_active":"2024-09-22T09:13:12.865380+0000","last_peered":"2024-09-22T09:13:12.865380+0000","last_clean":"2024-09-22T09:13:12.865380+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:13:12.865380+0000","last_undegraded":"2024-09-22T09:13:12.865380+0000","last_fullsized":"2024-09-22T09:13:12.865380+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:27.693570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.771403+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:12:37.771403+0000","last_peered":"2024-09-22T09:12:37.771403+0000","last_clean":"2024-09-22T09:12:37.771403+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:12:37.771403+0000","last_undegraded":"2024-09-22T09:12:37.771403+0000","last_fullsized":"2024-09-22T09:12:37.771403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:27.349451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774038+0000","last_change":"2024-09-22T08:33:33.309150+0000","last_active":"2024-09-22T09:13:11.774038+0000","last_peered":"2024-09-22T09:13:11.774038+0000","last_clean":"2024-09-22T09:13:11.774038+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:13:11.774038+0000","last_undegraded":"2024-09-22T09:13:11.774038+0000","last_fullsized":"2024-09-22T09:13:11.774038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:51.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.107807+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:16:02.107807+0000","last_peered":"2024-09-22T09:16:02.107807+0000","last_clean":"2024-09-22T09:16:02.107807+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:16:02.107807+0000","last_undegraded":"2024-09-22T09:16:02.107807+0000","last_fullsized":"2024-09-22T09:16:02.107807+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12859,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:22.859462+0000","last_change":"2024-09-22T08:36:14.518063+0000","last_active":"2024-09-22T09:12:22.859462+0000","last_peered":"2024-09-22T09:12:22.859462+0000","last_clean":"2024-09-22T09:12:22.859462+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:12:22.859462+0000","last_undegraded":"2024-09-22T09:12:22.859462+0000","last_fullsized":"2024-09-22T09:12:22.859462+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:02.424058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":100,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864566+0000","last_change":"2024-09-22T08:33:33.305508+0000","last_active":"2024-09-22T09:13:07.864566+0000","last_peered":"2024-09-22T09:13:07.864566+0000","last_clean":"2024-09-22T09:13:07.864566+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:13:07.864566+0000","last_undegraded":"2024-09-22T09:13:07.864566+0000","last_fullsized":"2024-09-22T09:13:07.864566+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:55.651981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:27.770184+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:12:27.770184+0000","last_peered":"2024-09-22T09:12:27.770184+0000","last_clean":"2024-09-22T09:12:27.770184+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:12:27.770184+0000","last_undegraded":"2024-09-22T09:12:27.770184+0000","last_fullsized":"2024-09-22T09:12:27.770184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:49.958042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885192+0000","last_change":"2024-09-22T08:36:17.553023+0000","last_active":"2024-09-22T09:15:52.885192+0000","last_peered":"2024-09-22T09:15:52.885192+0000","last_clean":"2024-09-22T09:15:52.885192+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:15:52.885192+0000","last_undegraded":"2024-09-22T09:15:52.885192+0000","last_fullsized":"2024-09-22T09:15:52.885192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:05.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.791107+0000","last_change":"2024-09-22T08:36:14.520504+0000","last_active":"2024-09-22T09:15:51.791107+0000","last_peered":"2024-09-22T09:15:51.791107+0000","last_clean":"2024-09-22T09:15:51.791107+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:15:51.791107+0000","last_undegraded":"2024-09-22T09:15:51.791107+0000","last_fullsized":"2024-09-22T09:15:51.791107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:49.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885159+0000","last_change":"2024-09-22T08:36:17.548527+0000","last_active":"2024-09-22T09:15:52.885159+0000","last_peered":"2024-09-22T09:15:52.885159+0000","last_clean":"2024-09-22T09:15:52.885159+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:15:52.885159+0000","last_undegraded":"2024-09-22T09:15:52.885159+0000","last_fullsized":"2024-09-22T09:15:52.885159+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.567213+0000","last_change":"2024-09-22T08:36:14.524325+0000","last_active":"2024-09-22T09:16:02.567213+0000","last_peered":"2024-09-22T09:16:02.567213+0000","last_clean":"2024-09-22T09:16:02.567213+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:16:02.567213+0000","last_undegraded":"2024-09-22T09:16:02.567213+0000","last_fullsized":"2024-09-22T09:16:02.567213+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:58.736096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":87,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.867830+0000","last_change":"2024-09-22T08:33:33.312962+0000","last_active":"2024-09-22T09:13:37.867830+0000","last_peered":"2024-09-22T09:13:37.867830+0000","last_clean":"2024-09-22T09:13:37.867830+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:13:37.867830+0000","last_undegraded":"2024-09-22T09:13:37.867830+0000","last_fullsized":"2024-09-22T09:13:37.867830+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:56.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'395","reported_seq":1260,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.752785+0000","last_change":"2024-09-22T08:17:38.305362+0000","last_active":"2024-09-22T09:16:03.752785+0000","last_peered":"2024-09-22T09:16:03.752785+0000","last_clean":"2024-09-22T09:16:03.752785+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:03.752785+0000","last_undegraded":"2024-09-22T09:16:03.752785+0000","last_fullsized":"2024-09-22T09:16:03.752785+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.646132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1437,"num_read_kb":46472,"num_write":1276,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'948","reported_seq":2499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.763135+0000","last_change":"2024-09-22T08:17:40.306852+0000","last_active":"2024-09-22T09:15:22.763135+0000","last_peered":"2024-09-22T09:15:22.763135+0000","last_clean":"2024-09-22T09:15:22.763135+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:15:22.763135+0000","last_undegraded":"2024-09-22T09:15:22.763135+0000","last_fullsized":"2024-09-22T09:15:22.763135+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:10.143716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'396","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.789127+0000","last_change":"2024-09-22T08:17:38.302453+0000","last_active":"2024-09-22T09:16:03.789127+0000","last_peered":"2024-09-22T09:16:03.789127+0000","last_clean":"2024-09-22T09:16:03.789127+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:03.789127+0000","last_undegraded":"2024-09-22T09:16:03.789127+0000","last_fullsized":"2024-09-22T09:16:03.789127+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:03.443252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":784,"num_read_kb":45729,"num_write":1281,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'767","reported_seq":2185,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.179987+0000","last_change":"2024-09-22T08:17:40.311740+0000","last_active":"2024-09-22T09:13:23.179987+0000","last_peered":"2024-09-22T09:13:23.179987+0000","last_clean":"2024-09-22T09:13:23.179987+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:13:23.179987+0000","last_undegraded":"2024-09-22T09:13:23.179987+0000","last_fullsized":"2024-09-22T09:13:23.179987+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:16.749258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.818396+0000","last_change":"2024-09-22T08:17:38.306945+0000","last_active":"2024-09-22T09:16:03.818396+0000","last_peered":"2024-09-22T09:16:03.818396+0000","last_clean":"2024-09-22T09:16:03.818396+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:03.818396+0000","last_undegraded":"2024-09-22T09:16:03.818396+0000","last_fullsized":"2024-09-22T09:16:03.818396+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:40.207206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":64388,"num_write":1226,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'498","reported_seq":2127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.699167+0000","last_change":"2024-09-22T08:17:40.314265+0000","last_active":"2024-09-22T09:13:27.699167+0000","last_peered":"2024-09-22T09:13:27.699167+0000","last_clean":"2024-09-22T09:13:27.699167+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:13:27.699167+0000","last_undegraded":"2024-09-22T09:13:27.699167+0000","last_fullsized":"2024-09-22T09:13:27.699167+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:49.672590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'394","reported_seq":1083,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.959153+0000","last_change":"2024-09-22T08:17:38.311385+0000","last_active":"2024-09-22T09:16:03.959153+0000","last_peered":"2024-09-22T09:16:03.959153+0000","last_clean":"2024-09-22T09:16:03.959153+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:03.959153+0000","last_undegraded":"2024-09-22T09:16:03.959153+0000","last_fullsized":"2024-09-22T09:16:03.959153+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:11.719876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":100163,"num_write":1151,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'533","reported_seq":2199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697914+0000","last_change":"2024-09-22T08:17:40.315145+0000","last_active":"2024-09-22T09:13:27.697914+0000","last_peered":"2024-09-22T09:13:27.697914+0000","last_clean":"2024-09-22T09:13:27.697914+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:13:27.697914+0000","last_undegraded":"2024-09-22T09:13:27.697914+0000","last_fullsized":"2024-09-22T09:13:27.697914+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:28.617427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'374","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.958379+0000","last_change":"2024-09-22T08:17:38.308912+0000","last_active":"2024-09-22T09:16:03.958379+0000","last_peered":"2024-09-22T09:16:03.958379+0000","last_clean":"2024-09-22T09:16:03.958379+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:03.958379+0000","last_undegraded":"2024-09-22T09:16:03.958379+0000","last_fullsized":"2024-09-22T09:16:03.958379+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:46.873844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":101852,"num_write":1145,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'577","reported_seq":2234,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.975730+0000","last_change":"2024-09-22T08:17:40.308097+0000","last_active":"2024-09-22T09:13:47.975730+0000","last_peered":"2024-09-22T09:13:47.975730+0000","last_clean":"2024-09-22T09:13:47.975730+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:13:47.975730+0000","last_undegraded":"2024-09-22T09:13:47.975730+0000","last_fullsized":"2024-09-22T09:13:47.975730+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:54.012368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'402","reported_seq":1033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.929570+0000","last_change":"2024-09-22T08:17:38.311987+0000","last_active":"2024-09-22T09:16:03.929570+0000","last_peered":"2024-09-22T09:16:03.929570+0000","last_clean":"2024-09-22T09:16:03.929570+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:03.929570+0000","last_undegraded":"2024-09-22T09:16:03.929570+0000","last_fullsized":"2024-09-22T09:16:03.929570+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:46.139865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311674,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":20769,"num_write":1109,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1040","reported_seq":2582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976885+0000","last_change":"2024-09-22T08:17:40.316422+0000","last_active":"2024-09-22T09:13:57.976885+0000","last_peered":"2024-09-22T09:13:57.976885+0000","last_clean":"2024-09-22T09:13:57.976885+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:13:57.976885+0000","last_undegraded":"2024-09-22T09:13:57.976885+0000","last_fullsized":"2024-09-22T09:13:57.976885+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:15.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'329","reported_seq":945,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.963491+0000","last_change":"2024-09-22T08:17:38.301886+0000","last_active":"2024-09-22T09:16:03.963491+0000","last_peered":"2024-09-22T09:16:03.963491+0000","last_clean":"2024-09-22T09:16:03.963491+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:03.963491+0000","last_undegraded":"2024-09-22T09:16:03.963491+0000","last_fullsized":"2024-09-22T09:16:03.963491+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:54.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":9376,"num_write":1029,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'494","reported_seq":2087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870234+0000","last_change":"2024-09-22T08:17:40.318246+0000","last_active":"2024-09-22T09:13:57.870234+0000","last_peered":"2024-09-22T09:13:57.870234+0000","last_clean":"2024-09-22T09:13:57.870234+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:13:57.870234+0000","last_undegraded":"2024-09-22T09:13:57.870234+0000","last_fullsized":"2024-09-22T09:13:57.870234+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:43:12.074233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'376","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.833339+0000","last_change":"2024-09-22T08:17:38.312231+0000","last_active":"2024-09-22T09:16:03.833339+0000","last_peered":"2024-09-22T09:16:03.833339+0000","last_clean":"2024-09-22T09:16:03.833339+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:03.833339+0000","last_undegraded":"2024-09-22T09:16:03.833339+0000","last_fullsized":"2024-09-22T09:16:03.833339+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:59.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":772,"num_read_kb":32992,"num_write":1092,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'638","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780919+0000","last_change":"2024-09-22T08:17:40.319835+0000","last_active":"2024-09-22T09:13:56.780919+0000","last_peered":"2024-09-22T09:13:56.780919+0000","last_clean":"2024-09-22T09:13:56.780919+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:13:56.780919+0000","last_undegraded":"2024-09-22T09:13:56.780919+0000","last_fullsized":"2024-09-22T09:13:56.780919+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:37.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'401","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779056+0000","last_change":"2024-09-22T08:17:40.313776+0000","last_active":"2024-09-22T09:13:42.779056+0000","last_peered":"2024-09-22T09:13:42.779056+0000","last_clean":"2024-09-22T09:13:42.779056+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:13:42.779056+0000","last_undegraded":"2024-09-22T09:13:42.779056+0000","last_fullsized":"2024-09-22T09:13:42.779056+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:46.265677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'303","reported_seq":920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.796025+0000","last_change":"2024-09-22T08:17:38.304440+0000","last_active":"2024-09-22T09:16:03.796025+0000","last_peered":"2024-09-22T09:16:03.796025+0000","last_clean":"2024-09-22T09:16:03.796025+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:03.796025+0000","last_undegraded":"2024-09-22T09:16:03.796025+0000","last_fullsized":"2024-09-22T09:16:03.796025+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:45.235908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947307,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":25983,"num_write":980,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'393","reported_seq":1922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975164+0000","last_change":"2024-09-22T08:17:40.314476+0000","last_active":"2024-09-22T09:13:42.975164+0000","last_peered":"2024-09-22T09:13:42.975164+0000","last_clean":"2024-09-22T09:13:42.975164+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:13:42.975164+0000","last_undegraded":"2024-09-22T09:13:42.975164+0000","last_fullsized":"2024-09-22T09:13:42.975164+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.686734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'287","reported_seq":868,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.938119+0000","last_change":"2024-09-22T08:17:38.308456+0000","last_active":"2024-09-22T09:16:03.938119+0000","last_peered":"2024-09-22T09:16:03.938119+0000","last_clean":"2024-09-22T09:16:03.938119+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:03.938119+0000","last_undegraded":"2024-09-22T09:16:03.938119+0000","last_fullsized":"2024-09-22T09:16:03.938119+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:02.910243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":451,"num_read_kb":1407,"num_write":876,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'765","reported_seq":2318,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972775+0000","last_change":"2024-09-22T08:17:40.313996+0000","last_active":"2024-09-22T09:13:47.972775+0000","last_peered":"2024-09-22T09:13:47.972775+0000","last_clean":"2024-09-22T09:13:47.972775+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:13:47.972775+0000","last_undegraded":"2024-09-22T09:13:47.972775+0000","last_fullsized":"2024-09-22T09:13:47.972775+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'305","reported_seq":928,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.890607+0000","last_change":"2024-09-22T08:17:38.304225+0000","last_active":"2024-09-22T09:16:03.890607+0000","last_peered":"2024-09-22T09:16:03.890607+0000","last_clean":"2024-09-22T09:16:03.890607+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:03.890607+0000","last_undegraded":"2024-09-22T09:16:03.890607+0000","last_fullsized":"2024-09-22T09:16:03.890607+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:43.663554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":31210,"num_write":1028,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'769","reported_seq":2398,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211151+0000","last_change":"2024-09-22T08:17:40.320968+0000","last_active":"2024-09-22T09:14:02.211151+0000","last_peered":"2024-09-22T09:14:02.211151+0000","last_clean":"2024-09-22T09:14:02.211151+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:14:02.211151+0000","last_undegraded":"2024-09-22T09:14:02.211151+0000","last_fullsized":"2024-09-22T09:14:02.211151+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:57.247773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'326","reported_seq":1032,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.858609+0000","last_change":"2024-09-22T08:17:38.303600+0000","last_active":"2024-09-22T09:16:03.858609+0000","last_peered":"2024-09-22T09:16:03.858609+0000","last_clean":"2024-09-22T09:16:03.858609+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:03.858609+0000","last_undegraded":"2024-09-22T09:16:03.858609+0000","last_fullsized":"2024-09-22T09:16:03.858609+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:42.862930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655876,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":639,"num_read_kb":14450,"num_write":1076,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.948204+0000","last_change":"2024-09-22T08:17:40.319549+0000","last_active":"2024-09-22T09:13:17.948204+0000","last_peered":"2024-09-22T09:13:17.948204+0000","last_clean":"2024-09-22T09:13:17.948204+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:13:17.948204+0000","last_undegraded":"2024-09-22T09:13:17.948204+0000","last_fullsized":"2024-09-22T09:13:17.948204+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:41.286507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'352","reported_seq":971,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.796055+0000","last_change":"2024-09-22T08:17:38.301639+0000","last_active":"2024-09-22T09:16:03.796055+0000","last_peered":"2024-09-22T09:16:03.796055+0000","last_clean":"2024-09-22T09:16:03.796055+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:03.796055+0000","last_undegraded":"2024-09-22T09:16:03.796055+0000","last_fullsized":"2024-09-22T09:16:03.796055+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:54.649295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1523,"num_write":1216,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'580","reported_seq":2198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211841+0000","last_change":"2024-09-22T08:17:40.306201+0000","last_active":"2024-09-22T09:14:02.211841+0000","last_peered":"2024-09-22T09:14:02.211841+0000","last_clean":"2024-09-22T09:14:02.211841+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:14:02.211841+0000","last_undegraded":"2024-09-22T09:14:02.211841+0000","last_fullsized":"2024-09-22T09:14:02.211841+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:03.473601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'419","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.966604+0000","last_change":"2024-09-22T08:17:38.297373+0000","last_active":"2024-09-22T09:16:03.966604+0000","last_peered":"2024-09-22T09:16:03.966604+0000","last_clean":"2024-09-22T09:16:03.966604+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:03.966604+0000","last_undegraded":"2024-09-22T09:16:03.966604+0000","last_fullsized":"2024-09-22T09:16:03.966604+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:15.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":782,"num_read_kb":14779,"num_write":1492,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'120","reported_seq":619,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.502060+0000","last_change":"2024-09-22T08:17:48.369855+0000","last_active":"2024-09-22T09:14:05.502060+0000","last_peered":"2024-09-22T09:14:05.502060+0000","last_clean":"2024-09-22T09:14:05.502060+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:14:05.502060+0000","last_undegraded":"2024-09-22T09:14:05.502060+0000","last_fullsized":"2024-09-22T09:14:05.502060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:27.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'994","reported_seq":2719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.506452+0000","last_change":"2024-09-22T08:17:40.316511+0000","last_active":"2024-09-22T09:14:04.506452+0000","last_peered":"2024-09-22T09:14:04.506452+0000","last_clean":"2024-09-22T09:14:04.506452+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:14:04.506452+0000","last_undegraded":"2024-09-22T09:14:04.506452+0000","last_fullsized":"2024-09-22T09:14:04.506452+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:57.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'370","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.959284+0000","last_change":"2024-09-22T08:17:38.318139+0000","last_active":"2024-09-22T09:16:03.959284+0000","last_peered":"2024-09-22T09:16:03.959284+0000","last_clean":"2024-09-22T09:16:03.959284+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:03.959284+0000","last_undegraded":"2024-09-22T09:16:03.959284+0000","last_fullsized":"2024-09-22T09:16:03.959284+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.934545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1344,"num_read_kb":67744,"num_write":1254,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776258+0000","last_change":"2024-09-22T08:17:42.313314+0000","last_active":"2024-09-22T09:13:17.776258+0000","last_peered":"2024-09-22T09:13:17.776258+0000","last_clean":"2024-09-22T09:13:17.776258+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:13:17.776258+0000","last_undegraded":"2024-09-22T09:13:17.776258+0000","last_fullsized":"2024-09-22T09:13:17.776258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:45.452672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'345","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.376665+0000","last_change":"2024-09-22T08:17:44.340362+0000","last_active":"2024-09-22T09:16:02.376665+0000","last_peered":"2024-09-22T09:16:02.376665+0000","last_clean":"2024-09-22T09:16:02.376665+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:16:02.376665+0000","last_undegraded":"2024-09-22T09:16:02.376665+0000","last_fullsized":"2024-09-22T09:16:02.376665+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:24.766194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1201,"num_write":446,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970119+0000","last_change":"2024-09-22T08:17:46.352688+0000","last_active":"2024-09-22T09:13:22.970119+0000","last_peered":"2024-09-22T09:13:22.970119+0000","last_clean":"2024-09-22T09:13:22.970119+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:13:22.970119+0000","last_undegraded":"2024-09-22T09:13:22.970119+0000","last_fullsized":"2024-09-22T09:13:22.970119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:01.237921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'146","reported_seq":654,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970576+0000","last_change":"2024-09-22T08:17:48.369501+0000","last_active":"2024-09-22T09:13:27.970576+0000","last_peered":"2024-09-22T09:13:27.970576+0000","last_clean":"2024-09-22T09:13:27.970576+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:13:27.970576+0000","last_undegraded":"2024-09-22T09:13:27.970576+0000","last_fullsized":"2024-09-22T09:13:27.970576+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:58.815501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'462","reported_seq":2124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.524494+0000","last_change":"2024-09-22T08:17:40.313282+0000","last_active":"2024-09-22T09:14:04.524494+0000","last_peered":"2024-09-22T09:14:04.524494+0000","last_clean":"2024-09-22T09:14:04.524494+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:14:04.524494+0000","last_undegraded":"2024-09-22T09:14:04.524494+0000","last_fullsized":"2024-09-22T09:14:04.524494+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:54.516463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'376","reported_seq":1023,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.951096+0000","last_change":"2024-09-22T08:17:38.302469+0000","last_active":"2024-09-22T09:16:03.951096+0000","last_peered":"2024-09-22T09:16:03.951096+0000","last_clean":"2024-09-22T09:16:03.951096+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:03.951096+0000","last_undegraded":"2024-09-22T09:16:03.951096+0000","last_fullsized":"2024-09-22T09:16:03.951096+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:18.971472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":649,"num_read_kb":11781,"num_write":1236,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:31.756444+0000","last_change":"2024-09-22T08:17:42.314952+0000","last_active":"2024-09-22T09:11:31.756444+0000","last_peered":"2024-09-22T09:11:31.756444+0000","last_clean":"2024-09-22T09:11:31.756444+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:11:31.756444+0000","last_undegraded":"2024-09-22T09:11:31.756444+0000","last_fullsized":"2024-09-22T09:11:31.756444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:23.058529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'89","reported_seq":606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970112+0000","last_change":"2024-09-22T08:17:44.340327+0000","last_active":"2024-09-22T09:13:22.970112+0000","last_peered":"2024-09-22T09:13:22.970112+0000","last_clean":"2024-09-22T09:13:22.970112+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:13:22.970112+0000","last_undegraded":"2024-09-22T09:13:22.970112+0000","last_fullsized":"2024-09-22T09:13:22.970112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:28.780689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970081+0000","last_change":"2024-09-22T08:17:46.352088+0000","last_active":"2024-09-22T09:13:22.970081+0000","last_peered":"2024-09-22T09:13:22.970081+0000","last_clean":"2024-09-22T09:13:22.970081+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:13:22.970081+0000","last_undegraded":"2024-09-22T09:13:22.970081+0000","last_fullsized":"2024-09-22T09:13:22.970081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:40.458281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763658+0000","last_change":"2024-09-22T08:17:48.367697+0000","last_active":"2024-09-22T09:12:51.763658+0000","last_peered":"2024-09-22T09:12:51.763658+0000","last_clean":"2024-09-22T09:12:51.763658+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:12:51.763658+0000","last_undegraded":"2024-09-22T09:12:51.763658+0000","last_fullsized":"2024-09-22T09:12:51.763658+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:46.458711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183074+0000","last_change":"2024-09-22T08:17:40.317797+0000","last_active":"2024-09-22T09:13:23.183074+0000","last_peered":"2024-09-22T09:13:23.183074+0000","last_clean":"2024-09-22T09:13:23.183074+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:13:23.183074+0000","last_undegraded":"2024-09-22T09:13:23.183074+0000","last_fullsized":"2024-09-22T09:13:23.183074+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:17.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'316","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.860181+0000","last_change":"2024-09-22T08:17:38.317777+0000","last_active":"2024-09-22T09:16:03.860181+0000","last_peered":"2024-09-22T09:16:03.860181+0000","last_clean":"2024-09-22T09:16:03.860181+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:03.860181+0000","last_undegraded":"2024-09-22T09:16:03.860181+0000","last_fullsized":"2024-09-22T09:16:03.860181+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:33.381885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":672,"num_read_kb":483,"num_write":1016,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774779+0000","last_change":"2024-09-22T08:17:42.318734+0000","last_active":"2024-09-22T09:13:16.774779+0000","last_peered":"2024-09-22T09:13:16.774779+0000","last_clean":"2024-09-22T09:13:16.774779+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:13:16.774779+0000","last_undegraded":"2024-09-22T09:13:16.774779+0000","last_fullsized":"2024-09-22T09:13:16.774779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:10.711823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'121","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:58.536458+0000","last_change":"2024-09-22T08:17:44.337759+0000","last_active":"2024-09-22T09:12:58.536458+0000","last_peered":"2024-09-22T09:12:58.536458+0000","last_clean":"2024-09-22T09:12:58.536458+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:12:58.536458+0000","last_undegraded":"2024-09-22T09:12:58.536458+0000","last_fullsized":"2024-09-22T09:12:58.536458+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:58.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'794","reported_seq":2567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.082506+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:03.082506+0000","last_peered":"2024-09-22T09:16:03.082506+0000","last_clean":"2024-09-22T09:16:03.082506+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:03.082506+0000","last_undegraded":"2024-09-22T09:16:03.082506+0000","last_fullsized":"2024-09-22T09:16:03.082506+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'183","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.560177+0000","last_change":"2024-09-22T08:17:48.368241+0000","last_active":"2024-09-22T09:14:05.560177+0000","last_peered":"2024-09-22T09:14:05.560177+0000","last_clean":"2024-09-22T09:14:05.560177+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:14:05.560177+0000","last_undegraded":"2024-09-22T09:14:05.560177+0000","last_fullsized":"2024-09-22T09:14:05.560177+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:32.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'506","reported_seq":2212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.784964+0000","last_change":"2024-09-22T08:17:40.319980+0000","last_active":"2024-09-22T09:15:22.784964+0000","last_peered":"2024-09-22T09:15:22.784964+0000","last_clean":"2024-09-22T09:15:22.784964+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:15:22.784964+0000","last_undegraded":"2024-09-22T09:15:22.784964+0000","last_fullsized":"2024-09-22T09:15:22.784964+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:14.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'402","reported_seq":1063,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.935407+0000","last_change":"2024-09-22T08:17:38.306751+0000","last_active":"2024-09-22T09:16:03.935407+0000","last_peered":"2024-09-22T09:16:03.935407+0000","last_clean":"2024-09-22T09:16:03.935407+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:03.935407+0000","last_undegraded":"2024-09-22T09:16:03.935407+0000","last_fullsized":"2024-09-22T09:16:03.935407+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:13.757965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":777,"num_read_kb":8421,"num_write":1262,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776278+0000","last_change":"2024-09-22T08:17:42.314890+0000","last_active":"2024-09-22T09:13:17.776278+0000","last_peered":"2024-09-22T09:13:17.776278+0000","last_clean":"2024-09-22T09:13:17.776278+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:13:17.776278+0000","last_undegraded":"2024-09-22T09:13:17.776278+0000","last_fullsized":"2024-09-22T09:13:17.776278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:40.671613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'295","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.928483+0000","last_change":"2024-09-22T08:17:44.330975+0000","last_active":"2024-09-22T09:16:01.928483+0000","last_peered":"2024-09-22T09:16:01.928483+0000","last_clean":"2024-09-22T09:16:01.928483+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:01.928483+0000","last_undegraded":"2024-09-22T09:16:01.928483+0000","last_fullsized":"2024-09-22T09:16:01.928483+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:22.872610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'814","reported_seq":2606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.284415+0000","last_change":"2024-09-22T08:17:46.354277+0000","last_active":"2024-09-22T09:16:03.284415+0000","last_peered":"2024-09-22T09:16:03.284415+0000","last_clean":"2024-09-22T09:16:03.284415+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:03.284415+0000","last_undegraded":"2024-09-22T09:16:03.284415+0000","last_fullsized":"2024-09-22T09:16:03.284415+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:59.717058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'410","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.341702+0000","last_change":"2024-09-22T08:17:40.312740+0000","last_active":"2024-09-22T09:14:05.341702+0000","last_peered":"2024-09-22T09:14:05.341702+0000","last_clean":"2024-09-22T09:14:05.341702+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:14:05.341702+0000","last_undegraded":"2024-09-22T09:14:05.341702+0000","last_fullsized":"2024-09-22T09:14:05.341702+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:15.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'375","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.912009+0000","last_change":"2024-09-22T08:17:38.307222+0000","last_active":"2024-09-22T09:16:03.912009+0000","last_peered":"2024-09-22T09:16:03.912009+0000","last_clean":"2024-09-22T09:16:03.912009+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:03.912009+0000","last_undegraded":"2024-09-22T09:16:03.912009+0000","last_fullsized":"2024-09-22T09:16:03.912009+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:22.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":44787,"num_write":1101,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.960306+0000","last_change":"2024-09-22T08:17:42.318610+0000","last_active":"2024-09-22T09:11:52.960306+0000","last_peered":"2024-09-22T09:11:52.960306+0000","last_clean":"2024-09-22T09:11:52.960306+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:11:52.960306+0000","last_undegraded":"2024-09-22T09:11:52.960306+0000","last_fullsized":"2024-09-22T09:11:52.960306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:36.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'352","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.741049+0000","last_change":"2024-09-22T08:17:44.337617+0000","last_active":"2024-09-22T09:16:02.741049+0000","last_peered":"2024-09-22T09:16:02.741049+0000","last_clean":"2024-09-22T09:16:02.741049+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:02.741049+0000","last_undegraded":"2024-09-22T09:16:02.741049+0000","last_fullsized":"2024-09-22T09:16:02.741049+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:07.429989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:46.754597+0000","last_change":"2024-09-22T08:17:46.352678+0000","last_active":"2024-09-22T09:11:46.754597+0000","last_peered":"2024-09-22T09:11:46.754597+0000","last_clean":"2024-09-22T09:11:46.754597+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:11:46.754597+0000","last_undegraded":"2024-09-22T09:11:46.754597+0000","last_fullsized":"2024-09-22T09:11:46.754597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:08.207868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'558","reported_seq":1370,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.293017+0000","last_change":"2024-09-22T08:17:48.368074+0000","last_active":"2024-09-22T09:15:24.293017+0000","last_peered":"2024-09-22T09:15:24.293017+0000","last_clean":"2024-09-22T09:15:24.293017+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:15:24.293017+0000","last_undegraded":"2024-09-22T09:15:24.293017+0000","last_fullsized":"2024-09-22T09:15:24.293017+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'822","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.758885+0000","last_change":"2024-09-22T08:17:40.313132+0000","last_active":"2024-09-22T09:15:22.758885+0000","last_peered":"2024-09-22T09:15:22.758885+0000","last_clean":"2024-09-22T09:15:22.758885+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:15:22.758885+0000","last_undegraded":"2024-09-22T09:15:22.758885+0000","last_fullsized":"2024-09-22T09:15:22.758885+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:10.031355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'359","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.959432+0000","last_change":"2024-09-22T08:17:38.312208+0000","last_active":"2024-09-22T09:16:03.959432+0000","last_peered":"2024-09-22T09:16:03.959432+0000","last_clean":"2024-09-22T09:16:03.959432+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:03.959432+0000","last_undegraded":"2024-09-22T09:16:03.959432+0000","last_fullsized":"2024-09-22T09:16:03.959432+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":29046,"num_write":1024,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755206+0000","last_change":"2024-09-22T08:17:42.312266+0000","last_active":"2024-09-22T09:11:51.755206+0000","last_peered":"2024-09-22T09:11:51.755206+0000","last_clean":"2024-09-22T09:11:51.755206+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:11:51.755206+0000","last_undegraded":"2024-09-22T09:11:51.755206+0000","last_fullsized":"2024-09-22T09:11:51.755206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:19.806611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'273","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.699249+0000","last_change":"2024-09-22T08:17:44.341288+0000","last_active":"2024-09-22T09:16:03.699249+0000","last_peered":"2024-09-22T09:16:03.699249+0000","last_clean":"2024-09-22T09:16:03.699249+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:16:03.699249+0000","last_undegraded":"2024-09-22T09:16:03.699249+0000","last_fullsized":"2024-09-22T09:16:03.699249+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:38.968334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45093,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":1000,"num_write":352,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763009+0000","last_change":"2024-09-22T08:17:46.353515+0000","last_active":"2024-09-22T09:12:06.763009+0000","last_peered":"2024-09-22T09:12:06.763009+0000","last_clean":"2024-09-22T09:12:06.763009+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:12:06.763009+0000","last_undegraded":"2024-09-22T09:12:06.763009+0000","last_fullsized":"2024-09-22T09:12:06.763009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:30.603577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2489","reported_seq":4315,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589709+0000","last_change":"2024-09-22T08:17:48.370106+0000","last_active":"2024-09-22T09:15:22.589709+0000","last_peered":"2024-09-22T09:15:22.589709+0000","last_clean":"2024-09-22T09:15:22.589709+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:15:22.589709+0000","last_undegraded":"2024-09-22T09:15:22.589709+0000","last_fullsized":"2024-09-22T09:15:22.589709+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:41.845103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'408","reported_seq":1953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.767224+0000","last_change":"2024-09-22T08:17:40.318012+0000","last_active":"2024-09-22T09:15:22.767224+0000","last_peered":"2024-09-22T09:15:22.767224+0000","last_clean":"2024-09-22T09:15:22.767224+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:15:22.767224+0000","last_undegraded":"2024-09-22T09:15:22.767224+0000","last_fullsized":"2024-09-22T09:15:22.767224+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:28.192120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'366","reported_seq":1022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.950843+0000","last_change":"2024-09-22T08:17:38.308728+0000","last_active":"2024-09-22T09:16:03.950843+0000","last_peered":"2024-09-22T09:16:03.950843+0000","last_clean":"2024-09-22T09:16:03.950843+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:03.950843+0000","last_undegraded":"2024-09-22T09:16:03.950843+0000","last_fullsized":"2024-09-22T09:16:03.950843+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:31.777927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":639,"num_read_kb":70122,"num_write":1105,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759708+0000","last_change":"2024-09-22T08:17:42.319503+0000","last_active":"2024-09-22T09:11:41.759708+0000","last_peered":"2024-09-22T09:11:41.759708+0000","last_clean":"2024-09-22T09:11:41.759708+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:11:41.759708+0000","last_undegraded":"2024-09-22T09:11:41.759708+0000","last_fullsized":"2024-09-22T09:11:41.759708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:21.120703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'356","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.906933+0000","last_change":"2024-09-22T08:17:44.337630+0000","last_active":"2024-09-22T09:16:02.906933+0000","last_peered":"2024-09-22T09:16:02.906933+0000","last_clean":"2024-09-22T09:16:02.906933+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:16:02.906933+0000","last_undegraded":"2024-09-22T09:16:02.906933+0000","last_fullsized":"2024-09-22T09:16:02.906933+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.579003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1278,"num_write":480,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'814","reported_seq":4732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.284208+0000","last_change":"2024-09-22T08:17:46.356930+0000","last_active":"2024-09-22T09:16:03.284208+0000","last_peered":"2024-09-22T09:16:03.284208+0000","last_clean":"2024-09-22T09:16:03.284208+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:03.284208+0000","last_undegraded":"2024-09-22T09:16:03.284208+0000","last_fullsized":"2024-09-22T09:16:03.284208+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:21.225230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'120","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.589147+0000","last_change":"2024-09-22T08:17:48.366165+0000","last_active":"2024-09-22T09:15:22.589147+0000","last_peered":"2024-09-22T09:15:22.589147+0000","last_clean":"2024-09-22T09:15:22.589147+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:15:22.589147+0000","last_undegraded":"2024-09-22T09:15:22.589147+0000","last_fullsized":"2024-09-22T09:15:22.589147+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:59.292369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1207","reported_seq":2863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:14.961172+0000","last_change":"2024-09-22T08:17:40.315829+0000","last_active":"2024-09-22T09:12:14.961172+0000","last_peered":"2024-09-22T09:12:14.961172+0000","last_clean":"2024-09-22T09:12:14.961172+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:12:14.961172+0000","last_undegraded":"2024-09-22T09:12:14.961172+0000","last_fullsized":"2024-09-22T09:12:14.961172+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:53.760020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'358","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:07.592091+0000","last_change":"2024-09-22T09:16:07.591997+0000","last_active":"2024-09-22T09:16:07.592091+0000","last_peered":"2024-09-22T09:16:07.592091+0000","last_clean":"2024-09-22T09:16:07.592091+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:07.592091+0000","last_undegraded":"2024-09-22T09:16:07.592091+0000","last_fullsized":"2024-09-22T09:16:07.592091+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_clean_scrub_stamp":"2024-09-22T09:16:07.591858+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:25.904081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":651,"num_read_kb":2439,"num_write":1161,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.756824+0000","last_change":"2024-09-22T08:17:42.313688+0000","last_active":"2024-09-22T09:12:01.756824+0000","last_peered":"2024-09-22T09:12:01.756824+0000","last_clean":"2024-09-22T09:12:01.756824+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:12:01.756824+0000","last_undegraded":"2024-09-22T09:12:01.756824+0000","last_fullsized":"2024-09-22T09:12:01.756824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:58:46.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'500","reported_seq":1130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.900973+0000","last_change":"2024-09-22T08:17:44.340359+0000","last_active":"2024-09-22T09:16:03.900973+0000","last_peered":"2024-09-22T09:16:03.900973+0000","last_clean":"2024-09-22T09:16:03.900973+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:03.900973+0000","last_undegraded":"2024-09-22T09:16:03.900973+0000","last_fullsized":"2024-09-22T09:16:03.900973+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:10.001858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":879,"num_read_kb":2151,"num_write":728,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761810+0000","last_change":"2024-09-22T08:17:46.349859+0000","last_active":"2024-09-22T09:11:56.761810+0000","last_peered":"2024-09-22T09:11:56.761810+0000","last_clean":"2024-09-22T09:11:56.761810+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:11:56.761810+0000","last_undegraded":"2024-09-22T09:11:56.761810+0000","last_fullsized":"2024-09-22T09:11:56.761810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:54.379436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'132","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.496396+0000","last_change":"2024-09-22T08:17:48.368083+0000","last_active":"2024-09-22T09:14:05.496396+0000","last_peered":"2024-09-22T09:14:05.496396+0000","last_clean":"2024-09-22T09:14:05.496396+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:14:05.496396+0000","last_undegraded":"2024-09-22T09:14:05.496396+0000","last_fullsized":"2024-09-22T09:14:05.496396+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:52.729529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.211236+0000","last_change":"2024-09-22T08:17:40.315498+0000","last_active":"2024-09-22T09:13:21.211236+0000","last_peered":"2024-09-22T09:13:21.211236+0000","last_clean":"2024-09-22T09:13:21.211236+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:13:21.211236+0000","last_undegraded":"2024-09-22T09:13:21.211236+0000","last_fullsized":"2024-09-22T09:13:21.211236+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:32.268795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'403","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.924639+0000","last_change":"2024-09-22T08:17:38.301804+0000","last_active":"2024-09-22T09:16:03.924639+0000","last_peered":"2024-09-22T09:16:03.924639+0000","last_clean":"2024-09-22T09:16:03.924639+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:03.924639+0000","last_undegraded":"2024-09-22T09:16:03.924639+0000","last_fullsized":"2024-09-22T09:16:03.924639+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:48.176948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":12203,"num_write":1274,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.758407+0000","last_change":"2024-09-22T08:17:42.317745+0000","last_active":"2024-09-22T09:11:41.758407+0000","last_peered":"2024-09-22T09:11:41.758407+0000","last_clean":"2024-09-22T09:11:41.758407+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:11:41.758407+0000","last_undegraded":"2024-09-22T09:11:41.758407+0000","last_fullsized":"2024-09-22T09:11:41.758407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:55.976576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'302","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.972279+0000","last_change":"2024-09-22T08:17:44.340384+0000","last_active":"2024-09-22T09:16:03.972279+0000","last_peered":"2024-09-22T09:16:03.972279+0000","last_clean":"2024-09-22T09:16:03.972279+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:16:03.972279+0000","last_undegraded":"2024-09-22T09:16:03.972279+0000","last_fullsized":"2024-09-22T09:16:03.972279+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:51.178814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48624,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":466,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761329+0000","last_change":"2024-09-22T08:17:46.357757+0000","last_active":"2024-09-22T09:11:56.761329+0000","last_peered":"2024-09-22T09:11:56.761329+0000","last_clean":"2024-09-22T09:11:56.761329+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:11:56.761329+0000","last_undegraded":"2024-09-22T09:11:56.761329+0000","last_fullsized":"2024-09-22T09:11:56.761329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.170661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'175","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:12.994093+0000","last_change":"2024-09-22T08:17:48.369209+0000","last_active":"2024-09-22T09:15:12.994093+0000","last_peered":"2024-09-22T09:15:12.994093+0000","last_clean":"2024-09-22T09:15:12.994093+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:15:12.994093+0000","last_undegraded":"2024-09-22T09:15:12.994093+0000","last_fullsized":"2024-09-22T09:15:12.994093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:22.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'371","reported_seq":1863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183818+0000","last_change":"2024-09-22T08:17:40.318025+0000","last_active":"2024-09-22T09:13:23.183818+0000","last_peered":"2024-09-22T09:13:23.183818+0000","last_clean":"2024-09-22T09:13:23.183818+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:13:23.183818+0000","last_undegraded":"2024-09-22T09:13:23.183818+0000","last_fullsized":"2024-09-22T09:13:23.183818+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'472","reported_seq":1200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.891742+0000","last_change":"2024-09-22T08:17:38.322735+0000","last_active":"2024-09-22T09:16:03.891742+0000","last_peered":"2024-09-22T09:16:03.891742+0000","last_clean":"2024-09-22T09:16:03.891742+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:03.891742+0000","last_undegraded":"2024-09-22T09:16:03.891742+0000","last_fullsized":"2024-09-22T09:16:03.891742+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:20.868798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311644,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1051,"num_read_kb":33703,"num_write":1406,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:41.759746+0000","last_change":"2024-09-22T08:17:42.317557+0000","last_active":"2024-09-22T09:11:41.759746+0000","last_peered":"2024-09-22T09:11:41.759746+0000","last_clean":"2024-09-22T09:11:41.759746+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:11:41.759746+0000","last_undegraded":"2024-09-22T09:11:41.759746+0000","last_fullsized":"2024-09-22T09:11:41.759746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:12.874066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'318","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.493802+0000","last_change":"2024-09-22T08:17:44.331471+0000","last_active":"2024-09-22T09:16:03.493802+0000","last_peered":"2024-09-22T09:16:03.493802+0000","last_clean":"2024-09-22T09:16:03.493802+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:16:03.493802+0000","last_undegraded":"2024-09-22T09:16:03.493802+0000","last_fullsized":"2024-09-22T09:16:03.493802+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:15.784939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50318,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":418,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'795","reported_seq":4269,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.988610+0000","last_change":"2024-09-22T08:17:46.353620+0000","last_active":"2024-09-22T09:16:01.988610+0000","last_peered":"2024-09-22T09:16:01.988610+0000","last_clean":"2024-09-22T09:16:01.988610+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:01.988610+0000","last_undegraded":"2024-09-22T09:16:01.988610+0000","last_fullsized":"2024-09-22T09:16:01.988610+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:44.586630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":632,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.416944+0000","last_change":"2024-09-22T08:17:48.368255+0000","last_active":"2024-09-22T09:14:03.416944+0000","last_peered":"2024-09-22T09:14:03.416944+0000","last_clean":"2024-09-22T09:14:03.416944+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:14:03.416944+0000","last_undegraded":"2024-09-22T09:14:03.416944+0000","last_fullsized":"2024-09-22T09:14:03.416944+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:52.505757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'504","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.760231+0000","last_change":"2024-09-22T08:17:40.319745+0000","last_active":"2024-09-22T09:15:22.760231+0000","last_peered":"2024-09-22T09:15:22.760231+0000","last_clean":"2024-09-22T09:15:22.760231+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:15:22.760231+0000","last_undegraded":"2024-09-22T09:15:22.760231+0000","last_fullsized":"2024-09-22T09:15:22.760231+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:24.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'323","reported_seq":931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.968797+0000","last_change":"2024-09-22T08:17:38.305115+0000","last_active":"2024-09-22T09:16:03.968797+0000","last_peered":"2024-09-22T09:16:03.968797+0000","last_clean":"2024-09-22T09:16:03.968797+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:03.968797+0000","last_undegraded":"2024-09-22T09:16:03.968797+0000","last_fullsized":"2024-09-22T09:16:03.968797+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:22.303400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":25990,"num_write":923,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.357888+0000","last_change":"2024-09-22T08:17:42.319394+0000","last_active":"2024-09-22T09:16:01.357888+0000","last_peered":"2024-09-22T09:16:01.357888+0000","last_clean":"2024-09-22T09:16:01.357888+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:01.357888+0000","last_undegraded":"2024-09-22T09:16:01.357888+0000","last_fullsized":"2024-09-22T09:16:01.357888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:53.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.790388+0000","last_change":"2024-09-22T08:17:44.340629+0000","last_active":"2024-09-22T09:12:16.790388+0000","last_peered":"2024-09-22T09:12:16.790388+0000","last_clean":"2024-09-22T09:12:16.790388+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:12:16.790388+0000","last_undegraded":"2024-09-22T09:12:16.790388+0000","last_fullsized":"2024-09-22T09:12:16.790388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:15.874564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'784","reported_seq":2568,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.630640+0000","last_change":"2024-09-22T08:17:46.356179+0000","last_active":"2024-09-22T09:16:03.630640+0000","last_peered":"2024-09-22T09:16:03.630640+0000","last_clean":"2024-09-22T09:16:03.630640+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:03.630640+0000","last_undegraded":"2024-09-22T09:16:03.630640+0000","last_fullsized":"2024-09-22T09:16:03.630640+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:39.747201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'110","reported_seq":599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.414345+0000","last_change":"2024-09-22T08:17:48.366352+0000","last_active":"2024-09-22T09:14:03.414345+0000","last_peered":"2024-09-22T09:14:03.414345+0000","last_clean":"2024-09-22T09:14:03.414345+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:14:03.414345+0000","last_undegraded":"2024-09-22T09:14:03.414345+0000","last_fullsized":"2024-09-22T09:14:03.414345+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1178","reported_seq":2758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182228+0000","last_change":"2024-09-22T08:17:40.316192+0000","last_active":"2024-09-22T09:13:23.182228+0000","last_peered":"2024-09-22T09:13:23.182228+0000","last_clean":"2024-09-22T09:13:23.182228+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:13:23.182228+0000","last_undegraded":"2024-09-22T09:13:23.182228+0000","last_fullsized":"2024-09-22T09:13:23.182228+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:48.043270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'437","reported_seq":1103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.890968+0000","last_change":"2024-09-22T08:17:38.308011+0000","last_active":"2024-09-22T09:16:03.890968+0000","last_peered":"2024-09-22T09:16:03.890968+0000","last_clean":"2024-09-22T09:16:03.890968+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:03.890968+0000","last_undegraded":"2024-09-22T09:16:03.890968+0000","last_fullsized":"2024-09-22T09:16:03.890968+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:35.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":819,"num_read_kb":19795,"num_write":1316,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:42.764797+0000","last_change":"2024-09-22T08:17:42.313230+0000","last_active":"2024-09-22T09:11:42.764797+0000","last_peered":"2024-09-22T09:11:42.764797+0000","last_clean":"2024-09-22T09:11:42.764797+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:11:42.764797+0000","last_undegraded":"2024-09-22T09:11:42.764797+0000","last_fullsized":"2024-09-22T09:11:42.764797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:03.149245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'360","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.470236+0000","last_change":"2024-09-22T08:17:44.340330+0000","last_active":"2024-09-22T09:16:02.470236+0000","last_peered":"2024-09-22T09:16:02.470236+0000","last_clean":"2024-09-22T09:16:02.470236+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:02.470236+0000","last_undegraded":"2024-09-22T09:16:02.470236+0000","last_fullsized":"2024-09-22T09:16:02.470236+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:32:10.718081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855506+0000","last_change":"2024-09-22T08:17:46.346619+0000","last_active":"2024-09-22T09:11:47.855506+0000","last_peered":"2024-09-22T09:11:47.855506+0000","last_clean":"2024-09-22T09:11:47.855506+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:11:47.855506+0000","last_undegraded":"2024-09-22T09:11:47.855506+0000","last_fullsized":"2024-09-22T09:11:47.855506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:14.109434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'174","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.873297+0000","last_change":"2024-09-22T08:17:48.366379+0000","last_active":"2024-09-22T09:14:02.873297+0000","last_peered":"2024-09-22T09:14:02.873297+0000","last_clean":"2024-09-22T09:14:02.873297+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:14:02.873297+0000","last_undegraded":"2024-09-22T09:14:02.873297+0000","last_fullsized":"2024-09-22T09:14:02.873297+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:58:38.475121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'895","reported_seq":2544,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.774888+0000","last_change":"2024-09-22T08:17:40.315285+0000","last_active":"2024-09-22T09:12:16.774888+0000","last_peered":"2024-09-22T09:12:16.774888+0000","last_clean":"2024-09-22T09:12:16.774888+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:12:16.774888+0000","last_undegraded":"2024-09-22T09:12:16.774888+0000","last_fullsized":"2024-09-22T09:12:16.774888+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:30.566288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970017+0000","last_change":"2024-09-22T08:17:19.067058+0000","last_active":"2024-09-22T09:13:22.970017+0000","last_peered":"2024-09-22T09:13:22.970017+0000","last_clean":"2024-09-22T09:13:22.970017+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:13:22.970017+0000","last_undegraded":"2024-09-22T09:13:22.970017+0000","last_fullsized":"2024-09-22T09:13:22.970017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:17.179098+0000","last_clean_scrub_stamp":"2024-09-22T08:17:17.179098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:38.983853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779151+0000","last_change":"2024-09-22T08:17:27.236270+0000","last_active":"2024-09-22T09:13:42.779151+0000","last_peered":"2024-09-22T09:13:42.779151+0000","last_clean":"2024-09-22T09:13:42.779151+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:13:42.779151+0000","last_undegraded":"2024-09-22T09:13:42.779151+0000","last_fullsized":"2024-09-22T09:13:42.779151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:27.059952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'320","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.919092+0000","last_change":"2024-09-22T08:17:38.310448+0000","last_active":"2024-09-22T09:16:03.919092+0000","last_peered":"2024-09-22T09:16:03.919092+0000","last_clean":"2024-09-22T09:16:03.919092+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:03.919092+0000","last_undegraded":"2024-09-22T09:16:03.919092+0000","last_fullsized":"2024-09-22T09:16:03.919092+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:06.962881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":613,"num_read_kb":39972,"num_write":1027,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.976838+0000","last_change":"2024-09-22T08:17:42.319001+0000","last_active":"2024-09-22T09:13:57.976838+0000","last_peered":"2024-09-22T09:13:57.976838+0000","last_clean":"2024-09-22T09:13:57.976838+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:13:57.976838+0000","last_undegraded":"2024-09-22T09:13:57.976838+0000","last_fullsized":"2024-09-22T09:13:57.976838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'741","reported_seq":1437,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.353935+0000","last_change":"2024-09-22T08:17:44.340548+0000","last_active":"2024-09-22T09:16:03.353935+0000","last_peered":"2024-09-22T09:16:03.353935+0000","last_clean":"2024-09-22T09:16:03.353935+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:03.353935+0000","last_undegraded":"2024-09-22T09:16:03.353935+0000","last_fullsized":"2024-09-22T09:16:03.353935+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:42.555714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133117,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1419,"num_read_kb":3139,"num_write":1374,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:56.761952+0000","last_change":"2024-09-22T08:17:46.351335+0000","last_active":"2024-09-22T09:11:56.761952+0000","last_peered":"2024-09-22T09:11:56.761952+0000","last_clean":"2024-09-22T09:11:56.761952+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:11:56.761952+0000","last_undegraded":"2024-09-22T09:11:56.761952+0000","last_fullsized":"2024-09-22T09:11:56.761952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:59.583080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'205","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.392952+0000","last_change":"2024-09-22T08:17:48.371345+0000","last_active":"2024-09-22T09:14:05.392952+0000","last_peered":"2024-09-22T09:14:05.392952+0000","last_clean":"2024-09-22T09:14:05.392952+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:14:05.392952+0000","last_undegraded":"2024-09-22T09:14:05.392952+0000","last_fullsized":"2024-09-22T09:14:05.392952+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:25.861983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.697568+0000","last_change":"2024-09-22T08:17:40.318048+0000","last_active":"2024-09-22T09:13:27.697568+0000","last_peered":"2024-09-22T09:13:27.697568+0000","last_clean":"2024-09-22T09:13:27.697568+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:13:27.697568+0000","last_undegraded":"2024-09-22T09:13:27.697568+0000","last_fullsized":"2024-09-22T09:13:27.697568+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:48.343685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779075+0000","last_change":"2024-09-22T08:17:27.237005+0000","last_active":"2024-09-22T09:13:42.779075+0000","last_peered":"2024-09-22T09:13:42.779075+0000","last_clean":"2024-09-22T09:13:42.779075+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:13:42.779075+0000","last_undegraded":"2024-09-22T09:13:42.779075+0000","last_fullsized":"2024-09-22T09:13:42.779075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:58.233956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'335","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.918409+0000","last_change":"2024-09-22T08:17:38.309062+0000","last_active":"2024-09-22T09:16:03.918409+0000","last_peered":"2024-09-22T09:16:03.918409+0000","last_clean":"2024-09-22T09:16:03.918409+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:03.918409+0000","last_undegraded":"2024-09-22T09:16:03.918409+0000","last_fullsized":"2024-09-22T09:16:03.918409+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:47.956763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":6730,"num_write":1066,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:52.765977+0000","last_change":"2024-09-22T08:17:42.319964+0000","last_active":"2024-09-22T09:11:52.765977+0000","last_peered":"2024-09-22T09:11:52.765977+0000","last_clean":"2024-09-22T09:11:52.765977+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:11:52.765977+0000","last_undegraded":"2024-09-22T09:11:52.765977+0000","last_fullsized":"2024-09-22T09:11:52.765977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:30.133737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1335","reported_seq":2956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.975538+0000","last_change":"2024-09-22T08:17:44.340574+0000","last_active":"2024-09-22T09:16:03.975538+0000","last_peered":"2024-09-22T09:16:03.975538+0000","last_clean":"2024-09-22T09:16:03.975538+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:03.975538+0000","last_undegraded":"2024-09-22T09:16:03.975538+0000","last_fullsized":"2024-09-22T09:16:03.975538+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:35:13.936560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141570,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3855,"num_write":1170,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:12.768421+0000","last_change":"2024-09-22T08:17:46.355591+0000","last_active":"2024-09-22T09:12:12.768421+0000","last_peered":"2024-09-22T09:12:12.768421+0000","last_clean":"2024-09-22T09:12:12.768421+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:12:12.768421+0000","last_undegraded":"2024-09-22T09:12:12.768421+0000","last_fullsized":"2024-09-22T09:12:12.768421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:16.459442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'121","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.349060+0000","last_change":"2024-09-22T08:17:48.368412+0000","last_active":"2024-09-22T09:14:05.349060+0000","last_peered":"2024-09-22T09:14:05.349060+0000","last_clean":"2024-09-22T09:14:05.349060+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:14:05.349060+0000","last_undegraded":"2024-09-22T09:14:05.349060+0000","last_fullsized":"2024-09-22T09:14:05.349060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'465","reported_seq":2070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755403+0000","last_change":"2024-09-22T08:17:40.310102+0000","last_active":"2024-09-22T09:11:51.755403+0000","last_peered":"2024-09-22T09:11:51.755403+0000","last_clean":"2024-09-22T09:11:51.755403+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:11:51.755403+0000","last_undegraded":"2024-09-22T09:11:51.755403+0000","last_fullsized":"2024-09-22T09:11:51.755403+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:43.429819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778073+0000","last_change":"2024-09-22T08:17:27.826036+0000","last_active":"2024-09-22T09:13:41.778073+0000","last_peered":"2024-09-22T09:13:41.778073+0000","last_clean":"2024-09-22T09:13:41.778073+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:13:41.778073+0000","last_undegraded":"2024-09-22T09:13:41.778073+0000","last_fullsized":"2024-09-22T09:13:41.778073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:20.646063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'324","reported_seq":932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.861750+0000","last_change":"2024-09-22T08:17:38.321760+0000","last_active":"2024-09-22T09:16:03.861750+0000","last_peered":"2024-09-22T09:16:03.861750+0000","last_clean":"2024-09-22T09:16:03.861750+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:03.861750+0000","last_undegraded":"2024-09-22T09:16:03.861750+0000","last_fullsized":"2024-09-22T09:16:03.861750+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:53.153409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174880,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":1785,"num_write":1090,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"37'6","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.346566+0000","last_change":"2024-09-22T08:17:42.318777+0000","last_active":"2024-09-22T09:16:01.346566+0000","last_peered":"2024-09-22T09:16:01.346566+0000","last_clean":"2024-09-22T09:16:01.346566+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:01.346566+0000","last_undegraded":"2024-09-22T09:16:01.346566+0000","last_fullsized":"2024-09-22T09:16:01.346566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:08.823340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'259","reported_seq":1485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.651005+0000","last_change":"2024-09-22T08:17:44.340447+0000","last_active":"2024-09-22T09:15:22.651005+0000","last_peered":"2024-09-22T09:15:22.651005+0000","last_clean":"2024-09-22T09:15:22.651005+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:15:22.651005+0000","last_undegraded":"2024-09-22T09:15:22.651005+0000","last_fullsized":"2024-09-22T09:15:22.651005+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:25.891137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781313+0000","last_change":"2024-09-22T08:17:46.356277+0000","last_active":"2024-09-22T09:14:01.781313+0000","last_peered":"2024-09-22T09:14:01.781313+0000","last_clean":"2024-09-22T09:14:01.781313+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:14:01.781313+0000","last_undegraded":"2024-09-22T09:14:01.781313+0000","last_fullsized":"2024-09-22T09:14:01.781313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:32.511597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'261","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.635821+0000","last_change":"2024-09-22T08:17:48.371579+0000","last_active":"2024-09-22T09:14:05.635821+0000","last_peered":"2024-09-22T09:14:05.635821+0000","last_clean":"2024-09-22T09:14:05.635821+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:14:05.635821+0000","last_undegraded":"2024-09-22T09:14:05.635821+0000","last_fullsized":"2024-09-22T09:14:05.635821+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:45.916159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'775","reported_seq":2205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.773059+0000","last_change":"2024-09-22T08:17:40.310812+0000","last_active":"2024-09-22T09:13:56.773059+0000","last_peered":"2024-09-22T09:13:56.773059+0000","last_clean":"2024-09-22T09:13:56.773059+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:13:56.773059+0000","last_undegraded":"2024-09-22T09:13:56.773059+0000","last_fullsized":"2024-09-22T09:13:56.773059+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:58.245283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779128+0000","last_change":"2024-09-22T08:17:27.236689+0000","last_active":"2024-09-22T09:13:42.779128+0000","last_peered":"2024-09-22T09:13:42.779128+0000","last_clean":"2024-09-22T09:13:42.779128+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:13:42.779128+0000","last_undegraded":"2024-09-22T09:13:42.779128+0000","last_fullsized":"2024-09-22T09:13:42.779128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:24.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'390","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.947308+0000","last_change":"2024-09-22T08:18:09.819721+0000","last_active":"2024-09-22T09:16:03.947308+0000","last_peered":"2024-09-22T09:16:03.947308+0000","last_clean":"2024-09-22T09:16:03.947308+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:03.947308+0000","last_undegraded":"2024-09-22T09:16:03.947308+0000","last_fullsized":"2024-09-22T09:16:03.947308+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:02.135126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":48326,"num_write":1184,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:01.762146+0000","last_change":"2024-09-22T08:17:42.321314+0000","last_active":"2024-09-22T09:12:01.762146+0000","last_peered":"2024-09-22T09:12:01.762146+0000","last_clean":"2024-09-22T09:12:01.762146+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:12:01.762146+0000","last_undegraded":"2024-09-22T09:12:01.762146+0000","last_fullsized":"2024-09-22T09:12:01.762146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:59.774382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'141","reported_seq":680,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782537+0000","last_change":"2024-09-22T08:17:44.338734+0000","last_active":"2024-09-22T09:14:06.782537+0000","last_peered":"2024-09-22T09:14:06.782537+0000","last_clean":"2024-09-22T09:14:06.782537+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:14:06.782537+0000","last_undegraded":"2024-09-22T09:14:06.782537+0000","last_fullsized":"2024-09-22T09:14:06.782537+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:01.878832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.766574+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:11:57.766574+0000","last_peered":"2024-09-22T09:11:57.766574+0000","last_clean":"2024-09-22T09:11:57.766574+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:11:57.766574+0000","last_undegraded":"2024-09-22T09:11:57.766574+0000","last_fullsized":"2024-09-22T09:11:57.766574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:45.080426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'120","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:57.960999+0000","last_change":"2024-09-22T08:17:48.366537+0000","last_active":"2024-09-22T09:11:57.960999+0000","last_peered":"2024-09-22T09:11:57.960999+0000","last_clean":"2024-09-22T09:11:57.960999+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:11:57.960999+0000","last_undegraded":"2024-09-22T09:11:57.960999+0000","last_fullsized":"2024-09-22T09:11:57.960999+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:56.129113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'369","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.533414+0000","last_change":"2024-09-22T08:17:40.314415+0000","last_active":"2024-09-22T09:14:04.533414+0000","last_peered":"2024-09-22T09:14:04.533414+0000","last_clean":"2024-09-22T09:14:04.533414+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:14:04.533414+0000","last_undegraded":"2024-09-22T09:14:04.533414+0000","last_fullsized":"2024-09-22T09:14:04.533414+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:51.191984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'389","reported_seq":1087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.942620+0000","last_change":"2024-09-22T08:17:38.312313+0000","last_active":"2024-09-22T09:16:03.942620+0000","last_peered":"2024-09-22T09:16:03.942620+0000","last_clean":"2024-09-22T09:16:03.942620+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:03.942620+0000","last_undegraded":"2024-09-22T09:16:03.942620+0000","last_fullsized":"2024-09-22T09:16:03.942620+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6919332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":45053,"num_write":1379,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778206+0000","last_change":"2024-09-22T08:17:27.969790+0000","last_active":"2024-09-22T09:13:41.778206+0000","last_peered":"2024-09-22T09:13:41.778206+0000","last_clean":"2024-09-22T09:13:41.778206+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:13:41.778206+0000","last_undegraded":"2024-09-22T09:13:41.778206+0000","last_fullsized":"2024-09-22T09:13:41.778206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:12.723429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780582+0000","last_change":"2024-09-22T08:17:42.315400+0000","last_active":"2024-09-22T09:13:56.780582+0000","last_peered":"2024-09-22T09:13:56.780582+0000","last_clean":"2024-09-22T09:13:56.780582+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:13:56.780582+0000","last_undegraded":"2024-09-22T09:13:56.780582+0000","last_fullsized":"2024-09-22T09:13:56.780582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:35.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'588","reported_seq":1248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.419207+0000","last_change":"2024-09-22T08:17:44.332038+0000","last_active":"2024-09-22T09:16:03.419207+0000","last_peered":"2024-09-22T09:16:03.419207+0000","last_clean":"2024-09-22T09:16:03.419207+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:03.419207+0000","last_undegraded":"2024-09-22T09:16:03.419207+0000","last_fullsized":"2024-09-22T09:16:03.419207+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:32.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1681,"num_read_kb":2863,"num_write":2226,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870727+0000","last_change":"2024-09-22T08:17:46.353133+0000","last_active":"2024-09-22T09:14:02.870727+0000","last_peered":"2024-09-22T09:14:02.870727+0000","last_clean":"2024-09-22T09:14:02.870727+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:14:02.870727+0000","last_undegraded":"2024-09-22T09:14:02.870727+0000","last_fullsized":"2024-09-22T09:14:02.870727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'126","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.865467+0000","last_change":"2024-09-22T08:17:48.371983+0000","last_active":"2024-09-22T09:14:02.865467+0000","last_peered":"2024-09-22T09:14:02.865467+0000","last_clean":"2024-09-22T09:14:02.865467+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:14:02.865467+0000","last_undegraded":"2024-09-22T09:14:02.865467+0000","last_fullsized":"2024-09-22T09:14:02.865467+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:17.544287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'437","reported_seq":2050,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.530580+0000","last_change":"2024-09-22T08:17:40.310836+0000","last_active":"2024-09-22T09:14:04.530580+0000","last_peered":"2024-09-22T09:14:04.530580+0000","last_clean":"2024-09-22T09:14:04.530580+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:14:04.530580+0000","last_undegraded":"2024-09-22T09:14:04.530580+0000","last_fullsized":"2024-09-22T09:14:04.530580+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:50.194831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'404","reported_seq":1058,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.810988+0000","last_change":"2024-09-22T08:17:38.314470+0000","last_active":"2024-09-22T09:16:03.810988+0000","last_peered":"2024-09-22T09:16:03.810988+0000","last_clean":"2024-09-22T09:16:03.810988+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:03.810988+0000","last_undegraded":"2024-09-22T09:16:03.810988+0000","last_fullsized":"2024-09-22T09:16:03.810988+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:21.168095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":42178,"num_write":1167,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781067+0000","last_change":"2024-09-22T08:17:27.236535+0000","last_active":"2024-09-22T09:13:57.781067+0000","last_peered":"2024-09-22T09:13:57.781067+0000","last_clean":"2024-09-22T09:13:57.781067+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:13:57.781067+0000","last_undegraded":"2024-09-22T09:13:57.781067+0000","last_fullsized":"2024-09-22T09:13:57.781067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:26:03.216390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'3","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.370391+0000","last_change":"2024-09-22T08:17:42.319037+0000","last_active":"2024-09-22T09:16:01.370391+0000","last_peered":"2024-09-22T09:16:01.370391+0000","last_clean":"2024-09-22T09:16:01.370391+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:01.370391+0000","last_undegraded":"2024-09-22T09:16:01.370391+0000","last_fullsized":"2024-09-22T09:16:01.370391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:51.756538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'168","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.773647+0000","last_change":"2024-09-22T08:17:44.337754+0000","last_active":"2024-09-22T09:14:01.773647+0000","last_peered":"2024-09-22T09:14:01.773647+0000","last_clean":"2024-09-22T09:14:01.773647+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:14:01.773647+0000","last_undegraded":"2024-09-22T09:14:01.773647+0000","last_fullsized":"2024-09-22T09:14:01.773647+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:07.954994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'784","reported_seq":2599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.630587+0000","last_change":"2024-09-22T08:17:46.353169+0000","last_active":"2024-09-22T09:16:03.630587+0000","last_peered":"2024-09-22T09:16:03.630587+0000","last_clean":"2024-09-22T09:16:03.630587+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:03.630587+0000","last_undegraded":"2024-09-22T09:16:03.630587+0000","last_fullsized":"2024-09-22T09:16:03.630587+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:47.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'124","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783445+0000","last_change":"2024-09-22T08:17:48.370594+0000","last_active":"2024-09-22T09:14:16.783445+0000","last_peered":"2024-09-22T09:14:16.783445+0000","last_clean":"2024-09-22T09:14:16.783445+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:14:16.783445+0000","last_undegraded":"2024-09-22T09:14:16.783445+0000","last_fullsized":"2024-09-22T09:14:16.783445+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:38.200197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'478","reported_seq":2004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779781+0000","last_change":"2024-09-22T08:17:40.314079+0000","last_active":"2024-09-22T09:13:51.779781+0000","last_peered":"2024-09-22T09:13:51.779781+0000","last_clean":"2024-09-22T09:13:51.779781+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:13:51.779781+0000","last_undegraded":"2024-09-22T09:13:51.779781+0000","last_fullsized":"2024-09-22T09:13:51.779781+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:15.539629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'410","reported_seq":1111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.947162+0000","last_change":"2024-09-22T08:17:38.302210+0000","last_active":"2024-09-22T09:16:03.947162+0000","last_peered":"2024-09-22T09:16:03.947162+0000","last_clean":"2024-09-22T09:16:03.947162+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:03.947162+0000","last_undegraded":"2024-09-22T09:16:03.947162+0000","last_fullsized":"2024-09-22T09:16:03.947162+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:59.512304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":945,"num_read_kb":43241,"num_write":1287,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779024+0000","last_change":"2024-09-22T08:17:27.237726+0000","last_active":"2024-09-22T09:13:46.779024+0000","last_peered":"2024-09-22T09:13:46.779024+0000","last_clean":"2024-09-22T09:13:46.779024+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:13:46.779024+0000","last_undegraded":"2024-09-22T09:13:46.779024+0000","last_fullsized":"2024-09-22T09:13:46.779024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:17.240014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781014+0000","last_change":"2024-09-22T08:17:42.316704+0000","last_active":"2024-09-22T09:13:57.781014+0000","last_peered":"2024-09-22T09:13:57.781014+0000","last_clean":"2024-09-22T09:13:57.781014+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:13:57.781014+0000","last_undegraded":"2024-09-22T09:13:57.781014+0000","last_fullsized":"2024-09-22T09:13:57.781014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:09.379090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'111","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.781659+0000","last_change":"2024-09-22T08:17:44.338196+0000","last_active":"2024-09-22T09:14:02.781659+0000","last_peered":"2024-09-22T09:14:02.781659+0000","last_clean":"2024-09-22T09:14:02.781659+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:14:02.781659+0000","last_undegraded":"2024-09-22T09:14:02.781659+0000","last_fullsized":"2024-09-22T09:14:02.781659+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:17.767211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'813","reported_seq":2523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.981940+0000","last_change":"2024-09-22T08:17:46.352328+0000","last_active":"2024-09-22T09:16:03.981940+0000","last_peered":"2024-09-22T09:16:03.981940+0000","last_clean":"2024-09-22T09:16:03.981940+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:03.981940+0000","last_undegraded":"2024-09-22T09:16:03.981940+0000","last_fullsized":"2024-09-22T09:16:03.981940+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:57.228160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'287","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.761107+0000","last_change":"2024-09-22T08:17:48.371281+0000","last_active":"2024-09-22T09:11:51.761107+0000","last_peered":"2024-09-22T09:11:51.761107+0000","last_clean":"2024-09-22T09:11:51.761107+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:11:51.761107+0000","last_undegraded":"2024-09-22T09:11:51.761107+0000","last_fullsized":"2024-09-22T09:11:51.761107+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:03.377587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'782","reported_seq":2368,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214566+0000","last_change":"2024-09-22T08:17:40.316159+0000","last_active":"2024-09-22T09:14:02.214566+0000","last_peered":"2024-09-22T09:14:02.214566+0000","last_clean":"2024-09-22T09:14:02.214566+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:14:02.214566+0000","last_undegraded":"2024-09-22T09:14:02.214566+0000","last_fullsized":"2024-09-22T09:14:02.214566+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:31.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'327","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.924707+0000","last_change":"2024-09-22T08:17:38.300386+0000","last_active":"2024-09-22T09:16:03.924707+0000","last_peered":"2024-09-22T09:16:03.924707+0000","last_clean":"2024-09-22T09:16:03.924707+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:03.924707+0000","last_undegraded":"2024-09-22T09:16:03.924707+0000","last_fullsized":"2024-09-22T09:16:03.924707+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:23.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048951,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":907,"num_read_kb":63310,"num_write":970,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779847+0000","last_change":"2024-09-22T08:17:27.236812+0000","last_active":"2024-09-22T09:13:47.779847+0000","last_peered":"2024-09-22T09:13:47.779847+0000","last_clean":"2024-09-22T09:13:47.779847+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:13:47.779847+0000","last_undegraded":"2024-09-22T09:13:47.779847+0000","last_fullsized":"2024-09-22T09:13:47.779847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:24.206630+0000","last_clean_scrub_stamp":"2024-09-22T08:17:24.206630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:26.102049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779817+0000","last_change":"2024-09-22T08:17:42.311097+0000","last_active":"2024-09-22T09:13:51.779817+0000","last_peered":"2024-09-22T09:13:51.779817+0000","last_clean":"2024-09-22T09:13:51.779817+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:13:51.779817+0000","last_undegraded":"2024-09-22T09:13:51.779817+0000","last_fullsized":"2024-09-22T09:13:51.779817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:38.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'742","reported_seq":1454,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.826554+0000","last_change":"2024-09-22T08:17:44.333541+0000","last_active":"2024-09-22T09:16:03.826554+0000","last_peered":"2024-09-22T09:16:03.826554+0000","last_clean":"2024-09-22T09:16:03.826554+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:03.826554+0000","last_undegraded":"2024-09-22T09:16:03.826554+0000","last_fullsized":"2024-09-22T09:16:03.826554+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1336,"num_read_kb":3141,"num_write":1092,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781256+0000","last_change":"2024-09-22T08:17:46.355809+0000","last_active":"2024-09-22T09:14:01.781256+0000","last_peered":"2024-09-22T09:14:01.781256+0000","last_clean":"2024-09-22T09:14:01.781256+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:14:01.781256+0000","last_undegraded":"2024-09-22T09:14:01.781256+0000","last_fullsized":"2024-09-22T09:14:01.781256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:49.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'100","reported_seq":587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.079488+0000","last_change":"2024-09-22T08:17:48.367775+0000","last_active":"2024-09-22T09:14:05.079488+0000","last_peered":"2024-09-22T09:14:05.079488+0000","last_clean":"2024-09-22T09:14:05.079488+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:14:05.079488+0000","last_undegraded":"2024-09-22T09:14:05.079488+0000","last_fullsized":"2024-09-22T09:14:05.079488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:56.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'123","reported_seq":691,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.578802+0000","last_change":"2024-09-22T08:17:48.366489+0000","last_active":"2024-09-22T09:14:05.578802+0000","last_peered":"2024-09-22T09:14:05.578802+0000","last_clean":"2024-09-22T09:14:05.578802+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:14:05.578802+0000","last_undegraded":"2024-09-22T09:14:05.578802+0000","last_fullsized":"2024-09-22T09:14:05.578802+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:50.584912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'412","reported_seq":1973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868497+0000","last_change":"2024-09-22T08:17:40.313136+0000","last_active":"2024-09-22T09:13:42.868497+0000","last_peered":"2024-09-22T09:13:42.868497+0000","last_clean":"2024-09-22T09:13:42.868497+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:13:42.868497+0000","last_undegraded":"2024-09-22T09:13:42.868497+0000","last_fullsized":"2024-09-22T09:13:42.868497+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:06.500375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'314","reported_seq":960,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.923595+0000","last_change":"2024-09-22T08:18:09.816788+0000","last_active":"2024-09-22T09:16:03.923595+0000","last_peered":"2024-09-22T09:16:03.923595+0000","last_clean":"2024-09-22T09:16:03.923595+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:03.923595+0000","last_undegraded":"2024-09-22T09:16:03.923595+0000","last_fullsized":"2024-09-22T09:16:03.923595+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:13.227442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":48776,"num_write":1072,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.770677+0000","last_change":"2024-09-22T08:17:42.317519+0000","last_active":"2024-09-22T09:13:41.770677+0000","last_peered":"2024-09-22T09:13:41.770677+0000","last_clean":"2024-09-22T09:13:41.770677+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:13:41.770677+0000","last_undegraded":"2024-09-22T09:13:41.770677+0000","last_fullsized":"2024-09-22T09:13:41.770677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:17.290304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'299","reported_seq":862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.819361+0000","last_change":"2024-09-22T08:17:44.340784+0000","last_active":"2024-09-22T09:16:02.819361+0000","last_peered":"2024-09-22T09:16:02.819361+0000","last_clean":"2024-09-22T09:16:02.819361+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:16:02.819361+0000","last_undegraded":"2024-09-22T09:16:02.819361+0000","last_fullsized":"2024-09-22T09:16:02.819361+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:27.691033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44144,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1008,"num_write":380,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778797+0000","last_change":"2024-09-22T08:17:46.357807+0000","last_active":"2024-09-22T09:13:46.778797+0000","last_peered":"2024-09-22T09:13:46.778797+0000","last_clean":"2024-09-22T09:13:46.778797+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:13:46.778797+0000","last_undegraded":"2024-09-22T09:13:46.778797+0000","last_fullsized":"2024-09-22T09:13:46.778797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:34.146262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'156","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781302+0000","last_change":"2024-09-22T08:17:48.370244+0000","last_active":"2024-09-22T09:14:01.781302+0000","last_peered":"2024-09-22T09:14:01.781302+0000","last_clean":"2024-09-22T09:14:01.781302+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:14:01.781302+0000","last_undegraded":"2024-09-22T09:14:01.781302+0000","last_fullsized":"2024-09-22T09:14:01.781302+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:47.163289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'477","reported_seq":2018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.214640+0000","last_change":"2024-09-22T08:17:40.313313+0000","last_active":"2024-09-22T09:14:02.214640+0000","last_peered":"2024-09-22T09:14:02.214640+0000","last_clean":"2024-09-22T09:14:02.214640+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:14:02.214640+0000","last_undegraded":"2024-09-22T09:14:02.214640+0000","last_fullsized":"2024-09-22T09:14:02.214640+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:57.603890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'343","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.788755+0000","last_change":"2024-09-22T08:17:38.309041+0000","last_active":"2024-09-22T09:16:03.788755+0000","last_peered":"2024-09-22T09:16:03.788755+0000","last_clean":"2024-09-22T09:16:03.788755+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:03.788755+0000","last_undegraded":"2024-09-22T09:16:03.788755+0000","last_fullsized":"2024-09-22T09:16:03.788755+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.738401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":615,"num_read_kb":26096,"num_write":1031,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778236+0000","last_change":"2024-09-22T08:17:42.315462+0000","last_active":"2024-09-22T09:13:41.778236+0000","last_peered":"2024-09-22T09:13:41.778236+0000","last_clean":"2024-09-22T09:13:41.778236+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:13:41.778236+0000","last_undegraded":"2024-09-22T09:13:41.778236+0000","last_fullsized":"2024-09-22T09:13:41.778236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:17.089358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'49","reported_seq":550,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778914+0000","last_change":"2024-09-22T08:17:44.334218+0000","last_active":"2024-09-22T09:13:46.778914+0000","last_peered":"2024-09-22T09:13:46.778914+0000","last_clean":"2024-09-22T09:13:46.778914+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:13:46.778914+0000","last_undegraded":"2024-09-22T09:13:46.778914+0000","last_fullsized":"2024-09-22T09:13:46.778914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:02.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869006+0000","last_change":"2024-09-22T08:17:46.350484+0000","last_active":"2024-09-22T09:13:47.869006+0000","last_peered":"2024-09-22T09:13:47.869006+0000","last_clean":"2024-09-22T09:13:47.869006+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:13:47.869006+0000","last_undegraded":"2024-09-22T09:13:47.869006+0000","last_fullsized":"2024-09-22T09:13:47.869006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'168","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.540022+0000","last_change":"2024-09-22T08:17:48.364413+0000","last_active":"2024-09-22T09:14:04.540022+0000","last_peered":"2024-09-22T09:14:04.540022+0000","last_clean":"2024-09-22T09:14:04.540022+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:14:04.540022+0000","last_undegraded":"2024-09-22T09:14:04.540022+0000","last_fullsized":"2024-09-22T09:14:04.540022+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:40:16.567547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1112","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778132+0000","last_change":"2024-09-22T08:17:40.310933+0000","last_active":"2024-09-22T09:13:41.778132+0000","last_peered":"2024-09-22T09:13:41.778132+0000","last_clean":"2024-09-22T09:13:41.778132+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:13:41.778132+0000","last_undegraded":"2024-09-22T09:13:41.778132+0000","last_fullsized":"2024-09-22T09:13:41.778132+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:19.043581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'345","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.800775+0000","last_change":"2024-09-22T08:17:38.312709+0000","last_active":"2024-09-22T09:16:03.800775+0000","last_peered":"2024-09-22T09:16:03.800775+0000","last_clean":"2024-09-22T09:16:03.800775+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:03.800775+0000","last_undegraded":"2024-09-22T09:16:03.800775+0000","last_fullsized":"2024-09-22T09:16:03.800775+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:06.465797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":10746,"num_write":1198,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.868449+0000","last_change":"2024-09-22T08:17:42.313569+0000","last_active":"2024-09-22T09:13:42.868449+0000","last_peered":"2024-09-22T09:13:42.868449+0000","last_clean":"2024-09-22T09:13:42.868449+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:13:42.868449+0000","last_undegraded":"2024-09-22T09:13:42.868449+0000","last_fullsized":"2024-09-22T09:13:42.868449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:08.034183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'296","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.840963+0000","last_change":"2024-09-22T08:17:44.330003+0000","last_active":"2024-09-22T09:16:01.840963+0000","last_peered":"2024-09-22T09:16:01.840963+0000","last_clean":"2024-09-22T09:16:01.840963+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:01.840963+0000","last_undegraded":"2024-09-22T09:16:01.840963+0000","last_fullsized":"2024-09-22T09:16:01.840963+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:32.877991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51577,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1040,"num_write":388,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972795+0000","last_change":"2024-09-22T08:17:46.356371+0000","last_active":"2024-09-22T09:13:47.972795+0000","last_peered":"2024-09-22T09:13:47.972795+0000","last_clean":"2024-09-22T09:13:47.972795+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:13:47.972795+0000","last_undegraded":"2024-09-22T09:13:47.972795+0000","last_fullsized":"2024-09-22T09:13:47.972795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'671","reported_seq":2216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.368365+0000","last_change":"2024-09-22T08:17:40.311434+0000","last_active":"2024-09-22T09:14:05.368365+0000","last_peered":"2024-09-22T09:14:05.368365+0000","last_clean":"2024-09-22T09:14:05.368365+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:14:05.368365+0000","last_undegraded":"2024-09-22T09:14:05.368365+0000","last_fullsized":"2024-09-22T09:14:05.368365+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:05.862018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'398","reported_seq":1108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.887874+0000","last_change":"2024-09-22T08:17:38.311519+0000","last_active":"2024-09-22T09:16:03.887874+0000","last_peered":"2024-09-22T09:16:03.887874+0000","last_clean":"2024-09-22T09:16:03.887874+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:03.887874+0000","last_undegraded":"2024-09-22T09:16:03.887874+0000","last_fullsized":"2024-09-22T09:16:03.887874+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:22.084105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":91878,"num_write":1336,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779094+0000","last_change":"2024-09-22T08:17:42.314653+0000","last_active":"2024-09-22T09:13:42.779094+0000","last_peered":"2024-09-22T09:13:42.779094+0000","last_clean":"2024-09-22T09:13:42.779094+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:13:42.779094+0000","last_undegraded":"2024-09-22T09:13:42.779094+0000","last_fullsized":"2024-09-22T09:13:42.779094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:43.222863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'288","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.592734+0000","last_change":"2024-09-22T08:17:44.333516+0000","last_active":"2024-09-22T09:16:01.592734+0000","last_peered":"2024-09-22T09:16:01.592734+0000","last_clean":"2024-09-22T09:16:01.592734+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:01.592734+0000","last_undegraded":"2024-09-22T09:16:01.592734+0000","last_fullsized":"2024-09-22T09:16:01.592734+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778872+0000","last_change":"2024-09-22T08:17:46.353828+0000","last_active":"2024-09-22T09:13:46.778872+0000","last_peered":"2024-09-22T09:13:46.778872+0000","last_clean":"2024-09-22T09:13:46.778872+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:13:46.778872+0000","last_undegraded":"2024-09-22T09:13:46.778872+0000","last_fullsized":"2024-09-22T09:13:46.778872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:01.647431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'811","reported_seq":2471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211752+0000","last_change":"2024-09-22T08:17:40.320765+0000","last_active":"2024-09-22T09:14:02.211752+0000","last_peered":"2024-09-22T09:14:02.211752+0000","last_clean":"2024-09-22T09:14:02.211752+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:14:02.211752+0000","last_undegraded":"2024-09-22T09:14:02.211752+0000","last_fullsized":"2024-09-22T09:14:02.211752+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:32.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'342","reported_seq":949,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.913344+0000","last_change":"2024-09-22T08:17:38.312312+0000","last_active":"2024-09-22T09:16:03.913344+0000","last_peered":"2024-09-22T09:16:03.913344+0000","last_clean":"2024-09-22T09:16:03.913344+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:03.913344+0000","last_undegraded":"2024-09-22T09:16:03.913344+0000","last_fullsized":"2024-09-22T09:16:03.913344+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:42.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":11716,"num_write":1078,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.772343+0000","last_change":"2024-09-22T08:17:42.317020+0000","last_active":"2024-09-22T09:13:51.772343+0000","last_peered":"2024-09-22T09:13:51.772343+0000","last_clean":"2024-09-22T09:13:51.772343+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:13:51.772343+0000","last_undegraded":"2024-09-22T09:13:51.772343+0000","last_fullsized":"2024-09-22T09:13:51.772343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:52.212344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'468","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.287301+0000","last_change":"2024-09-22T08:17:44.328451+0000","last_active":"2024-09-22T09:16:03.287301+0000","last_peered":"2024-09-22T09:16:03.287301+0000","last_clean":"2024-09-22T09:16:03.287301+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:03.287301+0000","last_undegraded":"2024-09-22T09:16:03.287301+0000","last_fullsized":"2024-09-22T09:16:03.287301+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:33.770821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91839,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1972,"num_write":726,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862398+0000","last_change":"2024-09-22T08:17:46.357073+0000","last_active":"2024-09-22T09:12:47.862398+0000","last_peered":"2024-09-22T09:12:47.862398+0000","last_clean":"2024-09-22T09:12:47.862398+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:12:47.862398+0000","last_undegraded":"2024-09-22T09:12:47.862398+0000","last_fullsized":"2024-09-22T09:12:47.862398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:46.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779894+0000","last_change":"2024-09-22T08:17:48.368356+0000","last_active":"2024-09-22T09:13:51.779894+0000","last_peered":"2024-09-22T09:13:51.779894+0000","last_clean":"2024-09-22T09:13:51.779894+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:13:51.779894+0000","last_undegraded":"2024-09-22T09:13:51.779894+0000","last_fullsized":"2024-09-22T09:13:51.779894+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:44:13.835369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779952+0000","last_change":"2024-09-22T08:17:40.313468+0000","last_active":"2024-09-22T09:13:51.779952+0000","last_peered":"2024-09-22T09:13:51.779952+0000","last_clean":"2024-09-22T09:13:51.779952+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:13:51.779952+0000","last_undegraded":"2024-09-22T09:13:51.779952+0000","last_fullsized":"2024-09-22T09:13:51.779952+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:48.343824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'392","reported_seq":1051,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.913111+0000","last_change":"2024-09-22T08:17:38.309341+0000","last_active":"2024-09-22T09:16:03.913111+0000","last_peered":"2024-09-22T09:16:03.913111+0000","last_clean":"2024-09-22T09:16:03.913111+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:03.913111+0000","last_undegraded":"2024-09-22T09:16:03.913111+0000","last_fullsized":"2024-09-22T09:16:03.913111+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:09.613574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":782,"num_read_kb":2508,"num_write":1241,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870282+0000","last_change":"2024-09-22T08:17:42.318772+0000","last_active":"2024-09-22T09:13:57.870282+0000","last_peered":"2024-09-22T09:13:57.870282+0000","last_clean":"2024-09-22T09:13:57.870282+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:13:57.870282+0000","last_undegraded":"2024-09-22T09:13:57.870282+0000","last_fullsized":"2024-09-22T09:13:57.870282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.477954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.680306+0000","last_change":"2024-09-22T08:17:44.337248+0000","last_active":"2024-09-22T09:16:01.680306+0000","last_peered":"2024-09-22T09:16:01.680306+0000","last_clean":"2024-09-22T09:16:01.680306+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:01.680306+0000","last_undegraded":"2024-09-22T09:16:01.680306+0000","last_fullsized":"2024-09-22T09:16:01.680306+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:40.861866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.769839+0000","last_change":"2024-09-22T08:17:46.351080+0000","last_active":"2024-09-22T09:12:46.769839+0000","last_peered":"2024-09-22T09:12:46.769839+0000","last_clean":"2024-09-22T09:12:46.769839+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:12:46.769839+0000","last_undegraded":"2024-09-22T09:12:46.769839+0000","last_fullsized":"2024-09-22T09:12:46.769839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:09.613966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779767+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:13:47.779767+0000","last_peered":"2024-09-22T09:13:47.779767+0000","last_clean":"2024-09-22T09:13:47.779767+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:13:47.779767+0000","last_undegraded":"2024-09-22T09:13:47.779767+0000","last_fullsized":"2024-09-22T09:13:47.779767+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1248","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.366126+0000","last_change":"2024-09-22T08:17:40.308494+0000","last_active":"2024-09-22T09:14:05.366126+0000","last_peered":"2024-09-22T09:14:05.366126+0000","last_clean":"2024-09-22T09:14:05.366126+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:14:05.366126+0000","last_undegraded":"2024-09-22T09:14:05.366126+0000","last_fullsized":"2024-09-22T09:14:05.366126+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:17.224433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'364","reported_seq":1008,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.883316+0000","last_change":"2024-09-22T08:17:38.301468+0000","last_active":"2024-09-22T09:16:03.883316+0000","last_peered":"2024-09-22T09:16:03.883316+0000","last_clean":"2024-09-22T09:16:03.883316+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:03.883316+0000","last_undegraded":"2024-09-22T09:16:03.883316+0000","last_fullsized":"2024-09-22T09:16:03.883316+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:20.950022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":701,"num_read_kb":11614,"num_write":1118,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861833+0000","last_change":"2024-09-22T08:17:42.319109+0000","last_active":"2024-09-22T09:12:42.861833+0000","last_peered":"2024-09-22T09:12:42.861833+0000","last_clean":"2024-09-22T09:12:42.861833+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:12:42.861833+0000","last_undegraded":"2024-09-22T09:12:42.861833+0000","last_fullsized":"2024-09-22T09:12:42.861833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.764545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'291","reported_seq":857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.133811+0000","last_change":"2024-09-22T08:17:44.329668+0000","last_active":"2024-09-22T09:16:03.133811+0000","last_peered":"2024-09-22T09:16:03.133811+0000","last_clean":"2024-09-22T09:16:03.133811+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:16:03.133811+0000","last_undegraded":"2024-09-22T09:16:03.133811+0000","last_fullsized":"2024-09-22T09:16:03.133811+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:13.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1154,"num_write":408,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780532+0000","last_change":"2024-09-22T08:17:46.357031+0000","last_active":"2024-09-22T09:13:56.780532+0000","last_peered":"2024-09-22T09:13:56.780532+0000","last_clean":"2024-09-22T09:13:56.780532+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:13:56.780532+0000","last_undegraded":"2024-09-22T09:13:56.780532+0000","last_fullsized":"2024-09-22T09:13:56.780532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:29.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.296188+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.296188+0000","last_peered":"2024-09-22T09:15:24.296188+0000","last_clean":"2024-09-22T09:15:24.296188+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.296188+0000","last_undegraded":"2024-09-22T09:15:24.296188+0000","last_fullsized":"2024-09-22T09:15:24.296188+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'667","reported_seq":2093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211947+0000","last_change":"2024-09-22T08:17:40.312070+0000","last_active":"2024-09-22T09:14:02.211947+0000","last_peered":"2024-09-22T09:14:02.211947+0000","last_clean":"2024-09-22T09:14:02.211947+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:14:02.211947+0000","last_undegraded":"2024-09-22T09:14:02.211947+0000","last_fullsized":"2024-09-22T09:14:02.211947+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:59.960810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'302","reported_seq":1006,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.908164+0000","last_change":"2024-09-22T08:17:38.300439+0000","last_active":"2024-09-22T09:16:03.908164+0000","last_peered":"2024-09-22T09:16:03.908164+0000","last_clean":"2024-09-22T09:16:03.908164+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:03.908164+0000","last_undegraded":"2024-09-22T09:16:03.908164+0000","last_fullsized":"2024-09-22T09:16:03.908164+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:30.381994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655841,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":50029,"num_write":1017,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769245+0000","last_change":"2024-09-22T08:17:42.312738+0000","last_active":"2024-09-22T09:12:41.769245+0000","last_peered":"2024-09-22T09:12:41.769245+0000","last_clean":"2024-09-22T09:12:41.769245+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:12:41.769245+0000","last_undegraded":"2024-09-22T09:12:41.769245+0000","last_fullsized":"2024-09-22T09:12:41.769245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:45.180659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'89","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.795335+0000","last_change":"2024-09-22T08:17:44.336865+0000","last_active":"2024-09-22T09:15:22.795335+0000","last_peered":"2024-09-22T09:15:22.795335+0000","last_clean":"2024-09-22T09:15:22.795335+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:15:22.795335+0000","last_undegraded":"2024-09-22T09:15:22.795335+0000","last_fullsized":"2024-09-22T09:15:22.795335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.810068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'780","reported_seq":2591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.976535+0000","last_change":"2024-09-22T08:17:46.350387+0000","last_active":"2024-09-22T09:16:03.976535+0000","last_peered":"2024-09-22T09:16:03.976535+0000","last_clean":"2024-09-22T09:16:03.976535+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:03.976535+0000","last_undegraded":"2024-09-22T09:16:03.976535+0000","last_fullsized":"2024-09-22T09:16:03.976535+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779712+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:47.779712+0000","last_peered":"2024-09-22T09:13:47.779712+0000","last_clean":"2024-09-22T09:13:47.779712+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:47.779712+0000","last_undegraded":"2024-09-22T09:13:47.779712+0000","last_fullsized":"2024-09-22T09:13:47.779712+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'505","reported_seq":2211,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.700019+0000","last_change":"2024-09-22T08:17:40.320955+0000","last_active":"2024-09-22T09:13:27.700019+0000","last_peered":"2024-09-22T09:13:27.700019+0000","last_clean":"2024-09-22T09:13:27.700019+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:13:27.700019+0000","last_undegraded":"2024-09-22T09:13:27.700019+0000","last_fullsized":"2024-09-22T09:13:27.700019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:36.450185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'372","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.966772+0000","last_change":"2024-09-22T08:17:38.297556+0000","last_active":"2024-09-22T09:16:03.966772+0000","last_peered":"2024-09-22T09:16:03.966772+0000","last_clean":"2024-09-22T09:16:03.966772+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:03.966772+0000","last_undegraded":"2024-09-22T09:16:03.966772+0000","last_fullsized":"2024-09-22T09:16:03.966772+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:27.230525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":33741,"num_write":1117,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.965759+0000","last_change":"2024-09-22T08:17:42.321443+0000","last_active":"2024-09-22T09:12:42.965759+0000","last_peered":"2024-09-22T09:12:42.965759+0000","last_clean":"2024-09-22T09:12:42.965759+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:12:42.965759+0000","last_undegraded":"2024-09-22T09:12:42.965759+0000","last_fullsized":"2024-09-22T09:12:42.965759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:41.703609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'299","reported_seq":875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.563136+0000","last_change":"2024-09-22T08:17:44.334035+0000","last_active":"2024-09-22T09:16:03.563136+0000","last_peered":"2024-09-22T09:16:03.563136+0000","last_clean":"2024-09-22T09:16:03.563136+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:16:03.563136+0000","last_undegraded":"2024-09-22T09:16:03.563136+0000","last_fullsized":"2024-09-22T09:16:03.563136+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:29.638317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53474,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1042,"num_write":392,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.775383+0000","last_change":"2024-09-22T08:17:46.356892+0000","last_active":"2024-09-22T09:13:21.775383+0000","last_peered":"2024-09-22T09:13:21.775383+0000","last_clean":"2024-09-22T09:13:21.775383+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:13:21.775383+0000","last_undegraded":"2024-09-22T09:13:21.775383+0000","last_fullsized":"2024-09-22T09:13:21.775383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:04.578235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'130","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.528881+0000","last_change":"2024-09-22T08:17:48.366280+0000","last_active":"2024-09-22T09:14:02.528881+0000","last_peered":"2024-09-22T09:14:02.528881+0000","last_clean":"2024-09-22T09:14:02.528881+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:14:02.528881+0000","last_undegraded":"2024-09-22T09:14:02.528881+0000","last_fullsized":"2024-09-22T09:14:02.528881+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:56.027995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1506","reported_seq":3219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.183120+0000","last_change":"2024-09-22T08:17:40.310983+0000","last_active":"2024-09-22T09:13:23.183120+0000","last_peered":"2024-09-22T09:13:23.183120+0000","last_clean":"2024-09-22T09:13:23.183120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:13:23.183120+0000","last_undegraded":"2024-09-22T09:13:23.183120+0000","last_fullsized":"2024-09-22T09:13:23.183120+0000","mapping_epoch":27,"log_start":"261'1400","ondisk_log_start":"261'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:35.395564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'336","reported_seq":1079,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.944184+0000","last_change":"2024-09-22T08:17:38.304935+0000","last_active":"2024-09-22T09:16:03.944184+0000","last_peered":"2024-09-22T09:16:03.944184+0000","last_clean":"2024-09-22T09:16:03.944184+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:03.944184+0000","last_undegraded":"2024-09-22T09:16:03.944184+0000","last_fullsized":"2024-09-22T09:16:03.944184+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:21.548021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":31338,"num_write":1035,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.861818+0000","last_change":"2024-09-22T08:17:42.318147+0000","last_active":"2024-09-22T09:12:42.861818+0000","last_peered":"2024-09-22T09:12:42.861818+0000","last_clean":"2024-09-22T09:12:42.861818+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:12:42.861818+0000","last_undegraded":"2024-09-22T09:12:42.861818+0000","last_fullsized":"2024-09-22T09:12:42.861818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:04.949197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'310","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.636907+0000","last_change":"2024-09-22T08:17:44.332720+0000","last_active":"2024-09-22T09:16:03.636907+0000","last_peered":"2024-09-22T09:16:03.636907+0000","last_clean":"2024-09-22T09:16:03.636907+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:16:03.636907+0000","last_undegraded":"2024-09-22T09:16:03.636907+0000","last_fullsized":"2024-09-22T09:16:03.636907+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:17.326913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148291,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1361,"num_write":420,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'507","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.775921+0000","last_change":"2024-09-22T08:17:40.310131+0000","last_active":"2024-09-22T09:13:26.775921+0000","last_peered":"2024-09-22T09:13:26.775921+0000","last_clean":"2024-09-22T09:13:26.775921+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:13:26.775921+0000","last_undegraded":"2024-09-22T09:13:26.775921+0000","last_fullsized":"2024-09-22T09:13:26.775921+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:45.234169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'380","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.934364+0000","last_change":"2024-09-22T08:17:38.307916+0000","last_active":"2024-09-22T09:16:03.934364+0000","last_peered":"2024-09-22T09:16:03.934364+0000","last_clean":"2024-09-22T09:16:03.934364+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:03.934364+0000","last_undegraded":"2024-09-22T09:16:03.934364+0000","last_fullsized":"2024-09-22T09:16:03.934364+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:54.133795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":50427,"num_write":1201,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.969462+0000","last_change":"2024-09-22T08:17:42.318093+0000","last_active":"2024-09-22T09:13:17.969462+0000","last_peered":"2024-09-22T09:13:17.969462+0000","last_clean":"2024-09-22T09:13:17.969462+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:13:17.969462+0000","last_undegraded":"2024-09-22T09:13:17.969462+0000","last_fullsized":"2024-09-22T09:13:17.969462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:31:12.353580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'248","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.983828+0000","last_change":"2024-09-22T08:17:44.332231+0000","last_active":"2024-09-22T09:16:02.983828+0000","last_peered":"2024-09-22T09:16:02.983828+0000","last_clean":"2024-09-22T09:16:02.983828+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:16:02.983828+0000","last_undegraded":"2024-09-22T09:16:02.983828+0000","last_fullsized":"2024-09-22T09:16:02.983828+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:01.307744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43840,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":1016,"num_write":348,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'430","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.212080+0000","last_change":"2024-09-22T08:17:40.314834+0000","last_active":"2024-09-22T09:13:21.212080+0000","last_peered":"2024-09-22T09:13:21.212080+0000","last_clean":"2024-09-22T09:13:21.212080+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:13:21.212080+0000","last_undegraded":"2024-09-22T09:13:21.212080+0000","last_fullsized":"2024-09-22T09:13:21.212080+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:48.705025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'350","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.807915+0000","last_change":"2024-09-22T08:17:38.311548+0000","last_active":"2024-09-22T09:16:03.807915+0000","last_peered":"2024-09-22T09:16:03.807915+0000","last_clean":"2024-09-22T09:16:03.807915+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:03.807915+0000","last_undegraded":"2024-09-22T09:16:03.807915+0000","last_fullsized":"2024-09-22T09:16:03.807915+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:46.517280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":43723,"num_write":1129,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.776027+0000","last_change":"2024-09-22T08:17:42.314063+0000","last_active":"2024-09-22T09:13:26.776027+0000","last_peered":"2024-09-22T09:13:26.776027+0000","last_clean":"2024-09-22T09:13:26.776027+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:13:26.776027+0000","last_undegraded":"2024-09-22T09:13:26.776027+0000","last_fullsized":"2024-09-22T09:13:26.776027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:31.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'314","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.219440+0000","last_change":"2024-09-22T08:17:44.339434+0000","last_active":"2024-09-22T09:16:03.219440+0000","last_peered":"2024-09-22T09:16:03.219440+0000","last_clean":"2024-09-22T09:16:03.219440+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:16:03.219440+0000","last_undegraded":"2024-09-22T09:16:03.219440+0000","last_fullsized":"2024-09-22T09:16:03.219440+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:14.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":1187,"num_write":420,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.770004+0000","last_change":"2024-09-22T08:17:46.354487+0000","last_active":"2024-09-22T09:12:46.770004+0000","last_peered":"2024-09-22T09:12:46.770004+0000","last_clean":"2024-09-22T09:12:46.770004+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:12:46.770004+0000","last_undegraded":"2024-09-22T09:12:46.770004+0000","last_fullsized":"2024-09-22T09:12:46.770004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:13.119686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'139","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.752829+0000","last_change":"2024-09-22T08:17:48.372094+0000","last_active":"2024-09-22T09:15:22.752829+0000","last_peered":"2024-09-22T09:15:22.752829+0000","last_clean":"2024-09-22T09:15:22.752829+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:15:22.752829+0000","last_undegraded":"2024-09-22T09:15:22.752829+0000","last_fullsized":"2024-09-22T09:15:22.752829+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:49.984539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'514","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:08.228455+0000","last_change":"2024-09-22T08:17:40.316760+0000","last_active":"2024-09-22T09:13:08.228455+0000","last_peered":"2024-09-22T09:13:08.228455+0000","last_clean":"2024-09-22T09:13:08.228455+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:13:08.228455+0000","last_undegraded":"2024-09-22T09:13:08.228455+0000","last_fullsized":"2024-09-22T09:13:08.228455+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:42.550645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'327","reported_seq":964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.959576+0000","last_change":"2024-09-22T08:17:38.311771+0000","last_active":"2024-09-22T09:16:03.959576+0000","last_peered":"2024-09-22T09:16:03.959576+0000","last_clean":"2024-09-22T09:16:03.959576+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:03.959576+0000","last_undegraded":"2024-09-22T09:16:03.959576+0000","last_fullsized":"2024-09-22T09:16:03.959576+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:56.381847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":538,"num_read_kb":33852,"num_write":961,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'417","reported_seq":1875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.760299+0000","last_change":"2024-09-22T08:17:40.313063+0000","last_active":"2024-09-22T09:11:51.760299+0000","last_peered":"2024-09-22T09:11:51.760299+0000","last_clean":"2024-09-22T09:11:51.760299+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:11:51.760299+0000","last_undegraded":"2024-09-22T09:11:51.760299+0000","last_fullsized":"2024-09-22T09:11:51.760299+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:14:41.064638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'329","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.946896+0000","last_change":"2024-09-22T08:17:38.300470+0000","last_active":"2024-09-22T09:16:03.946896+0000","last_peered":"2024-09-22T09:16:03.946896+0000","last_clean":"2024-09-22T09:16:03.946896+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:03.946896+0000","last_undegraded":"2024-09-22T09:16:03.946896+0000","last_fullsized":"2024-09-22T09:16:03.946896+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:42.767130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":555,"num_read_kb":87971,"num_write":959,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.766032+0000","last_change":"2024-09-22T08:17:40.312973+0000","last_active":"2024-09-22T09:15:22.766032+0000","last_peered":"2024-09-22T09:15:22.766032+0000","last_clean":"2024-09-22T09:15:22.766032+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:15:22.766032+0000","last_undegraded":"2024-09-22T09:15:22.766032+0000","last_fullsized":"2024-09-22T09:15:22.766032+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:51:28.486740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'408","reported_seq":1105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.877200+0000","last_change":"2024-09-22T08:17:38.323059+0000","last_active":"2024-09-22T09:16:03.877200+0000","last_peered":"2024-09-22T09:16:03.877200+0000","last_clean":"2024-09-22T09:16:03.877200+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:03.877200+0000","last_undegraded":"2024-09-22T09:16:03.877200+0000","last_fullsized":"2024-09-22T09:16:03.877200+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:37.193303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":902,"num_read_kb":34719,"num_write":1272,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'748","reported_seq":2556,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.184911+0000","last_change":"2024-09-22T08:17:40.313093+0000","last_active":"2024-09-22T09:14:02.184911+0000","last_peered":"2024-09-22T09:14:02.184911+0000","last_clean":"2024-09-22T09:14:02.184911+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:14:02.184911+0000","last_undegraded":"2024-09-22T09:14:02.184911+0000","last_fullsized":"2024-09-22T09:14:02.184911+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:35.949195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'354","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.661327+0000","last_change":"2024-09-22T08:17:38.310044+0000","last_active":"2024-09-22T09:16:03.661327+0000","last_peered":"2024-09-22T09:16:03.661327+0000","last_clean":"2024-09-22T09:16:03.661327+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:03.661327+0000","last_undegraded":"2024-09-22T09:16:03.661327+0000","last_fullsized":"2024-09-22T09:16:03.661327+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:59.605789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":20346,"num_write":1128,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'494","reported_seq":2066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:05.245095+0000","last_change":"2024-09-22T08:17:40.314007+0000","last_active":"2024-09-22T09:13:05.245095+0000","last_peered":"2024-09-22T09:13:05.245095+0000","last_clean":"2024-09-22T09:13:05.245095+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:13:05.245095+0000","last_undegraded":"2024-09-22T09:13:05.245095+0000","last_fullsized":"2024-09-22T09:13:05.245095+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:29:30.609929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'326","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.812634+0000","last_change":"2024-09-22T08:17:38.312019+0000","last_active":"2024-09-22T09:16:03.812634+0000","last_peered":"2024-09-22T09:16:03.812634+0000","last_clean":"2024-09-22T09:16:03.812634+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:03.812634+0000","last_undegraded":"2024-09-22T09:16:03.812634+0000","last_fullsized":"2024-09-22T09:16:03.812634+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:06.122619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26435,"num_write":1053,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'717","reported_seq":2220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.362495+0000","last_change":"2024-09-22T08:17:40.312561+0000","last_active":"2024-09-22T09:14:05.362495+0000","last_peered":"2024-09-22T09:14:05.362495+0000","last_clean":"2024-09-22T09:14:05.362495+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:14:05.362495+0000","last_undegraded":"2024-09-22T09:14:05.362495+0000","last_fullsized":"2024-09-22T09:14:05.362495+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:01.994997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'356","reported_seq":1022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.947431+0000","last_change":"2024-09-22T08:17:38.308183+0000","last_active":"2024-09-22T09:16:03.947431+0000","last_peered":"2024-09-22T09:16:03.947431+0000","last_clean":"2024-09-22T09:16:03.947431+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:03.947431+0000","last_undegraded":"2024-09-22T09:16:03.947431+0000","last_fullsized":"2024-09-22T09:16:03.947431+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:02.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":911,"num_write":1065,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'458","reported_seq":2142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.210418+0000","last_change":"2024-09-22T08:17:40.319770+0000","last_active":"2024-09-22T09:14:02.210418+0000","last_peered":"2024-09-22T09:14:02.210418+0000","last_clean":"2024-09-22T09:14:02.210418+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:14:02.210418+0000","last_undegraded":"2024-09-22T09:14:02.210418+0000","last_fullsized":"2024-09-22T09:14:02.210418+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:00.471168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'445","reported_seq":1145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.965529+0000","last_change":"2024-09-22T08:17:38.312486+0000","last_active":"2024-09-22T09:16:03.965529+0000","last_peered":"2024-09-22T09:16:03.965529+0000","last_clean":"2024-09-22T09:16:03.965529+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:03.965529+0000","last_undegraded":"2024-09-22T09:16:03.965529+0000","last_fullsized":"2024-09-22T09:16:03.965529+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":934,"num_read_kb":31165,"num_write":1662,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'488","reported_seq":2208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.973888+0000","last_change":"2024-09-22T08:17:40.316623+0000","last_active":"2024-09-22T09:13:57.973888+0000","last_peered":"2024-09-22T09:13:57.973888+0000","last_clean":"2024-09-22T09:13:57.973888+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:13:57.973888+0000","last_undegraded":"2024-09-22T09:13:57.973888+0000","last_fullsized":"2024-09-22T09:13:57.973888+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:49.821404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'323","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.908397+0000","last_change":"2024-09-22T08:17:38.311100+0000","last_active":"2024-09-22T09:16:03.908397+0000","last_peered":"2024-09-22T09:16:03.908397+0000","last_clean":"2024-09-22T09:16:03.908397+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:03.908397+0000","last_undegraded":"2024-09-22T09:16:03.908397+0000","last_fullsized":"2024-09-22T09:16:03.908397+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:07.379794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":8118,"num_write":1009,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'852","reported_seq":2593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.783462+0000","last_change":"2024-09-22T08:17:40.310815+0000","last_active":"2024-09-22T09:15:22.783462+0000","last_peered":"2024-09-22T09:15:22.783462+0000","last_clean":"2024-09-22T09:15:22.783462+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:15:22.783462+0000","last_undegraded":"2024-09-22T09:15:22.783462+0000","last_fullsized":"2024-09-22T09:15:22.783462+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:55.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'407","reported_seq":1110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.869355+0000","last_change":"2024-09-22T08:17:38.301015+0000","last_active":"2024-09-22T09:16:03.869355+0000","last_peered":"2024-09-22T09:16:03.869355+0000","last_clean":"2024-09-22T09:16:03.869355+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:03.869355+0000","last_undegraded":"2024-09-22T09:16:03.869355+0000","last_fullsized":"2024-09-22T09:16:03.869355+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:50.406073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":152949,"num_write":1317,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'439","reported_seq":2069,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.975225+0000","last_change":"2024-09-22T08:17:40.307816+0000","last_active":"2024-09-22T09:13:42.975225+0000","last_peered":"2024-09-22T09:13:42.975225+0000","last_clean":"2024-09-22T09:13:42.975225+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:13:42.975225+0000","last_undegraded":"2024-09-22T09:13:42.975225+0000","last_fullsized":"2024-09-22T09:13:42.975225+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:41.447631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'344","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.896468+0000","last_change":"2024-09-22T08:17:38.309543+0000","last_active":"2024-09-22T09:16:03.896468+0000","last_peered":"2024-09-22T09:16:03.896468+0000","last_clean":"2024-09-22T09:16:03.896468+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:03.896468+0000","last_undegraded":"2024-09-22T09:16:03.896468+0000","last_fullsized":"2024-09-22T09:16:03.896468+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:22.497443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":609,"num_read_kb":9331,"num_write":1190,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'926","reported_seq":2504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.182211+0000","last_change":"2024-09-22T08:17:40.318830+0000","last_active":"2024-09-22T09:13:23.182211+0000","last_peered":"2024-09-22T09:13:23.182211+0000","last_clean":"2024-09-22T09:13:23.182211+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:13:23.182211+0000","last_undegraded":"2024-09-22T09:13:23.182211+0000","last_fullsized":"2024-09-22T09:13:23.182211+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:03.450267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'357","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.959389+0000","last_change":"2024-09-22T08:17:38.301156+0000","last_active":"2024-09-22T09:16:03.959389+0000","last_peered":"2024-09-22T09:16:03.959389+0000","last_clean":"2024-09-22T09:16:03.959389+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:03.959389+0000","last_undegraded":"2024-09-22T09:16:03.959389+0000","last_fullsized":"2024-09-22T09:16:03.959389+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":484,"num_write":1192,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'829","reported_seq":2459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.345949+0000","last_change":"2024-09-22T08:17:40.315626+0000","last_active":"2024-09-22T09:14:05.345949+0000","last_peered":"2024-09-22T09:14:05.345949+0000","last_clean":"2024-09-22T09:14:05.345949+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:14:05.345949+0000","last_undegraded":"2024-09-22T09:14:05.345949+0000","last_fullsized":"2024-09-22T09:14:05.345949+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:29.496843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'455","reported_seq":1174,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.868353+0000","last_change":"2024-09-22T08:17:38.311224+0000","last_active":"2024-09-22T09:16:03.868353+0000","last_peered":"2024-09-22T09:16:03.868353+0000","last_clean":"2024-09-22T09:16:03.868353+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:03.868353+0000","last_undegraded":"2024-09-22T09:16:03.868353+0000","last_fullsized":"2024-09-22T09:16:03.868353+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:31.603904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":882,"num_read_kb":67486,"num_write":1537,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.180874+0000","last_change":"2024-09-22T08:17:40.316250+0000","last_active":"2024-09-22T09:14:02.180874+0000","last_peered":"2024-09-22T09:14:02.180874+0000","last_clean":"2024-09-22T09:14:02.180874+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:14:02.180874+0000","last_undegraded":"2024-09-22T09:14:02.180874+0000","last_fullsized":"2024-09-22T09:14:02.180874+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:06.328790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'315","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.951259+0000","last_change":"2024-09-22T08:17:38.310546+0000","last_active":"2024-09-22T09:16:03.951259+0000","last_peered":"2024-09-22T09:16:03.951259+0000","last_clean":"2024-09-22T09:16:03.951259+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:03.951259+0000","last_undegraded":"2024-09-22T09:16:03.951259+0000","last_fullsized":"2024-09-22T09:16:03.951259+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":4113,"num_write":1035,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1339","reported_seq":3007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.333630+0000","last_change":"2024-09-22T08:17:40.314448+0000","last_active":"2024-09-22T09:14:05.333630+0000","last_peered":"2024-09-22T09:14:05.333630+0000","last_clean":"2024-09-22T09:14:05.333630+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:14:05.333630+0000","last_undegraded":"2024-09-22T09:14:05.333630+0000","last_fullsized":"2024-09-22T09:14:05.333630+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:14.842589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'330","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.941938+0000","last_change":"2024-09-22T08:17:38.320511+0000","last_active":"2024-09-22T09:16:03.941938+0000","last_peered":"2024-09-22T09:16:03.941938+0000","last_clean":"2024-09-22T09:16:03.941938+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:03.941938+0000","last_undegraded":"2024-09-22T09:16:03.941938+0000","last_fullsized":"2024-09-22T09:16:03.941938+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:38.170118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515353,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":7532,"num_write":972,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'878","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.768832+0000","last_change":"2024-09-22T08:17:40.320847+0000","last_active":"2024-09-22T09:15:22.768832+0000","last_peered":"2024-09-22T09:15:22.768832+0000","last_clean":"2024-09-22T09:15:22.768832+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:15:22.768832+0000","last_undegraded":"2024-09-22T09:15:22.768832+0000","last_fullsized":"2024-09-22T09:15:22.768832+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:28.338764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'315","reported_seq":1008,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.951773+0000","last_change":"2024-09-22T08:18:09.819737+0000","last_active":"2024-09-22T09:16:03.951773+0000","last_peered":"2024-09-22T09:16:03.951773+0000","last_clean":"2024-09-22T09:16:03.951773+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:03.951773+0000","last_undegraded":"2024-09-22T09:16:03.951773+0000","last_fullsized":"2024-09-22T09:16:03.951773+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:16.118674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263494,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":814,"num_read_kb":1206,"num_write":1027,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'587","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.755926+0000","last_change":"2024-09-22T08:17:40.320732+0000","last_active":"2024-09-22T09:15:22.755926+0000","last_peered":"2024-09-22T09:15:22.755926+0000","last_clean":"2024-09-22T09:15:22.755926+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:15:22.755926+0000","last_undegraded":"2024-09-22T09:15:22.755926+0000","last_fullsized":"2024-09-22T09:15:22.755926+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:52.124048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'352","reported_seq":995,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.941902+0000","last_change":"2024-09-22T08:17:38.316645+0000","last_active":"2024-09-22T09:16:03.941902+0000","last_peered":"2024-09-22T09:16:03.941902+0000","last_clean":"2024-09-22T09:16:03.941902+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:03.941902+0000","last_undegraded":"2024-09-22T09:16:03.941902+0000","last_fullsized":"2024-09-22T09:16:03.941902+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:19.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":65832,"num_write":1085,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":886,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.917723+0000","last_change":"2024-09-22T08:17:38.316368+0000","last_active":"2024-09-22T09:16:03.917723+0000","last_peered":"2024-09-22T09:16:03.917723+0000","last_clean":"2024-09-22T09:16:03.917723+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:03.917723+0000","last_undegraded":"2024-09-22T09:16:03.917723+0000","last_fullsized":"2024-09-22T09:16:03.917723+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:43.345144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":15571,"num_write":1043,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'501","reported_seq":2189,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.789250+0000","last_change":"2024-09-22T08:17:40.321379+0000","last_active":"2024-09-22T09:15:22.789250+0000","last_peered":"2024-09-22T09:15:22.789250+0000","last_clean":"2024-09-22T09:15:22.789250+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:15:22.789250+0000","last_undegraded":"2024-09-22T09:15:22.789250+0000","last_fullsized":"2024-09-22T09:15:22.789250+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:25.433258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.895733+0000","last_change":"2024-09-22T08:17:38.303976+0000","last_active":"2024-09-22T09:16:03.895733+0000","last_peered":"2024-09-22T09:16:03.895733+0000","last_clean":"2024-09-22T09:16:03.895733+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:03.895733+0000","last_undegraded":"2024-09-22T09:16:03.895733+0000","last_fullsized":"2024-09-22T09:16:03.895733+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:37.261159+0000","last_clean_scrub_stamp":"2024-09-22T08:17:37.261159+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:08.002217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":80287,"num_write":1039,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'500","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.527398+0000","last_change":"2024-09-22T08:17:40.312319+0000","last_active":"2024-09-22T09:14:04.527398+0000","last_peered":"2024-09-22T09:14:04.527398+0000","last_clean":"2024-09-22T09:14:04.527398+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:14:04.527398+0000","last_undegraded":"2024-09-22T09:14:04.527398+0000","last_fullsized":"2024-09-22T09:14:04.527398+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.277593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637503,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18076,"num_read_kb":37621,"num_write":15217,"num_write_kb":11954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2127,"ondisk_log_size":2127,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":51675961,"num_objects":284,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":44405,"num_read_kb":2189102,"num_write":73344,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70811648,"data_stored":70811648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3860,"ondisk_log_size":3860,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":207543,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198277,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510149,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272148,"kb_used_data":15868,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94099692,"statfs":{"total":96636764160,"available":96358084608,"internally_reserved":0,"allocated":16248832,"data_stored":14279973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510149,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172964,"kb_used_data":15304,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":94198876,"statfs":{"total":96636764160,"available":96459649024,"internally_reserved":0,"allocated":15671296,"data_stored":13729926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510152,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333252,"kb_used_data":13204,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038588,"statfs":{"total":96636764160,"available":96295514112,"internally_reserved":0,"allocated":13520896,"data_stored":11543840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510151,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142924,"kb_used_data":12896,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94228916,"statfs":{"total":96636764160,"available":96490409984,"internally_reserved":0,"allocated":13205504,"data_stored":11218915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542854,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250028,"kb_used_data":11796,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94121812,"statfs":{"total":96636764160,"available":96380735488,"internally_reserved":0,"allocated":12079104,"data_stored":10115731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542856,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117036,"kb_used_data":9212,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94254804,"statfs":{"total":96636764160,"available":96516919296,"internally_reserved":0,"allocated":9433088,"data_stored":7445675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542855,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286392,"kb_used_data":12044,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94085448,"statfs":{"total":96636764160,"available":96343498752,"internally_reserved":0,"allocated":12333056,"data_stored":10357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542853,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224240,"kb_used_data":12548,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147600,"statfs":{"total":96636764160,"available":96407142400,"internally_reserved":0,"allocated":12849152,"data_stored":10882684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8757248,"data_stored":8757248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":12083200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7569408,"data_stored":7569408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7917568,"data_stored":7917568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.548 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.549 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.550 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.551 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.552 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.553 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.554 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.555 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.556 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.557 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.558 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.559 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.560 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.561 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.562 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.563 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.564 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.565 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.566 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.567 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.568 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T08:17:17.179098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.569 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.570 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.571 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.572 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.573 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.574 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T08:17:24.206630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=24, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.575 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.576 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.577 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.578 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.579 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.580 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.581 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.582 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.583 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.584 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-22T08:17:37.261159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:10.585 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:16:30.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:30.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:30.961 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2030,"stamp":"2024-09-22T09:16:29.863015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53921399,"num_objects":751,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":313725,"num_read_kb":2862731,"num_write":165438,"num_write_kb":2483177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":582872,"num_omap_keys":1386,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13672,"ondisk_log_size":13672,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1797400,"kb_used_data":102872,"kb_used_omap":12,"kb_used_meta":1694387,"kb_avail":753177320,"statfs":{"total":773094113280,"available":771253575680,"internally_reserved":0,"allocated":105340928,"data_stored":89574178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1735052848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":582872,"num_omap_keys":1386,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005776"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962647+0000","last_change":"2024-09-22T08:51:48.551836+0000","last_active":"2024-09-22T09:11:47.962647+0000","last_peered":"2024-09-22T09:11:47.962647+0000","last_clean":"2024-09-22T09:11:47.962647+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:11:47.962647+0000","last_undegraded":"2024-09-22T09:11:47.962647+0000","last_fullsized":"2024-09-22T09:11:47.962647+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:38.864929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.286780+0000","last_change":"2024-09-22T08:36:17.554312+0000","last_active":"2024-09-22T09:16:02.286780+0000","last_peered":"2024-09-22T09:16:02.286780+0000","last_clean":"2024-09-22T09:16:02.286780+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:16:02.286780+0000","last_undegraded":"2024-09-22T09:16:02.286780+0000","last_fullsized":"2024-09-22T09:16:02.286780+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778930+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:13:46.778930+0000","last_peered":"2024-09-22T09:13:46.778930+0000","last_clean":"2024-09-22T09:13:46.778930+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:13:46.778930+0000","last_undegraded":"2024-09-22T09:13:46.778930+0000","last_fullsized":"2024-09-22T09:13:46.778930+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775065+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:16:01.775065+0000","last_peered":"2024-09-22T09:16:01.775065+0000","last_clean":"2024-09-22T09:16:01.775065+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:16:01.775065+0000","last_undegraded":"2024-09-22T09:16:01.775065+0000","last_fullsized":"2024-09-22T09:16:01.775065+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779025+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:13:46.779025+0000","last_peered":"2024-09-22T09:13:46.779025+0000","last_clean":"2024-09-22T09:13:46.779025+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:13:46.779025+0000","last_undegraded":"2024-09-22T09:13:46.779025+0000","last_fullsized":"2024-09-22T09:13:46.779025+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799341+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:15:51.799341+0000","last_peered":"2024-09-22T09:15:51.799341+0000","last_clean":"2024-09-22T09:15:51.799341+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:15:51.799341+0000","last_undegraded":"2024-09-22T09:15:51.799341+0000","last_fullsized":"2024-09-22T09:15:51.799341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.428303+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:16:01.428303+0000","last_peered":"2024-09-22T09:16:01.428303+0000","last_clean":"2024-09-22T09:16:01.428303+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:16:01.428303+0000","last_undegraded":"2024-09-22T09:16:01.428303+0000","last_fullsized":"2024-09-22T09:16:01.428303+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769938+0000","last_change":"2024-09-22T08:33:33.306873+0000","last_active":"2024-09-22T09:13:36.769938+0000","last_peered":"2024-09-22T09:13:36.769938+0000","last_clean":"2024-09-22T09:13:36.769938+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:13:36.769938+0000","last_undegraded":"2024-09-22T09:13:36.769938+0000","last_fullsized":"2024-09-22T09:13:36.769938+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:59.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778131+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:13:41.778131+0000","last_peered":"2024-09-22T09:13:41.778131+0000","last_clean":"2024-09-22T09:13:41.778131+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:13:41.778131+0000","last_undegraded":"2024-09-22T09:13:41.778131+0000","last_fullsized":"2024-09-22T09:13:41.778131+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:26.785326+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:14:26.785326+0000","last_peered":"2024-09-22T09:14:26.785326+0000","last_clean":"2024-09-22T09:14:26.785326+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:14:26.785326+0000","last_undegraded":"2024-09-22T09:14:26.785326+0000","last_fullsized":"2024-09-22T09:14:26.785326+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.988838+0000","last_change":"2024-09-22T08:36:14.521822+0000","last_active":"2024-09-22T09:15:52.988838+0000","last_peered":"2024-09-22T09:15:52.988838+0000","last_clean":"2024-09-22T09:15:52.988838+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:15:52.988838+0000","last_undegraded":"2024-09-22T09:15:52.988838+0000","last_fullsized":"2024-09-22T09:15:52.988838+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:17.576650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769870+0000","last_change":"2024-09-22T08:33:33.299815+0000","last_active":"2024-09-22T09:13:36.769870+0000","last_peered":"2024-09-22T09:13:36.769870+0000","last_clean":"2024-09-22T09:13:36.769870+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:13:36.769870+0000","last_undegraded":"2024-09-22T09:13:36.769870+0000","last_fullsized":"2024-09-22T09:13:36.769870+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:22.030960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968129+0000","last_change":"2024-09-22T08:36:17.552221+0000","last_active":"2024-09-22T09:12:37.968129+0000","last_peered":"2024-09-22T09:12:37.968129+0000","last_clean":"2024-09-22T09:12:37.968129+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:12:37.968129+0000","last_undegraded":"2024-09-22T09:12:37.968129+0000","last_fullsized":"2024-09-22T09:12:37.968129+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:55.269454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769825+0000","last_change":"2024-09-22T08:33:33.312653+0000","last_active":"2024-09-22T09:13:36.769825+0000","last_peered":"2024-09-22T09:13:36.769825+0000","last_clean":"2024-09-22T09:13:36.769825+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:13:36.769825+0000","last_undegraded":"2024-09-22T09:13:36.769825+0000","last_fullsized":"2024-09-22T09:13:36.769825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:50.718606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:07.790972+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:15:07.790972+0000","last_peered":"2024-09-22T09:15:07.790972+0000","last_clean":"2024-09-22T09:15:07.790972+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:15:07.790972+0000","last_undegraded":"2024-09-22T09:15:07.790972+0000","last_fullsized":"2024-09-22T09:15:07.790972+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.867290+0000","last_change":"2024-09-22T08:33:33.314397+0000","last_active":"2024-09-22T09:13:32.867290+0000","last_peered":"2024-09-22T09:13:32.867290+0000","last_clean":"2024-09-22T09:13:32.867290+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:13:32.867290+0000","last_undegraded":"2024-09-22T09:13:32.867290+0000","last_fullsized":"2024-09-22T09:13:32.867290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:17.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.855481+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:11:47.855481+0000","last_peered":"2024-09-22T09:11:47.855481+0000","last_clean":"2024-09-22T09:11:47.855481+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:11:47.855481+0000","last_undegraded":"2024-09-22T09:11:47.855481+0000","last_fullsized":"2024-09-22T09:11:47.855481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:01.855409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869084+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:13:47.869084+0000","last_peered":"2024-09-22T09:13:47.869084+0000","last_clean":"2024-09-22T09:13:47.869084+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:13:47.869084+0000","last_undegraded":"2024-09-22T09:13:47.869084+0000","last_fullsized":"2024-09-22T09:13:47.869084+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.652123+0000","last_change":"2024-09-22T08:36:14.522217+0000","last_active":"2024-09-22T09:16:02.652123+0000","last_peered":"2024-09-22T09:16:02.652123+0000","last_clean":"2024-09-22T09:16:02.652123+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:16:02.652123+0000","last_undegraded":"2024-09-22T09:16:02.652123+0000","last_fullsized":"2024-09-22T09:16:02.652123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":747,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765671+0000","last_change":"2024-09-22T08:33:33.306368+0000","last_active":"2024-09-22T09:12:21.765671+0000","last_peered":"2024-09-22T09:12:21.765671+0000","last_clean":"2024-09-22T09:12:21.765671+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:12:21.765671+0000","last_undegraded":"2024-09-22T09:12:21.765671+0000","last_fullsized":"2024-09-22T09:12:21.765671+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:28.062281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:47.962738+0000","last_change":"2024-09-22T08:51:48.550754+0000","last_active":"2024-09-22T09:11:47.962738+0000","last_peered":"2024-09-22T09:11:47.962738+0000","last_clean":"2024-09-22T09:11:47.962738+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:11:47.962738+0000","last_undegraded":"2024-09-22T09:11:47.962738+0000","last_fullsized":"2024-09-22T09:11:47.962738+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:50.620910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.476515+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:16:02.476515+0000","last_peered":"2024-09-22T09:16:02.476515+0000","last_clean":"2024-09-22T09:16:02.476515+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:16:02.476515+0000","last_undegraded":"2024-09-22T09:16:02.476515+0000","last_fullsized":"2024-09-22T09:16:02.476515+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.652123+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:16:02.652123+0000","last_peered":"2024-09-22T09:16:02.652123+0000","last_clean":"2024-09-22T09:16:02.652123+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:16:02.652123+0000","last_undegraded":"2024-09-22T09:16:02.652123+0000","last_fullsized":"2024-09-22T09:16:02.652123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758893+0000","last_change":"2024-09-22T08:33:33.303993+0000","last_active":"2024-09-22T09:12:16.758893+0000","last_peered":"2024-09-22T09:12:16.758893+0000","last_clean":"2024-09-22T09:12:16.758893+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:12:16.758893+0000","last_undegraded":"2024-09-22T09:12:16.758893+0000","last_fullsized":"2024-09-22T09:12:16.758893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:11.898143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789167+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:14:56.789167+0000","last_peered":"2024-09-22T09:14:56.789167+0000","last_clean":"2024-09-22T09:14:56.789167+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:14:56.789167+0000","last_undegraded":"2024-09-22T09:14:56.789167+0000","last_fullsized":"2024-09-22T09:14:56.789167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'5","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.501257+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:16:03.501257+0000","last_peered":"2024-09-22T09:16:03.501257+0000","last_clean":"2024-09-22T09:16:03.501257+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:16:03.501257+0000","last_undegraded":"2024-09-22T09:16:03.501257+0000","last_fullsized":"2024-09-22T09:16:03.501257+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778956+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:13:46.778956+0000","last_peered":"2024-09-22T09:13:46.778956+0000","last_clean":"2024-09-22T09:13:46.778956+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:13:46.778956+0000","last_undegraded":"2024-09-22T09:13:46.778956+0000","last_fullsized":"2024-09-22T09:13:46.778956+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984645+0000","last_change":"2024-09-22T08:36:14.525609+0000","last_active":"2024-09-22T09:14:57.984645+0000","last_peered":"2024-09-22T09:14:57.984645+0000","last_clean":"2024-09-22T09:14:57.984645+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:14:57.984645+0000","last_undegraded":"2024-09-22T09:14:57.984645+0000","last_fullsized":"2024-09-22T09:14:57.984645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:03.854966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764817+0000","last_change":"2024-09-22T08:33:33.315166+0000","last_active":"2024-09-22T09:12:16.764817+0000","last_peered":"2024-09-22T09:12:16.764817+0000","last_clean":"2024-09-22T09:12:16.764817+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:12:16.764817+0000","last_undegraded":"2024-09-22T09:12:16.764817+0000","last_fullsized":"2024-09-22T09:12:16.764817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:41.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'8","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789232+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:14:56.789232+0000","last_peered":"2024-09-22T09:14:56.789232+0000","last_clean":"2024-09-22T09:14:56.789232+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:14:56.789232+0000","last_undegraded":"2024-09-22T09:14:56.789232+0000","last_fullsized":"2024-09-22T09:14:56.789232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789203+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:14:56.789203+0000","last_peered":"2024-09-22T09:14:56.789203+0000","last_clean":"2024-09-22T09:14:56.789203+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:14:56.789203+0000","last_undegraded":"2024-09-22T09:14:56.789203+0000","last_fullsized":"2024-09-22T09:14:56.789203+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764788+0000","last_change":"2024-09-22T08:33:33.311367+0000","last_active":"2024-09-22T09:12:16.764788+0000","last_peered":"2024-09-22T09:12:16.764788+0000","last_clean":"2024-09-22T09:12:16.764788+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:12:16.764788+0000","last_undegraded":"2024-09-22T09:12:16.764788+0000","last_fullsized":"2024-09-22T09:12:16.764788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:18.812618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.969239+0000","last_change":"2024-09-22T08:51:48.549838+0000","last_active":"2024-09-22T09:12:47.969239+0000","last_peered":"2024-09-22T09:12:47.969239+0000","last_clean":"2024-09-22T09:12:47.969239+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:12:47.969239+0000","last_undegraded":"2024-09-22T09:12:47.969239+0000","last_fullsized":"2024-09-22T09:12:47.969239+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:35.628007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:57.984688+0000","last_change":"2024-09-22T08:36:17.553737+0000","last_active":"2024-09-22T09:14:57.984688+0000","last_peered":"2024-09-22T09:14:57.984688+0000","last_clean":"2024-09-22T09:14:57.984688+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:14:57.984688+0000","last_undegraded":"2024-09-22T09:14:57.984688+0000","last_fullsized":"2024-09-22T09:14:57.984688+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:21.818626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971629+0000","last_change":"2024-09-22T08:36:14.520890+0000","last_active":"2024-09-22T09:13:37.971629+0000","last_peered":"2024-09-22T09:13:37.971629+0000","last_clean":"2024-09-22T09:13:37.971629+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:13:37.971629+0000","last_undegraded":"2024-09-22T09:13:37.971629+0000","last_fullsized":"2024-09-22T09:13:37.971629+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:40.858239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774744+0000","last_change":"2024-09-22T08:33:33.310293+0000","last_active":"2024-09-22T09:13:16.774744+0000","last_peered":"2024-09-22T09:13:16.774744+0000","last_clean":"2024-09-22T09:13:16.774744+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:13:16.774744+0000","last_undegraded":"2024-09-22T09:13:16.774744+0000","last_fullsized":"2024-09-22T09:13:16.774744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:23:54.882161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971695+0000","last_change":"2024-09-22T08:36:14.521414+0000","last_active":"2024-09-22T09:13:37.971695+0000","last_peered":"2024-09-22T09:13:37.971695+0000","last_clean":"2024-09-22T09:13:37.971695+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:13:37.971695+0000","last_undegraded":"2024-09-22T09:13:37.971695+0000","last_fullsized":"2024-09-22T09:13:37.971695+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:00.328885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865324+0000","last_change":"2024-09-22T08:33:33.305009+0000","last_active":"2024-09-22T09:13:12.865324+0000","last_peered":"2024-09-22T09:13:12.865324+0000","last_clean":"2024-09-22T09:13:12.865324+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:13:12.865324+0000","last_undegraded":"2024-09-22T09:13:12.865324+0000","last_fullsized":"2024-09-22T09:13:12.865324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:50.446180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:57.798094+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:15:57.798094+0000","last_peered":"2024-09-22T09:15:57.798094+0000","last_clean":"2024-09-22T09:15:57.798094+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:15:57.798094+0000","last_undegraded":"2024-09-22T09:15:57.798094+0000","last_fullsized":"2024-09-22T09:15:57.798094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":26642,"num_write":15,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.971719+0000","last_change":"2024-09-22T08:36:14.515004+0000","last_active":"2024-09-22T09:13:37.971719+0000","last_peered":"2024-09-22T09:13:37.971719+0000","last_clean":"2024-09-22T09:13:37.971719+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:13:37.971719+0000","last_undegraded":"2024-09-22T09:13:37.971719+0000","last_fullsized":"2024-09-22T09:13:37.971719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:07.837552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774690+0000","last_change":"2024-09-22T08:33:33.306842+0000","last_active":"2024-09-22T09:13:16.774690+0000","last_peered":"2024-09-22T09:13:16.774690+0000","last_clean":"2024-09-22T09:13:16.774690+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:13:16.774690+0000","last_undegraded":"2024-09-22T09:13:16.774690+0000","last_fullsized":"2024-09-22T09:13:16.774690+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:18:03.666172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764814+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:12:16.764814+0000","last_peered":"2024-09-22T09:12:16.764814+0000","last_clean":"2024-09-22T09:12:16.764814+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:12:16.764814+0000","last_undegraded":"2024-09-22T09:12:16.764814+0000","last_fullsized":"2024-09-22T09:12:16.764814+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:42:23.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.858820+0000","last_change":"2024-09-22T08:36:14.524581+0000","last_active":"2024-09-22T09:12:17.858820+0000","last_peered":"2024-09-22T09:12:17.858820+0000","last_clean":"2024-09-22T09:12:17.858820+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:12:17.858820+0000","last_undegraded":"2024-09-22T09:12:17.858820+0000","last_fullsized":"2024-09-22T09:12:17.858820+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:13.432035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":174,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:11.782729+0000","last_change":"2024-09-22T08:33:33.310511+0000","last_active":"2024-09-22T09:14:11.782729+0000","last_peered":"2024-09-22T09:14:11.782729+0000","last_clean":"2024-09-22T09:14:11.782729+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:14:11.782729+0000","last_undegraded":"2024-09-22T09:14:11.782729+0000","last_fullsized":"2024-09-22T09:14:11.782729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.961550+0000","last_change":"2024-09-22T08:51:48.553902+0000","last_active":"2024-09-22T09:12:02.961550+0000","last_peered":"2024-09-22T09:12:02.961550+0000","last_clean":"2024-09-22T09:12:02.961550+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:12:02.961550+0000","last_undegraded":"2024-09-22T09:12:02.961550+0000","last_fullsized":"2024-09-22T09:12:02.961550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:09.641607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:31.785482+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:14:31.785482+0000","last_peered":"2024-09-22T09:14:31.785482+0000","last_clean":"2024-09-22T09:14:31.785482+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:14:31.785482+0000","last_undegraded":"2024-09-22T09:14:31.785482+0000","last_fullsized":"2024-09-22T09:14:31.785482+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:59.325382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.758982+0000","last_change":"2024-09-22T08:36:14.523378+0000","last_active":"2024-09-22T09:12:16.758982+0000","last_peered":"2024-09-22T09:12:16.758982+0000","last_clean":"2024-09-22T09:12:16.758982+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:12:16.758982+0000","last_undegraded":"2024-09-22T09:12:16.758982+0000","last_fullsized":"2024-09-22T09:12:16.758982+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:26.533836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.781717+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:14:02.781717+0000","last_peered":"2024-09-22T09:14:02.781717+0000","last_clean":"2024-09-22T09:14:02.781717+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:14:02.781717+0000","last_undegraded":"2024-09-22T09:14:02.781717+0000","last_fullsized":"2024-09-22T09:14:02.781717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764842+0000","last_change":"2024-09-22T08:36:14.521867+0000","last_active":"2024-09-22T09:12:16.764842+0000","last_peered":"2024-09-22T09:12:16.764842+0000","last_clean":"2024-09-22T09:12:16.764842+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:12:16.764842+0000","last_undegraded":"2024-09-22T09:12:16.764842+0000","last_fullsized":"2024-09-22T09:12:16.764842+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:20.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":168,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.974814+0000","last_change":"2024-09-22T08:33:33.301439+0000","last_active":"2024-09-22T09:14:02.974814+0000","last_peered":"2024-09-22T09:14:02.974814+0000","last_clean":"2024-09-22T09:14:02.974814+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:14:02.974814+0000","last_undegraded":"2024-09-22T09:14:02.974814+0000","last_fullsized":"2024-09-22T09:14:02.974814+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970549+0000","last_change":"2024-09-22T08:51:48.546986+0000","last_active":"2024-09-22T09:13:27.970549+0000","last_peered":"2024-09-22T09:13:27.970549+0000","last_clean":"2024-09-22T09:13:27.970549+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:13:27.970549+0000","last_undegraded":"2024-09-22T09:13:27.970549+0000","last_fullsized":"2024-09-22T09:13:27.970549+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:43.329879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.142118+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:16:03.142118+0000","last_peered":"2024-09-22T09:16:03.142118+0000","last_clean":"2024-09-22T09:16:03.142118+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:16:03.142118+0000","last_undegraded":"2024-09-22T09:16:03.142118+0000","last_fullsized":"2024-09-22T09:16:03.142118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:47.077061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:36.786233+0000","last_change":"2024-09-22T08:36:14.525673+0000","last_active":"2024-09-22T09:14:36.786233+0000","last_peered":"2024-09-22T09:14:36.786233+0000","last_clean":"2024-09-22T09:14:36.786233+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:14:36.786233+0000","last_undegraded":"2024-09-22T09:14:36.786233+0000","last_fullsized":"2024-09-22T09:14:36.786233+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:00.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.774427+0000","last_change":"2024-09-22T08:33:33.306105+0000","last_active":"2024-09-22T09:14:06.774427+0000","last_peered":"2024-09-22T09:14:06.774427+0000","last_clean":"2024-09-22T09:14:06.774427+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:14:06.774427+0000","last_undegraded":"2024-09-22T09:14:06.774427+0000","last_fullsized":"2024-09-22T09:14:06.774427+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763478+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:12:06.763478+0000","last_peered":"2024-09-22T09:12:06.763478+0000","last_clean":"2024-09-22T09:12:06.763478+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:12:06.763478+0000","last_undegraded":"2024-09-22T09:12:06.763478+0000","last_fullsized":"2024-09-22T09:12:06.763478+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:21.783822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:06.773227+0000","last_change":"2024-09-22T08:36:14.521057+0000","last_active":"2024-09-22T09:13:06.773227+0000","last_peered":"2024-09-22T09:13:06.773227+0000","last_clean":"2024-09-22T09:13:06.773227+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:13:06.773227+0000","last_undegraded":"2024-09-22T09:13:06.773227+0000","last_fullsized":"2024-09-22T09:13:06.773227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:07.181295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.774401+0000","last_change":"2024-09-22T08:33:33.312566+0000","last_active":"2024-09-22T09:14:06.774401+0000","last_peered":"2024-09-22T09:14:06.774401+0000","last_clean":"2024-09-22T09:14:06.774401+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:14:06.774401+0000","last_undegraded":"2024-09-22T09:14:06.774401+0000","last_fullsized":"2024-09-22T09:14:06.774401+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.857195+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:12:02.857195+0000","last_peered":"2024-09-22T09:12:02.857195+0000","last_clean":"2024-09-22T09:12:02.857195+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:12:02.857195+0000","last_undegraded":"2024-09-22T09:12:02.857195+0000","last_fullsized":"2024-09-22T09:12:02.857195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:52.143784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.879891+0000","last_change":"2024-09-22T08:36:17.553257+0000","last_active":"2024-09-22T09:15:17.879891+0000","last_peered":"2024-09-22T09:15:17.879891+0000","last_clean":"2024-09-22T09:15:17.879891+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:15:17.879891+0000","last_undegraded":"2024-09-22T09:15:17.879891+0000","last_fullsized":"2024-09-22T09:15:17.879891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:25.217554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.427984+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:16:01.427984+0000","last_peered":"2024-09-22T09:16:01.427984+0000","last_clean":"2024-09-22T09:16:01.427984+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:16:01.427984+0000","last_undegraded":"2024-09-22T09:16:01.427984+0000","last_fullsized":"2024-09-22T09:16:01.427984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":249,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.861248+0000","last_change":"2024-09-22T08:33:33.306309+0000","last_active":"2024-09-22T09:12:37.861248+0000","last_peered":"2024-09-22T09:12:37.861248+0000","last_clean":"2024-09-22T09:12:37.861248+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:12:37.861248+0000","last_undegraded":"2024-09-22T09:12:37.861248+0000","last_fullsized":"2024-09-22T09:12:37.861248+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:31.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:02.964588+0000","last_change":"2024-09-22T08:51:48.549815+0000","last_active":"2024-09-22T09:12:02.964588+0000","last_peered":"2024-09-22T09:12:02.964588+0000","last_clean":"2024-09-22T09:12:02.964588+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:12:02.964588+0000","last_undegraded":"2024-09-22T09:12:02.964588+0000","last_fullsized":"2024-09-22T09:12:02.964588+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:49.616078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:31.777735+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:14:31.777735+0000","last_peered":"2024-09-22T09:14:31.777735+0000","last_clean":"2024-09-22T09:14:31.777735+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:14:31.777735+0000","last_undegraded":"2024-09-22T09:14:31.777735+0000","last_fullsized":"2024-09-22T09:14:31.777735+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:15.190970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.773987+0000","last_change":"2024-09-22T08:36:14.520376+0000","last_active":"2024-09-22T09:13:11.773987+0000","last_peered":"2024-09-22T09:13:11.773987+0000","last_clean":"2024-09-22T09:13:11.773987+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:13:11.773987+0000","last_undegraded":"2024-09-22T09:13:11.773987+0000","last_fullsized":"2024-09-22T09:13:11.773987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:17.182005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:06.763014+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:12:06.763014+0000","last_peered":"2024-09-22T09:12:06.763014+0000","last_clean":"2024-09-22T09:12:06.763014+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:12:06.763014+0000","last_undegraded":"2024-09-22T09:12:06.763014+0000","last_fullsized":"2024-09-22T09:12:06.763014+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:35.688578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.972039+0000","last_change":"2024-09-22T08:36:17.557866+0000","last_active":"2024-09-22T09:13:12.972039+0000","last_peered":"2024-09-22T09:13:12.972039+0000","last_clean":"2024-09-22T09:13:12.972039+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:13:12.972039+0000","last_undegraded":"2024-09-22T09:13:12.972039+0000","last_fullsized":"2024-09-22T09:13:12.972039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:04.889097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:17.769069+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:12:17.769069+0000","last_peered":"2024-09-22T09:12:17.769069+0000","last_clean":"2024-09-22T09:12:17.769069+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:12:17.769069+0000","last_undegraded":"2024-09-22T09:12:17.769069+0000","last_fullsized":"2024-09-22T09:12:17.769069+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:44.749004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.967432+0000","last_change":"2024-09-22T08:33:33.314991+0000","last_active":"2024-09-22T09:12:32.967432+0000","last_peered":"2024-09-22T09:12:32.967432+0000","last_clean":"2024-09-22T09:12:32.967432+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:12:32.967432+0000","last_undegraded":"2024-09-22T09:12:32.967432+0000","last_fullsized":"2024-09-22T09:12:32.967432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:02.113618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968162+0000","last_change":"2024-09-22T08:51:48.548861+0000","last_active":"2024-09-22T09:12:37.968162+0000","last_peered":"2024-09-22T09:12:37.968162+0000","last_clean":"2024-09-22T09:12:37.968162+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:12:37.968162+0000","last_undegraded":"2024-09-22T09:12:37.968162+0000","last_fullsized":"2024-09-22T09:12:37.968162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:02.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'7","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.802669+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:16:01.802669+0000","last_peered":"2024-09-22T09:16:01.802669+0000","last_clean":"2024-09-22T09:16:01.802669+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:16:01.802669+0000","last_undegraded":"2024-09-22T09:16:01.802669+0000","last_fullsized":"2024-09-22T09:16:01.802669+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4198,"num_write":12,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797384+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:15:52.797384+0000","last_peered":"2024-09-22T09:15:52.797384+0000","last_clean":"2024-09-22T09:15:52.797384+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:15:52.797384+0000","last_undegraded":"2024-09-22T09:15:52.797384+0000","last_fullsized":"2024-09-22T09:15:52.797384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768411+0000","last_change":"2024-09-22T08:33:33.310686+0000","last_active":"2024-09-22T09:12:36.768411+0000","last_peered":"2024-09-22T09:12:36.768411+0000","last_clean":"2024-09-22T09:12:36.768411+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:12:36.768411+0000","last_undegraded":"2024-09-22T09:12:36.768411+0000","last_fullsized":"2024-09-22T09:12:36.768411+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:29.066962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.968185+0000","last_change":"2024-09-22T08:51:48.549659+0000","last_active":"2024-09-22T09:12:37.968185+0000","last_peered":"2024-09-22T09:12:37.968185+0000","last_clean":"2024-09-22T09:12:37.968185+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:12:37.968185+0000","last_undegraded":"2024-09-22T09:12:37.968185+0000","last_fullsized":"2024-09-22T09:12:37.968185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:29.047532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799271+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:15:51.799271+0000","last_peered":"2024-09-22T09:15:51.799271+0000","last_clean":"2024-09-22T09:15:51.799271+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:15:51.799271+0000","last_undegraded":"2024-09-22T09:15:51.799271+0000","last_fullsized":"2024-09-22T09:15:51.799271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.986858+0000","last_change":"2024-09-22T08:36:17.549474+0000","last_active":"2024-09-22T09:15:17.986858+0000","last_peered":"2024-09-22T09:15:17.986858+0000","last_clean":"2024-09-22T09:15:17.986858+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:15:17.986858+0000","last_undegraded":"2024-09-22T09:15:17.986858+0000","last_fullsized":"2024-09-22T09:15:17.986858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:12.074363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864628+0000","last_change":"2024-09-22T08:36:14.518932+0000","last_active":"2024-09-22T09:13:07.864628+0000","last_peered":"2024-09-22T09:13:07.864628+0000","last_clean":"2024-09-22T09:13:07.864628+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:13:07.864628+0000","last_undegraded":"2024-09-22T09:13:07.864628+0000","last_fullsized":"2024-09-22T09:13:07.864628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:01.574307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.865380+0000","last_change":"2024-09-22T08:33:33.310910+0000","last_active":"2024-09-22T09:13:12.865380+0000","last_peered":"2024-09-22T09:13:12.865380+0000","last_clean":"2024-09-22T09:13:12.865380+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:13:12.865380+0000","last_undegraded":"2024-09-22T09:13:12.865380+0000","last_fullsized":"2024-09-22T09:13:12.865380+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:27.693570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:37.771403+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:12:37.771403+0000","last_peered":"2024-09-22T09:12:37.771403+0000","last_clean":"2024-09-22T09:12:37.771403+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:12:37.771403+0000","last_undegraded":"2024-09-22T09:12:37.771403+0000","last_fullsized":"2024-09-22T09:12:37.771403+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:27.349451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774038+0000","last_change":"2024-09-22T08:33:33.309150+0000","last_active":"2024-09-22T09:13:11.774038+0000","last_peered":"2024-09-22T09:13:11.774038+0000","last_clean":"2024-09-22T09:13:11.774038+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:13:11.774038+0000","last_undegraded":"2024-09-22T09:13:11.774038+0000","last_fullsized":"2024-09-22T09:13:11.774038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:51.935987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.107807+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:16:02.107807+0000","last_peered":"2024-09-22T09:16:02.107807+0000","last_clean":"2024-09-22T09:16:02.107807+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:16:02.107807+0000","last_undegraded":"2024-09-22T09:16:02.107807+0000","last_fullsized":"2024-09-22T09:16:02.107807+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12859,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:22.873403+0000","last_change":"2024-09-22T08:36:14.518063+0000","last_active":"2024-09-22T09:14:22.873403+0000","last_peered":"2024-09-22T09:14:22.873403+0000","last_clean":"2024-09-22T09:14:22.873403+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:14:22.873403+0000","last_undegraded":"2024-09-22T09:14:22.873403+0000","last_fullsized":"2024-09-22T09:14:22.873403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":100,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.864566+0000","last_change":"2024-09-22T08:33:33.305508+0000","last_active":"2024-09-22T09:13:07.864566+0000","last_peered":"2024-09-22T09:13:07.864566+0000","last_clean":"2024-09-22T09:13:07.864566+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:13:07.864566+0000","last_undegraded":"2024-09-22T09:13:07.864566+0000","last_fullsized":"2024-09-22T09:13:07.864566+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:55.651981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:27.785272+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:14:27.785272+0000","last_peered":"2024-09-22T09:14:27.785272+0000","last_clean":"2024-09-22T09:14:27.785272+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:14:27.785272+0000","last_undegraded":"2024-09-22T09:14:27.785272+0000","last_fullsized":"2024-09-22T09:14:27.785272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885192+0000","last_change":"2024-09-22T08:36:17.553023+0000","last_active":"2024-09-22T09:15:52.885192+0000","last_peered":"2024-09-22T09:15:52.885192+0000","last_clean":"2024-09-22T09:15:52.885192+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:15:52.885192+0000","last_undegraded":"2024-09-22T09:15:52.885192+0000","last_fullsized":"2024-09-22T09:15:52.885192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:05.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.791107+0000","last_change":"2024-09-22T08:36:14.520504+0000","last_active":"2024-09-22T09:15:51.791107+0000","last_peered":"2024-09-22T09:15:51.791107+0000","last_clean":"2024-09-22T09:15:51.791107+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:15:51.791107+0000","last_undegraded":"2024-09-22T09:15:51.791107+0000","last_fullsized":"2024-09-22T09:15:51.791107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:49.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.885159+0000","last_change":"2024-09-22T08:36:17.548527+0000","last_active":"2024-09-22T09:15:52.885159+0000","last_peered":"2024-09-22T09:15:52.885159+0000","last_clean":"2024-09-22T09:15:52.885159+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:15:52.885159+0000","last_undegraded":"2024-09-22T09:15:52.885159+0000","last_fullsized":"2024-09-22T09:15:52.885159+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:37.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.567213+0000","last_change":"2024-09-22T08:36:14.524325+0000","last_active":"2024-09-22T09:16:02.567213+0000","last_peered":"2024-09-22T09:16:02.567213+0000","last_clean":"2024-09-22T09:16:02.567213+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:16:02.567213+0000","last_undegraded":"2024-09-22T09:16:02.567213+0000","last_fullsized":"2024-09-22T09:16:02.567213+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:58.736096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":87,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.867830+0000","last_change":"2024-09-22T08:33:33.312962+0000","last_active":"2024-09-22T09:13:37.867830+0000","last_peered":"2024-09-22T09:13:37.867830+0000","last_clean":"2024-09-22T09:13:37.867830+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:13:37.867830+0000","last_undegraded":"2024-09-22T09:13:37.867830+0000","last_fullsized":"2024-09-22T09:13:37.867830+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:56.578234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'395","reported_seq":1268,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.512963+0000","last_change":"2024-09-22T09:16:15.512963+0000","last_active":"2024-09-22T09:16:15.512963+0000","last_peered":"2024-09-22T09:16:15.512963+0000","last_clean":"2024-09-22T09:16:15.512963+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:15.512963+0000","last_undegraded":"2024-09-22T09:16:15.512963+0000","last_fullsized":"2024-09-22T09:16:15.512963+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.512820+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:16.248546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1437,"num_read_kb":46472,"num_write":1276,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'951","reported_seq":2510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.195229+0000","last_change":"2024-09-22T09:16:22.195229+0000","last_active":"2024-09-22T09:16:22.195229+0000","last_peered":"2024-09-22T09:16:22.195229+0000","last_clean":"2024-09-22T09:16:22.195229+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:16:22.195229+0000","last_undegraded":"2024-09-22T09:16:22.195229+0000","last_fullsized":"2024-09-22T09:16:22.195229+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'951","last_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_deep_scrub":"261'951","last_deep_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.195138+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:36.195944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'396","reported_seq":1093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.736969+0000","last_change":"2024-09-22T09:16:22.736969+0000","last_active":"2024-09-22T09:16:22.736969+0000","last_peered":"2024-09-22T09:16:22.736969+0000","last_clean":"2024-09-22T09:16:22.736969+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:22.736969+0000","last_undegraded":"2024-09-22T09:16:22.736969+0000","last_fullsized":"2024-09-22T09:16:22.736969+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.736820+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:22.398536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":784,"num_read_kb":45729,"num_write":1281,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'767","reported_seq":2185,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.179987+0000","last_change":"2024-09-22T08:17:40.311740+0000","last_active":"2024-09-22T09:13:23.179987+0000","last_peered":"2024-09-22T09:13:23.179987+0000","last_clean":"2024-09-22T09:13:23.179987+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:13:23.179987+0000","last_undegraded":"2024-09-22T09:13:23.179987+0000","last_fullsized":"2024-09-22T09:13:23.179987+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:16.749258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.700568+0000","last_change":"2024-09-22T09:16:18.700568+0000","last_active":"2024-09-22T09:16:18.700568+0000","last_peered":"2024-09-22T09:16:18.700568+0000","last_clean":"2024-09-22T09:16:18.700568+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:18.700568+0000","last_undegraded":"2024-09-22T09:16:18.700568+0000","last_fullsized":"2024-09-22T09:16:18.700568+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'346","last_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_deep_scrub":"261'346","last_deep_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.700411+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:06.334626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":64388,"num_write":1226,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'498","reported_seq":2127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.699167+0000","last_change":"2024-09-22T08:17:40.314265+0000","last_active":"2024-09-22T09:13:27.699167+0000","last_peered":"2024-09-22T09:13:27.699167+0000","last_clean":"2024-09-22T09:13:27.699167+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:13:27.699167+0000","last_undegraded":"2024-09-22T09:13:27.699167+0000","last_fullsized":"2024-09-22T09:13:27.699167+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:05:49.672590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'394","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.909250+0000","last_change":"2024-09-22T09:16:15.909250+0000","last_active":"2024-09-22T09:16:15.909250+0000","last_peered":"2024-09-22T09:16:15.909250+0000","last_clean":"2024-09-22T09:16:15.909250+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:15.909250+0000","last_undegraded":"2024-09-22T09:16:15.909250+0000","last_fullsized":"2024-09-22T09:16:15.909250+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.909095+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:00.057217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":100163,"num_write":1151,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'536","reported_seq":2210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.721659+0000","last_change":"2024-09-22T09:16:25.721659+0000","last_active":"2024-09-22T09:16:25.721659+0000","last_peered":"2024-09-22T09:16:25.721659+0000","last_clean":"2024-09-22T09:16:25.721659+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:16:25.721659+0000","last_undegraded":"2024-09-22T09:16:25.721659+0000","last_fullsized":"2024-09-22T09:16:25.721659+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'536","last_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_deep_scrub":"261'536","last_deep_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.721574+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:07.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'374","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.484163+0000","last_change":"2024-09-22T09:16:16.484163+0000","last_active":"2024-09-22T09:16:16.484163+0000","last_peered":"2024-09-22T09:16:16.484163+0000","last_clean":"2024-09-22T09:16:16.484163+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:16.484163+0000","last_undegraded":"2024-09-22T09:16:16.484163+0000","last_fullsized":"2024-09-22T09:16:16.484163+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'374","last_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_deep_scrub":"261'374","last_deep_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.484052+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:58.010659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":101852,"num_write":1145,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'579","reported_seq":2244,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.486420+0000","last_change":"2024-09-22T09:16:21.486420+0000","last_active":"2024-09-22T09:16:21.486420+0000","last_peered":"2024-09-22T09:16:21.486420+0000","last_clean":"2024-09-22T09:16:21.486420+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:16:21.486420+0000","last_undegraded":"2024-09-22T09:16:21.486420+0000","last_fullsized":"2024-09-22T09:16:21.486420+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.486318+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.331269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'402","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.939126+0000","last_change":"2024-09-22T09:16:13.939126+0000","last_active":"2024-09-22T09:16:13.939126+0000","last_peered":"2024-09-22T09:16:13.939126+0000","last_clean":"2024-09-22T09:16:13.939126+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:13.939126+0000","last_undegraded":"2024-09-22T09:16:13.939126+0000","last_fullsized":"2024-09-22T09:16:13.939126+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.938974+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:23.382523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311674,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":20769,"num_write":1109,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1042","reported_seq":2592,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.481044+0000","last_change":"2024-09-22T09:16:22.481044+0000","last_active":"2024-09-22T09:16:22.481044+0000","last_peered":"2024-09-22T09:16:22.481044+0000","last_clean":"2024-09-22T09:16:22.481044+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:16:22.481044+0000","last_undegraded":"2024-09-22T09:16:22.481044+0000","last_fullsized":"2024-09-22T09:16:22.481044+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1042","last_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_deep_scrub":"261'1042","last_deep_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.480948+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:22.317236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'329","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.515526+0000","last_change":"2024-09-22T09:16:14.515526+0000","last_active":"2024-09-22T09:16:14.515526+0000","last_peered":"2024-09-22T09:16:14.515526+0000","last_clean":"2024-09-22T09:16:14.515526+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:14.515526+0000","last_undegraded":"2024-09-22T09:16:14.515526+0000","last_fullsized":"2024-09-22T09:16:14.515526+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.515318+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:36.695819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":9376,"num_write":1029,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'497","reported_seq":2098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.940307+0000","last_change":"2024-09-22T09:16:22.940307+0000","last_active":"2024-09-22T09:16:22.940307+0000","last_peered":"2024-09-22T09:16:22.940307+0000","last_clean":"2024-09-22T09:16:22.940307+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:16:22.940307+0000","last_undegraded":"2024-09-22T09:16:22.940307+0000","last_fullsized":"2024-09-22T09:16:22.940307+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'497","last_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_deep_scrub":"261'497","last_deep_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.940226+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:57.523147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'376","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.716405+0000","last_change":"2024-09-22T09:16:20.716405+0000","last_active":"2024-09-22T09:16:20.716405+0000","last_peered":"2024-09-22T09:16:20.716405+0000","last_clean":"2024-09-22T09:16:20.716405+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:20.716405+0000","last_undegraded":"2024-09-22T09:16:20.716405+0000","last_fullsized":"2024-09-22T09:16:20.716405+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.716279+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:27.920378+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":772,"num_read_kb":32992,"num_write":1092,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'638","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780919+0000","last_change":"2024-09-22T08:17:40.319835+0000","last_active":"2024-09-22T09:13:56.780919+0000","last_peered":"2024-09-22T09:13:56.780919+0000","last_clean":"2024-09-22T09:13:56.780919+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:13:56.780919+0000","last_undegraded":"2024-09-22T09:13:56.780919+0000","last_fullsized":"2024-09-22T09:13:56.780919+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:37.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'401","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779056+0000","last_change":"2024-09-22T08:17:40.313776+0000","last_active":"2024-09-22T09:13:42.779056+0000","last_peered":"2024-09-22T09:13:42.779056+0000","last_clean":"2024-09-22T09:13:42.779056+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:13:42.779056+0000","last_undegraded":"2024-09-22T09:13:42.779056+0000","last_fullsized":"2024-09-22T09:13:42.779056+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:46.265677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'303","reported_seq":928,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207647+0000","last_change":"2024-09-22T09:16:13.207647+0000","last_active":"2024-09-22T09:16:13.207647+0000","last_peered":"2024-09-22T09:16:13.207647+0000","last_clean":"2024-09-22T09:16:13.207647+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:13.207647+0000","last_undegraded":"2024-09-22T09:16:13.207647+0000","last_fullsized":"2024-09-22T09:16:13.207647+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.207542+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:43.122476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947307,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":25983,"num_write":980,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'394","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.525921+0000","last_change":"2024-09-22T09:16:20.525921+0000","last_active":"2024-09-22T09:16:20.525921+0000","last_peered":"2024-09-22T09:16:20.525921+0000","last_clean":"2024-09-22T09:16:20.525921+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:16:20.525921+0000","last_undegraded":"2024-09-22T09:16:20.525921+0000","last_fullsized":"2024-09-22T09:16:20.525921+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.525816+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:17.576244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'287","reported_seq":876,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.499416+0000","last_change":"2024-09-22T09:16:13.499416+0000","last_active":"2024-09-22T09:16:13.499416+0000","last_peered":"2024-09-22T09:16:13.499416+0000","last_clean":"2024-09-22T09:16:13.499416+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:13.499416+0000","last_undegraded":"2024-09-22T09:16:13.499416+0000","last_fullsized":"2024-09-22T09:16:13.499416+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.499276+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:01.659857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":451,"num_read_kb":1407,"num_write":876,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'766","reported_seq":2327,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.200824+0000","last_change":"2024-09-22T09:16:19.200824+0000","last_active":"2024-09-22T09:16:19.200824+0000","last_peered":"2024-09-22T09:16:19.200824+0000","last_clean":"2024-09-22T09:16:19.200824+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:16:19.200824+0000","last_undegraded":"2024-09-22T09:16:19.200824+0000","last_fullsized":"2024-09-22T09:16:19.200824+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'766","last_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_deep_scrub":"261'766","last_deep_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.200744+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:48.695705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'305","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.529861+0000","last_change":"2024-09-22T09:16:11.529861+0000","last_active":"2024-09-22T09:16:11.529861+0000","last_peered":"2024-09-22T09:16:11.529861+0000","last_clean":"2024-09-22T09:16:11.529861+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:11.529861+0000","last_undegraded":"2024-09-22T09:16:11.529861+0000","last_fullsized":"2024-09-22T09:16:11.529861+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.529676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:25.488246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":31210,"num_write":1028,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'771","reported_seq":2408,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.151660+0000","last_change":"2024-09-22T09:16:22.151660+0000","last_active":"2024-09-22T09:16:22.151660+0000","last_peered":"2024-09-22T09:16:22.151660+0000","last_clean":"2024-09-22T09:16:22.151660+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:16:22.151660+0000","last_undegraded":"2024-09-22T09:16:22.151660+0000","last_fullsized":"2024-09-22T09:16:22.151660+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'771","last_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_deep_scrub":"261'771","last_deep_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.151579+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:39.550280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1777,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'326","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.538362+0000","last_change":"2024-09-22T09:16:12.538362+0000","last_active":"2024-09-22T09:16:12.538362+0000","last_peered":"2024-09-22T09:16:12.538362+0000","last_clean":"2024-09-22T09:16:12.538362+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:12.538362+0000","last_undegraded":"2024-09-22T09:16:12.538362+0000","last_fullsized":"2024-09-22T09:16:12.538362+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.538192+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:14.191967+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655876,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":639,"num_read_kb":14450,"num_write":1076,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.948204+0000","last_change":"2024-09-22T08:17:40.319549+0000","last_active":"2024-09-22T09:13:17.948204+0000","last_peered":"2024-09-22T09:13:17.948204+0000","last_clean":"2024-09-22T09:13:17.948204+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:13:17.948204+0000","last_undegraded":"2024-09-22T09:13:17.948204+0000","last_fullsized":"2024-09-22T09:13:17.948204+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:41.286507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'352","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.247778+0000","last_change":"2024-09-22T09:16:14.247778+0000","last_active":"2024-09-22T09:16:14.247778+0000","last_peered":"2024-09-22T09:16:14.247778+0000","last_clean":"2024-09-22T09:16:14.247778+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:14.247778+0000","last_undegraded":"2024-09-22T09:16:14.247778+0000","last_fullsized":"2024-09-22T09:16:14.247778+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.247594+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:36.776380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1523,"num_write":1216,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'583","reported_seq":2209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.184302+0000","last_change":"2024-09-22T09:16:20.184302+0000","last_active":"2024-09-22T09:16:20.184302+0000","last_peered":"2024-09-22T09:16:20.184302+0000","last_clean":"2024-09-22T09:16:20.184302+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:16:20.184302+0000","last_undegraded":"2024-09-22T09:16:20.184302+0000","last_fullsized":"2024-09-22T09:16:20.184302+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'583","last_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_deep_scrub":"261'583","last_deep_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.184210+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:24.340294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1226,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'419","reported_seq":1094,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.209011+0000","last_change":"2024-09-22T09:16:17.209011+0000","last_active":"2024-09-22T09:16:17.209011+0000","last_peered":"2024-09-22T09:16:17.209011+0000","last_clean":"2024-09-22T09:16:17.209011+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:17.209011+0000","last_undegraded":"2024-09-22T09:16:17.209011+0000","last_fullsized":"2024-09-22T09:16:17.209011+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.208816+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:49.867009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":782,"num_read_kb":14779,"num_write":1492,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'120","reported_seq":619,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.502060+0000","last_change":"2024-09-22T08:17:48.369855+0000","last_active":"2024-09-22T09:14:05.502060+0000","last_peered":"2024-09-22T09:14:05.502060+0000","last_clean":"2024-09-22T09:14:05.502060+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:14:05.502060+0000","last_undegraded":"2024-09-22T09:14:05.502060+0000","last_fullsized":"2024-09-22T09:14:05.502060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:27.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'998","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.196121+0000","last_change":"2024-09-22T09:16:21.196121+0000","last_active":"2024-09-22T09:16:21.196121+0000","last_peered":"2024-09-22T09:16:21.196121+0000","last_clean":"2024-09-22T09:16:21.196121+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:16:21.196121+0000","last_undegraded":"2024-09-22T09:16:21.196121+0000","last_fullsized":"2024-09-22T09:16:21.196121+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'998","last_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_deep_scrub":"261'998","last_deep_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.196028+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:20.279066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'370","reported_seq":1248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.233157+0000","last_change":"2024-09-22T09:16:16.233157+0000","last_active":"2024-09-22T09:16:16.233157+0000","last_peered":"2024-09-22T09:16:16.233157+0000","last_clean":"2024-09-22T09:16:16.233157+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:16.233157+0000","last_undegraded":"2024-09-22T09:16:16.233157+0000","last_fullsized":"2024-09-22T09:16:16.233157+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'370","last_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_deep_scrub":"261'370","last_deep_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.233008+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:54.584470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1344,"num_read_kb":67744,"num_write":1254,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776258+0000","last_change":"2024-09-22T08:17:42.313314+0000","last_active":"2024-09-22T09:13:17.776258+0000","last_peered":"2024-09-22T09:13:17.776258+0000","last_clean":"2024-09-22T09:13:17.776258+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:13:17.776258+0000","last_undegraded":"2024-09-22T09:13:17.776258+0000","last_fullsized":"2024-09-22T09:13:17.776258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:45.452672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'345","reported_seq":947,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.376665+0000","last_change":"2024-09-22T08:17:44.340362+0000","last_active":"2024-09-22T09:16:02.376665+0000","last_peered":"2024-09-22T09:16:02.376665+0000","last_clean":"2024-09-22T09:16:02.376665+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:16:02.376665+0000","last_undegraded":"2024-09-22T09:16:02.376665+0000","last_fullsized":"2024-09-22T09:16:02.376665+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:24.766194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1201,"num_write":446,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970119+0000","last_change":"2024-09-22T08:17:46.352688+0000","last_active":"2024-09-22T09:13:22.970119+0000","last_peered":"2024-09-22T09:13:22.970119+0000","last_clean":"2024-09-22T09:13:22.970119+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:13:22.970119+0000","last_undegraded":"2024-09-22T09:13:22.970119+0000","last_fullsized":"2024-09-22T09:13:22.970119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:01.237921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'146","reported_seq":654,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.970576+0000","last_change":"2024-09-22T08:17:48.369501+0000","last_active":"2024-09-22T09:13:27.970576+0000","last_peered":"2024-09-22T09:13:27.970576+0000","last_clean":"2024-09-22T09:13:27.970576+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:13:27.970576+0000","last_undegraded":"2024-09-22T09:13:27.970576+0000","last_fullsized":"2024-09-22T09:13:27.970576+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:58.815501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'462","reported_seq":2124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.524494+0000","last_change":"2024-09-22T08:17:40.313282+0000","last_active":"2024-09-22T09:14:04.524494+0000","last_peered":"2024-09-22T09:14:04.524494+0000","last_clean":"2024-09-22T09:14:04.524494+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:14:04.524494+0000","last_undegraded":"2024-09-22T09:14:04.524494+0000","last_fullsized":"2024-09-22T09:14:04.524494+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:54.516463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'376","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.202024+0000","last_change":"2024-09-22T09:16:15.202024+0000","last_active":"2024-09-22T09:16:15.202024+0000","last_peered":"2024-09-22T09:16:15.202024+0000","last_clean":"2024-09-22T09:16:15.202024+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:15.202024+0000","last_undegraded":"2024-09-22T09:16:15.202024+0000","last_fullsized":"2024-09-22T09:16:15.202024+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.201907+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:52.431996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":649,"num_read_kb":11781,"num_write":1236,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779902+0000","last_change":"2024-09-22T08:17:42.314952+0000","last_active":"2024-09-22T09:13:51.779902+0000","last_peered":"2024-09-22T09:13:51.779902+0000","last_clean":"2024-09-22T09:13:51.779902+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:13:51.779902+0000","last_undegraded":"2024-09-22T09:13:51.779902+0000","last_fullsized":"2024-09-22T09:13:51.779902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'89","reported_seq":606,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970112+0000","last_change":"2024-09-22T08:17:44.340327+0000","last_active":"2024-09-22T09:13:22.970112+0000","last_peered":"2024-09-22T09:13:22.970112+0000","last_clean":"2024-09-22T09:13:22.970112+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:13:22.970112+0000","last_undegraded":"2024-09-22T09:13:22.970112+0000","last_fullsized":"2024-09-22T09:13:22.970112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:46:28.780689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.970081+0000","last_change":"2024-09-22T08:17:46.352088+0000","last_active":"2024-09-22T09:13:22.970081+0000","last_peered":"2024-09-22T09:13:22.970081+0000","last_clean":"2024-09-22T09:13:22.970081+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:13:22.970081+0000","last_undegraded":"2024-09-22T09:13:22.970081+0000","last_fullsized":"2024-09-22T09:13:22.970081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:29:40.458281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763658+0000","last_change":"2024-09-22T08:17:48.367697+0000","last_active":"2024-09-22T09:12:51.763658+0000","last_peered":"2024-09-22T09:12:51.763658+0000","last_clean":"2024-09-22T09:12:51.763658+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:12:51.763658+0000","last_undegraded":"2024-09-22T09:12:51.763658+0000","last_fullsized":"2024-09-22T09:12:51.763658+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:46.458711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.695681+0000","last_change":"2024-09-22T09:16:26.695681+0000","last_active":"2024-09-22T09:16:26.695681+0000","last_peered":"2024-09-22T09:16:26.695681+0000","last_clean":"2024-09-22T09:16:26.695681+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:16:26.695681+0000","last_undegraded":"2024-09-22T09:16:26.695681+0000","last_fullsized":"2024-09-22T09:16:26.695681+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.695595+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:50:56.527592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'316","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.273692+0000","last_change":"2024-09-22T09:16:18.273692+0000","last_active":"2024-09-22T09:16:18.273692+0000","last_peered":"2024-09-22T09:16:18.273692+0000","last_clean":"2024-09-22T09:16:18.273692+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:18.273692+0000","last_undegraded":"2024-09-22T09:16:18.273692+0000","last_fullsized":"2024-09-22T09:16:18.273692+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'316","last_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_deep_scrub":"261'316","last_deep_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.273530+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:43.936947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":672,"num_read_kb":483,"num_write":1016,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:16.774779+0000","last_change":"2024-09-22T08:17:42.318734+0000","last_active":"2024-09-22T09:13:16.774779+0000","last_peered":"2024-09-22T09:13:16.774779+0000","last_clean":"2024-09-22T09:13:16.774779+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:13:16.774779+0000","last_undegraded":"2024-09-22T09:13:16.774779+0000","last_fullsized":"2024-09-22T09:13:16.774779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:10.711823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'121","reported_seq":656,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780607+0000","last_change":"2024-09-22T08:17:44.337759+0000","last_active":"2024-09-22T09:13:56.780607+0000","last_peered":"2024-09-22T09:13:56.780607+0000","last_clean":"2024-09-22T09:13:56.780607+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:13:56.780607+0000","last_undegraded":"2024-09-22T09:13:56.780607+0000","last_fullsized":"2024-09-22T09:13:56.780607+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'794","reported_seq":2567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.082506+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:03.082506+0000","last_peered":"2024-09-22T09:16:03.082506+0000","last_clean":"2024-09-22T09:16:03.082506+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:03.082506+0000","last_undegraded":"2024-09-22T09:16:03.082506+0000","last_fullsized":"2024-09-22T09:16:03.082506+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'183","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.560177+0000","last_change":"2024-09-22T08:17:48.368241+0000","last_active":"2024-09-22T09:14:05.560177+0000","last_peered":"2024-09-22T09:14:05.560177+0000","last_clean":"2024-09-22T09:14:05.560177+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:14:05.560177+0000","last_undegraded":"2024-09-22T09:14:05.560177+0000","last_fullsized":"2024-09-22T09:14:05.560177+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:32.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'506","reported_seq":2212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.784964+0000","last_change":"2024-09-22T08:17:40.319980+0000","last_active":"2024-09-22T09:15:22.784964+0000","last_peered":"2024-09-22T09:15:22.784964+0000","last_clean":"2024-09-22T09:15:22.784964+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:15:22.784964+0000","last_undegraded":"2024-09-22T09:15:22.784964+0000","last_fullsized":"2024-09-22T09:15:22.784964+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:14.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'402","reported_seq":1071,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.110814+0000","last_change":"2024-09-22T09:16:09.110814+0000","last_active":"2024-09-22T09:16:09.110814+0000","last_peered":"2024-09-22T09:16:09.110814+0000","last_clean":"2024-09-22T09:16:09.110814+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:09.110814+0000","last_undegraded":"2024-09-22T09:16:09.110814+0000","last_fullsized":"2024-09-22T09:16:09.110814+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.110739+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:11.343495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":777,"num_read_kb":8421,"num_write":1262,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:17.776278+0000","last_change":"2024-09-22T08:17:42.314890+0000","last_active":"2024-09-22T09:13:17.776278+0000","last_peered":"2024-09-22T09:13:17.776278+0000","last_clean":"2024-09-22T09:13:17.776278+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:13:17.776278+0000","last_undegraded":"2024-09-22T09:13:17.776278+0000","last_fullsized":"2024-09-22T09:13:17.776278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:40.671613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'298","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.992797+0000","last_change":"2024-09-22T09:16:26.992797+0000","last_active":"2024-09-22T09:16:26.992797+0000","last_peered":"2024-09-22T09:16:26.992797+0000","last_clean":"2024-09-22T09:16:26.992797+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:26.992797+0000","last_undegraded":"2024-09-22T09:16:26.992797+0000","last_fullsized":"2024-09-22T09:16:26.992797+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.992702+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:45.241158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'814","reported_seq":2607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.982845+0000","last_change":"2024-09-22T08:17:46.354277+0000","last_active":"2024-09-22T09:16:03.982845+0000","last_peered":"2024-09-22T09:16:03.982845+0000","last_clean":"2024-09-22T09:16:03.982845+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:03.982845+0000","last_undegraded":"2024-09-22T09:16:03.982845+0000","last_fullsized":"2024-09-22T09:16:03.982845+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'412","reported_seq":1974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.254280+0000","last_change":"2024-09-22T09:16:25.254280+0000","last_active":"2024-09-22T09:16:25.254280+0000","last_peered":"2024-09-22T09:16:25.254280+0000","last_clean":"2024-09-22T09:16:25.254280+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:16:25.254280+0000","last_undegraded":"2024-09-22T09:16:25.254280+0000","last_fullsized":"2024-09-22T09:16:25.254280+0000","mapping_epoch":27,"log_start":"261'401","ondisk_log_start":"261'401","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'412","last_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_deep_scrub":"261'412","last_deep_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.254178+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:55.621599+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'375","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.571610+0000","last_change":"2024-09-22T09:16:10.571562+0000","last_active":"2024-09-22T09:16:10.571610+0000","last_peered":"2024-09-22T09:16:10.571610+0000","last_clean":"2024-09-22T09:16:10.571610+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:10.571610+0000","last_undegraded":"2024-09-22T09:16:10.571610+0000","last_fullsized":"2024-09-22T09:16:10.571610+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.571456+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:35.266733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":44787,"num_write":1101,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.216317+0000","last_change":"2024-09-22T09:16:23.216317+0000","last_active":"2024-09-22T09:16:23.216317+0000","last_peered":"2024-09-22T09:16:23.216317+0000","last_clean":"2024-09-22T09:16:23.216317+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:16:23.216317+0000","last_undegraded":"2024-09-22T09:16:23.216317+0000","last_fullsized":"2024-09-22T09:16:23.216317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.216231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:44.267586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'360","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.587861+0000","last_change":"2024-09-22T09:16:27.587861+0000","last_active":"2024-09-22T09:16:27.587861+0000","last_peered":"2024-09-22T09:16:27.587861+0000","last_clean":"2024-09-22T09:16:27.587861+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:27.587861+0000","last_undegraded":"2024-09-22T09:16:27.587861+0000","last_fullsized":"2024-09-22T09:16:27.587861+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'360","last_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_deep_scrub":"261'360","last_deep_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.587755+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:54.278181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.773682+0000","last_change":"2024-09-22T08:17:46.352678+0000","last_active":"2024-09-22T09:14:01.773682+0000","last_peered":"2024-09-22T09:14:01.773682+0000","last_clean":"2024-09-22T09:14:01.773682+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:14:01.773682+0000","last_undegraded":"2024-09-22T09:14:01.773682+0000","last_fullsized":"2024-09-22T09:14:01.773682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'558","reported_seq":1370,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.293017+0000","last_change":"2024-09-22T08:17:48.368074+0000","last_active":"2024-09-22T09:15:24.293017+0000","last_peered":"2024-09-22T09:15:24.293017+0000","last_clean":"2024-09-22T09:15:24.293017+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:15:24.293017+0000","last_undegraded":"2024-09-22T09:15:24.293017+0000","last_fullsized":"2024-09-22T09:15:24.293017+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'825","reported_seq":2462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.195453+0000","last_change":"2024-09-22T09:16:14.195453+0000","last_active":"2024-09-22T09:16:14.195453+0000","last_peered":"2024-09-22T09:16:14.195453+0000","last_clean":"2024-09-22T09:16:14.195453+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:16:14.195453+0000","last_undegraded":"2024-09-22T09:16:14.195453+0000","last_fullsized":"2024-09-22T09:16:14.195453+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'825","last_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_deep_scrub":"261'825","last_deep_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.195374+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:30.730771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'359","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.848770+0000","last_change":"2024-09-22T09:16:08.848770+0000","last_active":"2024-09-22T09:16:08.848770+0000","last_peered":"2024-09-22T09:16:08.848770+0000","last_clean":"2024-09-22T09:16:08.848770+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:08.848770+0000","last_undegraded":"2024-09-22T09:16:08.848770+0000","last_fullsized":"2024-09-22T09:16:08.848770+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.848662+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:01.073654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":29046,"num_write":1024,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.183966+0000","last_change":"2024-09-22T09:16:25.183966+0000","last_active":"2024-09-22T09:16:25.183966+0000","last_peered":"2024-09-22T09:16:25.183966+0000","last_clean":"2024-09-22T09:16:25.183966+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:16:25.183966+0000","last_undegraded":"2024-09-22T09:16:25.183966+0000","last_fullsized":"2024-09-22T09:16:25.183966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.183868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:41.982899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'273","reported_seq":843,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.700133+0000","last_change":"2024-09-22T08:17:44.341288+0000","last_active":"2024-09-22T09:16:03.700133+0000","last_peered":"2024-09-22T09:16:03.700133+0000","last_clean":"2024-09-22T09:16:03.700133+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:16:03.700133+0000","last_undegraded":"2024-09-22T09:16:03.700133+0000","last_fullsized":"2024-09-22T09:16:03.700133+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45093,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":1000,"num_write":352,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783454+0000","last_change":"2024-09-22T08:17:46.353515+0000","last_active":"2024-09-22T09:14:16.783454+0000","last_peered":"2024-09-22T09:14:16.783454+0000","last_clean":"2024-09-22T09:14:16.783454+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:14:16.783454+0000","last_undegraded":"2024-09-22T09:14:16.783454+0000","last_fullsized":"2024-09-22T09:14:16.783454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2489","reported_seq":4316,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.777755+0000","last_change":"2024-09-22T08:17:48.370106+0000","last_active":"2024-09-22T09:15:22.777755+0000","last_peered":"2024-09-22T09:15:22.777755+0000","last_clean":"2024-09-22T09:15:22.777755+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:15:22.777755+0000","last_undegraded":"2024-09-22T09:15:22.777755+0000","last_fullsized":"2024-09-22T09:15:22.777755+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'409","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.934530+0000","last_change":"2024-09-22T09:16:16.934474+0000","last_active":"2024-09-22T09:16:16.934530+0000","last_peered":"2024-09-22T09:16:16.934530+0000","last_clean":"2024-09-22T09:16:16.934530+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:16:16.934530+0000","last_undegraded":"2024-09-22T09:16:16.934530+0000","last_fullsized":"2024-09-22T09:16:16.934530+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.934388+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:53.392109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'366","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.276481+0000","last_change":"2024-09-22T09:16:17.276481+0000","last_active":"2024-09-22T09:16:17.276481+0000","last_peered":"2024-09-22T09:16:17.276481+0000","last_clean":"2024-09-22T09:16:17.276481+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:17.276481+0000","last_undegraded":"2024-09-22T09:16:17.276481+0000","last_fullsized":"2024-09-22T09:16:17.276481+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.276321+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:57.728982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":639,"num_read_kb":70122,"num_write":1105,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780733+0000","last_change":"2024-09-22T08:17:42.319503+0000","last_active":"2024-09-22T09:13:56.780733+0000","last_peered":"2024-09-22T09:13:56.780733+0000","last_clean":"2024-09-22T09:13:56.780733+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:13:56.780733+0000","last_undegraded":"2024-09-22T09:13:56.780733+0000","last_fullsized":"2024-09-22T09:13:56.780733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'356","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.907976+0000","last_change":"2024-09-22T08:17:44.337630+0000","last_active":"2024-09-22T09:16:02.907976+0000","last_peered":"2024-09-22T09:16:02.907976+0000","last_clean":"2024-09-22T09:16:02.907976+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:16:02.907976+0000","last_undegraded":"2024-09-22T09:16:02.907976+0000","last_fullsized":"2024-09-22T09:16:02.907976+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1278,"num_write":480,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'814","reported_seq":4733,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.983841+0000","last_change":"2024-09-22T08:17:46.356930+0000","last_active":"2024-09-22T09:16:03.983841+0000","last_peered":"2024-09-22T09:16:03.983841+0000","last_clean":"2024-09-22T09:16:03.983841+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:03.983841+0000","last_undegraded":"2024-09-22T09:16:03.983841+0000","last_fullsized":"2024-09-22T09:16:03.983841+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'120","reported_seq":597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.772093+0000","last_change":"2024-09-22T08:17:48.366165+0000","last_active":"2024-09-22T09:15:22.772093+0000","last_peered":"2024-09-22T09:15:22.772093+0000","last_clean":"2024-09-22T09:15:22.772093+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:15:22.772093+0000","last_undegraded":"2024-09-22T09:15:22.772093+0000","last_fullsized":"2024-09-22T09:15:22.772093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1208","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.713666+0000","last_change":"2024-09-22T09:16:24.713666+0000","last_active":"2024-09-22T09:16:24.713666+0000","last_peered":"2024-09-22T09:16:24.713666+0000","last_clean":"2024-09-22T09:16:24.713666+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:16:24.713666+0000","last_undegraded":"2024-09-22T09:16:24.713666+0000","last_fullsized":"2024-09-22T09:16:24.713666+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1208","last_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_deep_scrub":"261'1208","last_deep_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.713578+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:01.700381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'358","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:07.592091+0000","last_change":"2024-09-22T09:16:07.591997+0000","last_active":"2024-09-22T09:16:07.592091+0000","last_peered":"2024-09-22T09:16:07.592091+0000","last_clean":"2024-09-22T09:16:07.592091+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:07.592091+0000","last_undegraded":"2024-09-22T09:16:07.592091+0000","last_fullsized":"2024-09-22T09:16:07.592091+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_clean_scrub_stamp":"2024-09-22T09:16:07.591858+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:25.904081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":651,"num_read_kb":2439,"num_write":1161,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.192204+0000","last_change":"2024-09-22T09:16:24.192204+0000","last_active":"2024-09-22T09:16:24.192204+0000","last_peered":"2024-09-22T09:16:24.192204+0000","last_clean":"2024-09-22T09:16:24.192204+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:16:24.192204+0000","last_undegraded":"2024-09-22T09:16:24.192204+0000","last_fullsized":"2024-09-22T09:16:24.192204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.192115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:19.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'500","reported_seq":1131,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.901940+0000","last_change":"2024-09-22T08:17:44.340359+0000","last_active":"2024-09-22T09:16:03.901940+0000","last_peered":"2024-09-22T09:16:03.901940+0000","last_clean":"2024-09-22T09:16:03.901940+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:03.901940+0000","last_undegraded":"2024-09-22T09:16:03.901940+0000","last_fullsized":"2024-09-22T09:16:03.901940+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":879,"num_read_kb":2151,"num_write":728,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782352+0000","last_change":"2024-09-22T08:17:46.349859+0000","last_active":"2024-09-22T09:14:06.782352+0000","last_peered":"2024-09-22T09:14:06.782352+0000","last_clean":"2024-09-22T09:14:06.782352+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:14:06.782352+0000","last_undegraded":"2024-09-22T09:14:06.782352+0000","last_fullsized":"2024-09-22T09:14:06.782352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'132","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:11.782755+0000","last_change":"2024-09-22T08:17:48.368083+0000","last_active":"2024-09-22T09:14:11.782755+0000","last_peered":"2024-09-22T09:14:11.782755+0000","last_clean":"2024-09-22T09:14:11.782755+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:14:11.782755+0000","last_undegraded":"2024-09-22T09:14:11.782755+0000","last_fullsized":"2024-09-22T09:14:11.782755+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.443183+0000","last_change":"2024-09-22T09:16:17.443183+0000","last_active":"2024-09-22T09:16:17.443183+0000","last_peered":"2024-09-22T09:16:17.443183+0000","last_clean":"2024-09-22T09:16:17.443183+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:16:17.443183+0000","last_undegraded":"2024-09-22T09:16:17.443183+0000","last_fullsized":"2024-09-22T09:16:17.443183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'866","last_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_deep_scrub":"261'866","last_deep_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.443086+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:08.368887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'403","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.839046+0000","last_change":"2024-09-22T09:16:11.839046+0000","last_active":"2024-09-22T09:16:11.839046+0000","last_peered":"2024-09-22T09:16:11.839046+0000","last_clean":"2024-09-22T09:16:11.839046+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:11.839046+0000","last_undegraded":"2024-09-22T09:16:11.839046+0000","last_fullsized":"2024-09-22T09:16:11.839046+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.838921+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:56:29.399743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":12203,"num_write":1274,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.688842+0000","last_change":"2024-09-22T09:16:24.688842+0000","last_active":"2024-09-22T09:16:24.688842+0000","last_peered":"2024-09-22T09:16:24.688842+0000","last_clean":"2024-09-22T09:16:24.688842+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:16:24.688842+0000","last_undegraded":"2024-09-22T09:16:24.688842+0000","last_fullsized":"2024-09-22T09:16:24.688842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.688752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:06.256561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'302","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.973228+0000","last_change":"2024-09-22T08:17:44.340384+0000","last_active":"2024-09-22T09:16:03.973228+0000","last_peered":"2024-09-22T09:16:03.973228+0000","last_clean":"2024-09-22T09:16:03.973228+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:16:03.973228+0000","last_undegraded":"2024-09-22T09:16:03.973228+0000","last_fullsized":"2024-09-22T09:16:03.973228+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48624,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":466,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:11.782765+0000","last_change":"2024-09-22T08:17:46.357757+0000","last_active":"2024-09-22T09:14:11.782765+0000","last_peered":"2024-09-22T09:14:11.782765+0000","last_clean":"2024-09-22T09:14:11.782765+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:14:11.782765+0000","last_undegraded":"2024-09-22T09:14:11.782765+0000","last_fullsized":"2024-09-22T09:14:11.782765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'175","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:12.994093+0000","last_change":"2024-09-22T08:17:48.369209+0000","last_active":"2024-09-22T09:15:12.994093+0000","last_peered":"2024-09-22T09:15:12.994093+0000","last_clean":"2024-09-22T09:15:12.994093+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:15:12.994093+0000","last_undegraded":"2024-09-22T09:15:12.994093+0000","last_fullsized":"2024-09-22T09:15:12.994093+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:22.364763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'371","reported_seq":1864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781093+0000","last_change":"2024-09-22T08:17:40.318025+0000","last_active":"2024-09-22T09:13:57.781093+0000","last_peered":"2024-09-22T09:13:57.781093+0000","last_clean":"2024-09-22T09:13:57.781093+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:13:57.781093+0000","last_undegraded":"2024-09-22T09:13:57.781093+0000","last_fullsized":"2024-09-22T09:13:57.781093+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'472","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207139+0000","last_change":"2024-09-22T09:16:13.207072+0000","last_active":"2024-09-22T09:16:13.207139+0000","last_peered":"2024-09-22T09:16:13.207139+0000","last_clean":"2024-09-22T09:16:13.207139+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:13.207139+0000","last_undegraded":"2024-09-22T09:16:13.207139+0000","last_fullsized":"2024-09-22T09:16:13.207139+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'472","last_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_deep_scrub":"261'472","last_deep_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.206750+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:12.619430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311644,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1051,"num_read_kb":33703,"num_write":1406,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780785+0000","last_change":"2024-09-22T08:17:42.317557+0000","last_active":"2024-09-22T09:13:56.780785+0000","last_peered":"2024-09-22T09:13:56.780785+0000","last_clean":"2024-09-22T09:13:56.780785+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:13:56.780785+0000","last_undegraded":"2024-09-22T09:13:56.780785+0000","last_fullsized":"2024-09-22T09:13:56.780785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'318","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.494755+0000","last_change":"2024-09-22T08:17:44.331471+0000","last_active":"2024-09-22T09:16:03.494755+0000","last_peered":"2024-09-22T09:16:03.494755+0000","last_clean":"2024-09-22T09:16:03.494755+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:16:03.494755+0000","last_undegraded":"2024-09-22T09:16:03.494755+0000","last_fullsized":"2024-09-22T09:16:03.494755+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50318,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":418,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'795","reported_seq":4270,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.979936+0000","last_change":"2024-09-22T08:17:46.353620+0000","last_active":"2024-09-22T09:16:03.979936+0000","last_peered":"2024-09-22T09:16:03.979936+0000","last_clean":"2024-09-22T09:16:03.979936+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:03.979936+0000","last_undegraded":"2024-09-22T09:16:03.979936+0000","last_fullsized":"2024-09-22T09:16:03.979936+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.774361+0000","last_change":"2024-09-22T08:17:48.368255+0000","last_active":"2024-09-22T09:14:06.774361+0000","last_peered":"2024-09-22T09:14:06.774361+0000","last_clean":"2024-09-22T09:14:06.774361+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:14:06.774361+0000","last_undegraded":"2024-09-22T09:14:06.774361+0000","last_fullsized":"2024-09-22T09:14:06.774361+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'507","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.890344+0000","last_change":"2024-09-22T09:16:17.890344+0000","last_active":"2024-09-22T09:16:17.890344+0000","last_peered":"2024-09-22T09:16:17.890344+0000","last_clean":"2024-09-22T09:16:17.890344+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:16:17.890344+0000","last_undegraded":"2024-09-22T09:16:17.890344+0000","last_fullsized":"2024-09-22T09:16:17.890344+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'507","last_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_deep_scrub":"261'507","last_deep_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.890235+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:42.972286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'323","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.215100+0000","last_change":"2024-09-22T09:16:15.215100+0000","last_active":"2024-09-22T09:16:15.215100+0000","last_peered":"2024-09-22T09:16:15.215100+0000","last_clean":"2024-09-22T09:16:15.215100+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:15.215100+0000","last_undegraded":"2024-09-22T09:16:15.215100+0000","last_fullsized":"2024-09-22T09:16:15.215100+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.214985+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:13.621351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":25990,"num_write":923,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1465,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.267481+0000","last_change":"2024-09-22T09:16:24.267481+0000","last_active":"2024-09-22T09:16:24.267481+0000","last_peered":"2024-09-22T09:16:24.267481+0000","last_clean":"2024-09-22T09:16:24.267481+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:24.267481+0000","last_undegraded":"2024-09-22T09:16:24.267481+0000","last_fullsized":"2024-09-22T09:16:24.267481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.267396+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:33.710111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'80","reported_seq":589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.773724+0000","last_change":"2024-09-22T08:17:44.340629+0000","last_active":"2024-09-22T09:14:01.773724+0000","last_peered":"2024-09-22T09:14:01.773724+0000","last_clean":"2024-09-22T09:14:01.773724+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:14:01.773724+0000","last_undegraded":"2024-09-22T09:14:01.773724+0000","last_fullsized":"2024-09-22T09:14:01.773724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'784","reported_seq":2569,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.980850+0000","last_change":"2024-09-22T08:17:46.356179+0000","last_active":"2024-09-22T09:16:03.980850+0000","last_peered":"2024-09-22T09:16:03.980850+0000","last_clean":"2024-09-22T09:16:03.980850+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:03.980850+0000","last_undegraded":"2024-09-22T09:16:03.980850+0000","last_fullsized":"2024-09-22T09:16:03.980850+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'110","reported_seq":599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:03.414345+0000","last_change":"2024-09-22T08:17:48.366352+0000","last_active":"2024-09-22T09:14:03.414345+0000","last_peered":"2024-09-22T09:14:03.414345+0000","last_clean":"2024-09-22T09:14:03.414345+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:14:03.414345+0000","last_undegraded":"2024-09-22T09:14:03.414345+0000","last_fullsized":"2024-09-22T09:14:03.414345+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1180","reported_seq":2769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.786239+0000","last_change":"2024-09-22T09:16:14.786187+0000","last_active":"2024-09-22T09:16:14.786239+0000","last_peered":"2024-09-22T09:16:14.786239+0000","last_clean":"2024-09-22T09:16:14.786239+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:16:14.786239+0000","last_undegraded":"2024-09-22T09:16:14.786239+0000","last_fullsized":"2024-09-22T09:16:14.786239+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1180","last_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_deep_scrub":"261'1180","last_deep_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.786101+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:54.467939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'437","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.777822+0000","last_change":"2024-09-22T09:16:12.777822+0000","last_active":"2024-09-22T09:16:12.777822+0000","last_peered":"2024-09-22T09:16:12.777822+0000","last_clean":"2024-09-22T09:16:12.777822+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:12.777822+0000","last_undegraded":"2024-09-22T09:16:12.777822+0000","last_fullsized":"2024-09-22T09:16:12.777822+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'437","last_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_deep_scrub":"261'437","last_deep_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.777701+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:43.034360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":819,"num_read_kb":19795,"num_write":1316,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781110+0000","last_change":"2024-09-22T08:17:42.313230+0000","last_active":"2024-09-22T09:13:57.781110+0000","last_peered":"2024-09-22T09:13:57.781110+0000","last_clean":"2024-09-22T09:13:57.781110+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:13:57.781110+0000","last_undegraded":"2024-09-22T09:13:57.781110+0000","last_fullsized":"2024-09-22T09:13:57.781110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'367","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.190390+0000","last_change":"2024-09-22T09:16:27.190390+0000","last_active":"2024-09-22T09:16:27.190390+0000","last_peered":"2024-09-22T09:16:27.190390+0000","last_clean":"2024-09-22T09:16:27.190390+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:27.190390+0000","last_undegraded":"2024-09-22T09:16:27.190390+0000","last_fullsized":"2024-09-22T09:16:27.190390+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.190267+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:44.961351+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870789+0000","last_change":"2024-09-22T08:17:46.346619+0000","last_active":"2024-09-22T09:14:02.870789+0000","last_peered":"2024-09-22T09:14:02.870789+0000","last_clean":"2024-09-22T09:14:02.870789+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:14:02.870789+0000","last_undegraded":"2024-09-22T09:14:02.870789+0000","last_fullsized":"2024-09-22T09:14:02.870789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'174","reported_seq":703,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.781965+0000","last_change":"2024-09-22T08:17:48.366379+0000","last_active":"2024-09-22T09:14:06.781965+0000","last_peered":"2024-09-22T09:14:06.781965+0000","last_clean":"2024-09-22T09:14:06.781965+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:14:06.781965+0000","last_undegraded":"2024-09-22T09:14:06.781965+0000","last_fullsized":"2024-09-22T09:14:06.781965+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'899","reported_seq":2557,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.219147+0000","last_change":"2024-09-22T09:16:26.219147+0000","last_active":"2024-09-22T09:16:26.219147+0000","last_peered":"2024-09-22T09:16:26.219147+0000","last_clean":"2024-09-22T09:16:26.219147+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:16:26.219147+0000","last_undegraded":"2024-09-22T09:16:26.219147+0000","last_fullsized":"2024-09-22T09:16:26.219147+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'899","last_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_deep_scrub":"261'899","last_deep_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.219043+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:44.422572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3769,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.146779+0000","last_change":"2024-09-22T09:16:08.146779+0000","last_active":"2024-09-22T09:16:08.146779+0000","last_peered":"2024-09-22T09:16:08.146779+0000","last_clean":"2024-09-22T09:16:08.146779+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:16:08.146779+0000","last_undegraded":"2024-09-22T09:16:08.146779+0000","last_fullsized":"2024-09-22T09:16:08.146779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.146708+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:12.109321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.130511+0000","last_change":"2024-09-22T09:16:11.130511+0000","last_active":"2024-09-22T09:16:11.130511+0000","last_peered":"2024-09-22T09:16:11.130511+0000","last_clean":"2024-09-22T09:16:11.130511+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:16:11.130511+0000","last_undegraded":"2024-09-22T09:16:11.130511+0000","last_fullsized":"2024-09-22T09:16:11.130511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.130438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:05.095794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.804878+0000","last_change":"2024-09-22T09:16:09.804878+0000","last_active":"2024-09-22T09:16:09.804878+0000","last_peered":"2024-09-22T09:16:09.804878+0000","last_clean":"2024-09-22T09:16:09.804878+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:09.804878+0000","last_undegraded":"2024-09-22T09:16:09.804878+0000","last_fullsized":"2024-09-22T09:16:09.804878+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.804702+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:57.406186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":613,"num_read_kb":39972,"num_write":1027,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.508606+0000","last_change":"2024-09-22T09:16:23.508606+0000","last_active":"2024-09-22T09:16:23.508606+0000","last_peered":"2024-09-22T09:16:23.508606+0000","last_clean":"2024-09-22T09:16:23.508606+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:16:23.508606+0000","last_undegraded":"2024-09-22T09:16:23.508606+0000","last_fullsized":"2024-09-22T09:16:23.508606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.508510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:25.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'741","reported_seq":1438,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.354764+0000","last_change":"2024-09-22T08:17:44.340548+0000","last_active":"2024-09-22T09:16:03.354764+0000","last_peered":"2024-09-22T09:16:03.354764+0000","last_clean":"2024-09-22T09:16:03.354764+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:03.354764+0000","last_undegraded":"2024-09-22T09:16:03.354764+0000","last_fullsized":"2024-09-22T09:16:03.354764+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133117,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1419,"num_read_kb":3139,"num_write":1374,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782526+0000","last_change":"2024-09-22T08:17:46.351335+0000","last_active":"2024-09-22T09:14:06.782526+0000","last_peered":"2024-09-22T09:14:06.782526+0000","last_clean":"2024-09-22T09:14:06.782526+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:14:06.782526+0000","last_undegraded":"2024-09-22T09:14:06.782526+0000","last_fullsized":"2024-09-22T09:14:06.782526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'205","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:07.978354+0000","last_change":"2024-09-22T08:17:48.371345+0000","last_active":"2024-09-22T09:14:07.978354+0000","last_peered":"2024-09-22T09:14:07.978354+0000","last_clean":"2024-09-22T09:14:07.978354+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:14:07.978354+0000","last_undegraded":"2024-09-22T09:14:07.978354+0000","last_fullsized":"2024-09-22T09:14:07.978354+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.696665+0000","last_change":"2024-09-22T09:16:23.696665+0000","last_active":"2024-09-22T09:16:23.696665+0000","last_peered":"2024-09-22T09:16:23.696665+0000","last_clean":"2024-09-22T09:16:23.696665+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:16:23.696665+0000","last_undegraded":"2024-09-22T09:16:23.696665+0000","last_fullsized":"2024-09-22T09:16:23.696665+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'882","last_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_deep_scrub":"261'882","last_deep_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.696577+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:38.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.103337+0000","last_change":"2024-09-22T09:16:09.103337+0000","last_active":"2024-09-22T09:16:09.103337+0000","last_peered":"2024-09-22T09:16:09.103337+0000","last_clean":"2024-09-22T09:16:09.103337+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:16:09.103337+0000","last_undegraded":"2024-09-22T09:16:09.103337+0000","last_fullsized":"2024-09-22T09:16:09.103337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.103256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:48.650934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'335","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.221035+0000","last_change":"2024-09-22T09:16:10.221035+0000","last_active":"2024-09-22T09:16:10.221035+0000","last_peered":"2024-09-22T09:16:10.221035+0000","last_clean":"2024-09-22T09:16:10.221035+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:10.221035+0000","last_undegraded":"2024-09-22T09:16:10.221035+0000","last_fullsized":"2024-09-22T09:16:10.221035+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'335","last_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_deep_scrub":"261'335","last_deep_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.220912+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:01.000745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":6730,"num_write":1066,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.781750+0000","last_change":"2024-09-22T08:17:42.319964+0000","last_active":"2024-09-22T09:14:02.781750+0000","last_peered":"2024-09-22T09:14:02.781750+0000","last_clean":"2024-09-22T09:14:02.781750+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:14:02.781750+0000","last_undegraded":"2024-09-22T09:14:02.781750+0000","last_fullsized":"2024-09-22T09:14:02.781750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1343","reported_seq":2972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.741413+0000","last_change":"2024-09-22T09:16:25.741413+0000","last_active":"2024-09-22T09:16:25.741413+0000","last_peered":"2024-09-22T09:16:25.741413+0000","last_clean":"2024-09-22T09:16:25.741413+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:25.741413+0000","last_undegraded":"2024-09-22T09:16:25.741413+0000","last_fullsized":"2024-09-22T09:16:25.741413+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1343","last_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_deep_scrub":"261'1343","last_deep_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.741309+0000","objects_scrubbed":12,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:15.738101+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141570,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3855,"num_write":1170,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:17.784046+0000","last_change":"2024-09-22T08:17:46.355591+0000","last_active":"2024-09-22T09:14:17.784046+0000","last_peered":"2024-09-22T09:14:17.784046+0000","last_clean":"2024-09-22T09:14:17.784046+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:14:17.784046+0000","last_undegraded":"2024-09-22T09:14:17.784046+0000","last_fullsized":"2024-09-22T09:14:17.784046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'121","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.349060+0000","last_change":"2024-09-22T08:17:48.368412+0000","last_active":"2024-09-22T09:14:05.349060+0000","last_peered":"2024-09-22T09:14:05.349060+0000","last_clean":"2024-09-22T09:14:05.349060+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:14:05.349060+0000","last_undegraded":"2024-09-22T09:14:05.349060+0000","last_fullsized":"2024-09-22T09:14:05.349060+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:53.740005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'467","reported_seq":2081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.232945+0000","last_change":"2024-09-22T09:16:19.232945+0000","last_active":"2024-09-22T09:16:19.232945+0000","last_peered":"2024-09-22T09:16:19.232945+0000","last_clean":"2024-09-22T09:16:19.232945+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:16:19.232945+0000","last_undegraded":"2024-09-22T09:16:19.232945+0000","last_fullsized":"2024-09-22T09:16:19.232945+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.232833+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:17.313258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.820588+0000","last_change":"2024-09-22T09:16:10.820588+0000","last_active":"2024-09-22T09:16:10.820588+0000","last_peered":"2024-09-22T09:16:10.820588+0000","last_clean":"2024-09-22T09:16:10.820588+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:16:10.820588+0000","last_undegraded":"2024-09-22T09:16:10.820588+0000","last_fullsized":"2024-09-22T09:16:10.820588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.820505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:43.185792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'324","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.734585+0000","last_change":"2024-09-22T09:16:09.734585+0000","last_active":"2024-09-22T09:16:09.734585+0000","last_peered":"2024-09-22T09:16:09.734585+0000","last_clean":"2024-09-22T09:16:09.734585+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:09.734585+0000","last_undegraded":"2024-09-22T09:16:09.734585+0000","last_fullsized":"2024-09-22T09:16:09.734585+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.734427+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:44.034840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174880,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":1785,"num_write":1090,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'8","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.725370+0000","last_change":"2024-09-22T09:16:20.725370+0000","last_active":"2024-09-22T09:16:20.725370+0000","last_peered":"2024-09-22T09:16:20.725370+0000","last_clean":"2024-09-22T09:16:20.725370+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:20.725370+0000","last_undegraded":"2024-09-22T09:16:20.725370+0000","last_fullsized":"2024-09-22T09:16:20.725370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.725286+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:56.727213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'268","reported_seq":1503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.569532+0000","last_change":"2024-09-22T09:16:26.569532+0000","last_active":"2024-09-22T09:16:26.569532+0000","last_peered":"2024-09-22T09:16:26.569532+0000","last_clean":"2024-09-22T09:16:26.569532+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:16:26.569532+0000","last_undegraded":"2024-09-22T09:16:26.569532+0000","last_fullsized":"2024-09-22T09:16:26.569532+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'268","last_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_deep_scrub":"261'268","last_deep_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.569422+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:23.239715+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781313+0000","last_change":"2024-09-22T08:17:46.356277+0000","last_active":"2024-09-22T09:14:01.781313+0000","last_peered":"2024-09-22T09:14:01.781313+0000","last_clean":"2024-09-22T09:14:01.781313+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:14:01.781313+0000","last_undegraded":"2024-09-22T09:14:01.781313+0000","last_fullsized":"2024-09-22T09:14:01.781313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:15:32.511597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'261","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782052+0000","last_change":"2024-09-22T08:17:48.371579+0000","last_active":"2024-09-22T09:14:06.782052+0000","last_peered":"2024-09-22T09:14:06.782052+0000","last_clean":"2024-09-22T09:14:06.782052+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:14:06.782052+0000","last_undegraded":"2024-09-22T09:14:06.782052+0000","last_fullsized":"2024-09-22T09:14:06.782052+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'776","reported_seq":2214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.202744+0000","last_change":"2024-09-22T09:16:18.202744+0000","last_active":"2024-09-22T09:16:18.202744+0000","last_peered":"2024-09-22T09:16:18.202744+0000","last_clean":"2024-09-22T09:16:18.202744+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:16:18.202744+0000","last_undegraded":"2024-09-22T09:16:18.202744+0000","last_fullsized":"2024-09-22T09:16:18.202744+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'776","last_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_deep_scrub":"261'776","last_deep_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.202607+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:20.032816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":528,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.098720+0000","last_change":"2024-09-22T09:16:10.098720+0000","last_active":"2024-09-22T09:16:10.098720+0000","last_peered":"2024-09-22T09:16:10.098720+0000","last_clean":"2024-09-22T09:16:10.098720+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:16:10.098720+0000","last_undegraded":"2024-09-22T09:16:10.098720+0000","last_fullsized":"2024-09-22T09:16:10.098720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.098658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:32.867298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'390","reported_seq":1008,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.778005+0000","last_change":"2024-09-22T09:16:13.778005+0000","last_active":"2024-09-22T09:16:13.778005+0000","last_peered":"2024-09-22T09:16:13.778005+0000","last_clean":"2024-09-22T09:16:13.778005+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:13.778005+0000","last_undegraded":"2024-09-22T09:16:13.778005+0000","last_fullsized":"2024-09-22T09:16:13.778005+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'390","last_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_deep_scrub":"261'390","last_deep_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.777834+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:00.884220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":48326,"num_write":1184,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.706486+0000","last_change":"2024-09-22T09:16:21.706486+0000","last_active":"2024-09-22T09:16:21.706486+0000","last_peered":"2024-09-22T09:16:21.706486+0000","last_clean":"2024-09-22T09:16:21.706486+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:16:21.706486+0000","last_undegraded":"2024-09-22T09:16:21.706486+0000","last_fullsized":"2024-09-22T09:16:21.706486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.706389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:33.368571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'141","reported_seq":681,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.439112+0000","last_change":"2024-09-22T08:17:44.338734+0000","last_active":"2024-09-22T09:15:24.439112+0000","last_peered":"2024-09-22T09:15:24.439112+0000","last_clean":"2024-09-22T09:15:24.439112+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:15:24.439112+0000","last_undegraded":"2024-09-22T09:15:24.439112+0000","last_fullsized":"2024-09-22T09:15:24.439112+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:07.782571+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:14:07.782571+0000","last_peered":"2024-09-22T09:14:07.782571+0000","last_clean":"2024-09-22T09:14:07.782571+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:14:07.782571+0000","last_undegraded":"2024-09-22T09:14:07.782571+0000","last_fullsized":"2024-09-22T09:14:07.782571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'120","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:07.975649+0000","last_change":"2024-09-22T08:17:48.366537+0000","last_active":"2024-09-22T09:14:07.975649+0000","last_peered":"2024-09-22T09:14:07.975649+0000","last_clean":"2024-09-22T09:14:07.975649+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:14:07.975649+0000","last_undegraded":"2024-09-22T09:14:07.975649+0000","last_fullsized":"2024-09-22T09:14:07.975649+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'373","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.204350+0000","last_change":"2024-09-22T09:16:20.204350+0000","last_active":"2024-09-22T09:16:20.204350+0000","last_peered":"2024-09-22T09:16:20.204350+0000","last_clean":"2024-09-22T09:16:20.204350+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:16:20.204350+0000","last_undegraded":"2024-09-22T09:16:20.204350+0000","last_fullsized":"2024-09-22T09:16:20.204350+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'373","last_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_deep_scrub":"261'373","last_deep_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.204251+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:02.514748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'389","reported_seq":1095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.883341+0000","last_change":"2024-09-22T09:16:09.883341+0000","last_active":"2024-09-22T09:16:09.883341+0000","last_peered":"2024-09-22T09:16:09.883341+0000","last_clean":"2024-09-22T09:16:09.883341+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:09.883341+0000","last_undegraded":"2024-09-22T09:16:09.883341+0000","last_fullsized":"2024-09-22T09:16:09.883341+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'389","last_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_deep_scrub":"261'389","last_deep_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.883202+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.123770+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6919332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":45053,"num_write":1379,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.781614+0000","last_change":"2024-09-22T09:16:10.781614+0000","last_active":"2024-09-22T09:16:10.781614+0000","last_peered":"2024-09-22T09:16:10.781614+0000","last_clean":"2024-09-22T09:16:10.781614+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:16:10.781614+0000","last_undegraded":"2024-09-22T09:16:10.781614+0000","last_fullsized":"2024-09-22T09:16:10.781614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.781523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:03.872420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.698988+0000","last_change":"2024-09-22T09:16:26.698988+0000","last_active":"2024-09-22T09:16:26.698988+0000","last_peered":"2024-09-22T09:16:26.698988+0000","last_clean":"2024-09-22T09:16:26.698988+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:16:26.698988+0000","last_undegraded":"2024-09-22T09:16:26.698988+0000","last_fullsized":"2024-09-22T09:16:26.698988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.698863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:05.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'596","reported_seq":1264,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.701953+0000","last_change":"2024-09-22T09:16:23.701953+0000","last_active":"2024-09-22T09:16:23.701953+0000","last_peered":"2024-09-22T09:16:23.701953+0000","last_clean":"2024-09-22T09:16:23.701953+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:23.701953+0000","last_undegraded":"2024-09-22T09:16:23.701953+0000","last_fullsized":"2024-09-22T09:16:23.701953+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'596","last_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_deep_scrub":"261'596","last_deep_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.701817+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:20.394276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1681,"num_read_kb":2863,"num_write":2226,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.870727+0000","last_change":"2024-09-22T08:17:46.353133+0000","last_active":"2024-09-22T09:14:02.870727+0000","last_peered":"2024-09-22T09:14:02.870727+0000","last_clean":"2024-09-22T09:14:02.870727+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:14:02.870727+0000","last_undegraded":"2024-09-22T09:14:02.870727+0000","last_fullsized":"2024-09-22T09:14:02.870727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'126","reported_seq":627,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782514+0000","last_change":"2024-09-22T08:17:48.371983+0000","last_active":"2024-09-22T09:14:06.782514+0000","last_peered":"2024-09-22T09:14:06.782514+0000","last_clean":"2024-09-22T09:14:06.782514+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:14:06.782514+0000","last_undegraded":"2024-09-22T09:14:06.782514+0000","last_fullsized":"2024-09-22T09:14:06.782514+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'438","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.211439+0000","last_change":"2024-09-22T09:16:16.211439+0000","last_active":"2024-09-22T09:16:16.211439+0000","last_peered":"2024-09-22T09:16:16.211439+0000","last_clean":"2024-09-22T09:16:16.211439+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:16:16.211439+0000","last_undegraded":"2024-09-22T09:16:16.211439+0000","last_fullsized":"2024-09-22T09:16:16.211439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'438","last_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_deep_scrub":"261'438","last_deep_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.211353+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:12.204748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'404","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.216484+0000","last_change":"2024-09-22T09:16:11.216484+0000","last_active":"2024-09-22T09:16:11.216484+0000","last_peered":"2024-09-22T09:16:11.216484+0000","last_clean":"2024-09-22T09:16:11.216484+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:11.216484+0000","last_undegraded":"2024-09-22T09:16:11.216484+0000","last_fullsized":"2024-09-22T09:16:11.216484+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.216383+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:43.556741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":42178,"num_write":1167,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.243905+0000","last_change":"2024-09-22T09:16:14.243905+0000","last_active":"2024-09-22T09:16:14.243905+0000","last_peered":"2024-09-22T09:16:14.243905+0000","last_clean":"2024-09-22T09:16:14.243905+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:16:14.243905+0000","last_undegraded":"2024-09-22T09:16:14.243905+0000","last_fullsized":"2024-09-22T09:16:14.243905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.243805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:17.107629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"261'4","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.547087+0000","last_change":"2024-09-22T09:16:24.547087+0000","last_active":"2024-09-22T09:16:24.547087+0000","last_peered":"2024-09-22T09:16:24.547087+0000","last_clean":"2024-09-22T09:16:24.547087+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:24.547087+0000","last_undegraded":"2024-09-22T09:16:24.547087+0000","last_fullsized":"2024-09-22T09:16:24.547087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.546984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:57.779533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'168","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.773647+0000","last_change":"2024-09-22T08:17:44.337754+0000","last_active":"2024-09-22T09:14:01.773647+0000","last_peered":"2024-09-22T09:14:01.773647+0000","last_clean":"2024-09-22T09:14:01.773647+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:14:01.773647+0000","last_undegraded":"2024-09-22T09:14:01.773647+0000","last_fullsized":"2024-09-22T09:14:01.773647+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:07.954994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'784","reported_seq":2599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.630587+0000","last_change":"2024-09-22T08:17:46.353169+0000","last_active":"2024-09-22T09:16:03.630587+0000","last_peered":"2024-09-22T09:16:03.630587+0000","last_clean":"2024-09-22T09:16:03.630587+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:03.630587+0000","last_undegraded":"2024-09-22T09:16:03.630587+0000","last_fullsized":"2024-09-22T09:16:03.630587+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:47.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'124","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:16.783445+0000","last_change":"2024-09-22T08:17:48.370594+0000","last_active":"2024-09-22T09:14:16.783445+0000","last_peered":"2024-09-22T09:14:16.783445+0000","last_clean":"2024-09-22T09:14:16.783445+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:14:16.783445+0000","last_undegraded":"2024-09-22T09:14:16.783445+0000","last_fullsized":"2024-09-22T09:14:16.783445+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:38.200197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'481","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.772601+0000","last_change":"2024-09-22T09:16:14.772601+0000","last_active":"2024-09-22T09:16:14.772601+0000","last_peered":"2024-09-22T09:16:14.772601+0000","last_clean":"2024-09-22T09:16:14.772601+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:16:14.772601+0000","last_undegraded":"2024-09-22T09:16:14.772601+0000","last_fullsized":"2024-09-22T09:16:14.772601+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'481","last_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_deep_scrub":"261'481","last_deep_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.772519+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:51.207310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'410","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.807161+0000","last_change":"2024-09-22T09:16:11.807161+0000","last_active":"2024-09-22T09:16:11.807161+0000","last_peered":"2024-09-22T09:16:11.807161+0000","last_clean":"2024-09-22T09:16:11.807161+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:11.807161+0000","last_undegraded":"2024-09-22T09:16:11.807161+0000","last_fullsized":"2024-09-22T09:16:11.807161+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'410","last_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_deep_scrub":"261'410","last_deep_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.807026+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:44.619900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":945,"num_read_kb":43241,"num_write":1287,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.823207+0000","last_change":"2024-09-22T09:16:08.823207+0000","last_active":"2024-09-22T09:16:08.823207+0000","last_peered":"2024-09-22T09:16:08.823207+0000","last_clean":"2024-09-22T09:16:08.823207+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:16:08.823207+0000","last_undegraded":"2024-09-22T09:16:08.823207+0000","last_fullsized":"2024-09-22T09:16:08.823207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.823085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:31.913983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.781014+0000","last_change":"2024-09-22T08:17:42.316704+0000","last_active":"2024-09-22T09:13:57.781014+0000","last_peered":"2024-09-22T09:13:57.781014+0000","last_clean":"2024-09-22T09:13:57.781014+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:13:57.781014+0000","last_undegraded":"2024-09-22T09:13:57.781014+0000","last_fullsized":"2024-09-22T09:13:57.781014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:09.379090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'111","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.781659+0000","last_change":"2024-09-22T08:17:44.338196+0000","last_active":"2024-09-22T09:14:02.781659+0000","last_peered":"2024-09-22T09:14:02.781659+0000","last_clean":"2024-09-22T09:14:02.781659+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:14:02.781659+0000","last_undegraded":"2024-09-22T09:14:02.781659+0000","last_fullsized":"2024-09-22T09:14:02.781659+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:24:17.767211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'813","reported_seq":2523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.981940+0000","last_change":"2024-09-22T08:17:46.352328+0000","last_active":"2024-09-22T09:16:03.981940+0000","last_peered":"2024-09-22T09:16:03.981940+0000","last_clean":"2024-09-22T09:16:03.981940+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:03.981940+0000","last_undegraded":"2024-09-22T09:16:03.981940+0000","last_fullsized":"2024-09-22T09:16:03.981940+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:57.228160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'287","reported_seq":810,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782473+0000","last_change":"2024-09-22T08:17:48.371281+0000","last_active":"2024-09-22T09:14:06.782473+0000","last_peered":"2024-09-22T09:14:06.782473+0000","last_clean":"2024-09-22T09:14:06.782473+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:14:06.782473+0000","last_undegraded":"2024-09-22T09:14:06.782473+0000","last_fullsized":"2024-09-22T09:14:06.782473+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.919376+0000","last_change":"2024-09-22T09:16:14.919376+0000","last_active":"2024-09-22T09:16:14.919376+0000","last_peered":"2024-09-22T09:16:14.919376+0000","last_clean":"2024-09-22T09:16:14.919376+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:16:14.919376+0000","last_undegraded":"2024-09-22T09:16:14.919376+0000","last_fullsized":"2024-09-22T09:16:14.919376+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.919282+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:08.650486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'327","reported_seq":1056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.772366+0000","last_change":"2024-09-22T09:16:10.772280+0000","last_active":"2024-09-22T09:16:10.772366+0000","last_peered":"2024-09-22T09:16:10.772366+0000","last_clean":"2024-09-22T09:16:10.772366+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:10.772366+0000","last_undegraded":"2024-09-22T09:16:10.772366+0000","last_fullsized":"2024-09-22T09:16:10.772366+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.772122+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:38.919070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048951,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":907,"num_read_kb":63310,"num_write":970,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.152744+0000","last_change":"2024-09-22T09:16:12.152744+0000","last_active":"2024-09-22T09:16:12.152744+0000","last_peered":"2024-09-22T09:16:12.152744+0000","last_clean":"2024-09-22T09:16:12.152744+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:16:12.152744+0000","last_undegraded":"2024-09-22T09:16:12.152744+0000","last_fullsized":"2024-09-22T09:16:12.152744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.152652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:42.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.748080+0000","last_change":"2024-09-22T09:16:24.748080+0000","last_active":"2024-09-22T09:16:24.748080+0000","last_peered":"2024-09-22T09:16:24.748080+0000","last_clean":"2024-09-22T09:16:24.748080+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:16:24.748080+0000","last_undegraded":"2024-09-22T09:16:24.748080+0000","last_fullsized":"2024-09-22T09:16:24.748080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.748000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:33.241849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'747","reported_seq":1467,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.563522+0000","last_change":"2024-09-22T09:16:25.563522+0000","last_active":"2024-09-22T09:16:25.563522+0000","last_peered":"2024-09-22T09:16:25.563522+0000","last_clean":"2024-09-22T09:16:25.563522+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:25.563522+0000","last_undegraded":"2024-09-22T09:16:25.563522+0000","last_fullsized":"2024-09-22T09:16:25.563522+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'747","last_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_deep_scrub":"261'747","last_deep_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.563415+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:22.893620+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1336,"num_read_kb":3141,"num_write":1092,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781256+0000","last_change":"2024-09-22T08:17:46.355809+0000","last_active":"2024-09-22T09:14:01.781256+0000","last_peered":"2024-09-22T09:14:01.781256+0000","last_clean":"2024-09-22T09:14:01.781256+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:14:01.781256+0000","last_undegraded":"2024-09-22T09:14:01.781256+0000","last_fullsized":"2024-09-22T09:14:01.781256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:49.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'100","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:05.490698+0000","last_change":"2024-09-22T08:17:48.367775+0000","last_active":"2024-09-22T09:14:05.490698+0000","last_peered":"2024-09-22T09:14:05.490698+0000","last_clean":"2024-09-22T09:14:05.490698+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:14:05.490698+0000","last_undegraded":"2024-09-22T09:14:05.490698+0000","last_fullsized":"2024-09-22T09:14:05.490698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'123","reported_seq":692,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782128+0000","last_change":"2024-09-22T08:17:48.366489+0000","last_active":"2024-09-22T09:14:06.782128+0000","last_peered":"2024-09-22T09:14:06.782128+0000","last_clean":"2024-09-22T09:14:06.782128+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:14:06.782128+0000","last_undegraded":"2024-09-22T09:14:06.782128+0000","last_fullsized":"2024-09-22T09:14:06.782128+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'413","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.864884+0000","last_change":"2024-09-22T09:16:18.864884+0000","last_active":"2024-09-22T09:16:18.864884+0000","last_peered":"2024-09-22T09:16:18.864884+0000","last_clean":"2024-09-22T09:16:18.864884+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:16:18.864884+0000","last_undegraded":"2024-09-22T09:16:18.864884+0000","last_fullsized":"2024-09-22T09:16:18.864884+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'413","last_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_deep_scrub":"261'413","last_deep_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.864732+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:46.218753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'314","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.295818+0000","last_change":"2024-09-22T09:16:19.295818+0000","last_active":"2024-09-22T09:16:19.295818+0000","last_peered":"2024-09-22T09:16:19.295818+0000","last_clean":"2024-09-22T09:16:19.295818+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:19.295818+0000","last_undegraded":"2024-09-22T09:16:19.295818+0000","last_fullsized":"2024-09-22T09:16:19.295818+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.295694+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:01.794130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":48776,"num_write":1072,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.770677+0000","last_change":"2024-09-22T08:17:42.317519+0000","last_active":"2024-09-22T09:13:41.770677+0000","last_peered":"2024-09-22T09:13:41.770677+0000","last_clean":"2024-09-22T09:13:41.770677+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:13:41.770677+0000","last_undegraded":"2024-09-22T09:13:41.770677+0000","last_fullsized":"2024-09-22T09:13:41.770677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:17.290304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'299","reported_seq":862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.819361+0000","last_change":"2024-09-22T08:17:44.340784+0000","last_active":"2024-09-22T09:16:02.819361+0000","last_peered":"2024-09-22T09:16:02.819361+0000","last_clean":"2024-09-22T09:16:02.819361+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:16:02.819361+0000","last_undegraded":"2024-09-22T09:16:02.819361+0000","last_fullsized":"2024-09-22T09:16:02.819361+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:27.691033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44144,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1008,"num_write":380,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778797+0000","last_change":"2024-09-22T08:17:46.357807+0000","last_active":"2024-09-22T09:13:46.778797+0000","last_peered":"2024-09-22T09:13:46.778797+0000","last_clean":"2024-09-22T09:13:46.778797+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:13:46.778797+0000","last_undegraded":"2024-09-22T09:13:46.778797+0000","last_fullsized":"2024-09-22T09:13:46.778797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:34.146262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'156","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:01.781302+0000","last_change":"2024-09-22T08:17:48.370244+0000","last_active":"2024-09-22T09:14:01.781302+0000","last_peered":"2024-09-22T09:14:01.781302+0000","last_clean":"2024-09-22T09:14:01.781302+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:14:01.781302+0000","last_undegraded":"2024-09-22T09:14:01.781302+0000","last_fullsized":"2024-09-22T09:14:01.781302+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:47.163289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'479","reported_seq":2028,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.799222+0000","last_change":"2024-09-22T09:16:18.799222+0000","last_active":"2024-09-22T09:16:18.799222+0000","last_peered":"2024-09-22T09:16:18.799222+0000","last_clean":"2024-09-22T09:16:18.799222+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:16:18.799222+0000","last_undegraded":"2024-09-22T09:16:18.799222+0000","last_fullsized":"2024-09-22T09:16:18.799222+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'479","last_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_deep_scrub":"261'479","last_deep_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.799137+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:41:01.860838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'343","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.582742+0000","last_change":"2024-09-22T09:16:08.582742+0000","last_active":"2024-09-22T09:16:08.582742+0000","last_peered":"2024-09-22T09:16:08.582742+0000","last_clean":"2024-09-22T09:16:08.582742+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:08.582742+0000","last_undegraded":"2024-09-22T09:16:08.582742+0000","last_fullsized":"2024-09-22T09:16:08.582742+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.582637+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:51.839030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":615,"num_read_kb":26096,"num_write":1031,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778236+0000","last_change":"2024-09-22T08:17:42.315462+0000","last_active":"2024-09-22T09:13:41.778236+0000","last_peered":"2024-09-22T09:13:41.778236+0000","last_clean":"2024-09-22T09:13:41.778236+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:13:41.778236+0000","last_undegraded":"2024-09-22T09:13:41.778236+0000","last_fullsized":"2024-09-22T09:13:41.778236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:17.089358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'49","reported_seq":550,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778914+0000","last_change":"2024-09-22T08:17:44.334218+0000","last_active":"2024-09-22T09:13:46.778914+0000","last_peered":"2024-09-22T09:13:46.778914+0000","last_clean":"2024-09-22T09:13:46.778914+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:13:46.778914+0000","last_undegraded":"2024-09-22T09:13:46.778914+0000","last_fullsized":"2024-09-22T09:13:46.778914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:19:02.161443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869006+0000","last_change":"2024-09-22T08:17:46.350484+0000","last_active":"2024-09-22T09:13:47.869006+0000","last_peered":"2024-09-22T09:13:47.869006+0000","last_clean":"2024-09-22T09:13:47.869006+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:13:47.869006+0000","last_undegraded":"2024-09-22T09:13:47.869006+0000","last_fullsized":"2024-09-22T09:13:47.869006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'168","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:04.540022+0000","last_change":"2024-09-22T08:17:48.364413+0000","last_active":"2024-09-22T09:14:04.540022+0000","last_peered":"2024-09-22T09:14:04.540022+0000","last_clean":"2024-09-22T09:14:04.540022+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:14:04.540022+0000","last_undegraded":"2024-09-22T09:14:04.540022+0000","last_fullsized":"2024-09-22T09:14:04.540022+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:40:16.567547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1114","reported_seq":2661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.752191+0000","last_change":"2024-09-22T09:16:17.752191+0000","last_active":"2024-09-22T09:16:17.752191+0000","last_peered":"2024-09-22T09:16:17.752191+0000","last_clean":"2024-09-22T09:16:17.752191+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:16:17.752191+0000","last_undegraded":"2024-09-22T09:16:17.752191+0000","last_fullsized":"2024-09-22T09:16:17.752191+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1114","last_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_deep_scrub":"261'1114","last_deep_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.752078+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":1100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:39.851809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'345","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.909478+0000","last_change":"2024-09-22T09:16:10.909478+0000","last_active":"2024-09-22T09:16:10.909478+0000","last_peered":"2024-09-22T09:16:10.909478+0000","last_clean":"2024-09-22T09:16:10.909478+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:10.909478+0000","last_undegraded":"2024-09-22T09:16:10.909478+0000","last_fullsized":"2024-09-22T09:16:10.909478+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.909398+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:48.269092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":10746,"num_write":1198,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.961164+0000","last_change":"2024-09-22T09:16:23.961164+0000","last_active":"2024-09-22T09:16:23.961164+0000","last_peered":"2024-09-22T09:16:23.961164+0000","last_clean":"2024-09-22T09:16:23.961164+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:16:23.961164+0000","last_undegraded":"2024-09-22T09:16:23.961164+0000","last_fullsized":"2024-09-22T09:16:23.961164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.961072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:18.031550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'300","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.702560+0000","last_change":"2024-09-22T09:16:26.702560+0000","last_active":"2024-09-22T09:16:26.702560+0000","last_peered":"2024-09-22T09:16:26.702560+0000","last_clean":"2024-09-22T09:16:26.702560+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:26.702560+0000","last_undegraded":"2024-09-22T09:16:26.702560+0000","last_fullsized":"2024-09-22T09:16:26.702560+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.702460+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:52:00.189471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51577,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1040,"num_write":388,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.972795+0000","last_change":"2024-09-22T08:17:46.356371+0000","last_active":"2024-09-22T09:13:47.972795+0000","last_peered":"2024-09-22T09:13:47.972795+0000","last_clean":"2024-09-22T09:13:47.972795+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:13:47.972795+0000","last_undegraded":"2024-09-22T09:13:47.972795+0000","last_fullsized":"2024-09-22T09:13:47.972795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'673","reported_seq":2226,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.783102+0000","last_change":"2024-09-22T09:16:15.783102+0000","last_active":"2024-09-22T09:16:15.783102+0000","last_peered":"2024-09-22T09:16:15.783102+0000","last_clean":"2024-09-22T09:16:15.783102+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:16:15.783102+0000","last_undegraded":"2024-09-22T09:16:15.783102+0000","last_fullsized":"2024-09-22T09:16:15.783102+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'673","last_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_deep_scrub":"261'673","last_deep_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.783012+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:05.838865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'398","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.720596+0000","last_change":"2024-09-22T09:16:15.720596+0000","last_active":"2024-09-22T09:16:15.720596+0000","last_peered":"2024-09-22T09:16:15.720596+0000","last_clean":"2024-09-22T09:16:15.720596+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:15.720596+0000","last_undegraded":"2024-09-22T09:16:15.720596+0000","last_fullsized":"2024-09-22T09:16:15.720596+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'398","last_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_deep_scrub":"261'398","last_deep_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.720482+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:21.561411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":91878,"num_write":1336,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:42.779094+0000","last_change":"2024-09-22T08:17:42.314653+0000","last_active":"2024-09-22T09:13:42.779094+0000","last_peered":"2024-09-22T09:13:42.779094+0000","last_clean":"2024-09-22T09:13:42.779094+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:13:42.779094+0000","last_undegraded":"2024-09-22T09:13:42.779094+0000","last_fullsized":"2024-09-22T09:13:42.779094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:43.222863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'288","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.592734+0000","last_change":"2024-09-22T08:17:44.333516+0000","last_active":"2024-09-22T09:16:01.592734+0000","last_peered":"2024-09-22T09:16:01.592734+0000","last_clean":"2024-09-22T09:16:01.592734+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:01.592734+0000","last_undegraded":"2024-09-22T09:16:01.592734+0000","last_fullsized":"2024-09-22T09:16:01.592734+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778872+0000","last_change":"2024-09-22T08:17:46.353828+0000","last_active":"2024-09-22T09:13:46.778872+0000","last_peered":"2024-09-22T09:13:46.778872+0000","last_clean":"2024-09-22T09:13:46.778872+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:13:46.778872+0000","last_undegraded":"2024-09-22T09:13:46.778872+0000","last_fullsized":"2024-09-22T09:13:46.778872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:01.647431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'811","reported_seq":2471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211752+0000","last_change":"2024-09-22T08:17:40.320765+0000","last_active":"2024-09-22T09:14:02.211752+0000","last_peered":"2024-09-22T09:14:02.211752+0000","last_clean":"2024-09-22T09:14:02.211752+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:14:02.211752+0000","last_undegraded":"2024-09-22T09:14:02.211752+0000","last_fullsized":"2024-09-22T09:14:02.211752+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:32.450363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'342","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.809805+0000","last_change":"2024-09-22T09:16:11.809805+0000","last_active":"2024-09-22T09:16:11.809805+0000","last_peered":"2024-09-22T09:16:11.809805+0000","last_clean":"2024-09-22T09:16:11.809805+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:11.809805+0000","last_undegraded":"2024-09-22T09:16:11.809805+0000","last_fullsized":"2024-09-22T09:16:11.809805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.809676+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:44.292039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":11716,"num_write":1078,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.206946+0000","last_change":"2024-09-22T09:16:26.206946+0000","last_active":"2024-09-22T09:16:26.206946+0000","last_peered":"2024-09-22T09:16:26.206946+0000","last_clean":"2024-09-22T09:16:26.206946+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:16:26.206946+0000","last_undegraded":"2024-09-22T09:16:26.206946+0000","last_fullsized":"2024-09-22T09:16:26.206946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.206849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:28.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'468","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.287301+0000","last_change":"2024-09-22T08:17:44.328451+0000","last_active":"2024-09-22T09:16:03.287301+0000","last_peered":"2024-09-22T09:16:03.287301+0000","last_clean":"2024-09-22T09:16:03.287301+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:03.287301+0000","last_undegraded":"2024-09-22T09:16:03.287301+0000","last_fullsized":"2024-09-22T09:16:03.287301+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:33.770821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91839,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1972,"num_write":726,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862398+0000","last_change":"2024-09-22T08:17:46.357073+0000","last_active":"2024-09-22T09:12:47.862398+0000","last_peered":"2024-09-22T09:12:47.862398+0000","last_clean":"2024-09-22T09:12:47.862398+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:12:47.862398+0000","last_undegraded":"2024-09-22T09:12:47.862398+0000","last_fullsized":"2024-09-22T09:12:47.862398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:52:46.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.196117+0000","last_change":"2024-09-22T08:17:48.368356+0000","last_active":"2024-09-22T09:14:02.196117+0000","last_peered":"2024-09-22T09:14:02.196117+0000","last_clean":"2024-09-22T09:14:02.196117+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:14:02.196117+0000","last_undegraded":"2024-09-22T09:14:02.196117+0000","last_fullsized":"2024-09-22T09:14:02.196117+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.783099+0000","last_change":"2024-09-22T09:16:20.783099+0000","last_active":"2024-09-22T09:16:20.783099+0000","last_peered":"2024-09-22T09:16:20.783099+0000","last_clean":"2024-09-22T09:16:20.783099+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:16:20.783099+0000","last_undegraded":"2024-09-22T09:16:20.783099+0000","last_fullsized":"2024-09-22T09:16:20.783099+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'441","last_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_deep_scrub":"261'441","last_deep_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.783016+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.329227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'392","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.796464+0000","last_change":"2024-09-22T09:16:13.796464+0000","last_active":"2024-09-22T09:16:13.796464+0000","last_peered":"2024-09-22T09:16:13.796464+0000","last_clean":"2024-09-22T09:16:13.796464+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:13.796464+0000","last_undegraded":"2024-09-22T09:16:13.796464+0000","last_fullsized":"2024-09-22T09:16:13.796464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'392","last_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_deep_scrub":"261'392","last_deep_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.796344+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:33.961247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":782,"num_read_kb":2508,"num_write":1241,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:57.870282+0000","last_change":"2024-09-22T08:17:42.318772+0000","last_active":"2024-09-22T09:13:57.870282+0000","last_peered":"2024-09-22T09:13:57.870282+0000","last_clean":"2024-09-22T09:13:57.870282+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:13:57.870282+0000","last_undegraded":"2024-09-22T09:13:57.870282+0000","last_fullsized":"2024-09-22T09:13:57.870282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.477954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.680306+0000","last_change":"2024-09-22T08:17:44.337248+0000","last_active":"2024-09-22T09:16:01.680306+0000","last_peered":"2024-09-22T09:16:01.680306+0000","last_clean":"2024-09-22T09:16:01.680306+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:01.680306+0000","last_undegraded":"2024-09-22T09:16:01.680306+0000","last_fullsized":"2024-09-22T09:16:01.680306+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:40.861866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.769839+0000","last_change":"2024-09-22T08:17:46.351080+0000","last_active":"2024-09-22T09:12:46.769839+0000","last_peered":"2024-09-22T09:12:46.769839+0000","last_clean":"2024-09-22T09:12:46.769839+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:12:46.769839+0000","last_undegraded":"2024-09-22T09:12:46.769839+0000","last_fullsized":"2024-09-22T09:12:46.769839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:09.613966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779767+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:13:47.779767+0000","last_peered":"2024-09-22T09:13:47.779767+0000","last_clean":"2024-09-22T09:13:47.779767+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:13:47.779767+0000","last_undegraded":"2024-09-22T09:13:47.779767+0000","last_fullsized":"2024-09-22T09:13:47.779767+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1249","reported_seq":2882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.747497+0000","last_change":"2024-09-22T09:16:16.747497+0000","last_active":"2024-09-22T09:16:16.747497+0000","last_peered":"2024-09-22T09:16:16.747497+0000","last_clean":"2024-09-22T09:16:16.747497+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:16:16.747497+0000","last_undegraded":"2024-09-22T09:16:16.747497+0000","last_fullsized":"2024-09-22T09:16:16.747497+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1249","last_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_deep_scrub":"261'1249","last_deep_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.747413+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:40.709656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'364","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.160466+0000","last_change":"2024-09-22T09:16:10.160466+0000","last_active":"2024-09-22T09:16:10.160466+0000","last_peered":"2024-09-22T09:16:10.160466+0000","last_clean":"2024-09-22T09:16:10.160466+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:10.160466+0000","last_undegraded":"2024-09-22T09:16:10.160466+0000","last_fullsized":"2024-09-22T09:16:10.160466+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.160369+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:26.305948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":701,"num_read_kb":11614,"num_write":1118,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.997725+0000","last_change":"2024-09-22T09:16:25.997725+0000","last_active":"2024-09-22T09:16:25.997725+0000","last_peered":"2024-09-22T09:16:25.997725+0000","last_clean":"2024-09-22T09:16:25.997725+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:16:25.997725+0000","last_undegraded":"2024-09-22T09:16:25.997725+0000","last_fullsized":"2024-09-22T09:16:25.997725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:27.550802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'291","reported_seq":857,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.133811+0000","last_change":"2024-09-22T08:17:44.329668+0000","last_active":"2024-09-22T09:16:03.133811+0000","last_peered":"2024-09-22T09:16:03.133811+0000","last_clean":"2024-09-22T09:16:03.133811+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:16:03.133811+0000","last_undegraded":"2024-09-22T09:16:03.133811+0000","last_fullsized":"2024-09-22T09:16:03.133811+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:13.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1154,"num_write":408,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780532+0000","last_change":"2024-09-22T08:17:46.357031+0000","last_active":"2024-09-22T09:13:56.780532+0000","last_peered":"2024-09-22T09:13:56.780532+0000","last_clean":"2024-09-22T09:13:56.780532+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:13:56.780532+0000","last_undegraded":"2024-09-22T09:13:56.780532+0000","last_fullsized":"2024-09-22T09:13:56.780532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:45:29.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.296188+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.296188+0000","last_peered":"2024-09-22T09:15:24.296188+0000","last_clean":"2024-09-22T09:15:24.296188+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.296188+0000","last_undegraded":"2024-09-22T09:15:24.296188+0000","last_fullsized":"2024-09-22T09:15:24.296188+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'671","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.771617+0000","last_change":"2024-09-22T09:16:19.771617+0000","last_active":"2024-09-22T09:16:19.771617+0000","last_peered":"2024-09-22T09:16:19.771617+0000","last_clean":"2024-09-22T09:16:19.771617+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:16:19.771617+0000","last_undegraded":"2024-09-22T09:16:19.771617+0000","last_fullsized":"2024-09-22T09:16:19.771617+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'671","last_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_deep_scrub":"261'671","last_deep_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.771511+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:54.246211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'302","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.735731+0000","last_change":"2024-09-22T09:16:15.735731+0000","last_active":"2024-09-22T09:16:15.735731+0000","last_peered":"2024-09-22T09:16:15.735731+0000","last_clean":"2024-09-22T09:16:15.735731+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:15.735731+0000","last_undegraded":"2024-09-22T09:16:15.735731+0000","last_fullsized":"2024-09-22T09:16:15.735731+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'302","last_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_deep_scrub":"261'302","last_deep_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.735596+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:46.178060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655841,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":50029,"num_write":1017,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769245+0000","last_change":"2024-09-22T08:17:42.312738+0000","last_active":"2024-09-22T09:12:41.769245+0000","last_peered":"2024-09-22T09:12:41.769245+0000","last_clean":"2024-09-22T09:12:41.769245+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:12:41.769245+0000","last_undegraded":"2024-09-22T09:12:41.769245+0000","last_fullsized":"2024-09-22T09:12:41.769245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:45.180659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'89","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.795335+0000","last_change":"2024-09-22T08:17:44.336865+0000","last_active":"2024-09-22T09:15:22.795335+0000","last_peered":"2024-09-22T09:15:22.795335+0000","last_clean":"2024-09-22T09:15:22.795335+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:15:22.795335+0000","last_undegraded":"2024-09-22T09:15:22.795335+0000","last_fullsized":"2024-09-22T09:15:22.795335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.810068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'780","reported_seq":2591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.976535+0000","last_change":"2024-09-22T08:17:46.350387+0000","last_active":"2024-09-22T09:16:03.976535+0000","last_peered":"2024-09-22T09:16:03.976535+0000","last_clean":"2024-09-22T09:16:03.976535+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:03.976535+0000","last_undegraded":"2024-09-22T09:16:03.976535+0000","last_fullsized":"2024-09-22T09:16:03.976535+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779712+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:47.779712+0000","last_peered":"2024-09-22T09:13:47.779712+0000","last_clean":"2024-09-22T09:13:47.779712+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:47.779712+0000","last_undegraded":"2024-09-22T09:13:47.779712+0000","last_fullsized":"2024-09-22T09:13:47.779712+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'509","reported_seq":2223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.919171+0000","last_change":"2024-09-22T09:16:21.919171+0000","last_active":"2024-09-22T09:16:21.919171+0000","last_peered":"2024-09-22T09:16:21.919171+0000","last_clean":"2024-09-22T09:16:21.919171+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:16:21.919171+0000","last_undegraded":"2024-09-22T09:16:21.919171+0000","last_fullsized":"2024-09-22T09:16:21.919171+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'509","last_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_deep_scrub":"261'509","last_deep_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.919066+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:06.667960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'372","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.163050+0000","last_change":"2024-09-22T09:16:11.163050+0000","last_active":"2024-09-22T09:16:11.163050+0000","last_peered":"2024-09-22T09:16:11.163050+0000","last_clean":"2024-09-22T09:16:11.163050+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:11.163050+0000","last_undegraded":"2024-09-22T09:16:11.163050+0000","last_fullsized":"2024-09-22T09:16:11.163050+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.162937+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:59.374048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":33741,"num_write":1117,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.202193+0000","last_change":"2024-09-22T09:16:26.202193+0000","last_active":"2024-09-22T09:16:26.202193+0000","last_peered":"2024-09-22T09:16:26.202193+0000","last_clean":"2024-09-22T09:16:26.202193+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:16:26.202193+0000","last_undegraded":"2024-09-22T09:16:26.202193+0000","last_fullsized":"2024-09-22T09:16:26.202193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.202094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:26.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'299","reported_seq":875,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.563136+0000","last_change":"2024-09-22T08:17:44.334035+0000","last_active":"2024-09-22T09:16:03.563136+0000","last_peered":"2024-09-22T09:16:03.563136+0000","last_clean":"2024-09-22T09:16:03.563136+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:16:03.563136+0000","last_undegraded":"2024-09-22T09:16:03.563136+0000","last_fullsized":"2024-09-22T09:16:03.563136+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:29.638317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53474,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1042,"num_write":392,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:21.775383+0000","last_change":"2024-09-22T08:17:46.356892+0000","last_active":"2024-09-22T09:13:21.775383+0000","last_peered":"2024-09-22T09:13:21.775383+0000","last_clean":"2024-09-22T09:13:21.775383+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:13:21.775383+0000","last_undegraded":"2024-09-22T09:13:21.775383+0000","last_fullsized":"2024-09-22T09:13:21.775383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:04.578235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'130","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.528881+0000","last_change":"2024-09-22T08:17:48.366280+0000","last_active":"2024-09-22T09:14:02.528881+0000","last_peered":"2024-09-22T09:14:02.528881+0000","last_clean":"2024-09-22T09:14:02.528881+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:14:02.528881+0000","last_undegraded":"2024-09-22T09:14:02.528881+0000","last_fullsized":"2024-09-22T09:14:02.528881+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:56.027995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1511","reported_seq":3232,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.894120+0000","last_change":"2024-09-22T09:16:20.894120+0000","last_active":"2024-09-22T09:16:20.894120+0000","last_peered":"2024-09-22T09:16:20.894120+0000","last_clean":"2024-09-22T09:16:20.894120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:16:20.894120+0000","last_undegraded":"2024-09-22T09:16:20.894120+0000","last_fullsized":"2024-09-22T09:16:20.894120+0000","mapping_epoch":27,"log_start":"261'1500","ondisk_log_start":"261'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1511","last_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_deep_scrub":"261'1511","last_deep_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.894035+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":1500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.749939+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'336","reported_seq":1087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.280118+0000","last_change":"2024-09-22T09:16:20.280118+0000","last_active":"2024-09-22T09:16:20.280118+0000","last_peered":"2024-09-22T09:16:20.280118+0000","last_clean":"2024-09-22T09:16:20.280118+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:20.280118+0000","last_undegraded":"2024-09-22T09:16:20.280118+0000","last_fullsized":"2024-09-22T09:16:20.280118+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.279952+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:57.092613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":31338,"num_write":1035,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.006452+0000","last_change":"2024-09-22T09:16:25.006452+0000","last_active":"2024-09-22T09:16:25.006452+0000","last_peered":"2024-09-22T09:16:25.006452+0000","last_clean":"2024-09-22T09:16:25.006452+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:16:25.006452+0000","last_undegraded":"2024-09-22T09:16:25.006452+0000","last_fullsized":"2024-09-22T09:16:25.006452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.006360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:22.141389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'310","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.636907+0000","last_change":"2024-09-22T08:17:44.332720+0000","last_active":"2024-09-22T09:16:03.636907+0000","last_peered":"2024-09-22T09:16:03.636907+0000","last_clean":"2024-09-22T09:16:03.636907+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:16:03.636907+0000","last_undegraded":"2024-09-22T09:16:03.636907+0000","last_fullsized":"2024-09-22T09:16:03.636907+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:17.326913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148291,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1361,"num_write":420,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'510","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.743151+0000","last_change":"2024-09-22T09:16:17.743151+0000","last_active":"2024-09-22T09:16:17.743151+0000","last_peered":"2024-09-22T09:16:17.743151+0000","last_clean":"2024-09-22T09:16:17.743151+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:16:17.743151+0000","last_undegraded":"2024-09-22T09:16:17.743151+0000","last_fullsized":"2024-09-22T09:16:17.743151+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.743028+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:54.091402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'380","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.809942+0000","last_change":"2024-09-22T09:16:12.809942+0000","last_active":"2024-09-22T09:16:12.809942+0000","last_peered":"2024-09-22T09:16:12.809942+0000","last_clean":"2024-09-22T09:16:12.809942+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:12.809942+0000","last_undegraded":"2024-09-22T09:16:12.809942+0000","last_fullsized":"2024-09-22T09:16:12.809942+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.809787+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:23.365576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":50427,"num_write":1201,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.227143+0000","last_change":"2024-09-22T09:16:25.227143+0000","last_active":"2024-09-22T09:16:25.227143+0000","last_peered":"2024-09-22T09:16:25.227143+0000","last_clean":"2024-09-22T09:16:25.227143+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:16:25.227143+0000","last_undegraded":"2024-09-22T09:16:25.227143+0000","last_fullsized":"2024-09-22T09:16:25.227143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.227042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'248","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.983828+0000","last_change":"2024-09-22T08:17:44.332231+0000","last_active":"2024-09-22T09:16:02.983828+0000","last_peered":"2024-09-22T09:16:02.983828+0000","last_clean":"2024-09-22T09:16:02.983828+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:16:02.983828+0000","last_undegraded":"2024-09-22T09:16:02.983828+0000","last_fullsized":"2024-09-22T09:16:02.983828+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:01.307744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43840,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":1016,"num_write":348,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'431","reported_seq":2007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.853453+0000","last_change":"2024-09-22T09:16:19.853453+0000","last_active":"2024-09-22T09:16:19.853453+0000","last_peered":"2024-09-22T09:16:19.853453+0000","last_clean":"2024-09-22T09:16:19.853453+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:16:19.853453+0000","last_undegraded":"2024-09-22T09:16:19.853453+0000","last_fullsized":"2024-09-22T09:16:19.853453+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'431","last_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_deep_scrub":"261'431","last_deep_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.853368+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:53.654543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'350","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.739492+0000","last_change":"2024-09-22T09:16:16.739492+0000","last_active":"2024-09-22T09:16:16.739492+0000","last_peered":"2024-09-22T09:16:16.739492+0000","last_clean":"2024-09-22T09:16:16.739492+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:16.739492+0000","last_undegraded":"2024-09-22T09:16:16.739492+0000","last_fullsized":"2024-09-22T09:16:16.739492+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'350","last_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_deep_scrub":"261'350","last_deep_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.739368+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:59.971534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":43723,"num_write":1129,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:26.776027+0000","last_change":"2024-09-22T08:17:42.314063+0000","last_active":"2024-09-22T09:13:26.776027+0000","last_peered":"2024-09-22T09:13:26.776027+0000","last_clean":"2024-09-22T09:13:26.776027+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:13:26.776027+0000","last_undegraded":"2024-09-22T09:13:26.776027+0000","last_fullsized":"2024-09-22T09:13:26.776027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:41.291548+0000","last_clean_scrub_stamp":"2024-09-22T08:17:41.291548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:31.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'314","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.219440+0000","last_change":"2024-09-22T08:17:44.339434+0000","last_active":"2024-09-22T09:16:03.219440+0000","last_peered":"2024-09-22T09:16:03.219440+0000","last_clean":"2024-09-22T09:16:03.219440+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:16:03.219440+0000","last_undegraded":"2024-09-22T09:16:03.219440+0000","last_fullsized":"2024-09-22T09:16:03.219440+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:43.307316+0000","last_clean_scrub_stamp":"2024-09-22T08:17:43.307316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:14.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":1187,"num_write":420,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:46.770004+0000","last_change":"2024-09-22T08:17:46.354487+0000","last_active":"2024-09-22T09:12:46.770004+0000","last_peered":"2024-09-22T09:12:46.770004+0000","last_clean":"2024-09-22T09:12:46.770004+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:12:46.770004+0000","last_undegraded":"2024-09-22T09:12:46.770004+0000","last_fullsized":"2024-09-22T09:12:46.770004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:13.119686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'139","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.797389+0000","last_change":"2024-09-22T08:17:48.372094+0000","last_active":"2024-09-22T09:15:22.797389+0000","last_peered":"2024-09-22T09:15:22.797389+0000","last_clean":"2024-09-22T09:15:22.797389+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:15:22.797389+0000","last_undegraded":"2024-09-22T09:15:22.797389+0000","last_fullsized":"2024-09-22T09:15:22.797389+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'515","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.759180+0000","last_change":"2024-09-22T09:16:21.759180+0000","last_active":"2024-09-22T09:16:21.759180+0000","last_peered":"2024-09-22T09:16:21.759180+0000","last_clean":"2024-09-22T09:16:21.759180+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:16:21.759180+0000","last_undegraded":"2024-09-22T09:16:21.759180+0000","last_fullsized":"2024-09-22T09:16:21.759180+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'515","last_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_deep_scrub":"261'515","last_deep_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.759089+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:02.438247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'327","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.872831+0000","last_change":"2024-09-22T09:16:11.872831+0000","last_active":"2024-09-22T09:16:11.872831+0000","last_peered":"2024-09-22T09:16:11.872831+0000","last_clean":"2024-09-22T09:16:11.872831+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:11.872831+0000","last_undegraded":"2024-09-22T09:16:11.872831+0000","last_fullsized":"2024-09-22T09:16:11.872831+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.872713+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:43.753796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":538,"num_read_kb":33852,"num_write":961,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'420","reported_seq":1887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.764056+0000","last_change":"2024-09-22T09:16:19.764056+0000","last_active":"2024-09-22T09:16:19.764056+0000","last_peered":"2024-09-22T09:16:19.764056+0000","last_clean":"2024-09-22T09:16:19.764056+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:16:19.764056+0000","last_undegraded":"2024-09-22T09:16:19.764056+0000","last_fullsized":"2024-09-22T09:16:19.764056+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'420","last_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_deep_scrub":"261'420","last_deep_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.763959+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:20.402662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'329","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.806176+0000","last_change":"2024-09-22T09:16:12.806176+0000","last_active":"2024-09-22T09:16:12.806176+0000","last_peered":"2024-09-22T09:16:12.806176+0000","last_clean":"2024-09-22T09:16:12.806176+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:12.806176+0000","last_undegraded":"2024-09-22T09:16:12.806176+0000","last_fullsized":"2024-09-22T09:16:12.806176+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.806058+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:03.340195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":555,"num_read_kb":87971,"num_write":959,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:22.790564+0000","last_change":"2024-09-22T08:17:40.312973+0000","last_active":"2024-09-22T09:15:22.790564+0000","last_peered":"2024-09-22T09:15:22.790564+0000","last_clean":"2024-09-22T09:15:22.790564+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:15:22.790564+0000","last_undegraded":"2024-09-22T09:15:22.790564+0000","last_fullsized":"2024-09-22T09:15:22.790564+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'408","reported_seq":1113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.276787+0000","last_change":"2024-09-22T09:16:21.276787+0000","last_active":"2024-09-22T09:16:21.276787+0000","last_peered":"2024-09-22T09:16:21.276787+0000","last_clean":"2024-09-22T09:16:21.276787+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:21.276787+0000","last_undegraded":"2024-09-22T09:16:21.276787+0000","last_fullsized":"2024-09-22T09:16:21.276787+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.276682+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:18.486550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":902,"num_read_kb":34719,"num_write":1272,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'748","reported_seq":2557,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.211860+0000","last_change":"2024-09-22T08:17:40.313093+0000","last_active":"2024-09-22T09:14:02.211860+0000","last_peered":"2024-09-22T09:14:02.211860+0000","last_clean":"2024-09-22T09:14:02.211860+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:14:02.211860+0000","last_undegraded":"2024-09-22T09:14:02.211860+0000","last_fullsized":"2024-09-22T09:14:02.211860+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.763130+0000","last_change":"2024-09-22T09:16:14.763130+0000","last_active":"2024-09-22T09:16:14.763130+0000","last_peered":"2024-09-22T09:16:14.763130+0000","last_clean":"2024-09-22T09:16:14.763130+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:14.763130+0000","last_undegraded":"2024-09-22T09:16:14.763130+0000","last_fullsized":"2024-09-22T09:16:14.763130+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.762983+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:17.416002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":20346,"num_write":1128,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'501","reported_seq":2082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.679439+0000","last_change":"2024-09-22T09:16:25.679439+0000","last_active":"2024-09-22T09:16:25.679439+0000","last_peered":"2024-09-22T09:16:25.679439+0000","last_clean":"2024-09-22T09:16:25.679439+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:16:25.679439+0000","last_undegraded":"2024-09-22T09:16:25.679439+0000","last_fullsized":"2024-09-22T09:16:25.679439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'501","last_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_deep_scrub":"261'501","last_deep_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.679334+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:06:59.317670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'326","reported_seq":949,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.224569+0000","last_change":"2024-09-22T09:16:13.224569+0000","last_active":"2024-09-22T09:16:13.224569+0000","last_peered":"2024-09-22T09:16:13.224569+0000","last_clean":"2024-09-22T09:16:13.224569+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:13.224569+0000","last_undegraded":"2024-09-22T09:16:13.224569+0000","last_fullsized":"2024-09-22T09:16:13.224569+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.224470+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:14.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26435,"num_write":1053,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'719","reported_seq":2230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.439057+0000","last_change":"2024-09-22T09:16:18.439057+0000","last_active":"2024-09-22T09:16:18.439057+0000","last_peered":"2024-09-22T09:16:18.439057+0000","last_clean":"2024-09-22T09:16:18.439057+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:16:18.439057+0000","last_undegraded":"2024-09-22T09:16:18.439057+0000","last_fullsized":"2024-09-22T09:16:18.439057+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'719","last_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_deep_scrub":"261'719","last_deep_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.438942+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:24.048331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'356","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.218832+0000","last_change":"2024-09-22T09:16:12.218832+0000","last_active":"2024-09-22T09:16:12.218832+0000","last_peered":"2024-09-22T09:16:12.218832+0000","last_clean":"2024-09-22T09:16:12.218832+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:12.218832+0000","last_undegraded":"2024-09-22T09:16:12.218832+0000","last_fullsized":"2024-09-22T09:16:12.218832+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.218723+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:55.208712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":911,"num_write":1065,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'463","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.152371+0000","last_change":"2024-09-22T09:16:23.152371+0000","last_active":"2024-09-22T09:16:23.152371+0000","last_peered":"2024-09-22T09:16:23.152371+0000","last_clean":"2024-09-22T09:16:23.152371+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:16:23.152371+0000","last_undegraded":"2024-09-22T09:16:23.152371+0000","last_fullsized":"2024-09-22T09:16:23.152371+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'463","last_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_deep_scrub":"261'463","last_deep_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.152260+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:19.327801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'445","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.895888+0000","last_change":"2024-09-22T09:16:12.895888+0000","last_active":"2024-09-22T09:16:12.895888+0000","last_peered":"2024-09-22T09:16:12.895888+0000","last_clean":"2024-09-22T09:16:12.895888+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:12.895888+0000","last_undegraded":"2024-09-22T09:16:12.895888+0000","last_fullsized":"2024-09-22T09:16:12.895888+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.895757+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:49.967455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":934,"num_read_kb":31165,"num_write":1662,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'491","reported_seq":2219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.166984+0000","last_change":"2024-09-22T09:16:15.166984+0000","last_active":"2024-09-22T09:16:15.166984+0000","last_peered":"2024-09-22T09:16:15.166984+0000","last_clean":"2024-09-22T09:16:15.166984+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:16:15.166984+0000","last_undegraded":"2024-09-22T09:16:15.166984+0000","last_fullsized":"2024-09-22T09:16:15.166984+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'491","last_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_deep_scrub":"261'491","last_deep_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.166903+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:58.210857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'323","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.737155+0000","last_change":"2024-09-22T09:16:19.737155+0000","last_active":"2024-09-22T09:16:19.737155+0000","last_peered":"2024-09-22T09:16:19.737155+0000","last_clean":"2024-09-22T09:16:19.737155+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:19.737155+0000","last_undegraded":"2024-09-22T09:16:19.737155+0000","last_fullsized":"2024-09-22T09:16:19.737155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.737050+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:20.503931+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":8118,"num_write":1009,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'854","reported_seq":2603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.673418+0000","last_change":"2024-09-22T09:16:22.673418+0000","last_active":"2024-09-22T09:16:22.673418+0000","last_peered":"2024-09-22T09:16:22.673418+0000","last_clean":"2024-09-22T09:16:22.673418+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:16:22.673418+0000","last_undegraded":"2024-09-22T09:16:22.673418+0000","last_fullsized":"2024-09-22T09:16:22.673418+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'854","last_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_deep_scrub":"261'854","last_deep_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.673327+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:44.554979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'407","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.286192+0000","last_change":"2024-09-22T09:16:22.286115+0000","last_active":"2024-09-22T09:16:22.286192+0000","last_peered":"2024-09-22T09:16:22.286192+0000","last_clean":"2024-09-22T09:16:22.286192+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:22.286192+0000","last_undegraded":"2024-09-22T09:16:22.286192+0000","last_fullsized":"2024-09-22T09:16:22.286192+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'407","last_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_deep_scrub":"261'407","last_deep_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.285976+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:01:50.371655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":152949,"num_write":1317,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'442","reported_seq":2080,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.482793+0000","last_change":"2024-09-22T09:16:19.482793+0000","last_active":"2024-09-22T09:16:19.482793+0000","last_peered":"2024-09-22T09:16:19.482793+0000","last_clean":"2024-09-22T09:16:19.482793+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:16:19.482793+0000","last_undegraded":"2024-09-22T09:16:19.482793+0000","last_fullsized":"2024-09-22T09:16:19.482793+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'442","last_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_deep_scrub":"261'442","last_deep_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.482692+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:42.895660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'344","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.751453+0000","last_change":"2024-09-22T09:16:17.751453+0000","last_active":"2024-09-22T09:16:17.751453+0000","last_peered":"2024-09-22T09:16:17.751453+0000","last_clean":"2024-09-22T09:16:17.751453+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:17.751453+0000","last_undegraded":"2024-09-22T09:16:17.751453+0000","last_fullsized":"2024-09-22T09:16:17.751453+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.751277+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:30.489888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":609,"num_read_kb":9331,"num_write":1190,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'926","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:06.782491+0000","last_change":"2024-09-22T08:17:40.318830+0000","last_active":"2024-09-22T09:14:06.782491+0000","last_peered":"2024-09-22T09:14:06.782491+0000","last_clean":"2024-09-22T09:14:06.782491+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:14:06.782491+0000","last_undegraded":"2024-09-22T09:14:06.782491+0000","last_fullsized":"2024-09-22T09:14:06.782491+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:39.274838+0000","last_clean_scrub_stamp":"2024-09-22T08:17:39.274838+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'357","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.200735+0000","last_change":"2024-09-22T09:16:12.200735+0000","last_active":"2024-09-22T09:16:12.200735+0000","last_peered":"2024-09-22T09:16:12.200735+0000","last_clean":"2024-09-22T09:16:12.200735+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:12.200735+0000","last_undegraded":"2024-09-22T09:16:12.200735+0000","last_fullsized":"2024-09-22T09:16:12.200735+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.200550+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:39.553247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":484,"num_write":1192,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'831","reported_seq":2470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.203293+0000","last_change":"2024-09-22T09:16:18.203293+0000","last_active":"2024-09-22T09:16:18.203293+0000","last_peered":"2024-09-22T09:16:18.203293+0000","last_clean":"2024-09-22T09:16:18.203293+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:16:18.203293+0000","last_undegraded":"2024-09-22T09:16:18.203293+0000","last_fullsized":"2024-09-22T09:16:18.203293+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.203194+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:46.422305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'455","reported_seq":1183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.719575+0000","last_change":"2024-09-22T09:16:16.719575+0000","last_active":"2024-09-22T09:16:16.719575+0000","last_peered":"2024-09-22T09:16:16.719575+0000","last_clean":"2024-09-22T09:16:16.719575+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:16.719575+0000","last_undegraded":"2024-09-22T09:16:16.719575+0000","last_fullsized":"2024-09-22T09:16:16.719575+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'455","last_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_deep_scrub":"261'455","last_deep_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.719441+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:32.637454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":882,"num_read_kb":67486,"num_write":1537,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.178525+0000","last_change":"2024-09-22T09:16:17.178525+0000","last_active":"2024-09-22T09:16:17.178525+0000","last_peered":"2024-09-22T09:16:17.178525+0000","last_clean":"2024-09-22T09:16:17.178525+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:16:17.178525+0000","last_undegraded":"2024-09-22T09:16:17.178525+0000","last_fullsized":"2024-09-22T09:16:17.178525+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'443","last_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_deep_scrub":"261'443","last_deep_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.178441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.703833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'315","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.578353+0000","last_change":"2024-09-22T09:16:09.578353+0000","last_active":"2024-09-22T09:16:09.578353+0000","last_peered":"2024-09-22T09:16:09.578353+0000","last_clean":"2024-09-22T09:16:09.578353+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:09.578353+0000","last_undegraded":"2024-09-22T09:16:09.578353+0000","last_fullsized":"2024-09-22T09:16:09.578353+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.578247+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:57.589765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":4113,"num_write":1035,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1344","reported_seq":3021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.754474+0000","last_change":"2024-09-22T09:16:18.754474+0000","last_active":"2024-09-22T09:16:18.754474+0000","last_peered":"2024-09-22T09:16:18.754474+0000","last_clean":"2024-09-22T09:16:18.754474+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:16:18.754474+0000","last_undegraded":"2024-09-22T09:16:18.754474+0000","last_fullsized":"2024-09-22T09:16:18.754474+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1344","last_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_deep_scrub":"261'1344","last_deep_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.754381+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":1300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:57.272268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'330","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.246155+0000","last_change":"2024-09-22T09:16:23.246155+0000","last_active":"2024-09-22T09:16:23.246155+0000","last_peered":"2024-09-22T09:16:23.246155+0000","last_clean":"2024-09-22T09:16:23.246155+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:23.246155+0000","last_undegraded":"2024-09-22T09:16:23.246155+0000","last_fullsized":"2024-09-22T09:16:23.246155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.246014+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:58.979313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515353,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":7532,"num_write":972,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'880","reported_seq":2372,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.746082+0000","last_change":"2024-09-22T09:16:22.746082+0000","last_active":"2024-09-22T09:16:22.746082+0000","last_peered":"2024-09-22T09:16:22.746082+0000","last_clean":"2024-09-22T09:16:22.746082+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:16:22.746082+0000","last_undegraded":"2024-09-22T09:16:22.746082+0000","last_fullsized":"2024-09-22T09:16:22.746082+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'880","last_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_deep_scrub":"261'880","last_deep_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.745990+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:18.063674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'315","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.799122+0000","last_change":"2024-09-22T09:16:13.799122+0000","last_active":"2024-09-22T09:16:13.799122+0000","last_peered":"2024-09-22T09:16:13.799122+0000","last_clean":"2024-09-22T09:16:13.799122+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:13.799122+0000","last_undegraded":"2024-09-22T09:16:13.799122+0000","last_fullsized":"2024-09-22T09:16:13.799122+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.799007+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:31.530684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263494,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":814,"num_read_kb":1206,"num_write":1027,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'589","reported_seq":2176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.155968+0000","last_change":"2024-09-22T09:16:16.155915+0000","last_active":"2024-09-22T09:16:16.155968+0000","last_peered":"2024-09-22T09:16:16.155968+0000","last_clean":"2024-09-22T09:16:16.155968+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:16:16.155968+0000","last_undegraded":"2024-09-22T09:16:16.155968+0000","last_fullsized":"2024-09-22T09:16:16.155968+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'589","last_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_deep_scrub":"261'589","last_deep_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.155810+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:42.833807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'352","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.237090+0000","last_change":"2024-09-22T09:16:24.237090+0000","last_active":"2024-09-22T09:16:24.237090+0000","last_peered":"2024-09-22T09:16:24.237090+0000","last_clean":"2024-09-22T09:16:24.237090+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:24.237090+0000","last_undegraded":"2024-09-22T09:16:24.237090+0000","last_fullsized":"2024-09-22T09:16:24.237090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.236968+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:37.139334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":65832,"num_write":1085,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.212752+0000","last_change":"2024-09-22T09:16:27.212752+0000","last_active":"2024-09-22T09:16:27.212752+0000","last_peered":"2024-09-22T09:16:27.212752+0000","last_clean":"2024-09-22T09:16:27.212752+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:27.212752+0000","last_undegraded":"2024-09-22T09:16:27.212752+0000","last_fullsized":"2024-09-22T09:16:27.212752+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.212631+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:44.538803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":15571,"num_write":1043,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'504","reported_seq":2200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.792932+0000","last_change":"2024-09-22T09:16:23.792932+0000","last_active":"2024-09-22T09:16:23.792932+0000","last_peered":"2024-09-22T09:16:23.792932+0000","last_clean":"2024-09-22T09:16:23.792932+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:16:23.792932+0000","last_undegraded":"2024-09-22T09:16:23.792932+0000","last_fullsized":"2024-09-22T09:16:23.792932+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'504","last_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_deep_scrub":"261'504","last_deep_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.792820+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:41.074747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.712012+0000","last_change":"2024-09-22T09:16:21.712012+0000","last_active":"2024-09-22T09:16:21.712012+0000","last_peered":"2024-09-22T09:16:21.712012+0000","last_clean":"2024-09-22T09:16:21.712012+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:21.712012+0000","last_undegraded":"2024-09-22T09:16:21.712012+0000","last_fullsized":"2024-09-22T09:16:21.712012+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.711897+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:26.256735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":80287,"num_write":1039,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'505","reported_seq":2183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.178089+0000","last_change":"2024-09-22T09:16:21.178089+0000","last_active":"2024-09-22T09:16:21.178089+0000","last_peered":"2024-09-22T09:16:21.178089+0000","last_clean":"2024-09-22T09:16:21.178089+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:16:21.178089+0000","last_undegraded":"2024-09-22T09:16:21.178089+0000","last_fullsized":"2024-09-22T09:16:21.178089+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'505","last_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_deep_scrub":"261'505","last_deep_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.177984+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:26.746505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637503,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18076,"num_read_kb":37621,"num_write":15217,"num_write_kb":11954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":549378,"num_omap_keys":1250,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2179,"ondisk_log_size":2179,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33494,"num_omap_keys":136,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4046,"ondisk_log_size":4046,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":51675961,"num_objects":284,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":44405,"num_read_kb":2189102,"num_write":73344,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70811648,"data_stored":70811648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3860,"ondisk_log_size":3860,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":207543,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198277,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510153,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271948,"kb_used_data":15868,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94099892,"statfs":{"total":96636764160,"available":96358289408,"internally_reserved":0,"allocated":16248832,"data_stored":14279973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510153,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172824,"kb_used_data":15304,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":94199016,"statfs":{"total":96636764160,"available":96459792384,"internally_reserved":0,"allocated":15671296,"data_stored":13729926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510156,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333156,"kb_used_data":13204,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038684,"statfs":{"total":96636764160,"available":96295612416,"internally_reserved":0,"allocated":13520896,"data_stored":11543840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510155,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142640,"kb_used_data":12896,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94229200,"statfs":{"total":96636764160,"available":96490700800,"internally_reserved":0,"allocated":13205504,"data_stored":11218915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542858,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249764,"kb_used_data":11796,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94122076,"statfs":{"total":96636764160,"available":96381005824,"internally_reserved":0,"allocated":12079104,"data_stored":10115731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542860,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116748,"kb_used_data":9212,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255092,"statfs":{"total":96636764160,"available":96517214208,"internally_reserved":0,"allocated":9433088,"data_stored":7445675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542859,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286172,"kb_used_data":12044,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94085668,"statfs":{"total":96636764160,"available":96343724032,"internally_reserved":0,"allocated":12333056,"data_stored":10357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542857,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224148,"kb_used_data":12548,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147692,"statfs":{"total":96636764160,"available":96407236608,"internally_reserved":0,"allocated":12849152,"data_stored":10882684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8757248,"data_stored":8757248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":12083200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7569408,"data_stored":7569408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7917568,"data_stored":7917568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:30.975 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.975 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.975 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.975 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.976 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.977 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.978 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.979 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.980 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.981 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.982 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.983 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.984 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.985 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.986 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.987 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.988 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.989 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.990 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.991 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.992 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.993 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.994 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.995 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.996 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.997 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.998 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:30.999 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.000 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.001 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:17:41.291548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=41, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:17:43.307316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=43, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.002 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:17:39.274838+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:31.003 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:16:51.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:16:51.343 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:16:51.354 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:16:51.355 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2040,"stamp":"2024-09-22T09:16:49.872264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53921399,"num_objects":751,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":313725,"num_read_kb":2862731,"num_write":165438,"num_write_kb":2483177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":754049,"num_omap_keys":1804,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13799,"ondisk_log_size":13799,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1805720,"kb_used_data":102872,"kb_used_omap":12,"kb_used_meta":1702707,"kb_avail":753169000,"statfs":{"total":773094113280,"available":771245056000,"internally_reserved":0,"allocated":105340928,"data_stored":89574178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1743572528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122855,"num_omap_keys":304,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005795"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.526809+0000","last_change":"2024-09-22T09:16:45.526760+0000","last_active":"2024-09-22T09:16:45.526809+0000","last_peered":"2024-09-22T09:16:45.526809+0000","last_clean":"2024-09-22T09:16:45.526809+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:16:45.526809+0000","last_undegraded":"2024-09-22T09:16:45.526809+0000","last_fullsized":"2024-09-22T09:16:45.526809+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.526682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:00.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.256414+0000","last_change":"2024-09-22T09:16:45.256414+0000","last_active":"2024-09-22T09:16:45.256414+0000","last_peered":"2024-09-22T09:16:45.256414+0000","last_clean":"2024-09-22T09:16:45.256414+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:16:45.256414+0000","last_undegraded":"2024-09-22T09:16:45.256414+0000","last_fullsized":"2024-09-22T09:16:45.256414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.256321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:18.445322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778930+0000","last_change":"2024-09-22T08:36:14.528515+0000","last_active":"2024-09-22T09:13:46.778930+0000","last_peered":"2024-09-22T09:13:46.778930+0000","last_clean":"2024-09-22T09:13:46.778930+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:13:46.778930+0000","last_undegraded":"2024-09-22T09:13:46.778930+0000","last_fullsized":"2024-09-22T09:13:46.778930+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:11.774099+0000","last_change":"2024-09-22T08:33:33.306803+0000","last_active":"2024-09-22T09:13:11.774099+0000","last_peered":"2024-09-22T09:13:11.774099+0000","last_clean":"2024-09-22T09:13:11.774099+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:13:11.774099+0000","last_undegraded":"2024-09-22T09:13:11.774099+0000","last_fullsized":"2024-09-22T09:13:11.774099+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:54.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:11:51.755279+0000","last_change":"2024-09-22T08:51:48.553774+0000","last_active":"2024-09-22T09:11:51.755279+0000","last_peered":"2024-09-22T09:11:51.755279+0000","last_clean":"2024-09-22T09:11:51.755279+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:11:51.755279+0000","last_undegraded":"2024-09-22T09:11:51.755279+0000","last_fullsized":"2024-09-22T09:11:51.755279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:31.335642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.775065+0000","last_change":"2024-09-22T08:36:17.553224+0000","last_active":"2024-09-22T09:16:01.775065+0000","last_peered":"2024-09-22T09:16:01.775065+0000","last_clean":"2024-09-22T09:16:01.775065+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:16:01.775065+0000","last_undegraded":"2024-09-22T09:16:01.775065+0000","last_fullsized":"2024-09-22T09:16:01.775065+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.779025+0000","last_change":"2024-09-22T08:36:14.523115+0000","last_active":"2024-09-22T09:13:46.779025+0000","last_peered":"2024-09-22T09:13:46.779025+0000","last_clean":"2024-09-22T09:13:46.779025+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:13:46.779025+0000","last_undegraded":"2024-09-22T09:13:46.779025+0000","last_fullsized":"2024-09-22T09:13:46.779025+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778275+0000","last_change":"2024-09-22T08:33:33.315279+0000","last_active":"2024-09-22T09:13:41.778275+0000","last_peered":"2024-09-22T09:13:41.778275+0000","last_clean":"2024-09-22T09:13:41.778275+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:13:41.778275+0000","last_undegraded":"2024-09-22T09:13:41.778275+0000","last_fullsized":"2024-09-22T09:13:41.778275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:02.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:32.971072+0000","last_change":"2024-09-22T08:51:48.552822+0000","last_active":"2024-09-22T09:13:32.971072+0000","last_peered":"2024-09-22T09:13:32.971072+0000","last_clean":"2024-09-22T09:13:32.971072+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:13:32.971072+0000","last_undegraded":"2024-09-22T09:13:32.971072+0000","last_fullsized":"2024-09-22T09:13:32.971072+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:36.819913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799341+0000","last_change":"2024-09-22T08:36:17.556488+0000","last_active":"2024-09-22T09:15:51.799341+0000","last_peered":"2024-09-22T09:15:51.799341+0000","last_clean":"2024-09-22T09:15:51.799341+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:15:51.799341+0000","last_undegraded":"2024-09-22T09:15:51.799341+0000","last_fullsized":"2024-09-22T09:15:51.799341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:27.967883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.428303+0000","last_change":"2024-09-22T08:36:14.523141+0000","last_active":"2024-09-22T09:16:01.428303+0000","last_peered":"2024-09-22T09:16:01.428303+0000","last_clean":"2024-09-22T09:16:01.428303+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:16:01.428303+0000","last_undegraded":"2024-09-22T09:16:01.428303+0000","last_fullsized":"2024-09-22T09:16:01.428303+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.382373+0000","last_change":"2024-09-22T09:16:44.382373+0000","last_active":"2024-09-22T09:16:44.382373+0000","last_peered":"2024-09-22T09:16:44.382373+0000","last_clean":"2024-09-22T09:16:44.382373+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:16:44.382373+0000","last_undegraded":"2024-09-22T09:16:44.382373+0000","last_fullsized":"2024-09-22T09:16:44.382373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'62","last_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_deep_scrub":"261'62","last_deep_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.382287+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:32.719724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778131+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:13:41.778131+0000","last_peered":"2024-09-22T09:13:41.778131+0000","last_clean":"2024-09-22T09:13:41.778131+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:13:41.778131+0000","last_undegraded":"2024-09-22T09:13:41.778131+0000","last_fullsized":"2024-09-22T09:13:41.778131+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:26.785326+0000","last_change":"2024-09-22T08:36:17.558162+0000","last_active":"2024-09-22T09:14:26.785326+0000","last_peered":"2024-09-22T09:14:26.785326+0000","last_clean":"2024-09-22T09:14:26.785326+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:14:26.785326+0000","last_undegraded":"2024-09-22T09:14:26.785326+0000","last_fullsized":"2024-09-22T09:14:26.785326+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.240389+0000","last_change":"2024-09-22T09:16:44.240389+0000","last_active":"2024-09-22T09:16:44.240389+0000","last_peered":"2024-09-22T09:16:44.240389+0000","last_clean":"2024-09-22T09:16:44.240389+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:16:44.240389+0000","last_undegraded":"2024-09-22T09:16:44.240389+0000","last_fullsized":"2024-09-22T09:16:44.240389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.240305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:21:11.694952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.365856+0000","last_change":"2024-09-22T09:16:43.365856+0000","last_active":"2024-09-22T09:16:43.365856+0000","last_peered":"2024-09-22T09:16:43.365856+0000","last_clean":"2024-09-22T09:16:43.365856+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:16:43.365856+0000","last_undegraded":"2024-09-22T09:16:43.365856+0000","last_fullsized":"2024-09-22T09:16:43.365856+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.365756+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:43.604511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780514+0000","last_change":"2024-09-22T08:51:48.553649+0000","last_active":"2024-09-22T09:13:56.780514+0000","last_peered":"2024-09-22T09:13:56.780514+0000","last_clean":"2024-09-22T09:13:56.780514+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:13:56.780514+0000","last_undegraded":"2024-09-22T09:13:56.780514+0000","last_fullsized":"2024-09-22T09:13:56.780514+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:25.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.598266+0000","last_change":"2024-09-22T09:16:40.598266+0000","last_active":"2024-09-22T09:16:40.598266+0000","last_peered":"2024-09-22T09:16:40.598266+0000","last_clean":"2024-09-22T09:16:40.598266+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:16:40.598266+0000","last_undegraded":"2024-09-22T09:16:40.598266+0000","last_fullsized":"2024-09-22T09:16:40.598266+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.598158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:01.390559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789482+0000","last_change":"2024-09-22T08:36:14.527275+0000","last_active":"2024-09-22T09:14:56.789482+0000","last_peered":"2024-09-22T09:14:56.789482+0000","last_clean":"2024-09-22T09:14:56.789482+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:14:56.789482+0000","last_undegraded":"2024-09-22T09:14:56.789482+0000","last_fullsized":"2024-09-22T09:14:56.789482+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:03.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.308367+0000","last_change":"2024-09-22T09:16:41.308367+0000","last_active":"2024-09-22T09:16:41.308367+0000","last_peered":"2024-09-22T09:16:41.308367+0000","last_clean":"2024-09-22T09:16:41.308367+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:16:41.308367+0000","last_undegraded":"2024-09-22T09:16:41.308367+0000","last_fullsized":"2024-09-22T09:16:41.308367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.308277+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:23.833047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769281+0000","last_change":"2024-09-22T08:51:48.545655+0000","last_active":"2024-09-22T09:12:41.769281+0000","last_peered":"2024-09-22T09:12:41.769281+0000","last_clean":"2024-09-22T09:12:41.769281+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:12:41.769281+0000","last_undegraded":"2024-09-22T09:12:41.769281+0000","last_fullsized":"2024-09-22T09:12:41.769281+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:08:43.447539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:07.790972+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:15:07.790972+0000","last_peered":"2024-09-22T09:15:07.790972+0000","last_clean":"2024-09-22T09:15:07.790972+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:15:07.790972+0000","last_undegraded":"2024-09-22T09:15:07.790972+0000","last_fullsized":"2024-09-22T09:15:07.790972+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":190,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.921997+0000","last_change":"2024-09-22T09:16:40.921997+0000","last_active":"2024-09-22T09:16:40.921997+0000","last_peered":"2024-09-22T09:16:40.921997+0000","last_clean":"2024-09-22T09:16:40.921997+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:16:40.921997+0000","last_undegraded":"2024-09-22T09:16:40.921997+0000","last_fullsized":"2024-09-22T09:16:40.921997+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.921882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:35.683665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:17.872855+0000","last_change":"2024-09-22T08:51:48.549140+0000","last_active":"2024-09-22T09:14:17.872855+0000","last_peered":"2024-09-22T09:14:17.872855+0000","last_clean":"2024-09-22T09:14:17.872855+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:14:17.872855+0000","last_undegraded":"2024-09-22T09:14:17.872855+0000","last_fullsized":"2024-09-22T09:14:17.872855+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.869084+0000","last_change":"2024-09-22T08:36:17.548627+0000","last_active":"2024-09-22T09:13:47.869084+0000","last_peered":"2024-09-22T09:13:47.869084+0000","last_clean":"2024-09-22T09:13:47.869084+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:13:47.869084+0000","last_undegraded":"2024-09-22T09:13:47.869084+0000","last_fullsized":"2024-09-22T09:13:47.869084+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.558532+0000","last_change":"2024-09-22T09:16:36.558532+0000","last_active":"2024-09-22T09:16:36.558532+0000","last_peered":"2024-09-22T09:16:36.558532+0000","last_clean":"2024-09-22T09:16:36.558532+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:16:36.558532+0000","last_undegraded":"2024-09-22T09:16:36.558532+0000","last_fullsized":"2024-09-22T09:16:36.558532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.558400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:20.467650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.837862+0000","last_change":"2024-09-22T09:16:41.837862+0000","last_active":"2024-09-22T09:16:41.837862+0000","last_peered":"2024-09-22T09:16:41.837862+0000","last_clean":"2024-09-22T09:16:41.837862+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:16:41.837862+0000","last_undegraded":"2024-09-22T09:16:41.837862+0000","last_fullsized":"2024-09-22T09:16:41.837862+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'231","last_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_deep_scrub":"258'231","last_deep_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.837741+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:20.560690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.557169+0000","last_change":"2024-09-22T09:16:46.557103+0000","last_active":"2024-09-22T09:16:46.557169+0000","last_peered":"2024-09-22T09:16:46.557169+0000","last_clean":"2024-09-22T09:16:46.557169+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:16:46.557169+0000","last_undegraded":"2024-09-22T09:16:46.557169+0000","last_fullsized":"2024-09-22T09:16:46.557169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.557012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.050098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.476515+0000","last_change":"2024-09-22T08:36:17.559254+0000","last_active":"2024-09-22T09:16:02.476515+0000","last_peered":"2024-09-22T09:16:02.476515+0000","last_clean":"2024-09-22T09:16:02.476515+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:16:02.476515+0000","last_undegraded":"2024-09-22T09:16:02.476515+0000","last_fullsized":"2024-09-22T09:16:02.476515+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.652123+0000","last_change":"2024-09-22T08:36:14.521149+0000","last_active":"2024-09-22T09:16:02.652123+0000","last_peered":"2024-09-22T09:16:02.652123+0000","last_clean":"2024-09-22T09:16:02.652123+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:16:02.652123+0000","last_undegraded":"2024-09-22T09:16:02.652123+0000","last_fullsized":"2024-09-22T09:16:02.652123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.321672+0000","last_change":"2024-09-22T09:16:42.321672+0000","last_active":"2024-09-22T09:16:42.321672+0000","last_peered":"2024-09-22T09:16:42.321672+0000","last_clean":"2024-09-22T09:16:42.321672+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:16:42.321672+0000","last_undegraded":"2024-09-22T09:16:42.321672+0000","last_fullsized":"2024-09-22T09:16:42.321672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.321561+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:44.112776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.770523+0000","last_change":"2024-09-22T08:51:48.551396+0000","last_active":"2024-09-22T09:12:51.770523+0000","last_peered":"2024-09-22T09:12:51.770523+0000","last_clean":"2024-09-22T09:12:51.770523+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:12:51.770523+0000","last_undegraded":"2024-09-22T09:12:51.770523+0000","last_fullsized":"2024-09-22T09:12:51.770523+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:32:22.428961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789167+0000","last_change":"2024-09-22T08:36:17.559169+0000","last_active":"2024-09-22T09:14:56.789167+0000","last_peered":"2024-09-22T09:14:56.789167+0000","last_clean":"2024-09-22T09:14:56.789167+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:14:56.789167+0000","last_undegraded":"2024-09-22T09:14:56.789167+0000","last_fullsized":"2024-09-22T09:14:56.789167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:09:28.750643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'5","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.501257+0000","last_change":"2024-09-22T08:36:14.527663+0000","last_active":"2024-09-22T09:16:03.501257+0000","last_peered":"2024-09-22T09:16:03.501257+0000","last_clean":"2024-09-22T09:16:03.501257+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:16:03.501257+0000","last_undegraded":"2024-09-22T09:16:03.501257+0000","last_fullsized":"2024-09-22T09:16:03.501257+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.832929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:16.764845+0000","last_change":"2024-09-22T08:33:33.307916+0000","last_active":"2024-09-22T09:12:16.764845+0000","last_peered":"2024-09-22T09:12:16.764845+0000","last_clean":"2024-09-22T09:12:16.764845+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:12:16.764845+0000","last_undegraded":"2024-09-22T09:12:16.764845+0000","last_fullsized":"2024-09-22T09:12:16.764845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:02.328916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:51.763693+0000","last_change":"2024-09-22T08:51:48.549863+0000","last_active":"2024-09-22T09:12:51.763693+0000","last_peered":"2024-09-22T09:12:51.763693+0000","last_clean":"2024-09-22T09:12:51.763693+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:12:51.763693+0000","last_undegraded":"2024-09-22T09:12:51.763693+0000","last_fullsized":"2024-09-22T09:12:51.763693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.662878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:46.778956+0000","last_change":"2024-09-22T08:36:17.560474+0000","last_active":"2024-09-22T09:13:46.778956+0000","last_peered":"2024-09-22T09:13:46.778956+0000","last_clean":"2024-09-22T09:13:46.778956+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:13:46.778956+0000","last_undegraded":"2024-09-22T09:13:46.778956+0000","last_fullsized":"2024-09-22T09:13:46.778956+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:01.507640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.575100+0000","last_change":"2024-09-22T09:16:35.575100+0000","last_active":"2024-09-22T09:16:35.575100+0000","last_peered":"2024-09-22T09:16:35.575100+0000","last_clean":"2024-09-22T09:16:35.575100+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:16:35.575100+0000","last_undegraded":"2024-09-22T09:16:35.575100+0000","last_fullsized":"2024-09-22T09:16:35.575100+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.574995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:47.143313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.563359+0000","last_change":"2024-09-22T09:16:45.563359+0000","last_active":"2024-09-22T09:16:45.563359+0000","last_peered":"2024-09-22T09:16:45.563359+0000","last_clean":"2024-09-22T09:16:45.563359+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:16:45.563359+0000","last_undegraded":"2024-09-22T09:16:45.563359+0000","last_fullsized":"2024-09-22T09:16:45.563359+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.563268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:15.508239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.862318+0000","last_change":"2024-09-22T08:51:48.544883+0000","last_active":"2024-09-22T09:12:47.862318+0000","last_peered":"2024-09-22T09:12:47.862318+0000","last_clean":"2024-09-22T09:12:47.862318+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:12:47.862318+0000","last_undegraded":"2024-09-22T09:12:47.862318+0000","last_fullsized":"2024-09-22T09:12:47.862318+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:54.197007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'8","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789232+0000","last_change":"2024-09-22T08:36:17.551807+0000","last_active":"2024-09-22T09:14:56.789232+0000","last_peered":"2024-09-22T09:14:56.789232+0000","last_clean":"2024-09-22T09:14:56.789232+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:14:56.789232+0000","last_undegraded":"2024-09-22T09:14:56.789232+0000","last_fullsized":"2024-09-22T09:14:56.789232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:38.855661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789203+0000","last_change":"2024-09-22T08:36:14.526347+0000","last_active":"2024-09-22T09:14:56.789203+0000","last_peered":"2024-09-22T09:14:56.789203+0000","last_clean":"2024-09-22T09:14:56.789203+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:14:56.789203+0000","last_undegraded":"2024-09-22T09:14:56.789203+0000","last_fullsized":"2024-09-22T09:14:56.789203+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:03.179395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.818045+0000","last_change":"2024-09-22T09:16:40.818045+0000","last_active":"2024-09-22T09:16:40.818045+0000","last_peered":"2024-09-22T09:16:40.818045+0000","last_clean":"2024-09-22T09:16:40.818045+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:16:40.818045+0000","last_undegraded":"2024-09-22T09:16:40.818045+0000","last_fullsized":"2024-09-22T09:16:40.818045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.817964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:14.856963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.565348+0000","last_change":"2024-09-22T09:16:43.565348+0000","last_active":"2024-09-22T09:16:43.565348+0000","last_peered":"2024-09-22T09:16:43.565348+0000","last_clean":"2024-09-22T09:16:43.565348+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:16:43.565348+0000","last_undegraded":"2024-09-22T09:16:43.565348+0000","last_fullsized":"2024-09-22T09:16:43.565348+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.565209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:13.820778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.585871+0000","last_change":"2024-09-22T09:16:39.585871+0000","last_active":"2024-09-22T09:16:39.585871+0000","last_peered":"2024-09-22T09:16:39.585871+0000","last_clean":"2024-09-22T09:16:39.585871+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:16:39.585871+0000","last_undegraded":"2024-09-22T09:16:39.585871+0000","last_fullsized":"2024-09-22T09:16:39.585871+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.585774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:19.267444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:56.789610+0000","last_change":"2024-09-22T08:36:14.523984+0000","last_active":"2024-09-22T09:14:56.789610+0000","last_peered":"2024-09-22T09:14:56.789610+0000","last_clean":"2024-09-22T09:14:56.789610+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:14:56.789610+0000","last_undegraded":"2024-09-22T09:14:56.789610+0000","last_fullsized":"2024-09-22T09:14:56.789610+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:08.626984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:22.776801+0000","last_change":"2024-09-22T08:33:33.311805+0000","last_active":"2024-09-22T09:13:22.776801+0000","last_peered":"2024-09-22T09:13:22.776801+0000","last_clean":"2024-09-22T09:13:22.776801+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:13:22.776801+0000","last_undegraded":"2024-09-22T09:13:22.776801+0000","last_fullsized":"2024-09-22T09:13:22.776801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:55.059691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777347+0000","last_change":"2024-09-22T08:36:17.550032+0000","last_active":"2024-09-22T09:13:36.777347+0000","last_peered":"2024-09-22T09:13:36.777347+0000","last_clean":"2024-09-22T09:13:36.777347+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:13:36.777347+0000","last_undegraded":"2024-09-22T09:13:36.777347+0000","last_fullsized":"2024-09-22T09:13:36.777347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:57.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.174488+0000","last_change":"2024-09-22T09:16:41.174488+0000","last_active":"2024-09-22T09:16:41.174488+0000","last_peered":"2024-09-22T09:16:41.174488+0000","last_clean":"2024-09-22T09:16:41.174488+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:16:41.174488+0000","last_undegraded":"2024-09-22T09:16:41.174488+0000","last_fullsized":"2024-09-22T09:16:41.174488+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.174406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:18.069254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:12.775597+0000","last_change":"2024-09-22T08:33:33.311515+0000","last_active":"2024-09-22T09:13:12.775597+0000","last_peered":"2024-09-22T09:13:12.775597+0000","last_clean":"2024-09-22T09:13:12.775597+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:13:12.775597+0000","last_undegraded":"2024-09-22T09:13:12.775597+0000","last_fullsized":"2024-09-22T09:13:12.775597+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:09.454944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769958+0000","last_change":"2024-09-22T08:51:48.546034+0000","last_active":"2024-09-22T09:13:36.769958+0000","last_peered":"2024-09-22T09:13:36.769958+0000","last_clean":"2024-09-22T09:13:36.769958+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:13:36.769958+0000","last_undegraded":"2024-09-22T09:13:36.769958+0000","last_fullsized":"2024-09-22T09:13:36.769958+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:07:35.335843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777301+0000","last_change":"2024-09-22T08:36:17.550606+0000","last_active":"2024-09-22T09:13:36.777301+0000","last_peered":"2024-09-22T09:13:36.777301+0000","last_clean":"2024-09-22T09:13:36.777301+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:13:36.777301+0000","last_undegraded":"2024-09-22T09:13:36.777301+0000","last_fullsized":"2024-09-22T09:13:36.777301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:05:18.719275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777361+0000","last_change":"2024-09-22T08:36:14.518044+0000","last_active":"2024-09-22T09:13:36.777361+0000","last_peered":"2024-09-22T09:13:36.777361+0000","last_clean":"2024-09-22T09:13:36.777361+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:13:36.777361+0000","last_undegraded":"2024-09-22T09:13:36.777361+0000","last_fullsized":"2024-09-22T09:13:36.777361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.423976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.776787+0000","last_change":"2024-09-22T09:16:39.776787+0000","last_active":"2024-09-22T09:16:39.776787+0000","last_peered":"2024-09-22T09:16:39.776787+0000","last_clean":"2024-09-22T09:16:39.776787+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:16:39.776787+0000","last_undegraded":"2024-09-22T09:16:39.776787+0000","last_fullsized":"2024-09-22T09:16:39.776787+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.776702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:50.757487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:56.771581+0000","last_change":"2024-09-22T08:51:48.544080+0000","last_active":"2024-09-22T09:12:56.771581+0000","last_peered":"2024-09-22T09:12:56.771581+0000","last_clean":"2024-09-22T09:12:56.771581+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:12:56.771581+0000","last_undegraded":"2024-09-22T09:12:56.771581+0000","last_fullsized":"2024-09-22T09:12:56.771581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:28.818411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777329+0000","last_change":"2024-09-22T08:36:17.552698+0000","last_active":"2024-09-22T09:13:36.777329+0000","last_peered":"2024-09-22T09:13:36.777329+0000","last_clean":"2024-09-22T09:13:36.777329+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:13:36.777329+0000","last_undegraded":"2024-09-22T09:13:36.777329+0000","last_fullsized":"2024-09-22T09:13:36.777329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:53.081290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.164637+0000","last_change":"2024-09-22T09:16:42.164637+0000","last_active":"2024-09-22T09:16:42.164637+0000","last_peered":"2024-09-22T09:16:42.164637+0000","last_clean":"2024-09-22T09:16:42.164637+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:16:42.164637+0000","last_undegraded":"2024-09-22T09:16:42.164637+0000","last_fullsized":"2024-09-22T09:16:42.164637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.164533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.065385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":79,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.930369+0000","last_change":"2024-09-22T09:16:39.930369+0000","last_active":"2024-09-22T09:16:39.930369+0000","last_peered":"2024-09-22T09:16:39.930369+0000","last_clean":"2024-09-22T09:16:39.930369+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:16:39.930369+0000","last_undegraded":"2024-09-22T09:16:39.930369+0000","last_fullsized":"2024-09-22T09:16:39.930369+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.930265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:36.946812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.769923+0000","last_change":"2024-09-22T08:51:48.546852+0000","last_active":"2024-09-22T09:13:36.769923+0000","last_peered":"2024-09-22T09:13:36.769923+0000","last_clean":"2024-09-22T09:13:36.769923+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:13:36.769923+0000","last_undegraded":"2024-09-22T09:13:36.769923+0000","last_fullsized":"2024-09-22T09:13:36.769923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:34.041438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:57.798094+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:15:57.798094+0000","last_peered":"2024-09-22T09:15:57.798094+0000","last_clean":"2024-09-22T09:15:57.798094+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:15:57.798094+0000","last_undegraded":"2024-09-22T09:15:57.798094+0000","last_fullsized":"2024-09-22T09:15:57.798094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":26642,"num_write":15,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.211955+0000","last_change":"2024-09-22T09:16:43.211955+0000","last_active":"2024-09-22T09:16:43.211955+0000","last_peered":"2024-09-22T09:16:43.211955+0000","last_clean":"2024-09-22T09:16:43.211955+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:16:43.211955+0000","last_undegraded":"2024-09-22T09:16:43.211955+0000","last_fullsized":"2024-09-22T09:16:43.211955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.211856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:30.934538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":121,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.776115+0000","last_change":"2024-09-22T09:16:38.776115+0000","last_active":"2024-09-22T09:16:38.776115+0000","last_peered":"2024-09-22T09:16:38.776115+0000","last_clean":"2024-09-22T09:16:38.776115+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:16:38.776115+0000","last_undegraded":"2024-09-22T09:16:38.776115+0000","last_fullsized":"2024-09-22T09:16:38.776115+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.776008+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:55.501761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777391+0000","last_change":"2024-09-22T08:51:48.550602+0000","last_active":"2024-09-22T09:13:36.777391+0000","last_peered":"2024-09-22T09:13:36.777391+0000","last_clean":"2024-09-22T09:13:36.777391+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:13:36.777391+0000","last_undegraded":"2024-09-22T09:13:36.777391+0000","last_fullsized":"2024-09-22T09:13:36.777391+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.413385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:31.785519+0000","last_change":"2024-09-22T08:36:17.544669+0000","last_active":"2024-09-22T09:14:31.785519+0000","last_peered":"2024-09-22T09:14:31.785519+0000","last_clean":"2024-09-22T09:14:31.785519+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:14:31.785519+0000","last_undegraded":"2024-09-22T09:14:31.785519+0000","last_fullsized":"2024-09-22T09:14:31.785519+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.875900+0000","last_change":"2024-09-22T09:16:43.875827+0000","last_active":"2024-09-22T09:16:43.875900+0000","last_peered":"2024-09-22T09:16:43.875900+0000","last_clean":"2024-09-22T09:16:43.875900+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:16:43.875900+0000","last_undegraded":"2024-09-22T09:16:43.875900+0000","last_fullsized":"2024-09-22T09:16:43.875900+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.875715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:54.884470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.808080+0000","last_change":"2024-09-22T09:16:37.808080+0000","last_active":"2024-09-22T09:16:37.808080+0000","last_peered":"2024-09-22T09:16:37.808080+0000","last_clean":"2024-09-22T09:16:37.808080+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:16:37.808080+0000","last_undegraded":"2024-09-22T09:16:37.808080+0000","last_fullsized":"2024-09-22T09:16:37.808080+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'49","last_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_deep_scrub":"261'49","last_deep_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.807991+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:47.897618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.276431+0000","last_change":"2024-09-22T09:16:46.276431+0000","last_active":"2024-09-22T09:16:46.276431+0000","last_peered":"2024-09-22T09:16:46.276431+0000","last_clean":"2024-09-22T09:16:46.276431+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:16:46.276431+0000","last_undegraded":"2024-09-22T09:16:46.276431+0000","last_fullsized":"2024-09-22T09:16:46.276431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.276347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:06.468881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.286554+0000","last_change":"2024-09-22T08:36:17.560020+0000","last_active":"2024-09-22T09:16:02.286554+0000","last_peered":"2024-09-22T09:16:02.286554+0000","last_clean":"2024-09-22T09:16:02.286554+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:16:02.286554+0000","last_undegraded":"2024-09-22T09:16:02.286554+0000","last_fullsized":"2024-09-22T09:16:02.286554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.363098+0000","last_change":"2024-09-22T09:16:46.363035+0000","last_active":"2024-09-22T09:16:46.363098+0000","last_peered":"2024-09-22T09:16:46.363098+0000","last_clean":"2024-09-22T09:16:46.363098+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:16:46.363098+0000","last_undegraded":"2024-09-22T09:16:46.363098+0000","last_fullsized":"2024-09-22T09:16:46.363098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.362946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:20.934618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.781717+0000","last_change":"2024-09-22T08:33:33.314183+0000","last_active":"2024-09-22T09:14:02.781717+0000","last_peered":"2024-09-22T09:14:02.781717+0000","last_clean":"2024-09-22T09:14:02.781717+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:14:02.781717+0000","last_undegraded":"2024-09-22T09:14:02.781717+0000","last_fullsized":"2024-09-22T09:14:02.781717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:21.765820+0000","last_change":"2024-09-22T08:36:17.553020+0000","last_active":"2024-09-22T09:12:21.765820+0000","last_peered":"2024-09-22T09:12:21.765820+0000","last_clean":"2024-09-22T09:12:21.765820+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:12:21.765820+0000","last_undegraded":"2024-09-22T09:12:21.765820+0000","last_fullsized":"2024-09-22T09:12:21.765820+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:38.373611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.926965+0000","last_change":"2024-09-22T09:16:44.926898+0000","last_active":"2024-09-22T09:16:44.926965+0000","last_peered":"2024-09-22T09:16:44.926965+0000","last_clean":"2024-09-22T09:16:44.926965+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:16:44.926965+0000","last_undegraded":"2024-09-22T09:16:44.926965+0000","last_fullsized":"2024-09-22T09:16:44.926965+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.926806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:19.408134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.176625+0000","last_change":"2024-09-22T09:16:39.176625+0000","last_active":"2024-09-22T09:16:39.176625+0000","last_peered":"2024-09-22T09:16:39.176625+0000","last_clean":"2024-09-22T09:16:39.176625+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:16:39.176625+0000","last_undegraded":"2024-09-22T09:16:39.176625+0000","last_fullsized":"2024-09-22T09:16:39.176625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'41","last_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_deep_scrub":"261'41","last_deep_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.176539+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:01.618435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.264010+0000","last_change":"2024-09-22T09:16:47.264010+0000","last_active":"2024-09-22T09:16:47.264010+0000","last_peered":"2024-09-22T09:16:47.264010+0000","last_clean":"2024-09-22T09:16:47.264010+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:16:47.264010+0000","last_undegraded":"2024-09-22T09:16:47.264010+0000","last_fullsized":"2024-09-22T09:16:47.264010+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.263928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:18.442999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'5","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.906661+0000","last_change":"2024-09-22T08:36:17.556593+0000","last_active":"2024-09-22T09:16:03.906661+0000","last_peered":"2024-09-22T09:16:03.906661+0000","last_clean":"2024-09-22T09:16:03.906661+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:16:03.906661+0000","last_undegraded":"2024-09-22T09:16:03.906661+0000","last_fullsized":"2024-09-22T09:16:03.906661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.913056+0000","last_change":"2024-09-22T09:16:45.913056+0000","last_active":"2024-09-22T09:16:45.913056+0000","last_peered":"2024-09-22T09:16:45.913056+0000","last_clean":"2024-09-22T09:16:45.913056+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:16:45.913056+0000","last_undegraded":"2024-09-22T09:16:45.913056+0000","last_fullsized":"2024-09-22T09:16:45.913056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.912961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:19.445927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.290252+0000","last_change":"2024-09-22T09:16:39.290252+0000","last_active":"2024-09-22T09:16:39.290252+0000","last_peered":"2024-09-22T09:16:39.290252+0000","last_clean":"2024-09-22T09:16:39.290252+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:16:39.290252+0000","last_undegraded":"2024-09-22T09:16:39.290252+0000","last_fullsized":"2024-09-22T09:16:39.290252+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'25","last_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_deep_scrub":"261'25","last_deep_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.290151+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:25.985106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784609+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:14:21.784609+0000","last_peered":"2024-09-22T09:14:21.784609+0000","last_clean":"2024-09-22T09:14:21.784609+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:14:21.784609+0000","last_undegraded":"2024-09-22T09:14:21.784609+0000","last_fullsized":"2024-09-22T09:14:21.784609+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.877066+0000","last_change":"2024-09-22T09:16:42.877066+0000","last_active":"2024-09-22T09:16:42.877066+0000","last_peered":"2024-09-22T09:16:42.877066+0000","last_clean":"2024-09-22T09:16:42.877066+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:16:42.877066+0000","last_undegraded":"2024-09-22T09:16:42.877066+0000","last_fullsized":"2024-09-22T09:16:42.877066+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.876983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.724829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":175,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.280628+0000","last_change":"2024-09-22T09:16:38.280628+0000","last_active":"2024-09-22T09:16:38.280628+0000","last_peered":"2024-09-22T09:16:38.280628+0000","last_clean":"2024-09-22T09:16:38.280628+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:16:38.280628+0000","last_undegraded":"2024-09-22T09:16:38.280628+0000","last_fullsized":"2024-09-22T09:16:38.280628+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.280538+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:26.277335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:17.872925+0000","last_change":"2024-09-22T08:51:48.554102+0000","last_active":"2024-09-22T09:14:17.872925+0000","last_peered":"2024-09-22T09:14:17.872925+0000","last_clean":"2024-09-22T09:14:17.872925+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:14:17.872925+0000","last_undegraded":"2024-09-22T09:14:17.872925+0000","last_fullsized":"2024-09-22T09:14:17.872925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.774887+0000","last_change":"2024-09-22T09:16:47.774887+0000","last_active":"2024-09-22T09:16:47.774887+0000","last_peered":"2024-09-22T09:16:47.774887+0000","last_clean":"2024-09-22T09:16:47.774887+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:16:47.774887+0000","last_undegraded":"2024-09-22T09:16:47.774887+0000","last_fullsized":"2024-09-22T09:16:47.774887+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.774799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:50.971915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.427984+0000","last_change":"2024-09-22T08:36:14.516793+0000","last_active":"2024-09-22T09:16:01.427984+0000","last_peered":"2024-09-22T09:16:01.427984+0000","last_clean":"2024-09-22T09:16:01.427984+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:16:01.427984+0000","last_undegraded":"2024-09-22T09:16:01.427984+0000","last_fullsized":"2024-09-22T09:16:01.427984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:00.235845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":257,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.812257+0000","last_change":"2024-09-22T09:16:45.812257+0000","last_active":"2024-09-22T09:16:45.812257+0000","last_peered":"2024-09-22T09:16:45.812257+0000","last_clean":"2024-09-22T09:16:45.812257+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:16:45.812257+0000","last_undegraded":"2024-09-22T09:16:45.812257+0000","last_fullsized":"2024-09-22T09:16:45.812257+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'73","last_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_deep_scrub":"261'73","last_deep_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.812164+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:45.301719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.544634+0000","last_change":"2024-09-22T09:16:44.544634+0000","last_active":"2024-09-22T09:16:44.544634+0000","last_peered":"2024-09-22T09:16:44.544634+0000","last_clean":"2024-09-22T09:16:44.544634+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:16:44.544634+0000","last_undegraded":"2024-09-22T09:16:44.544634+0000","last_fullsized":"2024-09-22T09:16:44.544634+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.544540+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:05.655088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.285349+0000","last_change":"2024-09-22T08:36:17.557811+0000","last_active":"2024-09-22T09:16:02.285349+0000","last_peered":"2024-09-22T09:16:02.285349+0000","last_clean":"2024-09-22T09:16:02.285349+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:16:02.285349+0000","last_undegraded":"2024-09-22T09:16:02.285349+0000","last_fullsized":"2024-09-22T09:16:02.285349+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.894615+0000","last_change":"2024-09-22T09:16:43.894615+0000","last_active":"2024-09-22T09:16:43.894615+0000","last_peered":"2024-09-22T09:16:43.894615+0000","last_clean":"2024-09-22T09:16:43.894615+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:16:43.894615+0000","last_undegraded":"2024-09-22T09:16:43.894615+0000","last_fullsized":"2024-09-22T09:16:43.894615+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.894526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:57.633983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":96,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:36.768174+0000","last_change":"2024-09-22T08:33:33.305701+0000","last_active":"2024-09-22T09:12:36.768174+0000","last_peered":"2024-09-22T09:12:36.768174+0000","last_clean":"2024-09-22T09:12:36.768174+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:12:36.768174+0000","last_undegraded":"2024-09-22T09:12:36.768174+0000","last_fullsized":"2024-09-22T09:12:36.768174+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:13.838360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784182+0000","last_change":"2024-09-22T08:51:48.554589+0000","last_active":"2024-09-22T09:14:21.784182+0000","last_peered":"2024-09-22T09:14:21.784182+0000","last_clean":"2024-09-22T09:14:21.784182+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:14:21.784182+0000","last_undegraded":"2024-09-22T09:14:21.784182+0000","last_fullsized":"2024-09-22T09:14:21.784182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.593440+0000","last_change":"2024-09-22T09:16:38.593440+0000","last_active":"2024-09-22T09:16:38.593440+0000","last_peered":"2024-09-22T09:16:38.593440+0000","last_clean":"2024-09-22T09:16:38.593440+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:16:38.593440+0000","last_undegraded":"2024-09-22T09:16:38.593440+0000","last_fullsized":"2024-09-22T09:16:38.593440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.593354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:07.670762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:32.785949+0000","last_change":"2024-09-22T08:36:14.524574+0000","last_active":"2024-09-22T09:14:32.785949+0000","last_peered":"2024-09-22T09:14:32.785949+0000","last_clean":"2024-09-22T09:14:32.785949+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:14:32.785949+0000","last_undegraded":"2024-09-22T09:14:32.785949+0000","last_fullsized":"2024-09-22T09:14:32.785949+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.607201+0000","last_change":"2024-09-22T09:16:34.607201+0000","last_active":"2024-09-22T09:16:34.607201+0000","last_peered":"2024-09-22T09:16:34.607201+0000","last_clean":"2024-09-22T09:16:34.607201+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:16:34.607201+0000","last_undegraded":"2024-09-22T09:16:34.607201+0000","last_fullsized":"2024-09-22T09:16:34.607201+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.607103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:48.367495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.618385+0000","last_change":"2024-09-22T09:16:41.618333+0000","last_active":"2024-09-22T09:16:41.618385+0000","last_peered":"2024-09-22T09:16:41.618385+0000","last_clean":"2024-09-22T09:16:41.618385+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:16:41.618385+0000","last_undegraded":"2024-09-22T09:16:41.618385+0000","last_fullsized":"2024-09-22T09:16:41.618385+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.618245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:52.513592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'7","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:01.802669+0000","last_change":"2024-09-22T08:36:17.550572+0000","last_active":"2024-09-22T09:16:01.802669+0000","last_peered":"2024-09-22T09:16:01.802669+0000","last_clean":"2024-09-22T09:16:01.802669+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:16:01.802669+0000","last_undegraded":"2024-09-22T09:16:01.802669+0000","last_fullsized":"2024-09-22T09:16:01.802669+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:59.784578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4198,"num_write":12,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797384+0000","last_change":"2024-09-22T08:36:14.528643+0000","last_active":"2024-09-22T09:15:52.797384+0000","last_peered":"2024-09-22T09:15:52.797384+0000","last_clean":"2024-09-22T09:15:52.797384+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:15:52.797384+0000","last_undegraded":"2024-09-22T09:15:52.797384+0000","last_fullsized":"2024-09-22T09:15:52.797384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:20.920500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.554920+0000","last_change":"2024-09-22T09:16:46.554920+0000","last_active":"2024-09-22T09:16:46.554920+0000","last_peered":"2024-09-22T09:16:46.554920+0000","last_clean":"2024-09-22T09:16:46.554920+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:16:46.554920+0000","last_undegraded":"2024-09-22T09:16:46.554920+0000","last_fullsized":"2024-09-22T09:16:46.554920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.554816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:00.571695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.578268+0000","last_change":"2024-09-22T09:16:42.578200+0000","last_active":"2024-09-22T09:16:42.578268+0000","last_peered":"2024-09-22T09:16:42.578268+0000","last_clean":"2024-09-22T09:16:42.578268+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:16:42.578268+0000","last_undegraded":"2024-09-22T09:16:42.578268+0000","last_fullsized":"2024-09-22T09:16:42.578268+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.578116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:41:50.365456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:51.799271+0000","last_change":"2024-09-22T08:36:17.559806+0000","last_active":"2024-09-22T09:15:51.799271+0000","last_peered":"2024-09-22T09:15:51.799271+0000","last_clean":"2024-09-22T09:15:51.799271+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:15:51.799271+0000","last_undegraded":"2024-09-22T09:15:51.799271+0000","last_fullsized":"2024-09-22T09:15:51.799271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:01.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:51.779925+0000","last_change":"2024-09-22T08:36:14.523195+0000","last_active":"2024-09-22T09:13:51.779925+0000","last_peered":"2024-09-22T09:13:51.779925+0000","last_clean":"2024-09-22T09:13:51.779925+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:13:51.779925+0000","last_undegraded":"2024-09-22T09:13:51.779925+0000","last_fullsized":"2024-09-22T09:13:51.779925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:48.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770902+0000","last_change":"2024-09-22T08:33:33.313716+0000","last_active":"2024-09-22T09:12:32.770902+0000","last_peered":"2024-09-22T09:12:32.770902+0000","last_clean":"2024-09-22T09:12:32.770902+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:12:32.770902+0000","last_undegraded":"2024-09-22T09:12:32.770902+0000","last_fullsized":"2024-09-22T09:12:32.770902+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:02.921988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:56.780620+0000","last_change":"2024-09-22T08:51:48.550209+0000","last_active":"2024-09-22T09:13:56.780620+0000","last_peered":"2024-09-22T09:13:56.780620+0000","last_clean":"2024-09-22T09:13:56.780620+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:13:56.780620+0000","last_undegraded":"2024-09-22T09:13:56.780620+0000","last_fullsized":"2024-09-22T09:13:56.780620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:32.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.571123+0000","last_change":"2024-09-22T09:16:37.571123+0000","last_active":"2024-09-22T09:16:37.571123+0000","last_peered":"2024-09-22T09:16:37.571123+0000","last_clean":"2024-09-22T09:16:37.571123+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:16:37.571123+0000","last_undegraded":"2024-09-22T09:16:37.571123+0000","last_fullsized":"2024-09-22T09:16:37.571123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.571036+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:42.202289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.922201+0000","last_change":"2024-09-22T09:16:42.922201+0000","last_active":"2024-09-22T09:16:42.922201+0000","last_peered":"2024-09-22T09:16:42.922201+0000","last_clean":"2024-09-22T09:16:42.922201+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:16:42.922201+0000","last_undegraded":"2024-09-22T09:16:42.922201+0000","last_fullsized":"2024-09-22T09:16:42.922201+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.922112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:28.190183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.964395+0000","last_change":"2024-09-22T09:16:38.964395+0000","last_active":"2024-09-22T09:16:38.964395+0000","last_peered":"2024-09-22T09:16:38.964395+0000","last_clean":"2024-09-22T09:16:38.964395+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:16:38.964395+0000","last_undegraded":"2024-09-22T09:16:38.964395+0000","last_fullsized":"2024-09-22T09:16:38.964395+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.964315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:37.172303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:42.787274+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:14:42.787274+0000","last_peered":"2024-09-22T09:14:42.787274+0000","last_clean":"2024-09-22T09:14:42.787274+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:14:42.787274+0000","last_undegraded":"2024-09-22T09:14:42.787274+0000","last_fullsized":"2024-09-22T09:14:42.787274+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:17.792500+0000","last_change":"2024-09-22T08:36:14.523117+0000","last_active":"2024-09-22T09:15:17.792500+0000","last_peered":"2024-09-22T09:15:17.792500+0000","last_clean":"2024-09-22T09:15:17.792500+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:15:17.792500+0000","last_undegraded":"2024-09-22T09:15:17.792500+0000","last_fullsized":"2024-09-22T09:15:17.792500+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:11.273689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.828769+0000","last_change":"2024-09-22T09:16:36.828769+0000","last_active":"2024-09-22T09:16:36.828769+0000","last_peered":"2024-09-22T09:16:36.828769+0000","last_clean":"2024-09-22T09:16:36.828769+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:16:36.828769+0000","last_undegraded":"2024-09-22T09:16:36.828769+0000","last_fullsized":"2024-09-22T09:16:36.828769+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.828686+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:56.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776681+0000","last_change":"2024-09-22T08:51:48.552852+0000","last_active":"2024-09-22T09:13:31.776681+0000","last_peered":"2024-09-22T09:13:31.776681+0000","last_clean":"2024-09-22T09:13:31.776681+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:13:31.776681+0000","last_undegraded":"2024-09-22T09:13:31.776681+0000","last_fullsized":"2024-09-22T09:13:31.776681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:22.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:02.107807+0000","last_change":"2024-09-22T08:36:17.553051+0000","last_active":"2024-09-22T09:16:02.107807+0000","last_peered":"2024-09-22T09:16:02.107807+0000","last_clean":"2024-09-22T09:16:02.107807+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:16:02.107807+0000","last_undegraded":"2024-09-22T09:16:02.107807+0000","last_fullsized":"2024-09-22T09:16:02.107807+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:20.899664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12859,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.898135+0000","last_change":"2024-09-22T09:16:41.898135+0000","last_active":"2024-09-22T09:16:41.898135+0000","last_peered":"2024-09-22T09:16:41.898135+0000","last_clean":"2024-09-22T09:16:41.898135+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:16:41.898135+0000","last_undegraded":"2024-09-22T09:16:41.898135+0000","last_fullsized":"2024-09-22T09:16:41.898135+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.898026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:27.564920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.964341+0000","last_change":"2024-09-22T09:16:36.964341+0000","last_active":"2024-09-22T09:16:36.964341+0000","last_peered":"2024-09-22T09:16:36.964341+0000","last_clean":"2024-09-22T09:16:36.964341+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:16:36.964341+0000","last_undegraded":"2024-09-22T09:16:36.964341+0000","last_fullsized":"2024-09-22T09:16:36.964341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.964266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:27.066433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:31.776802+0000","last_change":"2024-09-22T08:51:48.547680+0000","last_active":"2024-09-22T09:13:31.776802+0000","last_peered":"2024-09-22T09:13:31.776802+0000","last_clean":"2024-09-22T09:13:31.776802+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:13:31.776802+0000","last_undegraded":"2024-09-22T09:13:31.776802+0000","last_fullsized":"2024-09-22T09:13:31.776802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:49.227430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:27.785272+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:14:27.785272+0000","last_peered":"2024-09-22T09:14:27.785272+0000","last_clean":"2024-09-22T09:14:27.785272+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:14:27.785272+0000","last_undegraded":"2024-09-22T09:14:27.785272+0000","last_fullsized":"2024-09-22T09:14:27.785272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:52.797312+0000","last_change":"2024-09-22T08:36:14.522634+0000","last_active":"2024-09-22T09:15:52.797312+0000","last_peered":"2024-09-22T09:15:52.797312+0000","last_clean":"2024-09-22T09:15:52.797312+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:15:52.797312+0000","last_undegraded":"2024-09-22T09:15:52.797312+0000","last_fullsized":"2024-09-22T09:15:52.797312+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:42.059395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":283,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774945+0000","last_change":"2024-09-22T08:33:33.312017+0000","last_active":"2024-09-22T09:13:07.774945+0000","last_peered":"2024-09-22T09:13:07.774945+0000","last_clean":"2024-09-22T09:13:07.774945+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:13:07.774945+0000","last_undegraded":"2024-09-22T09:13:07.774945+0000","last_fullsized":"2024-09-22T09:13:07.774945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:49:01.730365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:41.769026+0000","last_change":"2024-09-22T08:51:48.550832+0000","last_active":"2024-09-22T09:12:41.769026+0000","last_peered":"2024-09-22T09:12:41.769026+0000","last_clean":"2024-09-22T09:12:41.769026+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:12:41.769026+0000","last_undegraded":"2024-09-22T09:12:41.769026+0000","last_fullsized":"2024-09-22T09:12:41.769026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:19.182284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.796777+0000","last_change":"2024-09-22T09:16:46.796777+0000","last_active":"2024-09-22T09:16:46.796777+0000","last_peered":"2024-09-22T09:16:46.796777+0000","last_clean":"2024-09-22T09:16:46.796777+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:16:46.796777+0000","last_undegraded":"2024-09-22T09:16:46.796777+0000","last_fullsized":"2024-09-22T09:16:46.796777+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.796697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:24.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.384345+0000","last_change":"2024-09-22T09:16:45.384345+0000","last_active":"2024-09-22T09:16:45.384345+0000","last_peered":"2024-09-22T09:16:45.384345+0000","last_clean":"2024-09-22T09:16:45.384345+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:16:45.384345+0000","last_undegraded":"2024-09-22T09:16:45.384345+0000","last_fullsized":"2024-09-22T09:16:45.384345+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.384229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:45.682719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774883+0000","last_change":"2024-09-22T08:33:33.311458+0000","last_active":"2024-09-22T09:13:07.774883+0000","last_peered":"2024-09-22T09:13:07.774883+0000","last_clean":"2024-09-22T09:13:07.774883+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:13:07.774883+0000","last_undegraded":"2024-09-22T09:13:07.774883+0000","last_fullsized":"2024-09-22T09:13:07.774883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:33:32.276047+0000","last_clean_scrub_stamp":"2024-09-22T08:33:32.276047+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:03.567184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:42.772169+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:12:42.772169+0000","last_peered":"2024-09-22T09:12:42.772169+0000","last_clean":"2024-09-22T09:12:42.772169+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:12:42.772169+0000","last_undegraded":"2024-09-22T09:12:42.772169+0000","last_fullsized":"2024-09-22T09:12:42.772169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:36:30.486529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.847390+0000","last_change":"2024-09-22T09:16:44.847390+0000","last_active":"2024-09-22T09:16:44.847390+0000","last_peered":"2024-09-22T09:16:44.847390+0000","last_clean":"2024-09-22T09:16:44.847390+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:16:44.847390+0000","last_undegraded":"2024-09-22T09:16:44.847390+0000","last_fullsized":"2024-09-22T09:16:44.847390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.847285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:48.377069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":62,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.145192+0000","last_change":"2024-09-22T09:16:40.145192+0000","last_active":"2024-09-22T09:16:40.145192+0000","last_peered":"2024-09-22T09:16:40.145192+0000","last_clean":"2024-09-22T09:16:40.145192+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:16:40.145192+0000","last_undegraded":"2024-09-22T09:16:40.145192+0000","last_fullsized":"2024-09-22T09:16:40.145192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.145086+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:02.203653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":95,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.012765+0000","last_change":"2024-09-22T09:16:38.012765+0000","last_active":"2024-09-22T09:16:38.012765+0000","last_peered":"2024-09-22T09:16:38.012765+0000","last_clean":"2024-09-22T09:16:38.012765+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:16:38.012765+0000","last_undegraded":"2024-09-22T09:16:38.012765+0000","last_fullsized":"2024-09-22T09:16:38.012765+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.012671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:31.079655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'395","reported_seq":1268,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.512963+0000","last_change":"2024-09-22T09:16:15.512963+0000","last_active":"2024-09-22T09:16:15.512963+0000","last_peered":"2024-09-22T09:16:15.512963+0000","last_clean":"2024-09-22T09:16:15.512963+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:15.512963+0000","last_undegraded":"2024-09-22T09:16:15.512963+0000","last_fullsized":"2024-09-22T09:16:15.512963+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.512820+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:16.248546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1437,"num_read_kb":46472,"num_write":1276,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'951","reported_seq":2510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.195229+0000","last_change":"2024-09-22T09:16:22.195229+0000","last_active":"2024-09-22T09:16:22.195229+0000","last_peered":"2024-09-22T09:16:22.195229+0000","last_clean":"2024-09-22T09:16:22.195229+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:16:22.195229+0000","last_undegraded":"2024-09-22T09:16:22.195229+0000","last_fullsized":"2024-09-22T09:16:22.195229+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'951","last_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_deep_scrub":"261'951","last_deep_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.195138+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:36.195944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'396","reported_seq":1093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.736969+0000","last_change":"2024-09-22T09:16:22.736969+0000","last_active":"2024-09-22T09:16:22.736969+0000","last_peered":"2024-09-22T09:16:22.736969+0000","last_clean":"2024-09-22T09:16:22.736969+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:22.736969+0000","last_undegraded":"2024-09-22T09:16:22.736969+0000","last_fullsized":"2024-09-22T09:16:22.736969+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.736820+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:22.398536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":784,"num_read_kb":45729,"num_write":1281,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'769","reported_seq":2195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.117657+0000","last_change":"2024-09-22T09:16:33.117657+0000","last_active":"2024-09-22T09:16:33.117657+0000","last_peered":"2024-09-22T09:16:33.117657+0000","last_clean":"2024-09-22T09:16:33.117657+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:16:33.117657+0000","last_undegraded":"2024-09-22T09:16:33.117657+0000","last_fullsized":"2024-09-22T09:16:33.117657+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'769","last_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_deep_scrub":"261'769","last_deep_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.117556+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:48.851231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.700568+0000","last_change":"2024-09-22T09:16:18.700568+0000","last_active":"2024-09-22T09:16:18.700568+0000","last_peered":"2024-09-22T09:16:18.700568+0000","last_clean":"2024-09-22T09:16:18.700568+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:18.700568+0000","last_undegraded":"2024-09-22T09:16:18.700568+0000","last_fullsized":"2024-09-22T09:16:18.700568+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'346","last_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_deep_scrub":"261'346","last_deep_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.700411+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:06.334626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":64388,"num_write":1226,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'499","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.084051+0000","last_change":"2024-09-22T09:16:34.084051+0000","last_active":"2024-09-22T09:16:34.084051+0000","last_peered":"2024-09-22T09:16:34.084051+0000","last_clean":"2024-09-22T09:16:34.084051+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:16:34.084051+0000","last_undegraded":"2024-09-22T09:16:34.084051+0000","last_fullsized":"2024-09-22T09:16:34.084051+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'499","last_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_deep_scrub":"261'499","last_deep_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.083973+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:29.818260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'394","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.909250+0000","last_change":"2024-09-22T09:16:15.909250+0000","last_active":"2024-09-22T09:16:15.909250+0000","last_peered":"2024-09-22T09:16:15.909250+0000","last_clean":"2024-09-22T09:16:15.909250+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:15.909250+0000","last_undegraded":"2024-09-22T09:16:15.909250+0000","last_fullsized":"2024-09-22T09:16:15.909250+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.909095+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:00.057217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":100163,"num_write":1151,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'536","reported_seq":2210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.721659+0000","last_change":"2024-09-22T09:16:25.721659+0000","last_active":"2024-09-22T09:16:25.721659+0000","last_peered":"2024-09-22T09:16:25.721659+0000","last_clean":"2024-09-22T09:16:25.721659+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:16:25.721659+0000","last_undegraded":"2024-09-22T09:16:25.721659+0000","last_fullsized":"2024-09-22T09:16:25.721659+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'536","last_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_deep_scrub":"261'536","last_deep_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.721574+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:07.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'374","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.484163+0000","last_change":"2024-09-22T09:16:16.484163+0000","last_active":"2024-09-22T09:16:16.484163+0000","last_peered":"2024-09-22T09:16:16.484163+0000","last_clean":"2024-09-22T09:16:16.484163+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:16.484163+0000","last_undegraded":"2024-09-22T09:16:16.484163+0000","last_fullsized":"2024-09-22T09:16:16.484163+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'374","last_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_deep_scrub":"261'374","last_deep_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.484052+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:58.010659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":101852,"num_write":1145,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'579","reported_seq":2244,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.486420+0000","last_change":"2024-09-22T09:16:21.486420+0000","last_active":"2024-09-22T09:16:21.486420+0000","last_peered":"2024-09-22T09:16:21.486420+0000","last_clean":"2024-09-22T09:16:21.486420+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:16:21.486420+0000","last_undegraded":"2024-09-22T09:16:21.486420+0000","last_fullsized":"2024-09-22T09:16:21.486420+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.486318+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.331269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'402","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.939126+0000","last_change":"2024-09-22T09:16:13.939126+0000","last_active":"2024-09-22T09:16:13.939126+0000","last_peered":"2024-09-22T09:16:13.939126+0000","last_clean":"2024-09-22T09:16:13.939126+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:13.939126+0000","last_undegraded":"2024-09-22T09:16:13.939126+0000","last_fullsized":"2024-09-22T09:16:13.939126+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.938974+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:23.382523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311674,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":20769,"num_write":1109,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1042","reported_seq":2592,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.481044+0000","last_change":"2024-09-22T09:16:22.481044+0000","last_active":"2024-09-22T09:16:22.481044+0000","last_peered":"2024-09-22T09:16:22.481044+0000","last_clean":"2024-09-22T09:16:22.481044+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:16:22.481044+0000","last_undegraded":"2024-09-22T09:16:22.481044+0000","last_fullsized":"2024-09-22T09:16:22.481044+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1042","last_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_deep_scrub":"261'1042","last_deep_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.480948+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:22.317236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'329","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.515526+0000","last_change":"2024-09-22T09:16:14.515526+0000","last_active":"2024-09-22T09:16:14.515526+0000","last_peered":"2024-09-22T09:16:14.515526+0000","last_clean":"2024-09-22T09:16:14.515526+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:14.515526+0000","last_undegraded":"2024-09-22T09:16:14.515526+0000","last_fullsized":"2024-09-22T09:16:14.515526+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.515318+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:36.695819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":9376,"num_write":1029,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'497","reported_seq":2098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.940307+0000","last_change":"2024-09-22T09:16:22.940307+0000","last_active":"2024-09-22T09:16:22.940307+0000","last_peered":"2024-09-22T09:16:22.940307+0000","last_clean":"2024-09-22T09:16:22.940307+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:16:22.940307+0000","last_undegraded":"2024-09-22T09:16:22.940307+0000","last_fullsized":"2024-09-22T09:16:22.940307+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'497","last_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_deep_scrub":"261'497","last_deep_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.940226+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:57.523147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'376","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.716405+0000","last_change":"2024-09-22T09:16:20.716405+0000","last_active":"2024-09-22T09:16:20.716405+0000","last_peered":"2024-09-22T09:16:20.716405+0000","last_clean":"2024-09-22T09:16:20.716405+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:20.716405+0000","last_undegraded":"2024-09-22T09:16:20.716405+0000","last_fullsized":"2024-09-22T09:16:20.716405+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.716279+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:27.920378+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":772,"num_read_kb":32992,"num_write":1092,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'641","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.692287+0000","last_change":"2024-09-22T09:16:31.692287+0000","last_active":"2024-09-22T09:16:31.692287+0000","last_peered":"2024-09-22T09:16:31.692287+0000","last_clean":"2024-09-22T09:16:31.692287+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:16:31.692287+0000","last_undegraded":"2024-09-22T09:16:31.692287+0000","last_fullsized":"2024-09-22T09:16:31.692287+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'641","last_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_deep_scrub":"261'641","last_deep_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.692200+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:29.079608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'403","reported_seq":1992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.153849+0000","last_change":"2024-09-22T09:16:32.153849+0000","last_active":"2024-09-22T09:16:32.153849+0000","last_peered":"2024-09-22T09:16:32.153849+0000","last_clean":"2024-09-22T09:16:32.153849+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:16:32.153849+0000","last_undegraded":"2024-09-22T09:16:32.153849+0000","last_fullsized":"2024-09-22T09:16:32.153849+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.153759+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:38.043677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'303","reported_seq":928,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207647+0000","last_change":"2024-09-22T09:16:13.207647+0000","last_active":"2024-09-22T09:16:13.207647+0000","last_peered":"2024-09-22T09:16:13.207647+0000","last_clean":"2024-09-22T09:16:13.207647+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:13.207647+0000","last_undegraded":"2024-09-22T09:16:13.207647+0000","last_fullsized":"2024-09-22T09:16:13.207647+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.207542+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:43.122476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947307,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":25983,"num_write":980,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'394","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.525921+0000","last_change":"2024-09-22T09:16:20.525921+0000","last_active":"2024-09-22T09:16:20.525921+0000","last_peered":"2024-09-22T09:16:20.525921+0000","last_clean":"2024-09-22T09:16:20.525921+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:16:20.525921+0000","last_undegraded":"2024-09-22T09:16:20.525921+0000","last_fullsized":"2024-09-22T09:16:20.525921+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.525816+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:17.576244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'287","reported_seq":876,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.499416+0000","last_change":"2024-09-22T09:16:13.499416+0000","last_active":"2024-09-22T09:16:13.499416+0000","last_peered":"2024-09-22T09:16:13.499416+0000","last_clean":"2024-09-22T09:16:13.499416+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:13.499416+0000","last_undegraded":"2024-09-22T09:16:13.499416+0000","last_fullsized":"2024-09-22T09:16:13.499416+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.499276+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:01.659857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":451,"num_read_kb":1407,"num_write":876,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'766","reported_seq":2327,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.200824+0000","last_change":"2024-09-22T09:16:19.200824+0000","last_active":"2024-09-22T09:16:19.200824+0000","last_peered":"2024-09-22T09:16:19.200824+0000","last_clean":"2024-09-22T09:16:19.200824+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:16:19.200824+0000","last_undegraded":"2024-09-22T09:16:19.200824+0000","last_fullsized":"2024-09-22T09:16:19.200824+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'766","last_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_deep_scrub":"261'766","last_deep_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.200744+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:48.695705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'305","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.529861+0000","last_change":"2024-09-22T09:16:11.529861+0000","last_active":"2024-09-22T09:16:11.529861+0000","last_peered":"2024-09-22T09:16:11.529861+0000","last_clean":"2024-09-22T09:16:11.529861+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:11.529861+0000","last_undegraded":"2024-09-22T09:16:11.529861+0000","last_fullsized":"2024-09-22T09:16:11.529861+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.529676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:25.488246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":31210,"num_write":1028,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'771","reported_seq":2408,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.151660+0000","last_change":"2024-09-22T09:16:22.151660+0000","last_active":"2024-09-22T09:16:22.151660+0000","last_peered":"2024-09-22T09:16:22.151660+0000","last_clean":"2024-09-22T09:16:22.151660+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:16:22.151660+0000","last_undegraded":"2024-09-22T09:16:22.151660+0000","last_fullsized":"2024-09-22T09:16:22.151660+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'771","last_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_deep_scrub":"261'771","last_deep_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.151579+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:39.550280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1777,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'326","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.538362+0000","last_change":"2024-09-22T09:16:12.538362+0000","last_active":"2024-09-22T09:16:12.538362+0000","last_peered":"2024-09-22T09:16:12.538362+0000","last_clean":"2024-09-22T09:16:12.538362+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:12.538362+0000","last_undegraded":"2024-09-22T09:16:12.538362+0000","last_fullsized":"2024-09-22T09:16:12.538362+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.538192+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:14.191967+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655876,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":639,"num_read_kb":14450,"num_write":1076,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.697183+0000","last_change":"2024-09-22T09:16:30.697183+0000","last_active":"2024-09-22T09:16:30.697183+0000","last_peered":"2024-09-22T09:16:30.697183+0000","last_clean":"2024-09-22T09:16:30.697183+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:16:30.697183+0000","last_undegraded":"2024-09-22T09:16:30.697183+0000","last_fullsized":"2024-09-22T09:16:30.697183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.697081+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:28.453426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'352","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.247778+0000","last_change":"2024-09-22T09:16:14.247778+0000","last_active":"2024-09-22T09:16:14.247778+0000","last_peered":"2024-09-22T09:16:14.247778+0000","last_clean":"2024-09-22T09:16:14.247778+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:14.247778+0000","last_undegraded":"2024-09-22T09:16:14.247778+0000","last_fullsized":"2024-09-22T09:16:14.247778+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.247594+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:36.776380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1523,"num_write":1216,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'583","reported_seq":2209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.184302+0000","last_change":"2024-09-22T09:16:20.184302+0000","last_active":"2024-09-22T09:16:20.184302+0000","last_peered":"2024-09-22T09:16:20.184302+0000","last_clean":"2024-09-22T09:16:20.184302+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:16:20.184302+0000","last_undegraded":"2024-09-22T09:16:20.184302+0000","last_fullsized":"2024-09-22T09:16:20.184302+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'583","last_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_deep_scrub":"261'583","last_deep_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.184210+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:24.340294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1226,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'419","reported_seq":1094,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.209011+0000","last_change":"2024-09-22T09:16:17.209011+0000","last_active":"2024-09-22T09:16:17.209011+0000","last_peered":"2024-09-22T09:16:17.209011+0000","last_clean":"2024-09-22T09:16:17.209011+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:17.209011+0000","last_undegraded":"2024-09-22T09:16:17.209011+0000","last_fullsized":"2024-09-22T09:16:17.209011+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.208816+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:49.867009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":782,"num_read_kb":14779,"num_write":1492,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'123","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.600494+0000","last_change":"2024-09-22T09:16:33.600494+0000","last_active":"2024-09-22T09:16:33.600494+0000","last_peered":"2024-09-22T09:16:33.600494+0000","last_clean":"2024-09-22T09:16:33.600494+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:16:33.600494+0000","last_undegraded":"2024-09-22T09:16:33.600494+0000","last_fullsized":"2024-09-22T09:16:33.600494+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.600393+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:39.719506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'998","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.196121+0000","last_change":"2024-09-22T09:16:21.196121+0000","last_active":"2024-09-22T09:16:21.196121+0000","last_peered":"2024-09-22T09:16:21.196121+0000","last_clean":"2024-09-22T09:16:21.196121+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:16:21.196121+0000","last_undegraded":"2024-09-22T09:16:21.196121+0000","last_fullsized":"2024-09-22T09:16:21.196121+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'998","last_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_deep_scrub":"261'998","last_deep_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.196028+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:20.279066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'370","reported_seq":1248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.233157+0000","last_change":"2024-09-22T09:16:16.233157+0000","last_active":"2024-09-22T09:16:16.233157+0000","last_peered":"2024-09-22T09:16:16.233157+0000","last_clean":"2024-09-22T09:16:16.233157+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:16.233157+0000","last_undegraded":"2024-09-22T09:16:16.233157+0000","last_fullsized":"2024-09-22T09:16:16.233157+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'370","last_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_deep_scrub":"261'370","last_deep_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.233008+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:54.584470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1344,"num_read_kb":67744,"num_write":1254,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.036882+0000","last_change":"2024-09-22T09:16:39.036882+0000","last_active":"2024-09-22T09:16:39.036882+0000","last_peered":"2024-09-22T09:16:39.036882+0000","last_clean":"2024-09-22T09:16:39.036882+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:16:39.036882+0000","last_undegraded":"2024-09-22T09:16:39.036882+0000","last_fullsized":"2024-09-22T09:16:39.036882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.036799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:34:43.889677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'349","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.645001+0000","last_change":"2024-09-22T09:16:36.645001+0000","last_active":"2024-09-22T09:16:36.645001+0000","last_peered":"2024-09-22T09:16:36.645001+0000","last_clean":"2024-09-22T09:16:36.645001+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:16:36.645001+0000","last_undegraded":"2024-09-22T09:16:36.645001+0000","last_fullsized":"2024-09-22T09:16:36.645001+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.644903+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.282957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1201,"num_write":446,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.193051+0000","last_change":"2024-09-22T09:16:34.193051+0000","last_active":"2024-09-22T09:16:34.193051+0000","last_peered":"2024-09-22T09:16:34.193051+0000","last_clean":"2024-09-22T09:16:34.193051+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:16:34.193051+0000","last_undegraded":"2024-09-22T09:16:34.193051+0000","last_fullsized":"2024-09-22T09:16:34.193051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.192958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:01.619450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'150","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.205571+0000","last_change":"2024-09-22T09:16:37.205571+0000","last_active":"2024-09-22T09:16:37.205571+0000","last_peered":"2024-09-22T09:16:37.205571+0000","last_clean":"2024-09-22T09:16:37.205571+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:16:37.205571+0000","last_undegraded":"2024-09-22T09:16:37.205571+0000","last_fullsized":"2024-09-22T09:16:37.205571+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'150","last_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_deep_scrub":"261'150","last_deep_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.205475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:37.338187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'467","reported_seq":2137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.208019+0000","last_change":"2024-09-22T09:16:29.208019+0000","last_active":"2024-09-22T09:16:29.208019+0000","last_peered":"2024-09-22T09:16:29.208019+0000","last_clean":"2024-09-22T09:16:29.208019+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:16:29.208019+0000","last_undegraded":"2024-09-22T09:16:29.208019+0000","last_fullsized":"2024-09-22T09:16:29.208019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.207926+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:10.096936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'376","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.202024+0000","last_change":"2024-09-22T09:16:15.202024+0000","last_active":"2024-09-22T09:16:15.202024+0000","last_peered":"2024-09-22T09:16:15.202024+0000","last_clean":"2024-09-22T09:16:15.202024+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:15.202024+0000","last_undegraded":"2024-09-22T09:16:15.202024+0000","last_fullsized":"2024-09-22T09:16:15.202024+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.201907+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:52.431996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":649,"num_read_kb":11781,"num_write":1236,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.676949+0000","last_change":"2024-09-22T09:16:28.676949+0000","last_active":"2024-09-22T09:16:28.676949+0000","last_peered":"2024-09-22T09:16:28.676949+0000","last_clean":"2024-09-22T09:16:28.676949+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:16:28.676949+0000","last_undegraded":"2024-09-22T09:16:28.676949+0000","last_fullsized":"2024-09-22T09:16:28.676949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.676822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:02.194477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'92","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.189670+0000","last_change":"2024-09-22T09:16:30.189670+0000","last_active":"2024-09-22T09:16:30.189670+0000","last_peered":"2024-09-22T09:16:30.189670+0000","last_clean":"2024-09-22T09:16:30.189670+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:16:30.189670+0000","last_undegraded":"2024-09-22T09:16:30.189670+0000","last_fullsized":"2024-09-22T09:16:30.189670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.189584+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:48.517209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.189325+0000","last_change":"2024-09-22T09:16:33.189325+0000","last_active":"2024-09-22T09:16:33.189325+0000","last_peered":"2024-09-22T09:16:33.189325+0000","last_clean":"2024-09-22T09:16:33.189325+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:16:33.189325+0000","last_undegraded":"2024-09-22T09:16:33.189325+0000","last_fullsized":"2024-09-22T09:16:33.189325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.189234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:09.142849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'142","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.315990+0000","last_change":"2024-09-22T09:16:36.315990+0000","last_active":"2024-09-22T09:16:36.315990+0000","last_peered":"2024-09-22T09:16:36.315990+0000","last_clean":"2024-09-22T09:16:36.315990+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:16:36.315990+0000","last_undegraded":"2024-09-22T09:16:36.315990+0000","last_fullsized":"2024-09-22T09:16:36.315990+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.315902+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:30.170908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.695681+0000","last_change":"2024-09-22T09:16:26.695681+0000","last_active":"2024-09-22T09:16:26.695681+0000","last_peered":"2024-09-22T09:16:26.695681+0000","last_clean":"2024-09-22T09:16:26.695681+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:16:26.695681+0000","last_undegraded":"2024-09-22T09:16:26.695681+0000","last_fullsized":"2024-09-22T09:16:26.695681+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.695595+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:50:56.527592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'316","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.273692+0000","last_change":"2024-09-22T09:16:18.273692+0000","last_active":"2024-09-22T09:16:18.273692+0000","last_peered":"2024-09-22T09:16:18.273692+0000","last_clean":"2024-09-22T09:16:18.273692+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:18.273692+0000","last_undegraded":"2024-09-22T09:16:18.273692+0000","last_fullsized":"2024-09-22T09:16:18.273692+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'316","last_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_deep_scrub":"261'316","last_deep_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.273530+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:43.936947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":672,"num_read_kb":483,"num_write":1016,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676439+0000","last_change":"2024-09-22T09:16:29.676439+0000","last_active":"2024-09-22T09:16:29.676439+0000","last_peered":"2024-09-22T09:16:29.676439+0000","last_clean":"2024-09-22T09:16:29.676439+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:16:29.676439+0000","last_undegraded":"2024-09-22T09:16:29.676439+0000","last_fullsized":"2024-09-22T09:16:29.676439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:03.918455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'127","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.660505+0000","last_change":"2024-09-22T09:16:35.660505+0000","last_active":"2024-09-22T09:16:35.660505+0000","last_peered":"2024-09-22T09:16:35.660505+0000","last_clean":"2024-09-22T09:16:35.660505+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:16:35.660505+0000","last_undegraded":"2024-09-22T09:16:35.660505+0000","last_fullsized":"2024-09-22T09:16:35.660505+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.660394+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:18.158723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'794","reported_seq":2567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:03.082506+0000","last_change":"2024-09-22T08:17:46.353665+0000","last_active":"2024-09-22T09:16:03.082506+0000","last_peered":"2024-09-22T09:16:03.082506+0000","last_clean":"2024-09-22T09:16:03.082506+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:03.082506+0000","last_undegraded":"2024-09-22T09:16:03.082506+0000","last_fullsized":"2024-09-22T09:16:03.082506+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:40.550036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'185","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.906240+0000","last_change":"2024-09-22T09:16:34.906240+0000","last_active":"2024-09-22T09:16:34.906240+0000","last_peered":"2024-09-22T09:16:34.906240+0000","last_clean":"2024-09-22T09:16:34.906240+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:16:34.906240+0000","last_undegraded":"2024-09-22T09:16:34.906240+0000","last_fullsized":"2024-09-22T09:16:34.906240+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'185","last_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_deep_scrub":"261'185","last_deep_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.906160+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:30.698172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'510","reported_seq":2224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.721488+0000","last_change":"2024-09-22T09:16:27.721488+0000","last_active":"2024-09-22T09:16:27.721488+0000","last_peered":"2024-09-22T09:16:27.721488+0000","last_clean":"2024-09-22T09:16:27.721488+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:16:27.721488+0000","last_undegraded":"2024-09-22T09:16:27.721488+0000","last_fullsized":"2024-09-22T09:16:27.721488+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.721372+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:34.833972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'402","reported_seq":1071,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.110814+0000","last_change":"2024-09-22T09:16:09.110814+0000","last_active":"2024-09-22T09:16:09.110814+0000","last_peered":"2024-09-22T09:16:09.110814+0000","last_clean":"2024-09-22T09:16:09.110814+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:09.110814+0000","last_undegraded":"2024-09-22T09:16:09.110814+0000","last_fullsized":"2024-09-22T09:16:09.110814+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.110739+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:11.343495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":777,"num_read_kb":8421,"num_write":1262,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.036919+0000","last_change":"2024-09-22T09:16:40.036919+0000","last_active":"2024-09-22T09:16:40.036919+0000","last_peered":"2024-09-22T09:16:40.036919+0000","last_clean":"2024-09-22T09:16:40.036919+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:16:40.036919+0000","last_undegraded":"2024-09-22T09:16:40.036919+0000","last_fullsized":"2024-09-22T09:16:40.036919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.036819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:53.136015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'298","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.992797+0000","last_change":"2024-09-22T09:16:26.992797+0000","last_active":"2024-09-22T09:16:26.992797+0000","last_peered":"2024-09-22T09:16:26.992797+0000","last_clean":"2024-09-22T09:16:26.992797+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:26.992797+0000","last_undegraded":"2024-09-22T09:16:26.992797+0000","last_fullsized":"2024-09-22T09:16:26.992797+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.992702+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:45.241158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'815","reported_seq":2616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.839128+0000","last_change":"2024-09-22T09:16:41.839128+0000","last_active":"2024-09-22T09:16:41.839128+0000","last_peered":"2024-09-22T09:16:41.839128+0000","last_clean":"2024-09-22T09:16:41.839128+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:41.839128+0000","last_undegraded":"2024-09-22T09:16:41.839128+0000","last_fullsized":"2024-09-22T09:16:41.839128+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.839029+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:42:06.512324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'412","reported_seq":1974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.254280+0000","last_change":"2024-09-22T09:16:25.254280+0000","last_active":"2024-09-22T09:16:25.254280+0000","last_peered":"2024-09-22T09:16:25.254280+0000","last_clean":"2024-09-22T09:16:25.254280+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:16:25.254280+0000","last_undegraded":"2024-09-22T09:16:25.254280+0000","last_fullsized":"2024-09-22T09:16:25.254280+0000","mapping_epoch":27,"log_start":"261'401","ondisk_log_start":"261'401","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'412","last_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_deep_scrub":"261'412","last_deep_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.254178+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:55.621599+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'375","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.571610+0000","last_change":"2024-09-22T09:16:10.571562+0000","last_active":"2024-09-22T09:16:10.571610+0000","last_peered":"2024-09-22T09:16:10.571610+0000","last_clean":"2024-09-22T09:16:10.571610+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:10.571610+0000","last_undegraded":"2024-09-22T09:16:10.571610+0000","last_fullsized":"2024-09-22T09:16:10.571610+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.571456+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:35.266733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":44787,"num_write":1101,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.216317+0000","last_change":"2024-09-22T09:16:23.216317+0000","last_active":"2024-09-22T09:16:23.216317+0000","last_peered":"2024-09-22T09:16:23.216317+0000","last_clean":"2024-09-22T09:16:23.216317+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:16:23.216317+0000","last_undegraded":"2024-09-22T09:16:23.216317+0000","last_fullsized":"2024-09-22T09:16:23.216317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.216231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:44.267586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'360","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.587861+0000","last_change":"2024-09-22T09:16:27.587861+0000","last_active":"2024-09-22T09:16:27.587861+0000","last_peered":"2024-09-22T09:16:27.587861+0000","last_clean":"2024-09-22T09:16:27.587861+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:27.587861+0000","last_undegraded":"2024-09-22T09:16:27.587861+0000","last_fullsized":"2024-09-22T09:16:27.587861+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'360","last_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_deep_scrub":"261'360","last_deep_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.587755+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:54.278181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.254294+0000","last_change":"2024-09-22T09:16:33.254294+0000","last_active":"2024-09-22T09:16:33.254294+0000","last_peered":"2024-09-22T09:16:33.254294+0000","last_clean":"2024-09-22T09:16:33.254294+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:16:33.254294+0000","last_undegraded":"2024-09-22T09:16:33.254294+0000","last_fullsized":"2024-09-22T09:16:33.254294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.254209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:27.817340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'561","reported_seq":1381,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.918170+0000","last_change":"2024-09-22T09:16:33.918170+0000","last_active":"2024-09-22T09:16:33.918170+0000","last_peered":"2024-09-22T09:16:33.918170+0000","last_clean":"2024-09-22T09:16:33.918170+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:16:33.918170+0000","last_undegraded":"2024-09-22T09:16:33.918170+0000","last_fullsized":"2024-09-22T09:16:33.918170+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'561","last_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_deep_scrub":"261'561","last_deep_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.918083+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:22.619736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'825","reported_seq":2462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.195453+0000","last_change":"2024-09-22T09:16:14.195453+0000","last_active":"2024-09-22T09:16:14.195453+0000","last_peered":"2024-09-22T09:16:14.195453+0000","last_clean":"2024-09-22T09:16:14.195453+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:16:14.195453+0000","last_undegraded":"2024-09-22T09:16:14.195453+0000","last_fullsized":"2024-09-22T09:16:14.195453+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'825","last_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_deep_scrub":"261'825","last_deep_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.195374+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:30.730771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'359","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.848770+0000","last_change":"2024-09-22T09:16:08.848770+0000","last_active":"2024-09-22T09:16:08.848770+0000","last_peered":"2024-09-22T09:16:08.848770+0000","last_clean":"2024-09-22T09:16:08.848770+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:08.848770+0000","last_undegraded":"2024-09-22T09:16:08.848770+0000","last_fullsized":"2024-09-22T09:16:08.848770+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.848662+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:01.073654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":29046,"num_write":1024,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.183966+0000","last_change":"2024-09-22T09:16:25.183966+0000","last_active":"2024-09-22T09:16:25.183966+0000","last_peered":"2024-09-22T09:16:25.183966+0000","last_clean":"2024-09-22T09:16:25.183966+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:16:25.183966+0000","last_undegraded":"2024-09-22T09:16:25.183966+0000","last_fullsized":"2024-09-22T09:16:25.183966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.183868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:41.982899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.660025+0000","last_change":"2024-09-22T09:16:33.660025+0000","last_active":"2024-09-22T09:16:33.660025+0000","last_peered":"2024-09-22T09:16:33.660025+0000","last_clean":"2024-09-22T09:16:33.660025+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:16:33.660025+0000","last_undegraded":"2024-09-22T09:16:33.660025+0000","last_fullsized":"2024-09-22T09:16:33.660025+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.659907+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:49.474414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45093,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":1000,"num_write":352,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.573049+0000","last_change":"2024-09-22T09:16:40.573049+0000","last_active":"2024-09-22T09:16:40.573049+0000","last_peered":"2024-09-22T09:16:40.573049+0000","last_clean":"2024-09-22T09:16:40.573049+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:16:40.573049+0000","last_undegraded":"2024-09-22T09:16:40.573049+0000","last_fullsized":"2024-09-22T09:16:40.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.572966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:43.876946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2491","reported_seq":4326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.158050+0000","last_change":"2024-09-22T09:16:35.158050+0000","last_active":"2024-09-22T09:16:35.158050+0000","last_peered":"2024-09-22T09:16:35.158050+0000","last_clean":"2024-09-22T09:16:35.158050+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:16:35.158050+0000","last_undegraded":"2024-09-22T09:16:35.158050+0000","last_fullsized":"2024-09-22T09:16:35.158050+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2491","last_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_deep_scrub":"261'2491","last_deep_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.157954+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:48.968960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'409","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.934530+0000","last_change":"2024-09-22T09:16:16.934474+0000","last_active":"2024-09-22T09:16:16.934530+0000","last_peered":"2024-09-22T09:16:16.934530+0000","last_clean":"2024-09-22T09:16:16.934530+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:16:16.934530+0000","last_undegraded":"2024-09-22T09:16:16.934530+0000","last_fullsized":"2024-09-22T09:16:16.934530+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.934388+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:53.392109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'366","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.276481+0000","last_change":"2024-09-22T09:16:17.276481+0000","last_active":"2024-09-22T09:16:17.276481+0000","last_peered":"2024-09-22T09:16:17.276481+0000","last_clean":"2024-09-22T09:16:17.276481+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:17.276481+0000","last_undegraded":"2024-09-22T09:16:17.276481+0000","last_fullsized":"2024-09-22T09:16:17.276481+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.276321+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:57.728982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":639,"num_read_kb":70122,"num_write":1105,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.640762+0000","last_change":"2024-09-22T09:16:32.640762+0000","last_active":"2024-09-22T09:16:32.640762+0000","last_peered":"2024-09-22T09:16:32.640762+0000","last_clean":"2024-09-22T09:16:32.640762+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:16:32.640762+0000","last_undegraded":"2024-09-22T09:16:32.640762+0000","last_fullsized":"2024-09-22T09:16:32.640762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.640677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:25.874693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'365","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.102662+0000","last_change":"2024-09-22T09:16:43.102662+0000","last_active":"2024-09-22T09:16:43.102662+0000","last_peered":"2024-09-22T09:16:43.102662+0000","last_clean":"2024-09-22T09:16:43.102662+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:16:43.102662+0000","last_undegraded":"2024-09-22T09:16:43.102662+0000","last_fullsized":"2024-09-22T09:16:43.102662+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.102571+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:22.471531+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1278,"num_write":480,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'815","reported_seq":4742,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.775015+0000","last_change":"2024-09-22T09:16:39.775015+0000","last_active":"2024-09-22T09:16:39.775015+0000","last_peered":"2024-09-22T09:16:39.775015+0000","last_clean":"2024-09-22T09:16:39.775015+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:39.775015+0000","last_undegraded":"2024-09-22T09:16:39.775015+0000","last_fullsized":"2024-09-22T09:16:39.775015+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.774931+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:35.874772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'123","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.264089+0000","last_change":"2024-09-22T09:16:35.264089+0000","last_active":"2024-09-22T09:16:35.264089+0000","last_peered":"2024-09-22T09:16:35.264089+0000","last_clean":"2024-09-22T09:16:35.264089+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:16:35.264089+0000","last_undegraded":"2024-09-22T09:16:35.264089+0000","last_fullsized":"2024-09-22T09:16:35.264089+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.263984+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:43.868350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1208","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.713666+0000","last_change":"2024-09-22T09:16:24.713666+0000","last_active":"2024-09-22T09:16:24.713666+0000","last_peered":"2024-09-22T09:16:24.713666+0000","last_clean":"2024-09-22T09:16:24.713666+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:16:24.713666+0000","last_undegraded":"2024-09-22T09:16:24.713666+0000","last_fullsized":"2024-09-22T09:16:24.713666+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1208","last_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_deep_scrub":"261'1208","last_deep_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.713578+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:01.700381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'358","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:07.592091+0000","last_change":"2024-09-22T09:16:07.591997+0000","last_active":"2024-09-22T09:16:07.592091+0000","last_peered":"2024-09-22T09:16:07.592091+0000","last_clean":"2024-09-22T09:16:07.592091+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:07.592091+0000","last_undegraded":"2024-09-22T09:16:07.592091+0000","last_fullsized":"2024-09-22T09:16:07.592091+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_clean_scrub_stamp":"2024-09-22T09:16:07.591858+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:25.904081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":651,"num_read_kb":2439,"num_write":1161,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.192204+0000","last_change":"2024-09-22T09:16:24.192204+0000","last_active":"2024-09-22T09:16:24.192204+0000","last_peered":"2024-09-22T09:16:24.192204+0000","last_clean":"2024-09-22T09:16:24.192204+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:16:24.192204+0000","last_undegraded":"2024-09-22T09:16:24.192204+0000","last_fullsized":"2024-09-22T09:16:24.192204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.192115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:19.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'503","reported_seq":1142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.613309+0000","last_change":"2024-09-22T09:16:32.613309+0000","last_active":"2024-09-22T09:16:32.613309+0000","last_peered":"2024-09-22T09:16:32.613309+0000","last_clean":"2024-09-22T09:16:32.613309+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:32.613309+0000","last_undegraded":"2024-09-22T09:16:32.613309+0000","last_fullsized":"2024-09-22T09:16:32.613309+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'503","last_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_deep_scrub":"261'503","last_deep_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.613214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:23.175984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":879,"num_read_kb":2151,"num_write":728,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.774927+0000","last_change":"2024-09-22T09:16:37.774927+0000","last_active":"2024-09-22T09:16:37.774927+0000","last_peered":"2024-09-22T09:16:37.774927+0000","last_clean":"2024-09-22T09:16:37.774927+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:16:37.774927+0000","last_undegraded":"2024-09-22T09:16:37.774927+0000","last_fullsized":"2024-09-22T09:16:37.774927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.774829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:35.076905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'133","reported_seq":635,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.813243+0000","last_change":"2024-09-22T09:16:32.813243+0000","last_active":"2024-09-22T09:16:32.813243+0000","last_peered":"2024-09-22T09:16:32.813243+0000","last_clean":"2024-09-22T09:16:32.813243+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:16:32.813243+0000","last_undegraded":"2024-09-22T09:16:32.813243+0000","last_fullsized":"2024-09-22T09:16:32.813243+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'133","last_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_deep_scrub":"261'133","last_deep_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.813146+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:05.926213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.443183+0000","last_change":"2024-09-22T09:16:17.443183+0000","last_active":"2024-09-22T09:16:17.443183+0000","last_peered":"2024-09-22T09:16:17.443183+0000","last_clean":"2024-09-22T09:16:17.443183+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:16:17.443183+0000","last_undegraded":"2024-09-22T09:16:17.443183+0000","last_fullsized":"2024-09-22T09:16:17.443183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'866","last_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_deep_scrub":"261'866","last_deep_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.443086+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:08.368887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'403","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.839046+0000","last_change":"2024-09-22T09:16:11.839046+0000","last_active":"2024-09-22T09:16:11.839046+0000","last_peered":"2024-09-22T09:16:11.839046+0000","last_clean":"2024-09-22T09:16:11.839046+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:11.839046+0000","last_undegraded":"2024-09-22T09:16:11.839046+0000","last_fullsized":"2024-09-22T09:16:11.839046+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.838921+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:56:29.399743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":12203,"num_write":1274,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.688842+0000","last_change":"2024-09-22T09:16:24.688842+0000","last_active":"2024-09-22T09:16:24.688842+0000","last_peered":"2024-09-22T09:16:24.688842+0000","last_clean":"2024-09-22T09:16:24.688842+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:16:24.688842+0000","last_undegraded":"2024-09-22T09:16:24.688842+0000","last_fullsized":"2024-09-22T09:16:24.688842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.688752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:06.256561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'307","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.144583+0000","last_change":"2024-09-22T09:16:28.144583+0000","last_active":"2024-09-22T09:16:28.144583+0000","last_peered":"2024-09-22T09:16:28.144583+0000","last_clean":"2024-09-22T09:16:28.144583+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:16:28.144583+0000","last_undegraded":"2024-09-22T09:16:28.144583+0000","last_fullsized":"2024-09-22T09:16:28.144583+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.144472+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:57.321893+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48624,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":466,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.679467+0000","last_change":"2024-09-22T09:16:28.679467+0000","last_active":"2024-09-22T09:16:28.679467+0000","last_peered":"2024-09-22T09:16:28.679467+0000","last_clean":"2024-09-22T09:16:28.679467+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:16:28.679467+0000","last_undegraded":"2024-09-22T09:16:28.679467+0000","last_fullsized":"2024-09-22T09:16:28.679467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.679355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:11.686705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'180","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.814844+0000","last_change":"2024-09-22T09:16:42.814844+0000","last_active":"2024-09-22T09:16:42.814844+0000","last_peered":"2024-09-22T09:16:42.814844+0000","last_clean":"2024-09-22T09:16:42.814844+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:16:42.814844+0000","last_undegraded":"2024-09-22T09:16:42.814844+0000","last_fullsized":"2024-09-22T09:16:42.814844+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'180","last_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_deep_scrub":"261'180","last_deep_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.814757+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:44.221228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'372","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.170508+0000","last_change":"2024-09-22T09:16:28.170508+0000","last_active":"2024-09-22T09:16:28.170508+0000","last_peered":"2024-09-22T09:16:28.170508+0000","last_clean":"2024-09-22T09:16:28.170508+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:16:28.170508+0000","last_undegraded":"2024-09-22T09:16:28.170508+0000","last_fullsized":"2024-09-22T09:16:28.170508+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.170412+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:09.100145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'472","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207139+0000","last_change":"2024-09-22T09:16:13.207072+0000","last_active":"2024-09-22T09:16:13.207139+0000","last_peered":"2024-09-22T09:16:13.207139+0000","last_clean":"2024-09-22T09:16:13.207139+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:13.207139+0000","last_undegraded":"2024-09-22T09:16:13.207139+0000","last_fullsized":"2024-09-22T09:16:13.207139+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'472","last_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_deep_scrub":"261'472","last_deep_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.206750+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:12.619430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311644,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1051,"num_read_kb":33703,"num_write":1406,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.683650+0000","last_change":"2024-09-22T09:16:33.683650+0000","last_active":"2024-09-22T09:16:33.683650+0000","last_peered":"2024-09-22T09:16:33.683650+0000","last_clean":"2024-09-22T09:16:33.683650+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:16:33.683650+0000","last_undegraded":"2024-09-22T09:16:33.683650+0000","last_fullsized":"2024-09-22T09:16:33.683650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.683559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:32.388730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'325","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.757279+0000","last_change":"2024-09-22T09:16:35.757279+0000","last_active":"2024-09-22T09:16:35.757279+0000","last_peered":"2024-09-22T09:16:35.757279+0000","last_clean":"2024-09-22T09:16:35.757279+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:16:35.757279+0000","last_undegraded":"2024-09-22T09:16:35.757279+0000","last_fullsized":"2024-09-22T09:16:35.757279+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.757181+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:50.937583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50318,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":418,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'795","reported_seq":4278,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.686198+0000","last_change":"2024-09-22T09:16:27.686198+0000","last_active":"2024-09-22T09:16:27.686198+0000","last_peered":"2024-09-22T09:16:27.686198+0000","last_clean":"2024-09-22T09:16:27.686198+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:27.686198+0000","last_undegraded":"2024-09-22T09:16:27.686198+0000","last_fullsized":"2024-09-22T09:16:27.686198+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.686099+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:44.296879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'144","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.217813+0000","last_change":"2024-09-22T09:16:34.217813+0000","last_active":"2024-09-22T09:16:34.217813+0000","last_peered":"2024-09-22T09:16:34.217813+0000","last_clean":"2024-09-22T09:16:34.217813+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:16:34.217813+0000","last_undegraded":"2024-09-22T09:16:34.217813+0000","last_fullsized":"2024-09-22T09:16:34.217813+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'144","last_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_deep_scrub":"261'144","last_deep_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.217722+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:32.109666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'507","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.890344+0000","last_change":"2024-09-22T09:16:17.890344+0000","last_active":"2024-09-22T09:16:17.890344+0000","last_peered":"2024-09-22T09:16:17.890344+0000","last_clean":"2024-09-22T09:16:17.890344+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:16:17.890344+0000","last_undegraded":"2024-09-22T09:16:17.890344+0000","last_fullsized":"2024-09-22T09:16:17.890344+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'507","last_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_deep_scrub":"261'507","last_deep_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.890235+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:42.972286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'323","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.215100+0000","last_change":"2024-09-22T09:16:15.215100+0000","last_active":"2024-09-22T09:16:15.215100+0000","last_peered":"2024-09-22T09:16:15.215100+0000","last_clean":"2024-09-22T09:16:15.215100+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:15.215100+0000","last_undegraded":"2024-09-22T09:16:15.215100+0000","last_fullsized":"2024-09-22T09:16:15.215100+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.214985+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:13.621351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":25990,"num_write":923,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1465,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.267481+0000","last_change":"2024-09-22T09:16:24.267481+0000","last_active":"2024-09-22T09:16:24.267481+0000","last_peered":"2024-09-22T09:16:24.267481+0000","last_clean":"2024-09-22T09:16:24.267481+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:24.267481+0000","last_undegraded":"2024-09-22T09:16:24.267481+0000","last_fullsized":"2024-09-22T09:16:24.267481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.267396+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:33.710111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'85","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.236549+0000","last_change":"2024-09-22T09:16:28.236549+0000","last_active":"2024-09-22T09:16:28.236549+0000","last_peered":"2024-09-22T09:16:28.236549+0000","last_clean":"2024-09-22T09:16:28.236549+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:16:28.236549+0000","last_undegraded":"2024-09-22T09:16:28.236549+0000","last_fullsized":"2024-09-22T09:16:28.236549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.236453+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:10.057889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'784","reported_seq":2577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.169047+0000","last_change":"2024-09-22T09:16:31.169047+0000","last_active":"2024-09-22T09:16:31.169047+0000","last_peered":"2024-09-22T09:16:31.169047+0000","last_clean":"2024-09-22T09:16:31.169047+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:31.169047+0000","last_undegraded":"2024-09-22T09:16:31.169047+0000","last_fullsized":"2024-09-22T09:16:31.169047+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.168981+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:33.186208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'111","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.922582+0000","last_change":"2024-09-22T09:16:32.922582+0000","last_active":"2024-09-22T09:16:32.922582+0000","last_peered":"2024-09-22T09:16:32.922582+0000","last_clean":"2024-09-22T09:16:32.922582+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:16:32.922582+0000","last_undegraded":"2024-09-22T09:16:32.922582+0000","last_fullsized":"2024-09-22T09:16:32.922582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'111","last_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_deep_scrub":"261'111","last_deep_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.922490+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:09.185881+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1180","reported_seq":2769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.786239+0000","last_change":"2024-09-22T09:16:14.786187+0000","last_active":"2024-09-22T09:16:14.786239+0000","last_peered":"2024-09-22T09:16:14.786239+0000","last_clean":"2024-09-22T09:16:14.786239+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:16:14.786239+0000","last_undegraded":"2024-09-22T09:16:14.786239+0000","last_fullsized":"2024-09-22T09:16:14.786239+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1180","last_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_deep_scrub":"261'1180","last_deep_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.786101+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:54.467939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'437","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.777822+0000","last_change":"2024-09-22T09:16:12.777822+0000","last_active":"2024-09-22T09:16:12.777822+0000","last_peered":"2024-09-22T09:16:12.777822+0000","last_clean":"2024-09-22T09:16:12.777822+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:12.777822+0000","last_undegraded":"2024-09-22T09:16:12.777822+0000","last_fullsized":"2024-09-22T09:16:12.777822+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'437","last_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_deep_scrub":"261'437","last_deep_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.777701+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:43.034360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":819,"num_read_kb":19795,"num_write":1316,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.057672+0000","last_change":"2024-09-22T09:16:38.057672+0000","last_active":"2024-09-22T09:16:38.057672+0000","last_peered":"2024-09-22T09:16:38.057672+0000","last_clean":"2024-09-22T09:16:38.057672+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:16:38.057672+0000","last_undegraded":"2024-09-22T09:16:38.057672+0000","last_fullsized":"2024-09-22T09:16:38.057672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.057570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:45.412670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'367","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.190390+0000","last_change":"2024-09-22T09:16:27.190390+0000","last_active":"2024-09-22T09:16:27.190390+0000","last_peered":"2024-09-22T09:16:27.190390+0000","last_clean":"2024-09-22T09:16:27.190390+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:27.190390+0000","last_undegraded":"2024-09-22T09:16:27.190390+0000","last_fullsized":"2024-09-22T09:16:27.190390+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.190267+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:44.961351+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.969489+0000","last_change":"2024-09-22T09:16:29.969489+0000","last_active":"2024-09-22T09:16:29.969489+0000","last_peered":"2024-09-22T09:16:29.969489+0000","last_clean":"2024-09-22T09:16:29.969489+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:16:29.969489+0000","last_undegraded":"2024-09-22T09:16:29.969489+0000","last_fullsized":"2024-09-22T09:16:29.969489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.969406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:51.421775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'176","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.824926+0000","last_change":"2024-09-22T09:16:33.824926+0000","last_active":"2024-09-22T09:16:33.824926+0000","last_peered":"2024-09-22T09:16:33.824926+0000","last_clean":"2024-09-22T09:16:33.824926+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:16:33.824926+0000","last_undegraded":"2024-09-22T09:16:33.824926+0000","last_fullsized":"2024-09-22T09:16:33.824926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'176","last_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_deep_scrub":"261'176","last_deep_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.824818+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:04.659434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'899","reported_seq":2557,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.219147+0000","last_change":"2024-09-22T09:16:26.219147+0000","last_active":"2024-09-22T09:16:26.219147+0000","last_peered":"2024-09-22T09:16:26.219147+0000","last_clean":"2024-09-22T09:16:26.219147+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:16:26.219147+0000","last_undegraded":"2024-09-22T09:16:26.219147+0000","last_fullsized":"2024-09-22T09:16:26.219147+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'899","last_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_deep_scrub":"261'899","last_deep_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.219043+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:44.422572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3769,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.146779+0000","last_change":"2024-09-22T09:16:08.146779+0000","last_active":"2024-09-22T09:16:08.146779+0000","last_peered":"2024-09-22T09:16:08.146779+0000","last_clean":"2024-09-22T09:16:08.146779+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:16:08.146779+0000","last_undegraded":"2024-09-22T09:16:08.146779+0000","last_fullsized":"2024-09-22T09:16:08.146779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.146708+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:12.109321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.130511+0000","last_change":"2024-09-22T09:16:11.130511+0000","last_active":"2024-09-22T09:16:11.130511+0000","last_peered":"2024-09-22T09:16:11.130511+0000","last_clean":"2024-09-22T09:16:11.130511+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:16:11.130511+0000","last_undegraded":"2024-09-22T09:16:11.130511+0000","last_fullsized":"2024-09-22T09:16:11.130511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.130438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:05.095794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.804878+0000","last_change":"2024-09-22T09:16:09.804878+0000","last_active":"2024-09-22T09:16:09.804878+0000","last_peered":"2024-09-22T09:16:09.804878+0000","last_clean":"2024-09-22T09:16:09.804878+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:09.804878+0000","last_undegraded":"2024-09-22T09:16:09.804878+0000","last_fullsized":"2024-09-22T09:16:09.804878+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.804702+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:57.406186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":613,"num_read_kb":39972,"num_write":1027,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.508606+0000","last_change":"2024-09-22T09:16:23.508606+0000","last_active":"2024-09-22T09:16:23.508606+0000","last_peered":"2024-09-22T09:16:23.508606+0000","last_clean":"2024-09-22T09:16:23.508606+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:16:23.508606+0000","last_undegraded":"2024-09-22T09:16:23.508606+0000","last_fullsized":"2024-09-22T09:16:23.508606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.508510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:25.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'748","reported_seq":1453,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.058576+0000","last_change":"2024-09-22T09:16:42.058576+0000","last_active":"2024-09-22T09:16:42.058576+0000","last_peered":"2024-09-22T09:16:42.058576+0000","last_clean":"2024-09-22T09:16:42.058576+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:42.058576+0000","last_undegraded":"2024-09-22T09:16:42.058576+0000","last_fullsized":"2024-09-22T09:16:42.058576+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'748","last_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_deep_scrub":"261'748","last_deep_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.058458+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:12.275343+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133117,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1419,"num_read_kb":3139,"num_write":1374,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106794,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.814431+0000","last_change":"2024-09-22T09:16:38.814431+0000","last_active":"2024-09-22T09:16:38.814431+0000","last_peered":"2024-09-22T09:16:38.814431+0000","last_clean":"2024-09-22T09:16:38.814431+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:16:38.814431+0000","last_undegraded":"2024-09-22T09:16:38.814431+0000","last_fullsized":"2024-09-22T09:16:38.814431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.814353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:07.223791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'207","reported_seq":911,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.553926+0000","last_change":"2024-09-22T09:16:31.553926+0000","last_active":"2024-09-22T09:16:31.553926+0000","last_peered":"2024-09-22T09:16:31.553926+0000","last_clean":"2024-09-22T09:16:31.553926+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:16:31.553926+0000","last_undegraded":"2024-09-22T09:16:31.553926+0000","last_fullsized":"2024-09-22T09:16:31.553926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'207","last_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_deep_scrub":"261'207","last_deep_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.553843+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:22.975099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.696665+0000","last_change":"2024-09-22T09:16:23.696665+0000","last_active":"2024-09-22T09:16:23.696665+0000","last_peered":"2024-09-22T09:16:23.696665+0000","last_clean":"2024-09-22T09:16:23.696665+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:16:23.696665+0000","last_undegraded":"2024-09-22T09:16:23.696665+0000","last_fullsized":"2024-09-22T09:16:23.696665+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'882","last_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_deep_scrub":"261'882","last_deep_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.696577+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:38.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.103337+0000","last_change":"2024-09-22T09:16:09.103337+0000","last_active":"2024-09-22T09:16:09.103337+0000","last_peered":"2024-09-22T09:16:09.103337+0000","last_clean":"2024-09-22T09:16:09.103337+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:16:09.103337+0000","last_undegraded":"2024-09-22T09:16:09.103337+0000","last_fullsized":"2024-09-22T09:16:09.103337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.103256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:48.650934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'335","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.221035+0000","last_change":"2024-09-22T09:16:10.221035+0000","last_active":"2024-09-22T09:16:10.221035+0000","last_peered":"2024-09-22T09:16:10.221035+0000","last_clean":"2024-09-22T09:16:10.221035+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:10.221035+0000","last_undegraded":"2024-09-22T09:16:10.221035+0000","last_fullsized":"2024-09-22T09:16:10.221035+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'335","last_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_deep_scrub":"261'335","last_deep_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.220912+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:01.000745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":6730,"num_write":1066,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.032114+0000","last_change":"2024-09-22T09:16:36.032114+0000","last_active":"2024-09-22T09:16:36.032114+0000","last_peered":"2024-09-22T09:16:36.032114+0000","last_clean":"2024-09-22T09:16:36.032114+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:16:36.032114+0000","last_undegraded":"2024-09-22T09:16:36.032114+0000","last_fullsized":"2024-09-22T09:16:36.032114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.032028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:58.714746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1343","reported_seq":2972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.741413+0000","last_change":"2024-09-22T09:16:25.741413+0000","last_active":"2024-09-22T09:16:25.741413+0000","last_peered":"2024-09-22T09:16:25.741413+0000","last_clean":"2024-09-22T09:16:25.741413+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:25.741413+0000","last_undegraded":"2024-09-22T09:16:25.741413+0000","last_fullsized":"2024-09-22T09:16:25.741413+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1343","last_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_deep_scrub":"261'1343","last_deep_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.741309+0000","objects_scrubbed":12,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:15.738101+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141570,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3855,"num_write":1170,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.059685+0000","last_change":"2024-09-22T09:16:47.059685+0000","last_active":"2024-09-22T09:16:47.059685+0000","last_peered":"2024-09-22T09:16:47.059685+0000","last_clean":"2024-09-22T09:16:47.059685+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:16:47.059685+0000","last_undegraded":"2024-09-22T09:16:47.059685+0000","last_fullsized":"2024-09-22T09:16:47.059685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.059597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:03.787983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'124","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.863516+0000","last_change":"2024-09-22T09:16:43.863516+0000","last_active":"2024-09-22T09:16:43.863516+0000","last_peered":"2024-09-22T09:16:43.863516+0000","last_clean":"2024-09-22T09:16:43.863516+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:16:43.863516+0000","last_undegraded":"2024-09-22T09:16:43.863516+0000","last_fullsized":"2024-09-22T09:16:43.863516+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.863424+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:49.790428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'467","reported_seq":2081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.232945+0000","last_change":"2024-09-22T09:16:19.232945+0000","last_active":"2024-09-22T09:16:19.232945+0000","last_peered":"2024-09-22T09:16:19.232945+0000","last_clean":"2024-09-22T09:16:19.232945+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:16:19.232945+0000","last_undegraded":"2024-09-22T09:16:19.232945+0000","last_fullsized":"2024-09-22T09:16:19.232945+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.232833+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:17.313258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.820588+0000","last_change":"2024-09-22T09:16:10.820588+0000","last_active":"2024-09-22T09:16:10.820588+0000","last_peered":"2024-09-22T09:16:10.820588+0000","last_clean":"2024-09-22T09:16:10.820588+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:16:10.820588+0000","last_undegraded":"2024-09-22T09:16:10.820588+0000","last_fullsized":"2024-09-22T09:16:10.820588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.820505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:43.185792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'324","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.734585+0000","last_change":"2024-09-22T09:16:09.734585+0000","last_active":"2024-09-22T09:16:09.734585+0000","last_peered":"2024-09-22T09:16:09.734585+0000","last_clean":"2024-09-22T09:16:09.734585+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:09.734585+0000","last_undegraded":"2024-09-22T09:16:09.734585+0000","last_fullsized":"2024-09-22T09:16:09.734585+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.734427+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:44.034840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174880,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":1785,"num_write":1090,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'8","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.725370+0000","last_change":"2024-09-22T09:16:20.725370+0000","last_active":"2024-09-22T09:16:20.725370+0000","last_peered":"2024-09-22T09:16:20.725370+0000","last_clean":"2024-09-22T09:16:20.725370+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:20.725370+0000","last_undegraded":"2024-09-22T09:16:20.725370+0000","last_fullsized":"2024-09-22T09:16:20.725370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.725286+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:56.727213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'268","reported_seq":1503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.569532+0000","last_change":"2024-09-22T09:16:26.569532+0000","last_active":"2024-09-22T09:16:26.569532+0000","last_peered":"2024-09-22T09:16:26.569532+0000","last_clean":"2024-09-22T09:16:26.569532+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:16:26.569532+0000","last_undegraded":"2024-09-22T09:16:26.569532+0000","last_fullsized":"2024-09-22T09:16:26.569532+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'268","last_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_deep_scrub":"261'268","last_deep_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.569422+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:23.239715+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.554267+0000","last_change":"2024-09-22T09:16:39.554267+0000","last_active":"2024-09-22T09:16:39.554267+0000","last_peered":"2024-09-22T09:16:39.554267+0000","last_clean":"2024-09-22T09:16:39.554267+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:16:39.554267+0000","last_undegraded":"2024-09-22T09:16:39.554267+0000","last_fullsized":"2024-09-22T09:16:39.554267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.554148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:40.126687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.647850+0000","last_change":"2024-09-22T09:16:43.647850+0000","last_active":"2024-09-22T09:16:43.647850+0000","last_peered":"2024-09-22T09:16:43.647850+0000","last_clean":"2024-09-22T09:16:43.647850+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:16:43.647850+0000","last_undegraded":"2024-09-22T09:16:43.647850+0000","last_fullsized":"2024-09-22T09:16:43.647850+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.647767+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:03.889824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'776","reported_seq":2214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.202744+0000","last_change":"2024-09-22T09:16:18.202744+0000","last_active":"2024-09-22T09:16:18.202744+0000","last_peered":"2024-09-22T09:16:18.202744+0000","last_clean":"2024-09-22T09:16:18.202744+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:16:18.202744+0000","last_undegraded":"2024-09-22T09:16:18.202744+0000","last_fullsized":"2024-09-22T09:16:18.202744+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'776","last_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_deep_scrub":"261'776","last_deep_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.202607+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:20.032816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":528,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.098720+0000","last_change":"2024-09-22T09:16:10.098720+0000","last_active":"2024-09-22T09:16:10.098720+0000","last_peered":"2024-09-22T09:16:10.098720+0000","last_clean":"2024-09-22T09:16:10.098720+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:16:10.098720+0000","last_undegraded":"2024-09-22T09:16:10.098720+0000","last_fullsized":"2024-09-22T09:16:10.098720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.098658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:32.867298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'390","reported_seq":1009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.778066+0000","last_change":"2024-09-22T09:16:13.778005+0000","last_active":"2024-09-22T09:16:13.778066+0000","last_peered":"2024-09-22T09:16:13.778066+0000","last_clean":"2024-09-22T09:16:13.778066+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:13.778066+0000","last_undegraded":"2024-09-22T09:16:13.778066+0000","last_fullsized":"2024-09-22T09:16:13.778066+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'390","last_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_deep_scrub":"261'390","last_deep_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.777834+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:00.884220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":48326,"num_write":1184,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.706486+0000","last_change":"2024-09-22T09:16:21.706486+0000","last_active":"2024-09-22T09:16:21.706486+0000","last_peered":"2024-09-22T09:16:21.706486+0000","last_clean":"2024-09-22T09:16:21.706486+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:16:21.706486+0000","last_undegraded":"2024-09-22T09:16:21.706486+0000","last_fullsized":"2024-09-22T09:16:21.706486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.706389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:33.368571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'148","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.720118+0000","last_change":"2024-09-22T09:16:34.720118+0000","last_active":"2024-09-22T09:16:34.720118+0000","last_peered":"2024-09-22T09:16:34.720118+0000","last_clean":"2024-09-22T09:16:34.720118+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:16:34.720118+0000","last_undegraded":"2024-09-22T09:16:34.720118+0000","last_fullsized":"2024-09-22T09:16:34.720118+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'148","last_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_deep_scrub":"261'148","last_deep_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.720023+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:59.789283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:07.782571+0000","last_change":"2024-09-22T08:17:46.351157+0000","last_active":"2024-09-22T09:14:07.782571+0000","last_peered":"2024-09-22T09:14:07.782571+0000","last_clean":"2024-09-22T09:14:07.782571+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:14:07.782571+0000","last_undegraded":"2024-09-22T09:14:07.782571+0000","last_fullsized":"2024-09-22T09:14:07.782571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.154869+0000","last_change":"2024-09-22T09:16:36.154869+0000","last_active":"2024-09-22T09:16:36.154869+0000","last_peered":"2024-09-22T09:16:36.154869+0000","last_clean":"2024-09-22T09:16:36.154869+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:16:36.154869+0000","last_undegraded":"2024-09-22T09:16:36.154869+0000","last_fullsized":"2024-09-22T09:16:36.154869+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.154767+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:34.821467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'373","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.204350+0000","last_change":"2024-09-22T09:16:20.204350+0000","last_active":"2024-09-22T09:16:20.204350+0000","last_peered":"2024-09-22T09:16:20.204350+0000","last_clean":"2024-09-22T09:16:20.204350+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:16:20.204350+0000","last_undegraded":"2024-09-22T09:16:20.204350+0000","last_fullsized":"2024-09-22T09:16:20.204350+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'373","last_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_deep_scrub":"261'373","last_deep_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.204251+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:02.514748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'389","reported_seq":1095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.883341+0000","last_change":"2024-09-22T09:16:09.883341+0000","last_active":"2024-09-22T09:16:09.883341+0000","last_peered":"2024-09-22T09:16:09.883341+0000","last_clean":"2024-09-22T09:16:09.883341+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:09.883341+0000","last_undegraded":"2024-09-22T09:16:09.883341+0000","last_fullsized":"2024-09-22T09:16:09.883341+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'389","last_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_deep_scrub":"261'389","last_deep_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.883202+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.123770+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6919332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":45053,"num_write":1379,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.781614+0000","last_change":"2024-09-22T09:16:10.781614+0000","last_active":"2024-09-22T09:16:10.781614+0000","last_peered":"2024-09-22T09:16:10.781614+0000","last_clean":"2024-09-22T09:16:10.781614+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:16:10.781614+0000","last_undegraded":"2024-09-22T09:16:10.781614+0000","last_fullsized":"2024-09-22T09:16:10.781614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.781523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:03.872420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.698988+0000","last_change":"2024-09-22T09:16:26.698988+0000","last_active":"2024-09-22T09:16:26.698988+0000","last_peered":"2024-09-22T09:16:26.698988+0000","last_clean":"2024-09-22T09:16:26.698988+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:16:26.698988+0000","last_undegraded":"2024-09-22T09:16:26.698988+0000","last_fullsized":"2024-09-22T09:16:26.698988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.698863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:05.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'596","reported_seq":1264,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.701953+0000","last_change":"2024-09-22T09:16:23.701953+0000","last_active":"2024-09-22T09:16:23.701953+0000","last_peered":"2024-09-22T09:16:23.701953+0000","last_clean":"2024-09-22T09:16:23.701953+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:23.701953+0000","last_undegraded":"2024-09-22T09:16:23.701953+0000","last_fullsized":"2024-09-22T09:16:23.701953+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'596","last_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_deep_scrub":"261'596","last_deep_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.701817+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:20.394276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1681,"num_read_kb":2863,"num_write":2226,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.977574+0000","last_change":"2024-09-22T09:16:27.977574+0000","last_active":"2024-09-22T09:16:27.977574+0000","last_peered":"2024-09-22T09:16:27.977574+0000","last_clean":"2024-09-22T09:16:27.977574+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:16:27.977574+0000","last_undegraded":"2024-09-22T09:16:27.977574+0000","last_fullsized":"2024-09-22T09:16:27.977574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.977483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:36.365474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'132","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.837395+0000","last_change":"2024-09-22T09:16:45.837395+0000","last_active":"2024-09-22T09:16:45.837395+0000","last_peered":"2024-09-22T09:16:45.837395+0000","last_clean":"2024-09-22T09:16:45.837395+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:16:45.837395+0000","last_undegraded":"2024-09-22T09:16:45.837395+0000","last_fullsized":"2024-09-22T09:16:45.837395+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.837304+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:39.433815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'438","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.211439+0000","last_change":"2024-09-22T09:16:16.211439+0000","last_active":"2024-09-22T09:16:16.211439+0000","last_peered":"2024-09-22T09:16:16.211439+0000","last_clean":"2024-09-22T09:16:16.211439+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:16:16.211439+0000","last_undegraded":"2024-09-22T09:16:16.211439+0000","last_fullsized":"2024-09-22T09:16:16.211439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'438","last_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_deep_scrub":"261'438","last_deep_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.211353+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:12.204748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'404","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.216484+0000","last_change":"2024-09-22T09:16:11.216484+0000","last_active":"2024-09-22T09:16:11.216484+0000","last_peered":"2024-09-22T09:16:11.216484+0000","last_clean":"2024-09-22T09:16:11.216484+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:11.216484+0000","last_undegraded":"2024-09-22T09:16:11.216484+0000","last_fullsized":"2024-09-22T09:16:11.216484+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.216383+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:43.556741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":42178,"num_write":1167,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.243905+0000","last_change":"2024-09-22T09:16:14.243905+0000","last_active":"2024-09-22T09:16:14.243905+0000","last_peered":"2024-09-22T09:16:14.243905+0000","last_clean":"2024-09-22T09:16:14.243905+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:16:14.243905+0000","last_undegraded":"2024-09-22T09:16:14.243905+0000","last_fullsized":"2024-09-22T09:16:14.243905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.243805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:17.107629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"261'4","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.547087+0000","last_change":"2024-09-22T09:16:24.547087+0000","last_active":"2024-09-22T09:16:24.547087+0000","last_peered":"2024-09-22T09:16:24.547087+0000","last_clean":"2024-09-22T09:16:24.547087+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:24.547087+0000","last_undegraded":"2024-09-22T09:16:24.547087+0000","last_fullsized":"2024-09-22T09:16:24.547087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.546984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:57.779533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'175","reported_seq":738,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.202111+0000","last_change":"2024-09-22T09:16:27.202111+0000","last_active":"2024-09-22T09:16:27.202111+0000","last_peered":"2024-09-22T09:16:27.202111+0000","last_clean":"2024-09-22T09:16:27.202111+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:16:27.202111+0000","last_undegraded":"2024-09-22T09:16:27.202111+0000","last_fullsized":"2024-09-22T09:16:27.202111+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'175","last_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_deep_scrub":"261'175","last_deep_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.202023+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:39.841272+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'784","reported_seq":2607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.183448+0000","last_change":"2024-09-22T09:16:29.183448+0000","last_active":"2024-09-22T09:16:29.183448+0000","last_peered":"2024-09-22T09:16:29.183448+0000","last_clean":"2024-09-22T09:16:29.183448+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:29.183448+0000","last_undegraded":"2024-09-22T09:16:29.183448+0000","last_fullsized":"2024-09-22T09:16:29.183448+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.183343+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:58.686649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'131","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.864391+0000","last_change":"2024-09-22T09:16:34.864391+0000","last_active":"2024-09-22T09:16:34.864391+0000","last_peered":"2024-09-22T09:16:34.864391+0000","last_clean":"2024-09-22T09:16:34.864391+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:16:34.864391+0000","last_undegraded":"2024-09-22T09:16:34.864391+0000","last_fullsized":"2024-09-22T09:16:34.864391+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.864290+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:29.499370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'481","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.772601+0000","last_change":"2024-09-22T09:16:14.772601+0000","last_active":"2024-09-22T09:16:14.772601+0000","last_peered":"2024-09-22T09:16:14.772601+0000","last_clean":"2024-09-22T09:16:14.772601+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:16:14.772601+0000","last_undegraded":"2024-09-22T09:16:14.772601+0000","last_fullsized":"2024-09-22T09:16:14.772601+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'481","last_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_deep_scrub":"261'481","last_deep_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.772519+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:51.207310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'410","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.807161+0000","last_change":"2024-09-22T09:16:11.807161+0000","last_active":"2024-09-22T09:16:11.807161+0000","last_peered":"2024-09-22T09:16:11.807161+0000","last_clean":"2024-09-22T09:16:11.807161+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:11.807161+0000","last_undegraded":"2024-09-22T09:16:11.807161+0000","last_fullsized":"2024-09-22T09:16:11.807161+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'410","last_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_deep_scrub":"261'410","last_deep_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.807026+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:44.619900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":945,"num_read_kb":43241,"num_write":1287,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.823207+0000","last_change":"2024-09-22T09:16:08.823207+0000","last_active":"2024-09-22T09:16:08.823207+0000","last_peered":"2024-09-22T09:16:08.823207+0000","last_clean":"2024-09-22T09:16:08.823207+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:16:08.823207+0000","last_undegraded":"2024-09-22T09:16:08.823207+0000","last_fullsized":"2024-09-22T09:16:08.823207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.823085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:31.913983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.075573+0000","last_change":"2024-09-22T09:16:35.075573+0000","last_active":"2024-09-22T09:16:35.075573+0000","last_peered":"2024-09-22T09:16:35.075573+0000","last_clean":"2024-09-22T09:16:35.075573+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:16:35.075573+0000","last_undegraded":"2024-09-22T09:16:35.075573+0000","last_fullsized":"2024-09-22T09:16:35.075573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.075486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:55.025811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'116","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.036796+0000","last_change":"2024-09-22T09:16:41.036796+0000","last_active":"2024-09-22T09:16:41.036796+0000","last_peered":"2024-09-22T09:16:41.036796+0000","last_clean":"2024-09-22T09:16:41.036796+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:16:41.036796+0000","last_undegraded":"2024-09-22T09:16:41.036796+0000","last_fullsized":"2024-09-22T09:16:41.036796+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.036697+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:59.620262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'814","reported_seq":2532,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.793997+0000","last_change":"2024-09-22T09:16:36.793997+0000","last_active":"2024-09-22T09:16:36.793997+0000","last_peered":"2024-09-22T09:16:36.793997+0000","last_clean":"2024-09-22T09:16:36.793997+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:36.793997+0000","last_undegraded":"2024-09-22T09:16:36.793997+0000","last_fullsized":"2024-09-22T09:16:36.793997+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'814","last_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_deep_scrub":"261'814","last_deep_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.793904+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:46.387778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'291","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.885417+0000","last_change":"2024-09-22T09:16:44.885417+0000","last_active":"2024-09-22T09:16:44.885417+0000","last_peered":"2024-09-22T09:16:44.885417+0000","last_clean":"2024-09-22T09:16:44.885417+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:16:44.885417+0000","last_undegraded":"2024-09-22T09:16:44.885417+0000","last_fullsized":"2024-09-22T09:16:44.885417+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.885302+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:47.087058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.919376+0000","last_change":"2024-09-22T09:16:14.919376+0000","last_active":"2024-09-22T09:16:14.919376+0000","last_peered":"2024-09-22T09:16:14.919376+0000","last_clean":"2024-09-22T09:16:14.919376+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:16:14.919376+0000","last_undegraded":"2024-09-22T09:16:14.919376+0000","last_fullsized":"2024-09-22T09:16:14.919376+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.919282+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:08.650486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'327","reported_seq":1056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.772366+0000","last_change":"2024-09-22T09:16:10.772280+0000","last_active":"2024-09-22T09:16:10.772366+0000","last_peered":"2024-09-22T09:16:10.772366+0000","last_clean":"2024-09-22T09:16:10.772366+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:10.772366+0000","last_undegraded":"2024-09-22T09:16:10.772366+0000","last_fullsized":"2024-09-22T09:16:10.772366+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.772122+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:38.919070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048951,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":907,"num_read_kb":63310,"num_write":970,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.152744+0000","last_change":"2024-09-22T09:16:12.152744+0000","last_active":"2024-09-22T09:16:12.152744+0000","last_peered":"2024-09-22T09:16:12.152744+0000","last_clean":"2024-09-22T09:16:12.152744+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:16:12.152744+0000","last_undegraded":"2024-09-22T09:16:12.152744+0000","last_fullsized":"2024-09-22T09:16:12.152744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.152652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:42.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.748080+0000","last_change":"2024-09-22T09:16:24.748080+0000","last_active":"2024-09-22T09:16:24.748080+0000","last_peered":"2024-09-22T09:16:24.748080+0000","last_clean":"2024-09-22T09:16:24.748080+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:16:24.748080+0000","last_undegraded":"2024-09-22T09:16:24.748080+0000","last_fullsized":"2024-09-22T09:16:24.748080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.748000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:33.241849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'747","reported_seq":1467,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.563522+0000","last_change":"2024-09-22T09:16:25.563522+0000","last_active":"2024-09-22T09:16:25.563522+0000","last_peered":"2024-09-22T09:16:25.563522+0000","last_clean":"2024-09-22T09:16:25.563522+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:25.563522+0000","last_undegraded":"2024-09-22T09:16:25.563522+0000","last_fullsized":"2024-09-22T09:16:25.563522+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'747","last_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_deep_scrub":"261'747","last_deep_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.563415+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:22.893620+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1336,"num_read_kb":3141,"num_write":1092,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.576127+0000","last_change":"2024-09-22T09:16:38.576127+0000","last_active":"2024-09-22T09:16:38.576127+0000","last_peered":"2024-09-22T09:16:38.576127+0000","last_clean":"2024-09-22T09:16:38.576127+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:16:38.576127+0000","last_undegraded":"2024-09-22T09:16:38.576127+0000","last_fullsized":"2024-09-22T09:16:38.576127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.576031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:05.576920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'102","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.929801+0000","last_change":"2024-09-22T09:16:35.929801+0000","last_active":"2024-09-22T09:16:35.929801+0000","last_peered":"2024-09-22T09:16:35.929801+0000","last_clean":"2024-09-22T09:16:35.929801+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:16:35.929801+0000","last_undegraded":"2024-09-22T09:16:35.929801+0000","last_fullsized":"2024-09-22T09:16:35.929801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.929698+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:53.295003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'124","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.611669+0000","last_change":"2024-09-22T09:16:44.611669+0000","last_active":"2024-09-22T09:16:44.611669+0000","last_peered":"2024-09-22T09:16:44.611669+0000","last_clean":"2024-09-22T09:16:44.611669+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:16:44.611669+0000","last_undegraded":"2024-09-22T09:16:44.611669+0000","last_fullsized":"2024-09-22T09:16:44.611669+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.611578+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:35.821865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'413","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.864884+0000","last_change":"2024-09-22T09:16:18.864884+0000","last_active":"2024-09-22T09:16:18.864884+0000","last_peered":"2024-09-22T09:16:18.864884+0000","last_clean":"2024-09-22T09:16:18.864884+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:16:18.864884+0000","last_undegraded":"2024-09-22T09:16:18.864884+0000","last_fullsized":"2024-09-22T09:16:18.864884+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'413","last_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_deep_scrub":"261'413","last_deep_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.864732+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:46.218753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'314","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.295818+0000","last_change":"2024-09-22T09:16:19.295818+0000","last_active":"2024-09-22T09:16:19.295818+0000","last_peered":"2024-09-22T09:16:19.295818+0000","last_clean":"2024-09-22T09:16:19.295818+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:19.295818+0000","last_undegraded":"2024-09-22T09:16:19.295818+0000","last_fullsized":"2024-09-22T09:16:19.295818+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.295694+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:01.794130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":48776,"num_write":1072,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.245928+0000","last_change":"2024-09-22T09:16:29.245928+0000","last_active":"2024-09-22T09:16:29.245928+0000","last_peered":"2024-09-22T09:16:29.245928+0000","last_clean":"2024-09-22T09:16:29.245928+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:16:29.245928+0000","last_undegraded":"2024-09-22T09:16:29.245928+0000","last_fullsized":"2024-09-22T09:16:29.245928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.245818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:25.499134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'303","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.218828+0000","last_change":"2024-09-22T09:16:31.218828+0000","last_active":"2024-09-22T09:16:31.218828+0000","last_peered":"2024-09-22T09:16:31.218828+0000","last_clean":"2024-09-22T09:16:31.218828+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:16:31.218828+0000","last_undegraded":"2024-09-22T09:16:31.218828+0000","last_fullsized":"2024-09-22T09:16:31.218828+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.218740+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:12.818326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44144,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1008,"num_write":380,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676808+0000","last_change":"2024-09-22T09:16:29.676808+0000","last_active":"2024-09-22T09:16:29.676808+0000","last_peered":"2024-09-22T09:16:29.676808+0000","last_clean":"2024-09-22T09:16:29.676808+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:16:29.676808+0000","last_undegraded":"2024-09-22T09:16:29.676808+0000","last_fullsized":"2024-09-22T09:16:29.676808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:07.042343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'157","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.824503+0000","last_change":"2024-09-22T09:16:35.824503+0000","last_active":"2024-09-22T09:16:35.824503+0000","last_peered":"2024-09-22T09:16:35.824503+0000","last_clean":"2024-09-22T09:16:35.824503+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:16:35.824503+0000","last_undegraded":"2024-09-22T09:16:35.824503+0000","last_fullsized":"2024-09-22T09:16:35.824503+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.824415+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:46.659184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'479","reported_seq":2028,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.799222+0000","last_change":"2024-09-22T09:16:18.799222+0000","last_active":"2024-09-22T09:16:18.799222+0000","last_peered":"2024-09-22T09:16:18.799222+0000","last_clean":"2024-09-22T09:16:18.799222+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:16:18.799222+0000","last_undegraded":"2024-09-22T09:16:18.799222+0000","last_fullsized":"2024-09-22T09:16:18.799222+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'479","last_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_deep_scrub":"261'479","last_deep_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.799137+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:41:01.860838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'343","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.582742+0000","last_change":"2024-09-22T09:16:08.582742+0000","last_active":"2024-09-22T09:16:08.582742+0000","last_peered":"2024-09-22T09:16:08.582742+0000","last_clean":"2024-09-22T09:16:08.582742+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:08.582742+0000","last_undegraded":"2024-09-22T09:16:08.582742+0000","last_fullsized":"2024-09-22T09:16:08.582742+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.582637+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:51.839030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":615,"num_read_kb":26096,"num_write":1031,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.712354+0000","last_change":"2024-09-22T09:16:27.712354+0000","last_active":"2024-09-22T09:16:27.712354+0000","last_peered":"2024-09-22T09:16:27.712354+0000","last_clean":"2024-09-22T09:16:27.712354+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:16:27.712354+0000","last_undegraded":"2024-09-22T09:16:27.712354+0000","last_fullsized":"2024-09-22T09:16:27.712354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.712273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:11.133342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'52","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.657575+0000","last_change":"2024-09-22T09:16:34.657575+0000","last_active":"2024-09-22T09:16:34.657575+0000","last_peered":"2024-09-22T09:16:34.657575+0000","last_clean":"2024-09-22T09:16:34.657575+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:16:34.657575+0000","last_undegraded":"2024-09-22T09:16:34.657575+0000","last_fullsized":"2024-09-22T09:16:34.657575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'52","last_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_deep_scrub":"261'52","last_deep_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.657484+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.772569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.955597+0000","last_change":"2024-09-22T09:16:30.955597+0000","last_active":"2024-09-22T09:16:30.955597+0000","last_peered":"2024-09-22T09:16:30.955597+0000","last_clean":"2024-09-22T09:16:30.955597+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:16:30.955597+0000","last_undegraded":"2024-09-22T09:16:30.955597+0000","last_fullsized":"2024-09-22T09:16:30.955597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.955526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:58.716890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'170","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.297985+0000","last_change":"2024-09-22T09:16:40.297985+0000","last_active":"2024-09-22T09:16:40.297985+0000","last_peered":"2024-09-22T09:16:40.297985+0000","last_clean":"2024-09-22T09:16:40.297985+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:16:40.297985+0000","last_undegraded":"2024-09-22T09:16:40.297985+0000","last_fullsized":"2024-09-22T09:16:40.297985+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'170","last_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_deep_scrub":"261'170","last_deep_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.297900+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:20.684874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1114","reported_seq":2661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.752191+0000","last_change":"2024-09-22T09:16:17.752191+0000","last_active":"2024-09-22T09:16:17.752191+0000","last_peered":"2024-09-22T09:16:17.752191+0000","last_clean":"2024-09-22T09:16:17.752191+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:16:17.752191+0000","last_undegraded":"2024-09-22T09:16:17.752191+0000","last_fullsized":"2024-09-22T09:16:17.752191+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1114","last_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_deep_scrub":"261'1114","last_deep_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.752078+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":1100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:39.851809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'345","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.909478+0000","last_change":"2024-09-22T09:16:10.909478+0000","last_active":"2024-09-22T09:16:10.909478+0000","last_peered":"2024-09-22T09:16:10.909478+0000","last_clean":"2024-09-22T09:16:10.909478+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:10.909478+0000","last_undegraded":"2024-09-22T09:16:10.909478+0000","last_fullsized":"2024-09-22T09:16:10.909478+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.909398+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:48.269092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":10746,"num_write":1198,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.961164+0000","last_change":"2024-09-22T09:16:23.961164+0000","last_active":"2024-09-22T09:16:23.961164+0000","last_peered":"2024-09-22T09:16:23.961164+0000","last_clean":"2024-09-22T09:16:23.961164+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:16:23.961164+0000","last_undegraded":"2024-09-22T09:16:23.961164+0000","last_fullsized":"2024-09-22T09:16:23.961164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.961072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:18.031550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'300","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.702560+0000","last_change":"2024-09-22T09:16:26.702560+0000","last_active":"2024-09-22T09:16:26.702560+0000","last_peered":"2024-09-22T09:16:26.702560+0000","last_clean":"2024-09-22T09:16:26.702560+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:26.702560+0000","last_undegraded":"2024-09-22T09:16:26.702560+0000","last_fullsized":"2024-09-22T09:16:26.702560+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.702460+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:52:00.189471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51577,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1040,"num_write":388,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.193361+0000","last_change":"2024-09-22T09:16:32.193361+0000","last_active":"2024-09-22T09:16:32.193361+0000","last_peered":"2024-09-22T09:16:32.193361+0000","last_clean":"2024-09-22T09:16:32.193361+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:16:32.193361+0000","last_undegraded":"2024-09-22T09:16:32.193361+0000","last_fullsized":"2024-09-22T09:16:32.193361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.193280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:23.876371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'111","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:23.168711+0000","last_change":"2024-09-22T08:17:48.367781+0000","last_active":"2024-09-22T09:13:23.168711+0000","last_peered":"2024-09-22T09:13:23.168711+0000","last_clean":"2024-09-22T09:13:23.168711+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:13:23.168711+0000","last_undegraded":"2024-09-22T09:13:23.168711+0000","last_fullsized":"2024-09-22T09:13:23.168711+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:26.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'673","reported_seq":2226,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.783102+0000","last_change":"2024-09-22T09:16:15.783102+0000","last_active":"2024-09-22T09:16:15.783102+0000","last_peered":"2024-09-22T09:16:15.783102+0000","last_clean":"2024-09-22T09:16:15.783102+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:16:15.783102+0000","last_undegraded":"2024-09-22T09:16:15.783102+0000","last_fullsized":"2024-09-22T09:16:15.783102+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'673","last_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_deep_scrub":"261'673","last_deep_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.783012+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:05.838865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'398","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.720596+0000","last_change":"2024-09-22T09:16:15.720596+0000","last_active":"2024-09-22T09:16:15.720596+0000","last_peered":"2024-09-22T09:16:15.720596+0000","last_clean":"2024-09-22T09:16:15.720596+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:15.720596+0000","last_undegraded":"2024-09-22T09:16:15.720596+0000","last_fullsized":"2024-09-22T09:16:15.720596+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'398","last_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_deep_scrub":"261'398","last_deep_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.720482+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:21.561411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":91878,"num_write":1336,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.056882+0000","last_change":"2024-09-22T09:16:37.056882+0000","last_active":"2024-09-22T09:16:37.056882+0000","last_peered":"2024-09-22T09:16:37.056882+0000","last_clean":"2024-09-22T09:16:37.056882+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:16:37.056882+0000","last_undegraded":"2024-09-22T09:16:37.056882+0000","last_fullsized":"2024-09-22T09:16:37.056882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.056786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:18.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'291","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.628841+0000","last_change":"2024-09-22T09:16:28.628841+0000","last_active":"2024-09-22T09:16:28.628841+0000","last_peered":"2024-09-22T09:16:28.628841+0000","last_clean":"2024-09-22T09:16:28.628841+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:28.628841+0000","last_undegraded":"2024-09-22T09:16:28.628841+0000","last_fullsized":"2024-09-22T09:16:28.628841+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.628749+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.456602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.722816+0000","last_change":"2024-09-22T09:16:30.722816+0000","last_active":"2024-09-22T09:16:30.722816+0000","last_peered":"2024-09-22T09:16:30.722816+0000","last_clean":"2024-09-22T09:16:30.722816+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:16:30.722816+0000","last_undegraded":"2024-09-22T09:16:30.722816+0000","last_fullsized":"2024-09-22T09:16:30.722816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.722700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:40.178403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'815","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.228476+0000","last_change":"2024-09-22T09:16:30.228476+0000","last_active":"2024-09-22T09:16:30.228476+0000","last_peered":"2024-09-22T09:16:30.228476+0000","last_clean":"2024-09-22T09:16:30.228476+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:16:30.228476+0000","last_undegraded":"2024-09-22T09:16:30.228476+0000","last_fullsized":"2024-09-22T09:16:30.228476+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.228380+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:24.948927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'342","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.809805+0000","last_change":"2024-09-22T09:16:11.809805+0000","last_active":"2024-09-22T09:16:11.809805+0000","last_peered":"2024-09-22T09:16:11.809805+0000","last_clean":"2024-09-22T09:16:11.809805+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:11.809805+0000","last_undegraded":"2024-09-22T09:16:11.809805+0000","last_fullsized":"2024-09-22T09:16:11.809805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.809676+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:44.292039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":11716,"num_write":1078,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.206946+0000","last_change":"2024-09-22T09:16:26.206946+0000","last_active":"2024-09-22T09:16:26.206946+0000","last_peered":"2024-09-22T09:16:26.206946+0000","last_clean":"2024-09-22T09:16:26.206946+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:16:26.206946+0000","last_undegraded":"2024-09-22T09:16:26.206946+0000","last_fullsized":"2024-09-22T09:16:26.206946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.206849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:28.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'473","reported_seq":1098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.253512+0000","last_change":"2024-09-22T09:16:32.253512+0000","last_active":"2024-09-22T09:16:32.253512+0000","last_peered":"2024-09-22T09:16:32.253512+0000","last_clean":"2024-09-22T09:16:32.253512+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:32.253512+0000","last_undegraded":"2024-09-22T09:16:32.253512+0000","last_fullsized":"2024-09-22T09:16:32.253512+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'473","last_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_deep_scrub":"261'473","last_deep_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.253410+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:29.449772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91839,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1972,"num_write":726,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.923928+0000","last_change":"2024-09-22T09:16:31.923928+0000","last_active":"2024-09-22T09:16:31.923928+0000","last_peered":"2024-09-22T09:16:31.923928+0000","last_clean":"2024-09-22T09:16:31.923928+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:16:31.923928+0000","last_undegraded":"2024-09-22T09:16:31.923928+0000","last_fullsized":"2024-09-22T09:16:31.923928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.923838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:11.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":711,"reported_epoch":261,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-22T09:16:46.809068+0000","last_change":"2024-09-22T09:16:46.808816+0000","last_active":"2024-09-22T09:16:46.809068+0000","last_peered":"2024-09-22T09:16:46.809068+0000","last_clean":"2024-09-22T09:16:46.809068+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:16:46.809068+0000","last_undegraded":"2024-09-22T09:16:46.809068+0000","last_fullsized":"2024-09-22T09:16:46.809068+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.783099+0000","last_change":"2024-09-22T09:16:20.783099+0000","last_active":"2024-09-22T09:16:20.783099+0000","last_peered":"2024-09-22T09:16:20.783099+0000","last_clean":"2024-09-22T09:16:20.783099+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:16:20.783099+0000","last_undegraded":"2024-09-22T09:16:20.783099+0000","last_fullsized":"2024-09-22T09:16:20.783099+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'441","last_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_deep_scrub":"261'441","last_deep_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.783016+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.329227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'392","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.796464+0000","last_change":"2024-09-22T09:16:13.796464+0000","last_active":"2024-09-22T09:16:13.796464+0000","last_peered":"2024-09-22T09:16:13.796464+0000","last_clean":"2024-09-22T09:16:13.796464+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:13.796464+0000","last_undegraded":"2024-09-22T09:16:13.796464+0000","last_fullsized":"2024-09-22T09:16:13.796464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'392","last_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_deep_scrub":"261'392","last_deep_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.796344+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:33.961247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":782,"num_read_kb":2508,"num_write":1241,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.007305+0000","last_change":"2024-09-22T09:16:29.007305+0000","last_active":"2024-09-22T09:16:29.007305+0000","last_peered":"2024-09-22T09:16:29.007305+0000","last_clean":"2024-09-22T09:16:29.007305+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:16:29.007305+0000","last_undegraded":"2024-09-22T09:16:29.007305+0000","last_fullsized":"2024-09-22T09:16:29.007305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.007163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:12.241599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'308","reported_seq":895,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.123193+0000","last_change":"2024-09-22T09:16:45.123193+0000","last_active":"2024-09-22T09:16:45.123193+0000","last_peered":"2024-09-22T09:16:45.123193+0000","last_clean":"2024-09-22T09:16:45.123193+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:45.123193+0000","last_undegraded":"2024-09-22T09:16:45.123193+0000","last_fullsized":"2024-09-22T09:16:45.123193+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'308","last_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_deep_scrub":"261'308","last_deep_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.123088+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:15.176307+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.813683+0000","last_change":"2024-09-22T09:16:40.813683+0000","last_active":"2024-09-22T09:16:40.813683+0000","last_peered":"2024-09-22T09:16:40.813683+0000","last_clean":"2024-09-22T09:16:40.813683+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:16:40.813683+0000","last_undegraded":"2024-09-22T09:16:40.813683+0000","last_fullsized":"2024-09-22T09:16:40.813683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.813564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:49.900112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'200","reported_seq":702,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779767+0000","last_change":"2024-09-22T08:17:48.373471+0000","last_active":"2024-09-22T09:13:47.779767+0000","last_peered":"2024-09-22T09:13:47.779767+0000","last_clean":"2024-09-22T09:13:47.779767+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:13:47.779767+0000","last_undegraded":"2024-09-22T09:13:47.779767+0000","last_fullsized":"2024-09-22T09:13:47.779767+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:19.886268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1249","reported_seq":2882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.747497+0000","last_change":"2024-09-22T09:16:16.747497+0000","last_active":"2024-09-22T09:16:16.747497+0000","last_peered":"2024-09-22T09:16:16.747497+0000","last_clean":"2024-09-22T09:16:16.747497+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:16:16.747497+0000","last_undegraded":"2024-09-22T09:16:16.747497+0000","last_fullsized":"2024-09-22T09:16:16.747497+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1249","last_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_deep_scrub":"261'1249","last_deep_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.747413+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:40.709656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'364","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.160466+0000","last_change":"2024-09-22T09:16:10.160466+0000","last_active":"2024-09-22T09:16:10.160466+0000","last_peered":"2024-09-22T09:16:10.160466+0000","last_clean":"2024-09-22T09:16:10.160466+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:10.160466+0000","last_undegraded":"2024-09-22T09:16:10.160466+0000","last_fullsized":"2024-09-22T09:16:10.160466+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.160369+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:26.305948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":701,"num_read_kb":11614,"num_write":1118,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.997725+0000","last_change":"2024-09-22T09:16:25.997725+0000","last_active":"2024-09-22T09:16:25.997725+0000","last_peered":"2024-09-22T09:16:25.997725+0000","last_clean":"2024-09-22T09:16:25.997725+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:16:25.997725+0000","last_undegraded":"2024-09-22T09:16:25.997725+0000","last_fullsized":"2024-09-22T09:16:25.997725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:27.550802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'297","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.293457+0000","last_change":"2024-09-22T09:16:37.293457+0000","last_active":"2024-09-22T09:16:37.293457+0000","last_peered":"2024-09-22T09:16:37.293457+0000","last_clean":"2024-09-22T09:16:37.293457+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:16:37.293457+0000","last_undegraded":"2024-09-22T09:16:37.293457+0000","last_fullsized":"2024-09-22T09:16:37.293457+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.293351+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:56.164258+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1154,"num_write":408,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.767167+0000","last_change":"2024-09-22T09:16:31.767167+0000","last_active":"2024-09-22T09:16:31.767167+0000","last_peered":"2024-09-22T09:16:31.767167+0000","last_clean":"2024-09-22T09:16:31.767167+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:16:31.767167+0000","last_undegraded":"2024-09-22T09:16:31.767167+0000","last_fullsized":"2024-09-22T09:16:31.767167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.767068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:32.629069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'153","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.296188+0000","last_change":"2024-09-22T08:17:48.365625+0000","last_active":"2024-09-22T09:15:24.296188+0000","last_peered":"2024-09-22T09:15:24.296188+0000","last_clean":"2024-09-22T09:15:24.296188+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:15:24.296188+0000","last_undegraded":"2024-09-22T09:15:24.296188+0000","last_fullsized":"2024-09-22T09:15:24.296188+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:22.751064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'671","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.771617+0000","last_change":"2024-09-22T09:16:19.771617+0000","last_active":"2024-09-22T09:16:19.771617+0000","last_peered":"2024-09-22T09:16:19.771617+0000","last_clean":"2024-09-22T09:16:19.771617+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:16:19.771617+0000","last_undegraded":"2024-09-22T09:16:19.771617+0000","last_fullsized":"2024-09-22T09:16:19.771617+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'671","last_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_deep_scrub":"261'671","last_deep_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.771511+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:54.246211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'302","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.735731+0000","last_change":"2024-09-22T09:16:15.735731+0000","last_active":"2024-09-22T09:16:15.735731+0000","last_peered":"2024-09-22T09:16:15.735731+0000","last_clean":"2024-09-22T09:16:15.735731+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:15.735731+0000","last_undegraded":"2024-09-22T09:16:15.735731+0000","last_fullsized":"2024-09-22T09:16:15.735731+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'302","last_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_deep_scrub":"261'302","last_deep_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.735596+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:46.178060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655841,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":50029,"num_write":1017,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.637101+0000","last_change":"2024-09-22T09:16:31.637101+0000","last_active":"2024-09-22T09:16:31.637101+0000","last_peered":"2024-09-22T09:16:31.637101+0000","last_clean":"2024-09-22T09:16:31.637101+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:16:31.637101+0000","last_undegraded":"2024-09-22T09:16:31.637101+0000","last_fullsized":"2024-09-22T09:16:31.637101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.637013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:17.159451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'95","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.090331+0000","last_change":"2024-09-22T09:16:46.090331+0000","last_active":"2024-09-22T09:16:46.090331+0000","last_peered":"2024-09-22T09:16:46.090331+0000","last_clean":"2024-09-22T09:16:46.090331+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:16:46.090331+0000","last_undegraded":"2024-09-22T09:16:46.090331+0000","last_fullsized":"2024-09-22T09:16:46.090331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.090230+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:28.048688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'780","reported_seq":2599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.596983+0000","last_change":"2024-09-22T09:16:30.596983+0000","last_active":"2024-09-22T09:16:30.596983+0000","last_peered":"2024-09-22T09:16:30.596983+0000","last_clean":"2024-09-22T09:16:30.596983+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:30.596983+0000","last_undegraded":"2024-09-22T09:16:30.596983+0000","last_fullsized":"2024-09-22T09:16:30.596983+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.596880+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:46.027022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:47.779712+0000","last_change":"2024-09-22T08:17:48.370452+0000","last_active":"2024-09-22T09:13:47.779712+0000","last_peered":"2024-09-22T09:13:47.779712+0000","last_clean":"2024-09-22T09:13:47.779712+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:13:47.779712+0000","last_undegraded":"2024-09-22T09:13:47.779712+0000","last_fullsized":"2024-09-22T09:13:47.779712+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:32.369770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'509","reported_seq":2223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.919171+0000","last_change":"2024-09-22T09:16:21.919171+0000","last_active":"2024-09-22T09:16:21.919171+0000","last_peered":"2024-09-22T09:16:21.919171+0000","last_clean":"2024-09-22T09:16:21.919171+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:16:21.919171+0000","last_undegraded":"2024-09-22T09:16:21.919171+0000","last_fullsized":"2024-09-22T09:16:21.919171+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'509","last_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_deep_scrub":"261'509","last_deep_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.919066+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:06.667960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'372","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.163050+0000","last_change":"2024-09-22T09:16:11.163050+0000","last_active":"2024-09-22T09:16:11.163050+0000","last_peered":"2024-09-22T09:16:11.163050+0000","last_clean":"2024-09-22T09:16:11.163050+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:11.163050+0000","last_undegraded":"2024-09-22T09:16:11.163050+0000","last_fullsized":"2024-09-22T09:16:11.163050+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.162937+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:59.374048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":33741,"num_write":1117,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.202193+0000","last_change":"2024-09-22T09:16:26.202193+0000","last_active":"2024-09-22T09:16:26.202193+0000","last_peered":"2024-09-22T09:16:26.202193+0000","last_clean":"2024-09-22T09:16:26.202193+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:16:26.202193+0000","last_undegraded":"2024-09-22T09:16:26.202193+0000","last_fullsized":"2024-09-22T09:16:26.202193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.202094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:26.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.648190+0000","last_change":"2024-09-22T09:16:29.648190+0000","last_active":"2024-09-22T09:16:29.648190+0000","last_peered":"2024-09-22T09:16:29.648190+0000","last_clean":"2024-09-22T09:16:29.648190+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:16:29.648190+0000","last_undegraded":"2024-09-22T09:16:29.648190+0000","last_fullsized":"2024-09-22T09:16:29.648190+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.648057+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:58.062115+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53474,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1042,"num_write":392,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.575584+0000","last_change":"2024-09-22T09:16:41.575584+0000","last_active":"2024-09-22T09:16:41.575584+0000","last_peered":"2024-09-22T09:16:41.575584+0000","last_clean":"2024-09-22T09:16:41.575584+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:16:41.575584+0000","last_undegraded":"2024-09-22T09:16:41.575584+0000","last_fullsized":"2024-09-22T09:16:41.575584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.575466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:56.385870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'134","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.214251+0000","last_change":"2024-09-22T09:16:38.214251+0000","last_active":"2024-09-22T09:16:38.214251+0000","last_peered":"2024-09-22T09:16:38.214251+0000","last_clean":"2024-09-22T09:16:38.214251+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:16:38.214251+0000","last_undegraded":"2024-09-22T09:16:38.214251+0000","last_fullsized":"2024-09-22T09:16:38.214251+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.214150+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:12.089725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1511","reported_seq":3232,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.894120+0000","last_change":"2024-09-22T09:16:20.894120+0000","last_active":"2024-09-22T09:16:20.894120+0000","last_peered":"2024-09-22T09:16:20.894120+0000","last_clean":"2024-09-22T09:16:20.894120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:16:20.894120+0000","last_undegraded":"2024-09-22T09:16:20.894120+0000","last_fullsized":"2024-09-22T09:16:20.894120+0000","mapping_epoch":27,"log_start":"261'1500","ondisk_log_start":"261'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1511","last_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_deep_scrub":"261'1511","last_deep_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.894035+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":1500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.749939+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'336","reported_seq":1087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.280118+0000","last_change":"2024-09-22T09:16:20.280118+0000","last_active":"2024-09-22T09:16:20.280118+0000","last_peered":"2024-09-22T09:16:20.280118+0000","last_clean":"2024-09-22T09:16:20.280118+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:20.280118+0000","last_undegraded":"2024-09-22T09:16:20.280118+0000","last_fullsized":"2024-09-22T09:16:20.280118+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.279952+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:57.092613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":31338,"num_write":1035,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.006452+0000","last_change":"2024-09-22T09:16:25.006452+0000","last_active":"2024-09-22T09:16:25.006452+0000","last_peered":"2024-09-22T09:16:25.006452+0000","last_clean":"2024-09-22T09:16:25.006452+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:16:25.006452+0000","last_undegraded":"2024-09-22T09:16:25.006452+0000","last_fullsized":"2024-09-22T09:16:25.006452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.006360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:22.141389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'314","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.622472+0000","last_change":"2024-09-22T09:16:37.622472+0000","last_active":"2024-09-22T09:16:37.622472+0000","last_peered":"2024-09-22T09:16:37.622472+0000","last_clean":"2024-09-22T09:16:37.622472+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:16:37.622472+0000","last_undegraded":"2024-09-22T09:16:37.622472+0000","last_fullsized":"2024-09-22T09:16:37.622472+0000","mapping_epoch":31,"log_start":"261'301","ondisk_log_start":"261'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.622379+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:59.309829+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148291,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1361,"num_write":420,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:37.778502+0000","last_change":"2024-09-22T08:17:46.349509+0000","last_active":"2024-09-22T09:13:37.778502+0000","last_peered":"2024-09-22T09:13:37.778502+0000","last_clean":"2024-09-22T09:13:37.778502+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:13:37.778502+0000","last_undegraded":"2024-09-22T09:13:37.778502+0000","last_fullsized":"2024-09-22T09:13:37.778502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:47.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'131","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:24.287219+0000","last_change":"2024-09-22T08:17:48.369522+0000","last_active":"2024-09-22T09:15:24.287219+0000","last_peered":"2024-09-22T09:15:24.287219+0000","last_clean":"2024-09-22T09:15:24.287219+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:15:24.287219+0000","last_undegraded":"2024-09-22T09:15:24.287219+0000","last_fullsized":"2024-09-22T09:15:24.287219+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:47.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'510","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.743151+0000","last_change":"2024-09-22T09:16:17.743151+0000","last_active":"2024-09-22T09:16:17.743151+0000","last_peered":"2024-09-22T09:16:17.743151+0000","last_clean":"2024-09-22T09:16:17.743151+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:16:17.743151+0000","last_undegraded":"2024-09-22T09:16:17.743151+0000","last_fullsized":"2024-09-22T09:16:17.743151+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.743028+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:54.091402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'380","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.809942+0000","last_change":"2024-09-22T09:16:12.809942+0000","last_active":"2024-09-22T09:16:12.809942+0000","last_peered":"2024-09-22T09:16:12.809942+0000","last_clean":"2024-09-22T09:16:12.809942+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:12.809942+0000","last_undegraded":"2024-09-22T09:16:12.809942+0000","last_fullsized":"2024-09-22T09:16:12.809942+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.809787+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:23.365576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":50427,"num_write":1201,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.227143+0000","last_change":"2024-09-22T09:16:25.227143+0000","last_active":"2024-09-22T09:16:25.227143+0000","last_peered":"2024-09-22T09:16:25.227143+0000","last_clean":"2024-09-22T09:16:25.227143+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:16:25.227143+0000","last_undegraded":"2024-09-22T09:16:25.227143+0000","last_fullsized":"2024-09-22T09:16:25.227143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.227042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'249","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.205123+0000","last_change":"2024-09-22T09:16:30.205123+0000","last_active":"2024-09-22T09:16:30.205123+0000","last_peered":"2024-09-22T09:16:30.205123+0000","last_clean":"2024-09-22T09:16:30.205123+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:16:30.205123+0000","last_undegraded":"2024-09-22T09:16:30.205123+0000","last_fullsized":"2024-09-22T09:16:30.205123+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.205028+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:12.680661+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43840,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":1016,"num_write":348,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:47.772749+0000","last_change":"2024-09-22T08:17:46.353622+0000","last_active":"2024-09-22T09:12:47.772749+0000","last_peered":"2024-09-22T09:12:47.772749+0000","last_clean":"2024-09-22T09:12:47.772749+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:12:47.772749+0000","last_undegraded":"2024-09-22T09:12:47.772749+0000","last_fullsized":"2024-09-22T09:12:47.772749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:45.326678+0000","last_clean_scrub_stamp":"2024-09-22T08:17:45.326678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:31.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'187","reported_seq":1639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:02.503309+0000","last_change":"2024-09-22T08:17:48.363243+0000","last_active":"2024-09-22T09:14:02.503309+0000","last_peered":"2024-09-22T09:14:02.503309+0000","last_clean":"2024-09-22T09:14:02.503309+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:14:02.503309+0000","last_undegraded":"2024-09-22T09:14:02.503309+0000","last_fullsized":"2024-09-22T09:14:02.503309+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:17:47.343613+0000","last_clean_scrub_stamp":"2024-09-22T08:17:47.343613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:46.160599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'431","reported_seq":2007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.853453+0000","last_change":"2024-09-22T09:16:19.853453+0000","last_active":"2024-09-22T09:16:19.853453+0000","last_peered":"2024-09-22T09:16:19.853453+0000","last_clean":"2024-09-22T09:16:19.853453+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:16:19.853453+0000","last_undegraded":"2024-09-22T09:16:19.853453+0000","last_fullsized":"2024-09-22T09:16:19.853453+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'431","last_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_deep_scrub":"261'431","last_deep_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.853368+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:53.654543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'350","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.739492+0000","last_change":"2024-09-22T09:16:16.739492+0000","last_active":"2024-09-22T09:16:16.739492+0000","last_peered":"2024-09-22T09:16:16.739492+0000","last_clean":"2024-09-22T09:16:16.739492+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:16.739492+0000","last_undegraded":"2024-09-22T09:16:16.739492+0000","last_fullsized":"2024-09-22T09:16:16.739492+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'350","last_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_deep_scrub":"261'350","last_deep_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.739368+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:59.971534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":43723,"num_write":1129,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.658377+0000","last_change":"2024-09-22T09:16:30.658377+0000","last_active":"2024-09-22T09:16:30.658377+0000","last_peered":"2024-09-22T09:16:30.658377+0000","last_clean":"2024-09-22T09:16:30.658377+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:16:30.658377+0000","last_undegraded":"2024-09-22T09:16:30.658377+0000","last_fullsized":"2024-09-22T09:16:30.658377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.658291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:13.543896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'318","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.113220+0000","last_change":"2024-09-22T09:16:44.113220+0000","last_active":"2024-09-22T09:16:44.113220+0000","last_peered":"2024-09-22T09:16:44.113220+0000","last_clean":"2024-09-22T09:16:44.113220+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:16:44.113220+0000","last_undegraded":"2024-09-22T09:16:44.113220+0000","last_fullsized":"2024-09-22T09:16:44.113220+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.113127+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:18.587541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":1187,"num_write":420,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.621967+0000","last_change":"2024-09-22T09:16:42.621967+0000","last_active":"2024-09-22T09:16:42.621967+0000","last_peered":"2024-09-22T09:16:42.621967+0000","last_clean":"2024-09-22T09:16:42.621967+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:16:42.621967+0000","last_undegraded":"2024-09-22T09:16:42.621967+0000","last_fullsized":"2024-09-22T09:16:42.621967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.621829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:16.010558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'142","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.574857+0000","last_change":"2024-09-22T09:16:32.574857+0000","last_active":"2024-09-22T09:16:32.574857+0000","last_peered":"2024-09-22T09:16:32.574857+0000","last_clean":"2024-09-22T09:16:32.574857+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:16:32.574857+0000","last_undegraded":"2024-09-22T09:16:32.574857+0000","last_fullsized":"2024-09-22T09:16:32.574857+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.574766+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:40.930130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'515","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.759180+0000","last_change":"2024-09-22T09:16:21.759180+0000","last_active":"2024-09-22T09:16:21.759180+0000","last_peered":"2024-09-22T09:16:21.759180+0000","last_clean":"2024-09-22T09:16:21.759180+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:16:21.759180+0000","last_undegraded":"2024-09-22T09:16:21.759180+0000","last_fullsized":"2024-09-22T09:16:21.759180+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'515","last_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_deep_scrub":"261'515","last_deep_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.759089+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:02.438247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'327","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.872831+0000","last_change":"2024-09-22T09:16:11.872831+0000","last_active":"2024-09-22T09:16:11.872831+0000","last_peered":"2024-09-22T09:16:11.872831+0000","last_clean":"2024-09-22T09:16:11.872831+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:11.872831+0000","last_undegraded":"2024-09-22T09:16:11.872831+0000","last_fullsized":"2024-09-22T09:16:11.872831+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.872713+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:43.753796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":538,"num_read_kb":33852,"num_write":961,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'420","reported_seq":1887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.764056+0000","last_change":"2024-09-22T09:16:19.764056+0000","last_active":"2024-09-22T09:16:19.764056+0000","last_peered":"2024-09-22T09:16:19.764056+0000","last_clean":"2024-09-22T09:16:19.764056+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:16:19.764056+0000","last_undegraded":"2024-09-22T09:16:19.764056+0000","last_fullsized":"2024-09-22T09:16:19.764056+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'420","last_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_deep_scrub":"261'420","last_deep_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.763959+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:20.402662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'329","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.806176+0000","last_change":"2024-09-22T09:16:12.806176+0000","last_active":"2024-09-22T09:16:12.806176+0000","last_peered":"2024-09-22T09:16:12.806176+0000","last_clean":"2024-09-22T09:16:12.806176+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:12.806176+0000","last_undegraded":"2024-09-22T09:16:12.806176+0000","last_fullsized":"2024-09-22T09:16:12.806176+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.806058+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:03.340195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":555,"num_read_kb":87971,"num_write":959,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.189423+0000","last_change":"2024-09-22T09:16:31.189423+0000","last_active":"2024-09-22T09:16:31.189423+0000","last_peered":"2024-09-22T09:16:31.189423+0000","last_clean":"2024-09-22T09:16:31.189423+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:16:31.189423+0000","last_undegraded":"2024-09-22T09:16:31.189423+0000","last_fullsized":"2024-09-22T09:16:31.189423+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'828","last_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_deep_scrub":"261'828","last_deep_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.189355+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:13.809990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'408","reported_seq":1113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.276787+0000","last_change":"2024-09-22T09:16:21.276787+0000","last_active":"2024-09-22T09:16:21.276787+0000","last_peered":"2024-09-22T09:16:21.276787+0000","last_clean":"2024-09-22T09:16:21.276787+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:21.276787+0000","last_undegraded":"2024-09-22T09:16:21.276787+0000","last_fullsized":"2024-09-22T09:16:21.276787+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.276682+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:18.486550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":902,"num_read_kb":34719,"num_write":1272,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'749","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.677305+0000","last_change":"2024-09-22T09:16:28.677305+0000","last_active":"2024-09-22T09:16:28.677305+0000","last_peered":"2024-09-22T09:16:28.677305+0000","last_clean":"2024-09-22T09:16:28.677305+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:16:28.677305+0000","last_undegraded":"2024-09-22T09:16:28.677305+0000","last_fullsized":"2024-09-22T09:16:28.677305+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'749","last_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_deep_scrub":"261'749","last_deep_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.677182+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:57.444450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.763130+0000","last_change":"2024-09-22T09:16:14.763130+0000","last_active":"2024-09-22T09:16:14.763130+0000","last_peered":"2024-09-22T09:16:14.763130+0000","last_clean":"2024-09-22T09:16:14.763130+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:14.763130+0000","last_undegraded":"2024-09-22T09:16:14.763130+0000","last_fullsized":"2024-09-22T09:16:14.763130+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.762983+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:17.416002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":20346,"num_write":1128,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'501","reported_seq":2082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.679439+0000","last_change":"2024-09-22T09:16:25.679439+0000","last_active":"2024-09-22T09:16:25.679439+0000","last_peered":"2024-09-22T09:16:25.679439+0000","last_clean":"2024-09-22T09:16:25.679439+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:16:25.679439+0000","last_undegraded":"2024-09-22T09:16:25.679439+0000","last_fullsized":"2024-09-22T09:16:25.679439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'501","last_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_deep_scrub":"261'501","last_deep_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.679334+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:06:59.317670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'326","reported_seq":949,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.224569+0000","last_change":"2024-09-22T09:16:13.224569+0000","last_active":"2024-09-22T09:16:13.224569+0000","last_peered":"2024-09-22T09:16:13.224569+0000","last_clean":"2024-09-22T09:16:13.224569+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:13.224569+0000","last_undegraded":"2024-09-22T09:16:13.224569+0000","last_fullsized":"2024-09-22T09:16:13.224569+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.224470+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:14.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26435,"num_write":1053,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'719","reported_seq":2230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.439057+0000","last_change":"2024-09-22T09:16:18.439057+0000","last_active":"2024-09-22T09:16:18.439057+0000","last_peered":"2024-09-22T09:16:18.439057+0000","last_clean":"2024-09-22T09:16:18.439057+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:16:18.439057+0000","last_undegraded":"2024-09-22T09:16:18.439057+0000","last_fullsized":"2024-09-22T09:16:18.439057+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'719","last_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_deep_scrub":"261'719","last_deep_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.438942+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:24.048331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'356","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.218832+0000","last_change":"2024-09-22T09:16:12.218832+0000","last_active":"2024-09-22T09:16:12.218832+0000","last_peered":"2024-09-22T09:16:12.218832+0000","last_clean":"2024-09-22T09:16:12.218832+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:12.218832+0000","last_undegraded":"2024-09-22T09:16:12.218832+0000","last_fullsized":"2024-09-22T09:16:12.218832+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.218723+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:55.208712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":911,"num_write":1065,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'463","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.152371+0000","last_change":"2024-09-22T09:16:23.152371+0000","last_active":"2024-09-22T09:16:23.152371+0000","last_peered":"2024-09-22T09:16:23.152371+0000","last_clean":"2024-09-22T09:16:23.152371+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:16:23.152371+0000","last_undegraded":"2024-09-22T09:16:23.152371+0000","last_fullsized":"2024-09-22T09:16:23.152371+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'463","last_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_deep_scrub":"261'463","last_deep_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.152260+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:19.327801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'445","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.895888+0000","last_change":"2024-09-22T09:16:12.895888+0000","last_active":"2024-09-22T09:16:12.895888+0000","last_peered":"2024-09-22T09:16:12.895888+0000","last_clean":"2024-09-22T09:16:12.895888+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:12.895888+0000","last_undegraded":"2024-09-22T09:16:12.895888+0000","last_fullsized":"2024-09-22T09:16:12.895888+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.895757+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:49.967455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":934,"num_read_kb":31165,"num_write":1662,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'491","reported_seq":2219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.166984+0000","last_change":"2024-09-22T09:16:15.166984+0000","last_active":"2024-09-22T09:16:15.166984+0000","last_peered":"2024-09-22T09:16:15.166984+0000","last_clean":"2024-09-22T09:16:15.166984+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:16:15.166984+0000","last_undegraded":"2024-09-22T09:16:15.166984+0000","last_fullsized":"2024-09-22T09:16:15.166984+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'491","last_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_deep_scrub":"261'491","last_deep_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.166903+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:58.210857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'323","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.737155+0000","last_change":"2024-09-22T09:16:19.737155+0000","last_active":"2024-09-22T09:16:19.737155+0000","last_peered":"2024-09-22T09:16:19.737155+0000","last_clean":"2024-09-22T09:16:19.737155+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:19.737155+0000","last_undegraded":"2024-09-22T09:16:19.737155+0000","last_fullsized":"2024-09-22T09:16:19.737155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.737050+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:20.503931+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":8118,"num_write":1009,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'854","reported_seq":2603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.673418+0000","last_change":"2024-09-22T09:16:22.673418+0000","last_active":"2024-09-22T09:16:22.673418+0000","last_peered":"2024-09-22T09:16:22.673418+0000","last_clean":"2024-09-22T09:16:22.673418+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:16:22.673418+0000","last_undegraded":"2024-09-22T09:16:22.673418+0000","last_fullsized":"2024-09-22T09:16:22.673418+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'854","last_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_deep_scrub":"261'854","last_deep_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.673327+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:44.554979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'407","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.286192+0000","last_change":"2024-09-22T09:16:22.286115+0000","last_active":"2024-09-22T09:16:22.286192+0000","last_peered":"2024-09-22T09:16:22.286192+0000","last_clean":"2024-09-22T09:16:22.286192+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:22.286192+0000","last_undegraded":"2024-09-22T09:16:22.286192+0000","last_fullsized":"2024-09-22T09:16:22.286192+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'407","last_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_deep_scrub":"261'407","last_deep_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.285976+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:01:50.371655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":152949,"num_write":1317,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'442","reported_seq":2080,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.482793+0000","last_change":"2024-09-22T09:16:19.482793+0000","last_active":"2024-09-22T09:16:19.482793+0000","last_peered":"2024-09-22T09:16:19.482793+0000","last_clean":"2024-09-22T09:16:19.482793+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:16:19.482793+0000","last_undegraded":"2024-09-22T09:16:19.482793+0000","last_fullsized":"2024-09-22T09:16:19.482793+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'442","last_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_deep_scrub":"261'442","last_deep_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.482692+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:42.895660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'344","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.751453+0000","last_change":"2024-09-22T09:16:17.751453+0000","last_active":"2024-09-22T09:16:17.751453+0000","last_peered":"2024-09-22T09:16:17.751453+0000","last_clean":"2024-09-22T09:16:17.751453+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:17.751453+0000","last_undegraded":"2024-09-22T09:16:17.751453+0000","last_fullsized":"2024-09-22T09:16:17.751453+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.751277+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:30.489888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":609,"num_read_kb":9331,"num_write":1190,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'930","reported_seq":2517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.699494+0000","last_change":"2024-09-22T09:16:29.699494+0000","last_active":"2024-09-22T09:16:29.699494+0000","last_peered":"2024-09-22T09:16:29.699494+0000","last_clean":"2024-09-22T09:16:29.699494+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:16:29.699494+0000","last_undegraded":"2024-09-22T09:16:29.699494+0000","last_fullsized":"2024-09-22T09:16:29.699494+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'930","last_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_deep_scrub":"261'930","last_deep_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.699399+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:20.466619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'357","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.200735+0000","last_change":"2024-09-22T09:16:12.200735+0000","last_active":"2024-09-22T09:16:12.200735+0000","last_peered":"2024-09-22T09:16:12.200735+0000","last_clean":"2024-09-22T09:16:12.200735+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:12.200735+0000","last_undegraded":"2024-09-22T09:16:12.200735+0000","last_fullsized":"2024-09-22T09:16:12.200735+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.200550+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:39.553247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":484,"num_write":1192,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'831","reported_seq":2470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.203293+0000","last_change":"2024-09-22T09:16:18.203293+0000","last_active":"2024-09-22T09:16:18.203293+0000","last_peered":"2024-09-22T09:16:18.203293+0000","last_clean":"2024-09-22T09:16:18.203293+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:16:18.203293+0000","last_undegraded":"2024-09-22T09:16:18.203293+0000","last_fullsized":"2024-09-22T09:16:18.203293+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.203194+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:46.422305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'455","reported_seq":1183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.719575+0000","last_change":"2024-09-22T09:16:16.719575+0000","last_active":"2024-09-22T09:16:16.719575+0000","last_peered":"2024-09-22T09:16:16.719575+0000","last_clean":"2024-09-22T09:16:16.719575+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:16.719575+0000","last_undegraded":"2024-09-22T09:16:16.719575+0000","last_fullsized":"2024-09-22T09:16:16.719575+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'455","last_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_deep_scrub":"261'455","last_deep_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.719441+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:32.637454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":882,"num_read_kb":67486,"num_write":1537,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.178525+0000","last_change":"2024-09-22T09:16:17.178525+0000","last_active":"2024-09-22T09:16:17.178525+0000","last_peered":"2024-09-22T09:16:17.178525+0000","last_clean":"2024-09-22T09:16:17.178525+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:16:17.178525+0000","last_undegraded":"2024-09-22T09:16:17.178525+0000","last_fullsized":"2024-09-22T09:16:17.178525+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'443","last_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_deep_scrub":"261'443","last_deep_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.178441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.703833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'315","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.578353+0000","last_change":"2024-09-22T09:16:09.578353+0000","last_active":"2024-09-22T09:16:09.578353+0000","last_peered":"2024-09-22T09:16:09.578353+0000","last_clean":"2024-09-22T09:16:09.578353+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:09.578353+0000","last_undegraded":"2024-09-22T09:16:09.578353+0000","last_fullsized":"2024-09-22T09:16:09.578353+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.578247+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:57.589765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":4113,"num_write":1035,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1344","reported_seq":3021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.754474+0000","last_change":"2024-09-22T09:16:18.754474+0000","last_active":"2024-09-22T09:16:18.754474+0000","last_peered":"2024-09-22T09:16:18.754474+0000","last_clean":"2024-09-22T09:16:18.754474+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:16:18.754474+0000","last_undegraded":"2024-09-22T09:16:18.754474+0000","last_fullsized":"2024-09-22T09:16:18.754474+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1344","last_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_deep_scrub":"261'1344","last_deep_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.754381+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":1300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:57.272268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'330","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.246155+0000","last_change":"2024-09-22T09:16:23.246155+0000","last_active":"2024-09-22T09:16:23.246155+0000","last_peered":"2024-09-22T09:16:23.246155+0000","last_clean":"2024-09-22T09:16:23.246155+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:23.246155+0000","last_undegraded":"2024-09-22T09:16:23.246155+0000","last_fullsized":"2024-09-22T09:16:23.246155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.246014+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:58.979313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515353,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":7532,"num_write":972,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'880","reported_seq":2372,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.746082+0000","last_change":"2024-09-22T09:16:22.746082+0000","last_active":"2024-09-22T09:16:22.746082+0000","last_peered":"2024-09-22T09:16:22.746082+0000","last_clean":"2024-09-22T09:16:22.746082+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:16:22.746082+0000","last_undegraded":"2024-09-22T09:16:22.746082+0000","last_fullsized":"2024-09-22T09:16:22.746082+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'880","last_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_deep_scrub":"261'880","last_deep_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.745990+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:18.063674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'315","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.799122+0000","last_change":"2024-09-22T09:16:13.799122+0000","last_active":"2024-09-22T09:16:13.799122+0000","last_peered":"2024-09-22T09:16:13.799122+0000","last_clean":"2024-09-22T09:16:13.799122+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:13.799122+0000","last_undegraded":"2024-09-22T09:16:13.799122+0000","last_fullsized":"2024-09-22T09:16:13.799122+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.799007+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:31.530684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263494,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":814,"num_read_kb":1206,"num_write":1027,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'589","reported_seq":2176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.155968+0000","last_change":"2024-09-22T09:16:16.155915+0000","last_active":"2024-09-22T09:16:16.155968+0000","last_peered":"2024-09-22T09:16:16.155968+0000","last_clean":"2024-09-22T09:16:16.155968+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:16:16.155968+0000","last_undegraded":"2024-09-22T09:16:16.155968+0000","last_fullsized":"2024-09-22T09:16:16.155968+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'589","last_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_deep_scrub":"261'589","last_deep_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.155810+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:42.833807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'352","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.237090+0000","last_change":"2024-09-22T09:16:24.237090+0000","last_active":"2024-09-22T09:16:24.237090+0000","last_peered":"2024-09-22T09:16:24.237090+0000","last_clean":"2024-09-22T09:16:24.237090+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:24.237090+0000","last_undegraded":"2024-09-22T09:16:24.237090+0000","last_fullsized":"2024-09-22T09:16:24.237090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.236968+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:37.139334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":65832,"num_write":1085,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.212752+0000","last_change":"2024-09-22T09:16:27.212752+0000","last_active":"2024-09-22T09:16:27.212752+0000","last_peered":"2024-09-22T09:16:27.212752+0000","last_clean":"2024-09-22T09:16:27.212752+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:27.212752+0000","last_undegraded":"2024-09-22T09:16:27.212752+0000","last_fullsized":"2024-09-22T09:16:27.212752+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.212631+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:44.538803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":15571,"num_write":1043,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'504","reported_seq":2200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.792932+0000","last_change":"2024-09-22T09:16:23.792932+0000","last_active":"2024-09-22T09:16:23.792932+0000","last_peered":"2024-09-22T09:16:23.792932+0000","last_clean":"2024-09-22T09:16:23.792932+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:16:23.792932+0000","last_undegraded":"2024-09-22T09:16:23.792932+0000","last_fullsized":"2024-09-22T09:16:23.792932+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'504","last_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_deep_scrub":"261'504","last_deep_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.792820+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:41.074747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.712012+0000","last_change":"2024-09-22T09:16:21.712012+0000","last_active":"2024-09-22T09:16:21.712012+0000","last_peered":"2024-09-22T09:16:21.712012+0000","last_clean":"2024-09-22T09:16:21.712012+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:21.712012+0000","last_undegraded":"2024-09-22T09:16:21.712012+0000","last_fullsized":"2024-09-22T09:16:21.712012+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.711897+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:26.256735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":80287,"num_write":1039,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'505","reported_seq":2183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.178089+0000","last_change":"2024-09-22T09:16:21.178089+0000","last_active":"2024-09-22T09:16:21.178089+0000","last_peered":"2024-09-22T09:16:21.178089+0000","last_clean":"2024-09-22T09:16:21.178089+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:16:21.178089+0000","last_undegraded":"2024-09-22T09:16:21.178089+0000","last_fullsized":"2024-09-22T09:16:21.178089+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'505","last_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_deep_scrub":"261'505","last_deep_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.177984+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:26.746505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1875,"ondisk_log_size":1875,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637503,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18076,"num_read_kb":37621,"num_write":15217,"num_write_kb":11954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714578,"num_omap_keys":1636,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2200,"ondisk_log_size":2200,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36520,"num_omap_keys":148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4073,"ondisk_log_size":4073,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":51675961,"num_objects":284,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":44405,"num_read_kb":2189102,"num_write":73344,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70811648,"data_stored":70811648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3860,"ondisk_log_size":3860,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":207543,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198277,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510157,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276108,"kb_used_data":15868,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94095732,"statfs":{"total":96636764160,"available":96354029568,"internally_reserved":0,"allocated":16248832,"data_stored":14279973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510157,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172824,"kb_used_data":15304,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":94199016,"statfs":{"total":96636764160,"available":96459792384,"internally_reserved":0,"allocated":15671296,"data_stored":13729926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510160,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333156,"kb_used_data":13204,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038684,"statfs":{"total":96636764160,"available":96295612416,"internally_reserved":0,"allocated":13520896,"data_stored":11543840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510159,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142640,"kb_used_data":12896,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94229200,"statfs":{"total":96636764160,"available":96490700800,"internally_reserved":0,"allocated":13205504,"data_stored":11218915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542862,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249764,"kb_used_data":11796,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94122076,"statfs":{"total":96636764160,"available":96381005824,"internally_reserved":0,"allocated":12079104,"data_stored":10115731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542864,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116748,"kb_used_data":9212,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255092,"statfs":{"total":96636764160,"available":96517214208,"internally_reserved":0,"allocated":9433088,"data_stored":7445675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542863,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290332,"kb_used_data":12044,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94081508,"statfs":{"total":96636764160,"available":96339464192,"internally_reserved":0,"allocated":12333056,"data_stored":10357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542861,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224148,"kb_used_data":12548,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147692,"statfs":{"total":96636764160,"available":96407236608,"internally_reserved":0,"allocated":12849152,"data_stored":10882684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8757248,"data_stored":8757248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":12083200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7569408,"data_stored":7569408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7917568,"data_stored":7917568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:16:51.408 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.408 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.408 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.409 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.410 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.411 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.412 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.413 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.414 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.415 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.416 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.417 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.417 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:33:32.276047+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=33, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.417 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.417 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.418 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.419 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.419 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.419 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.419 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.419 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.420 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.420 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.420 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:17:45.326678+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=45, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.420 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:17:47.343613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=17, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:16:51.420 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:17:11.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:17:11.760 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:17:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:17:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2050,"stamp":"2024-09-22T09:17:09.881556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53921399,"num_objects":751,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":313725,"num_read_kb":2862731,"num_write":165438,"num_write_kb":2483177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":754989,"num_omap_keys":1814,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13824,"ondisk_log_size":13824,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1809880,"kb_used_data":102872,"kb_used_omap":12,"kb_used_meta":1706867,"kb_avail":753164840,"statfs":{"total":773094113280,"available":771240796160,"internally_reserved":0,"allocated":105340928,"data_stored":89574178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1747832368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005910"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.526809+0000","last_change":"2024-09-22T09:16:45.526760+0000","last_active":"2024-09-22T09:16:45.526809+0000","last_peered":"2024-09-22T09:16:45.526809+0000","last_clean":"2024-09-22T09:16:45.526809+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:16:45.526809+0000","last_undegraded":"2024-09-22T09:16:45.526809+0000","last_fullsized":"2024-09-22T09:16:45.526809+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.526682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:00.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.256414+0000","last_change":"2024-09-22T09:16:45.256414+0000","last_active":"2024-09-22T09:16:45.256414+0000","last_peered":"2024-09-22T09:16:45.256414+0000","last_clean":"2024-09-22T09:16:45.256414+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:16:45.256414+0000","last_undegraded":"2024-09-22T09:16:45.256414+0000","last_fullsized":"2024-09-22T09:16:45.256414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.256321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:18.445322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.879873+0000","last_change":"2024-09-22T09:16:47.879873+0000","last_active":"2024-09-22T09:16:47.879873+0000","last_peered":"2024-09-22T09:16:47.879873+0000","last_clean":"2024-09-22T09:16:47.879873+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:16:47.879873+0000","last_undegraded":"2024-09-22T09:16:47.879873+0000","last_fullsized":"2024-09-22T09:16:47.879873+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-22T09:16:47.879780+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-22T09:16:47.879780+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.879780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:22.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":177,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.568274+0000","last_change":"2024-09-22T09:16:49.568274+0000","last_active":"2024-09-22T09:16:49.568274+0000","last_peered":"2024-09-22T09:16:49.568274+0000","last_clean":"2024-09-22T09:16:49.568274+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:16:49.568274+0000","last_undegraded":"2024-09-22T09:16:49.568274+0000","last_fullsized":"2024-09-22T09:16:49.568274+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'43","last_scrub_stamp":"2024-09-22T09:16:49.568189+0000","last_deep_scrub":"261'43","last_deep_scrub_stamp":"2024-09-22T09:16:49.568189+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.568189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:40.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.558026+0000","last_change":"2024-09-22T09:16:52.558026+0000","last_active":"2024-09-22T09:16:52.558026+0000","last_peered":"2024-09-22T09:16:52.558026+0000","last_clean":"2024-09-22T09:16:52.558026+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:16:52.558026+0000","last_undegraded":"2024-09-22T09:16:52.558026+0000","last_fullsized":"2024-09-22T09:16:52.558026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:52.557928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:52.557928+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.557928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:01.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.733327+0000","last_change":"2024-09-22T09:16:49.733327+0000","last_active":"2024-09-22T09:16:49.733327+0000","last_peered":"2024-09-22T09:16:49.733327+0000","last_clean":"2024-09-22T09:16:49.733327+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:16:49.733327+0000","last_undegraded":"2024-09-22T09:16:49.733327+0000","last_fullsized":"2024-09-22T09:16:49.733327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-22T09:16:49.733234+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-22T09:16:49.733234+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.733234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:15.541853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":55,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.872662+0000","last_change":"2024-09-22T09:16:53.872662+0000","last_active":"2024-09-22T09:16:53.872662+0000","last_peered":"2024-09-22T09:16:53.872662+0000","last_clean":"2024-09-22T09:16:53.872662+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:16:53.872662+0000","last_undegraded":"2024-09-22T09:16:53.872662+0000","last_fullsized":"2024-09-22T09:16:53.872662+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:53.872563+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:53.872563+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.872563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:10.368268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":147,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.555038+0000","last_change":"2024-09-22T09:16:48.555038+0000","last_active":"2024-09-22T09:16:48.555038+0000","last_peered":"2024-09-22T09:16:48.555038+0000","last_clean":"2024-09-22T09:16:48.555038+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:16:48.555038+0000","last_undegraded":"2024-09-22T09:16:48.555038+0000","last_fullsized":"2024-09-22T09:16:48.555038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-22T09:16:48.554939+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-22T09:16:48.554939+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.554939+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:03.639890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.308570+0000","last_change":"2024-09-22T09:16:48.308570+0000","last_active":"2024-09-22T09:16:48.308570+0000","last_peered":"2024-09-22T09:16:48.308570+0000","last_clean":"2024-09-22T09:16:48.308570+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:16:48.308570+0000","last_undegraded":"2024-09-22T09:16:48.308570+0000","last_fullsized":"2024-09-22T09:16:48.308570+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:48.308484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:48.308484+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.308484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:18.776448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:02.916019+0000","last_change":"2024-09-22T09:17:02.916019+0000","last_active":"2024-09-22T09:17:02.916019+0000","last_peered":"2024-09-22T09:17:02.916019+0000","last_clean":"2024-09-22T09:17:02.916019+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:17:02.916019+0000","last_undegraded":"2024-09-22T09:17:02.916019+0000","last_fullsized":"2024-09-22T09:17:02.916019+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:17:02.915901+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:17:02.915901+0000","last_clean_scrub_stamp":"2024-09-22T09:17:02.915901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:40.923605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.886434+0000","last_change":"2024-09-22T09:16:48.886434+0000","last_active":"2024-09-22T09:16:48.886434+0000","last_peered":"2024-09-22T09:16:48.886434+0000","last_clean":"2024-09-22T09:16:48.886434+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:16:48.886434+0000","last_undegraded":"2024-09-22T09:16:48.886434+0000","last_fullsized":"2024-09-22T09:16:48.886434+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:48.886351+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:48.886351+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.886351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:16.817854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.382373+0000","last_change":"2024-09-22T09:16:44.382373+0000","last_active":"2024-09-22T09:16:44.382373+0000","last_peered":"2024-09-22T09:16:44.382373+0000","last_clean":"2024-09-22T09:16:44.382373+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:16:44.382373+0000","last_undegraded":"2024-09-22T09:16:44.382373+0000","last_fullsized":"2024-09-22T09:16:44.382373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'62","last_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_deep_scrub":"261'62","last_deep_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.382287+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:32.719724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:41.778131+0000","last_change":"2024-09-22T08:51:48.553187+0000","last_active":"2024-09-22T09:13:41.778131+0000","last_peered":"2024-09-22T09:13:41.778131+0000","last_clean":"2024-09-22T09:13:41.778131+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:13:41.778131+0000","last_undegraded":"2024-09-22T09:13:41.778131+0000","last_fullsized":"2024-09-22T09:13:41.778131+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:38.435160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:00.874163+0000","last_change":"2024-09-22T09:17:00.874163+0000","last_active":"2024-09-22T09:17:00.874163+0000","last_peered":"2024-09-22T09:17:00.874163+0000","last_clean":"2024-09-22T09:17:00.874163+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:17:00.874163+0000","last_undegraded":"2024-09-22T09:17:00.874163+0000","last_fullsized":"2024-09-22T09:17:00.874163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:00.874073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:00.874073+0000","last_clean_scrub_stamp":"2024-09-22T09:17:00.874073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:27.404252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.240389+0000","last_change":"2024-09-22T09:16:44.240389+0000","last_active":"2024-09-22T09:16:44.240389+0000","last_peered":"2024-09-22T09:16:44.240389+0000","last_clean":"2024-09-22T09:16:44.240389+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:16:44.240389+0000","last_undegraded":"2024-09-22T09:16:44.240389+0000","last_fullsized":"2024-09-22T09:16:44.240389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.240305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:21:11.694952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.365856+0000","last_change":"2024-09-22T09:16:43.365856+0000","last_active":"2024-09-22T09:16:43.365856+0000","last_peered":"2024-09-22T09:16:43.365856+0000","last_clean":"2024-09-22T09:16:43.365856+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:16:43.365856+0000","last_undegraded":"2024-09-22T09:16:43.365856+0000","last_fullsized":"2024-09-22T09:16:43.365856+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.365756+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:43.604511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.987897+0000","last_change":"2024-09-22T09:16:58.987897+0000","last_active":"2024-09-22T09:16:58.987897+0000","last_peered":"2024-09-22T09:16:58.987897+0000","last_clean":"2024-09-22T09:16:58.987897+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:16:58.987897+0000","last_undegraded":"2024-09-22T09:16:58.987897+0000","last_fullsized":"2024-09-22T09:16:58.987897+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:58.987803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:58.987803+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.987803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:56.778479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.598266+0000","last_change":"2024-09-22T09:16:40.598266+0000","last_active":"2024-09-22T09:16:40.598266+0000","last_peered":"2024-09-22T09:16:40.598266+0000","last_clean":"2024-09-22T09:16:40.598266+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:16:40.598266+0000","last_undegraded":"2024-09-22T09:16:40.598266+0000","last_fullsized":"2024-09-22T09:16:40.598266+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.598158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:01.390559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.886948+0000","last_change":"2024-09-22T09:16:52.886948+0000","last_active":"2024-09-22T09:16:52.886948+0000","last_peered":"2024-09-22T09:16:52.886948+0000","last_clean":"2024-09-22T09:16:52.886948+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:16:52.886948+0000","last_undegraded":"2024-09-22T09:16:52.886948+0000","last_fullsized":"2024-09-22T09:16:52.886948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:52.886838+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:52.886838+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.886838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:26.738065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.308367+0000","last_change":"2024-09-22T09:16:41.308367+0000","last_active":"2024-09-22T09:16:41.308367+0000","last_peered":"2024-09-22T09:16:41.308367+0000","last_clean":"2024-09-22T09:16:41.308367+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:16:41.308367+0000","last_undegraded":"2024-09-22T09:16:41.308367+0000","last_fullsized":"2024-09-22T09:16:41.308367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.308277+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:23.833047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.601217+0000","last_change":"2024-09-22T09:16:53.601217+0000","last_active":"2024-09-22T09:16:53.601217+0000","last_peered":"2024-09-22T09:16:53.601217+0000","last_clean":"2024-09-22T09:16:53.601217+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:16:53.601217+0000","last_undegraded":"2024-09-22T09:16:53.601217+0000","last_fullsized":"2024-09-22T09:16:53.601217+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:53.601126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:53.601126+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.601126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:15.700619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:12:32.770787+0000","last_change":"2024-09-22T08:36:17.552101+0000","last_active":"2024-09-22T09:12:32.770787+0000","last_peered":"2024-09-22T09:12:32.770787+0000","last_clean":"2024-09-22T09:12:32.770787+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:12:32.770787+0000","last_undegraded":"2024-09-22T09:12:32.770787+0000","last_fullsized":"2024-09-22T09:12:32.770787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:56.712818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:07.790972+0000","last_change":"2024-09-22T08:36:14.525606+0000","last_active":"2024-09-22T09:15:07.790972+0000","last_peered":"2024-09-22T09:15:07.790972+0000","last_clean":"2024-09-22T09:15:07.790972+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:15:07.790972+0000","last_undegraded":"2024-09-22T09:15:07.790972+0000","last_fullsized":"2024-09-22T09:15:07.790972+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:13.491552+0000","last_clean_scrub_stamp":"2024-09-22T08:36:13.491552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:39.398386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":190,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.921997+0000","last_change":"2024-09-22T09:16:40.921997+0000","last_active":"2024-09-22T09:16:40.921997+0000","last_peered":"2024-09-22T09:16:40.921997+0000","last_clean":"2024-09-22T09:16:40.921997+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:16:40.921997+0000","last_undegraded":"2024-09-22T09:16:40.921997+0000","last_fullsized":"2024-09-22T09:16:40.921997+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.921882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:35.683665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.700715+0000","last_change":"2024-09-22T09:16:52.700715+0000","last_active":"2024-09-22T09:16:52.700715+0000","last_peered":"2024-09-22T09:16:52.700715+0000","last_clean":"2024-09-22T09:16:52.700715+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:16:52.700715+0000","last_undegraded":"2024-09-22T09:16:52.700715+0000","last_fullsized":"2024-09-22T09:16:52.700715+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:52.700629+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:52.700629+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.700629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:15.661021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.757277+0000","last_change":"2024-09-22T09:16:48.757277+0000","last_active":"2024-09-22T09:16:48.757277+0000","last_peered":"2024-09-22T09:16:48.757277+0000","last_clean":"2024-09-22T09:16:48.757277+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:16:48.757277+0000","last_undegraded":"2024-09-22T09:16:48.757277+0000","last_fullsized":"2024-09-22T09:16:48.757277+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:48.757177+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:48.757177+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.757177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:36.202816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.558532+0000","last_change":"2024-09-22T09:16:36.558532+0000","last_active":"2024-09-22T09:16:36.558532+0000","last_peered":"2024-09-22T09:16:36.558532+0000","last_clean":"2024-09-22T09:16:36.558532+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:16:36.558532+0000","last_undegraded":"2024-09-22T09:16:36.558532+0000","last_fullsized":"2024-09-22T09:16:36.558532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.558400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:20.467650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.837862+0000","last_change":"2024-09-22T09:16:41.837862+0000","last_active":"2024-09-22T09:16:41.837862+0000","last_peered":"2024-09-22T09:16:41.837862+0000","last_clean":"2024-09-22T09:16:41.837862+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:16:41.837862+0000","last_undegraded":"2024-09-22T09:16:41.837862+0000","last_fullsized":"2024-09-22T09:16:41.837862+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'231","last_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_deep_scrub":"258'231","last_deep_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.837741+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:20.560690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.557169+0000","last_change":"2024-09-22T09:16:46.557103+0000","last_active":"2024-09-22T09:16:46.557169+0000","last_peered":"2024-09-22T09:16:46.557169+0000","last_clean":"2024-09-22T09:16:46.557169+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:16:46.557169+0000","last_undegraded":"2024-09-22T09:16:46.557169+0000","last_fullsized":"2024-09-22T09:16:46.557169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.557012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.050098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.973634+0000","last_change":"2024-09-22T09:16:55.973634+0000","last_active":"2024-09-22T09:16:55.973634+0000","last_peered":"2024-09-22T09:16:55.973634+0000","last_clean":"2024-09-22T09:16:55.973634+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:16:55.973634+0000","last_undegraded":"2024-09-22T09:16:55.973634+0000","last_fullsized":"2024-09-22T09:16:55.973634+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:55.973521+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:55.973521+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.973521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:25.588102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.407425+0000","last_change":"2024-09-22T09:16:47.407425+0000","last_active":"2024-09-22T09:16:47.407425+0000","last_peered":"2024-09-22T09:16:47.407425+0000","last_clean":"2024-09-22T09:16:47.407425+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:16:47.407425+0000","last_undegraded":"2024-09-22T09:16:47.407425+0000","last_fullsized":"2024-09-22T09:16:47.407425+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:47.407346+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:47.407346+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.407346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:42.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.321769+0000","last_change":"2024-09-22T09:16:42.321672+0000","last_active":"2024-09-22T09:16:42.321769+0000","last_peered":"2024-09-22T09:16:42.321769+0000","last_clean":"2024-09-22T09:16:42.321769+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:16:42.321769+0000","last_undegraded":"2024-09-22T09:16:42.321769+0000","last_fullsized":"2024-09-22T09:16:42.321769+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.321561+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:44.112776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:05.887807+0000","last_change":"2024-09-22T09:17:05.887807+0000","last_active":"2024-09-22T09:17:05.887807+0000","last_peered":"2024-09-22T09:17:05.887807+0000","last_clean":"2024-09-22T09:17:05.887807+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:17:05.887807+0000","last_undegraded":"2024-09-22T09:17:05.887807+0000","last_fullsized":"2024-09-22T09:17:05.887807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:05.887716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:05.887716+0000","last_clean_scrub_stamp":"2024-09-22T09:17:05.887716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:01.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.992310+0000","last_change":"2024-09-22T09:16:52.992310+0000","last_active":"2024-09-22T09:16:52.992310+0000","last_peered":"2024-09-22T09:16:52.992310+0000","last_clean":"2024-09-22T09:16:52.992310+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:16:52.992310+0000","last_undegraded":"2024-09-22T09:16:52.992310+0000","last_fullsized":"2024-09-22T09:16:52.992310+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:52.992201+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:52.992201+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.992201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:25:08.516951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'5","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:07.025572+0000","last_change":"2024-09-22T09:17:07.025572+0000","last_active":"2024-09-22T09:17:07.025572+0000","last_peered":"2024-09-22T09:17:07.025572+0000","last_clean":"2024-09-22T09:17:07.025572+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:17:07.025572+0000","last_undegraded":"2024-09-22T09:17:07.025572+0000","last_fullsized":"2024-09-22T09:17:07.025572+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:17:07.025470+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:17:07.025470+0000","last_clean_scrub_stamp":"2024-09-22T09:17:07.025470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:27.423097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.511483+0000","last_change":"2024-09-22T09:16:47.511423+0000","last_active":"2024-09-22T09:16:47.511483+0000","last_peered":"2024-09-22T09:16:47.511483+0000","last_clean":"2024-09-22T09:16:47.511483+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:16:47.511483+0000","last_undegraded":"2024-09-22T09:16:47.511483+0000","last_fullsized":"2024-09-22T09:16:47.511483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'58","last_scrub_stamp":"2024-09-22T09:16:47.511333+0000","last_deep_scrub":"261'58","last_deep_scrub_stamp":"2024-09-22T09:16:47.511333+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.511333+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:17.649586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.463304+0000","last_change":"2024-09-22T09:16:49.463304+0000","last_active":"2024-09-22T09:16:49.463304+0000","last_peered":"2024-09-22T09:16:49.463304+0000","last_clean":"2024-09-22T09:16:49.463304+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:16:49.463304+0000","last_undegraded":"2024-09-22T09:16:49.463304+0000","last_fullsized":"2024-09-22T09:16:49.463304+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:49.463214+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:49.463214+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.463214+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:24.961549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:59.823917+0000","last_change":"2024-09-22T09:16:59.823917+0000","last_active":"2024-09-22T09:16:59.823917+0000","last_peered":"2024-09-22T09:16:59.823917+0000","last_clean":"2024-09-22T09:16:59.823917+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:16:59.823917+0000","last_undegraded":"2024-09-22T09:16:59.823917+0000","last_fullsized":"2024-09-22T09:16:59.823917+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:59.823819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:59.823819+0000","last_clean_scrub_stamp":"2024-09-22T09:16:59.823819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:25.981552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.575100+0000","last_change":"2024-09-22T09:16:35.575100+0000","last_active":"2024-09-22T09:16:35.575100+0000","last_peered":"2024-09-22T09:16:35.575100+0000","last_clean":"2024-09-22T09:16:35.575100+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:16:35.575100+0000","last_undegraded":"2024-09-22T09:16:35.575100+0000","last_fullsized":"2024-09-22T09:16:35.575100+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.574995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:47.143313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.563426+0000","last_change":"2024-09-22T09:16:45.563359+0000","last_active":"2024-09-22T09:16:45.563426+0000","last_peered":"2024-09-22T09:16:45.563426+0000","last_clean":"2024-09-22T09:16:45.563426+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:16:45.563426+0000","last_undegraded":"2024-09-22T09:16:45.563426+0000","last_fullsized":"2024-09-22T09:16:45.563426+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.563268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:15.508239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.653289+0000","last_change":"2024-09-22T09:16:51.653289+0000","last_active":"2024-09-22T09:16:51.653289+0000","last_peered":"2024-09-22T09:16:51.653289+0000","last_clean":"2024-09-22T09:16:51.653289+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:16:51.653289+0000","last_undegraded":"2024-09-22T09:16:51.653289+0000","last_fullsized":"2024-09-22T09:16:51.653289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:51.653217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:51.653217+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.653217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:34.074491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'8","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.958630+0000","last_change":"2024-09-22T09:16:54.958630+0000","last_active":"2024-09-22T09:16:54.958630+0000","last_peered":"2024-09-22T09:16:54.958630+0000","last_clean":"2024-09-22T09:16:54.958630+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:16:54.958630+0000","last_undegraded":"2024-09-22T09:16:54.958630+0000","last_fullsized":"2024-09-22T09:16:54.958630+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:54.958540+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:54.958540+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.958540+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:21.344147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.900201+0000","last_change":"2024-09-22T09:16:46.900201+0000","last_active":"2024-09-22T09:16:46.900201+0000","last_peered":"2024-09-22T09:16:46.900201+0000","last_clean":"2024-09-22T09:16:46.900201+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:16:46.900201+0000","last_undegraded":"2024-09-22T09:16:46.900201+0000","last_fullsized":"2024-09-22T09:16:46.900201+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:46.900109+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:46.900109+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.900109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:36.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.818121+0000","last_change":"2024-09-22T09:16:40.818045+0000","last_active":"2024-09-22T09:16:40.818121+0000","last_peered":"2024-09-22T09:16:40.818121+0000","last_clean":"2024-09-22T09:16:40.818121+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:16:40.818121+0000","last_undegraded":"2024-09-22T09:16:40.818121+0000","last_fullsized":"2024-09-22T09:16:40.818121+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.817964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:14.856963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.565348+0000","last_change":"2024-09-22T09:16:43.565348+0000","last_active":"2024-09-22T09:16:43.565348+0000","last_peered":"2024-09-22T09:16:43.565348+0000","last_clean":"2024-09-22T09:16:43.565348+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:16:43.565348+0000","last_undegraded":"2024-09-22T09:16:43.565348+0000","last_fullsized":"2024-09-22T09:16:43.565348+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.565209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:13.820778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.585871+0000","last_change":"2024-09-22T09:16:39.585871+0000","last_active":"2024-09-22T09:16:39.585871+0000","last_peered":"2024-09-22T09:16:39.585871+0000","last_clean":"2024-09-22T09:16:39.585871+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:16:39.585871+0000","last_undegraded":"2024-09-22T09:16:39.585871+0000","last_fullsized":"2024-09-22T09:16:39.585871+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.585774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:19.267444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.872943+0000","last_change":"2024-09-22T09:16:51.872943+0000","last_active":"2024-09-22T09:16:51.872943+0000","last_peered":"2024-09-22T09:16:51.872943+0000","last_clean":"2024-09-22T09:16:51.872943+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:16:51.872943+0000","last_undegraded":"2024-09-22T09:16:51.872943+0000","last_fullsized":"2024-09-22T09:16:51.872943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:51.872813+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:51.872813+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.872813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:22.724278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":236,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:02.083231+0000","last_change":"2024-09-22T09:17:02.083231+0000","last_active":"2024-09-22T09:17:02.083231+0000","last_peered":"2024-09-22T09:17:02.083231+0000","last_clean":"2024-09-22T09:17:02.083231+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:17:02.083231+0000","last_undegraded":"2024-09-22T09:17:02.083231+0000","last_fullsized":"2024-09-22T09:17:02.083231+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-22T09:17:02.083150+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-22T09:17:02.083150+0000","last_clean_scrub_stamp":"2024-09-22T09:17:02.083150+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:17.076118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:36.777457+0000","last_change":"2024-09-22T08:51:48.551638+0000","last_active":"2024-09-22T09:13:36.777457+0000","last_peered":"2024-09-22T09:13:36.777457+0000","last_clean":"2024-09-22T09:13:36.777457+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:13:36.777457+0000","last_undegraded":"2024-09-22T09:13:36.777457+0000","last_fullsized":"2024-09-22T09:13:36.777457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:57.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.873571+0000","last_change":"2024-09-22T09:16:58.873571+0000","last_active":"2024-09-22T09:16:58.873571+0000","last_peered":"2024-09-22T09:16:58.873571+0000","last_clean":"2024-09-22T09:16:58.873571+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:16:58.873571+0000","last_undegraded":"2024-09-22T09:16:58.873571+0000","last_fullsized":"2024-09-22T09:16:58.873571+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:58.873479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:58.873479+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.873479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:18.176271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.174488+0000","last_change":"2024-09-22T09:16:41.174488+0000","last_active":"2024-09-22T09:16:41.174488+0000","last_peered":"2024-09-22T09:16:41.174488+0000","last_clean":"2024-09-22T09:16:41.174488+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:16:41.174488+0000","last_undegraded":"2024-09-22T09:16:41.174488+0000","last_fullsized":"2024-09-22T09:16:41.174488+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.174406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:18.069254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:01.059417+0000","last_change":"2024-09-22T09:17:01.059417+0000","last_active":"2024-09-22T09:17:01.059417+0000","last_peered":"2024-09-22T09:17:01.059417+0000","last_clean":"2024-09-22T09:17:01.059417+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:17:01.059417+0000","last_undegraded":"2024-09-22T09:17:01.059417+0000","last_fullsized":"2024-09-22T09:17:01.059417+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:17:01.059326+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:17:01.059326+0000","last_clean_scrub_stamp":"2024-09-22T09:17:01.059326+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:03.110912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.509412+0000","last_change":"2024-09-22T09:16:50.509412+0000","last_active":"2024-09-22T09:16:50.509412+0000","last_peered":"2024-09-22T09:16:50.509412+0000","last_clean":"2024-09-22T09:16:50.509412+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:16:50.509412+0000","last_undegraded":"2024-09-22T09:16:50.509412+0000","last_fullsized":"2024-09-22T09:16:50.509412+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.509287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.509287+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.509287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:28.291726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.888511+0000","last_change":"2024-09-22T09:16:57.888511+0000","last_active":"2024-09-22T09:16:57.888511+0000","last_peered":"2024-09-22T09:16:57.888511+0000","last_clean":"2024-09-22T09:16:57.888511+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:16:57.888511+0000","last_undegraded":"2024-09-22T09:16:57.888511+0000","last_fullsized":"2024-09-22T09:16:57.888511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:57.888420+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:57.888420+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.888420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:37.008048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.887860+0000","last_change":"2024-09-22T09:16:50.887860+0000","last_active":"2024-09-22T09:16:50.887860+0000","last_peered":"2024-09-22T09:16:50.887860+0000","last_clean":"2024-09-22T09:16:50.887860+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:16:50.887860+0000","last_undegraded":"2024-09-22T09:16:50.887860+0000","last_fullsized":"2024-09-22T09:16:50.887860+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.887764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.887764+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.887764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:41.284980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.776787+0000","last_change":"2024-09-22T09:16:39.776787+0000","last_active":"2024-09-22T09:16:39.776787+0000","last_peered":"2024-09-22T09:16:39.776787+0000","last_clean":"2024-09-22T09:16:39.776787+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:16:39.776787+0000","last_undegraded":"2024-09-22T09:16:39.776787+0000","last_fullsized":"2024-09-22T09:16:39.776787+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.776702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:50.757487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.649439+0000","last_change":"2024-09-22T09:16:54.649439+0000","last_active":"2024-09-22T09:16:54.649439+0000","last_peered":"2024-09-22T09:16:54.649439+0000","last_clean":"2024-09-22T09:16:54.649439+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:16:54.649439+0000","last_undegraded":"2024-09-22T09:16:54.649439+0000","last_fullsized":"2024-09-22T09:16:54.649439+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:54.649350+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:54.649350+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.649350+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.206964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.976779+0000","last_change":"2024-09-22T09:16:53.976779+0000","last_active":"2024-09-22T09:16:53.976779+0000","last_peered":"2024-09-22T09:16:53.976779+0000","last_clean":"2024-09-22T09:16:53.976779+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:16:53.976779+0000","last_undegraded":"2024-09-22T09:16:53.976779+0000","last_fullsized":"2024-09-22T09:16:53.976779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:53.976683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:53.976683+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.976683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:15.342300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.164637+0000","last_change":"2024-09-22T09:16:42.164637+0000","last_active":"2024-09-22T09:16:42.164637+0000","last_peered":"2024-09-22T09:16:42.164637+0000","last_clean":"2024-09-22T09:16:42.164637+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:16:42.164637+0000","last_undegraded":"2024-09-22T09:16:42.164637+0000","last_fullsized":"2024-09-22T09:16:42.164637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.164533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.065385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":79,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.930369+0000","last_change":"2024-09-22T09:16:39.930369+0000","last_active":"2024-09-22T09:16:39.930369+0000","last_peered":"2024-09-22T09:16:39.930369+0000","last_clean":"2024-09-22T09:16:39.930369+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:16:39.930369+0000","last_undegraded":"2024-09-22T09:16:39.930369+0000","last_fullsized":"2024-09-22T09:16:39.930369+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.930265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:36.946812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.528627+0000","last_change":"2024-09-22T09:16:51.528627+0000","last_active":"2024-09-22T09:16:51.528627+0000","last_peered":"2024-09-22T09:16:51.528627+0000","last_clean":"2024-09-22T09:16:51.528627+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:16:51.528627+0000","last_undegraded":"2024-09-22T09:16:51.528627+0000","last_fullsized":"2024-09-22T09:16:51.528627+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:51.528520+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:51.528520+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.528520+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.169637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:15:57.798094+0000","last_change":"2024-09-22T08:36:17.556923+0000","last_active":"2024-09-22T09:15:57.798094+0000","last_peered":"2024-09-22T09:15:57.798094+0000","last_clean":"2024-09-22T09:15:57.798094+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:15:57.798094+0000","last_undegraded":"2024-09-22T09:15:57.798094+0000","last_fullsized":"2024-09-22T09:15:57.798094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:34.218397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":26642,"num_write":15,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.211955+0000","last_change":"2024-09-22T09:16:43.211955+0000","last_active":"2024-09-22T09:16:43.211955+0000","last_peered":"2024-09-22T09:16:43.211955+0000","last_clean":"2024-09-22T09:16:43.211955+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:16:43.211955+0000","last_undegraded":"2024-09-22T09:16:43.211955+0000","last_fullsized":"2024-09-22T09:16:43.211955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.211856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:30.934538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":121,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.776115+0000","last_change":"2024-09-22T09:16:38.776115+0000","last_active":"2024-09-22T09:16:38.776115+0000","last_peered":"2024-09-22T09:16:38.776115+0000","last_clean":"2024-09-22T09:16:38.776115+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:16:38.776115+0000","last_undegraded":"2024-09-22T09:16:38.776115+0000","last_fullsized":"2024-09-22T09:16:38.776115+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.776008+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:55.501761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:04.925451+0000","last_change":"2024-09-22T09:17:04.925451+0000","last_active":"2024-09-22T09:17:04.925451+0000","last_peered":"2024-09-22T09:17:04.925451+0000","last_clean":"2024-09-22T09:17:04.925451+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:17:04.925451+0000","last_undegraded":"2024-09-22T09:17:04.925451+0000","last_fullsized":"2024-09-22T09:17:04.925451+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:04.925360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:04.925360+0000","last_clean_scrub_stamp":"2024-09-22T09:17:04.925360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:42.706766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.961150+0000","last_change":"2024-09-22T09:16:50.961150+0000","last_active":"2024-09-22T09:16:50.961150+0000","last_peered":"2024-09-22T09:16:50.961150+0000","last_clean":"2024-09-22T09:16:50.961150+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:16:50.961150+0000","last_undegraded":"2024-09-22T09:16:50.961150+0000","last_fullsized":"2024-09-22T09:16:50.961150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.961057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.961057+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.961057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:10.645656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.875900+0000","last_change":"2024-09-22T09:16:43.875827+0000","last_active":"2024-09-22T09:16:43.875900+0000","last_peered":"2024-09-22T09:16:43.875900+0000","last_clean":"2024-09-22T09:16:43.875900+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:16:43.875900+0000","last_undegraded":"2024-09-22T09:16:43.875900+0000","last_fullsized":"2024-09-22T09:16:43.875900+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.875715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:54.884470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.808080+0000","last_change":"2024-09-22T09:16:37.808080+0000","last_active":"2024-09-22T09:16:37.808080+0000","last_peered":"2024-09-22T09:16:37.808080+0000","last_clean":"2024-09-22T09:16:37.808080+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:16:37.808080+0000","last_undegraded":"2024-09-22T09:16:37.808080+0000","last_fullsized":"2024-09-22T09:16:37.808080+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'49","last_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_deep_scrub":"261'49","last_deep_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.807991+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:47.897618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.276431+0000","last_change":"2024-09-22T09:16:46.276431+0000","last_active":"2024-09-22T09:16:46.276431+0000","last_peered":"2024-09-22T09:16:46.276431+0000","last_clean":"2024-09-22T09:16:46.276431+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:16:46.276431+0000","last_undegraded":"2024-09-22T09:16:46.276431+0000","last_fullsized":"2024-09-22T09:16:46.276431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.276347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:06.468881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.926299+0000","last_change":"2024-09-22T09:16:49.926299+0000","last_active":"2024-09-22T09:16:49.926299+0000","last_peered":"2024-09-22T09:16:49.926299+0000","last_clean":"2024-09-22T09:16:49.926299+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:16:49.926299+0000","last_undegraded":"2024-09-22T09:16:49.926299+0000","last_fullsized":"2024-09-22T09:16:49.926299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:49.926211+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:49.926211+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.926211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:12.465662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.363098+0000","last_change":"2024-09-22T09:16:46.363035+0000","last_active":"2024-09-22T09:16:46.363098+0000","last_peered":"2024-09-22T09:16:46.363098+0000","last_clean":"2024-09-22T09:16:46.363098+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:16:46.363098+0000","last_undegraded":"2024-09-22T09:16:46.363098+0000","last_fullsized":"2024-09-22T09:16:46.363098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.362946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:20.934618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:00.017393+0000","last_change":"2024-09-22T09:17:00.017393+0000","last_active":"2024-09-22T09:17:00.017393+0000","last_peered":"2024-09-22T09:17:00.017393+0000","last_clean":"2024-09-22T09:17:00.017393+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:17:00.017393+0000","last_undegraded":"2024-09-22T09:17:00.017393+0000","last_fullsized":"2024-09-22T09:17:00.017393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-22T09:17:00.017284+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-22T09:17:00.017284+0000","last_clean_scrub_stamp":"2024-09-22T09:17:00.017284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:24.191460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:27.777283+0000","last_change":"2024-09-22T08:51:48.550277+0000","last_active":"2024-09-22T09:13:27.777283+0000","last_peered":"2024-09-22T09:13:27.777283+0000","last_clean":"2024-09-22T09:13:27.777283+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:13:27.777283+0000","last_undegraded":"2024-09-22T09:13:27.777283+0000","last_fullsized":"2024-09-22T09:13:27.777283+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:19.062696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.964269+0000","last_change":"2024-09-22T09:16:51.964269+0000","last_active":"2024-09-22T09:16:51.964269+0000","last_peered":"2024-09-22T09:16:51.964269+0000","last_clean":"2024-09-22T09:16:51.964269+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:16:51.964269+0000","last_undegraded":"2024-09-22T09:16:51.964269+0000","last_fullsized":"2024-09-22T09:16:51.964269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:51.964173+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:51.964173+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.964173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:34.879220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.926965+0000","last_change":"2024-09-22T09:16:44.926898+0000","last_active":"2024-09-22T09:16:44.926965+0000","last_peered":"2024-09-22T09:16:44.926965+0000","last_clean":"2024-09-22T09:16:44.926965+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:16:44.926965+0000","last_undegraded":"2024-09-22T09:16:44.926965+0000","last_fullsized":"2024-09-22T09:16:44.926965+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.926806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:19.408134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.176625+0000","last_change":"2024-09-22T09:16:39.176625+0000","last_active":"2024-09-22T09:16:39.176625+0000","last_peered":"2024-09-22T09:16:39.176625+0000","last_clean":"2024-09-22T09:16:39.176625+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:16:39.176625+0000","last_undegraded":"2024-09-22T09:16:39.176625+0000","last_fullsized":"2024-09-22T09:16:39.176625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'41","last_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_deep_scrub":"261'41","last_deep_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.176539+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:01.618435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.264010+0000","last_change":"2024-09-22T09:16:47.264010+0000","last_active":"2024-09-22T09:16:47.264010+0000","last_peered":"2024-09-22T09:16:47.264010+0000","last_clean":"2024-09-22T09:16:47.264010+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:16:47.264010+0000","last_undegraded":"2024-09-22T09:16:47.264010+0000","last_fullsized":"2024-09-22T09:16:47.264010+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.263928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:18.442999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.910086+0000","last_change":"2024-09-22T09:16:56.910086+0000","last_active":"2024-09-22T09:16:56.910086+0000","last_peered":"2024-09-22T09:16:56.910086+0000","last_clean":"2024-09-22T09:16:56.910086+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:16:56.910086+0000","last_undegraded":"2024-09-22T09:16:56.910086+0000","last_fullsized":"2024-09-22T09:16:56.910086+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:56.909984+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:56.909984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.909984+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:38.678346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.913153+0000","last_change":"2024-09-22T09:16:45.913056+0000","last_active":"2024-09-22T09:16:45.913153+0000","last_peered":"2024-09-22T09:16:45.913153+0000","last_clean":"2024-09-22T09:16:45.913153+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:16:45.913153+0000","last_undegraded":"2024-09-22T09:16:45.913153+0000","last_fullsized":"2024-09-22T09:16:45.913153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.912961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:19.445927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.290252+0000","last_change":"2024-09-22T09:16:39.290252+0000","last_active":"2024-09-22T09:16:39.290252+0000","last_peered":"2024-09-22T09:16:39.290252+0000","last_clean":"2024-09-22T09:16:39.290252+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:16:39.290252+0000","last_undegraded":"2024-09-22T09:16:39.290252+0000","last_fullsized":"2024-09-22T09:16:39.290252+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'25","last_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_deep_scrub":"261'25","last_deep_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.290151+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:25.985106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:21.784609+0000","last_change":"2024-09-22T08:51:48.550937+0000","last_active":"2024-09-22T09:14:21.784609+0000","last_peered":"2024-09-22T09:14:21.784609+0000","last_clean":"2024-09-22T09:14:21.784609+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:14:21.784609+0000","last_undegraded":"2024-09-22T09:14:21.784609+0000","last_fullsized":"2024-09-22T09:14:21.784609+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.774912+0000","last_change":"2024-09-22T08:36:17.555220+0000","last_active":"2024-09-22T09:13:07.774912+0000","last_peered":"2024-09-22T09:13:07.774912+0000","last_clean":"2024-09-22T09:13:07.774912+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:13:07.774912+0000","last_undegraded":"2024-09-22T09:13:07.774912+0000","last_fullsized":"2024-09-22T09:13:07.774912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:43.613698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.877066+0000","last_change":"2024-09-22T09:16:42.877066+0000","last_active":"2024-09-22T09:16:42.877066+0000","last_peered":"2024-09-22T09:16:42.877066+0000","last_clean":"2024-09-22T09:16:42.877066+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:16:42.877066+0000","last_undegraded":"2024-09-22T09:16:42.877066+0000","last_fullsized":"2024-09-22T09:16:42.877066+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.876983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.724829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":175,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.280628+0000","last_change":"2024-09-22T09:16:38.280628+0000","last_active":"2024-09-22T09:16:38.280628+0000","last_peered":"2024-09-22T09:16:38.280628+0000","last_clean":"2024-09-22T09:16:38.280628+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:16:38.280628+0000","last_undegraded":"2024-09-22T09:16:38.280628+0000","last_fullsized":"2024-09-22T09:16:38.280628+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.280538+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:26.277335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.697669+0000","last_change":"2024-09-22T09:16:50.697669+0000","last_active":"2024-09-22T09:16:50.697669+0000","last_peered":"2024-09-22T09:16:50.697669+0000","last_clean":"2024-09-22T09:16:50.697669+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:16:50.697669+0000","last_undegraded":"2024-09-22T09:16:50.697669+0000","last_fullsized":"2024-09-22T09:16:50.697669+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.697582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.697582+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.697582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:30.836313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.774887+0000","last_change":"2024-09-22T09:16:47.774887+0000","last_active":"2024-09-22T09:16:47.774887+0000","last_peered":"2024-09-22T09:16:47.774887+0000","last_clean":"2024-09-22T09:16:47.774887+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:16:47.774887+0000","last_undegraded":"2024-09-22T09:16:47.774887+0000","last_fullsized":"2024-09-22T09:16:47.774887+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.774799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:50.971915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'5","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.877276+0000","last_change":"2024-09-22T09:16:49.877276+0000","last_active":"2024-09-22T09:16:49.877276+0000","last_peered":"2024-09-22T09:16:49.877276+0000","last_clean":"2024-09-22T09:16:49.877276+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:16:49.877276+0000","last_undegraded":"2024-09-22T09:16:49.877276+0000","last_fullsized":"2024-09-22T09:16:49.877276+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:49.877189+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:49.877189+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.877189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:00.356025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":258,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.812362+0000","last_change":"2024-09-22T09:16:45.812257+0000","last_active":"2024-09-22T09:16:45.812362+0000","last_peered":"2024-09-22T09:16:45.812362+0000","last_clean":"2024-09-22T09:16:45.812362+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:16:45.812362+0000","last_undegraded":"2024-09-22T09:16:45.812362+0000","last_fullsized":"2024-09-22T09:16:45.812362+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'73","last_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_deep_scrub":"261'73","last_deep_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.812164+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:45.301719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.544634+0000","last_change":"2024-09-22T09:16:44.544634+0000","last_active":"2024-09-22T09:16:44.544634+0000","last_peered":"2024-09-22T09:16:44.544634+0000","last_clean":"2024-09-22T09:16:44.544634+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:16:44.544634+0000","last_undegraded":"2024-09-22T09:16:44.544634+0000","last_fullsized":"2024-09-22T09:16:44.544634+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.544540+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:05.655088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.436813+0000","last_change":"2024-09-22T09:16:48.436813+0000","last_active":"2024-09-22T09:16:48.436813+0000","last_peered":"2024-09-22T09:16:48.436813+0000","last_clean":"2024-09-22T09:16:48.436813+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:16:48.436813+0000","last_undegraded":"2024-09-22T09:16:48.436813+0000","last_fullsized":"2024-09-22T09:16:48.436813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:48.436725+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:48.436725+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.436725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:31.963757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.894615+0000","last_change":"2024-09-22T09:16:43.894615+0000","last_active":"2024-09-22T09:16:43.894615+0000","last_peered":"2024-09-22T09:16:43.894615+0000","last_clean":"2024-09-22T09:16:43.894615+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:16:43.894615+0000","last_undegraded":"2024-09-22T09:16:43.894615+0000","last_fullsized":"2024-09-22T09:16:43.894615+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.894526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:57.633983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.853268+0000","last_change":"2024-09-22T09:16:48.853214+0000","last_active":"2024-09-22T09:16:48.853268+0000","last_peered":"2024-09-22T09:16:48.853268+0000","last_clean":"2024-09-22T09:16:48.853268+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:16:48.853268+0000","last_undegraded":"2024-09-22T09:16:48.853268+0000","last_fullsized":"2024-09-22T09:16:48.853268+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:16:48.853131+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:16:48.853131+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.853131+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:49.353422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.953526+0000","last_change":"2024-09-22T09:16:57.953526+0000","last_active":"2024-09-22T09:16:57.953526+0000","last_peered":"2024-09-22T09:16:57.953526+0000","last_clean":"2024-09-22T09:16:57.953526+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:16:57.953526+0000","last_undegraded":"2024-09-22T09:16:57.953526+0000","last_fullsized":"2024-09-22T09:16:57.953526+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:57.953434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:57.953434+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.953434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:22.223134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.593440+0000","last_change":"2024-09-22T09:16:38.593440+0000","last_active":"2024-09-22T09:16:38.593440+0000","last_peered":"2024-09-22T09:16:38.593440+0000","last_clean":"2024-09-22T09:16:38.593440+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:16:38.593440+0000","last_undegraded":"2024-09-22T09:16:38.593440+0000","last_fullsized":"2024-09-22T09:16:38.593440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.593354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:07.670762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:06.049353+0000","last_change":"2024-09-22T09:17:06.049353+0000","last_active":"2024-09-22T09:17:06.049353+0000","last_peered":"2024-09-22T09:17:06.049353+0000","last_clean":"2024-09-22T09:17:06.049353+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:17:06.049353+0000","last_undegraded":"2024-09-22T09:17:06.049353+0000","last_fullsized":"2024-09-22T09:17:06.049353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:06.049244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:06.049244+0000","last_clean_scrub_stamp":"2024-09-22T09:17:06.049244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:09.875472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.607265+0000","last_change":"2024-09-22T09:16:34.607201+0000","last_active":"2024-09-22T09:16:34.607265+0000","last_peered":"2024-09-22T09:16:34.607265+0000","last_clean":"2024-09-22T09:16:34.607265+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:16:34.607265+0000","last_undegraded":"2024-09-22T09:16:34.607265+0000","last_fullsized":"2024-09-22T09:16:34.607265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.607103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:48.367495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.618385+0000","last_change":"2024-09-22T09:16:41.618333+0000","last_active":"2024-09-22T09:16:41.618385+0000","last_peered":"2024-09-22T09:16:41.618385+0000","last_clean":"2024-09-22T09:16:41.618385+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:16:41.618385+0000","last_undegraded":"2024-09-22T09:16:41.618385+0000","last_fullsized":"2024-09-22T09:16:41.618385+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.618245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:52.513592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.916622+0000","last_change":"2024-09-22T09:16:55.916622+0000","last_active":"2024-09-22T09:16:55.916622+0000","last_peered":"2024-09-22T09:16:55.916622+0000","last_clean":"2024-09-22T09:16:55.916622+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:16:55.916622+0000","last_undegraded":"2024-09-22T09:16:55.916622+0000","last_fullsized":"2024-09-22T09:16:55.916622+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-22T09:16:55.916512+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-22T09:16:55.916512+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.916512+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:38.215866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4198,"num_write":12,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'8","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:04.081981+0000","last_change":"2024-09-22T09:17:04.081981+0000","last_active":"2024-09-22T09:17:04.081981+0000","last_peered":"2024-09-22T09:17:04.081981+0000","last_clean":"2024-09-22T09:17:04.081981+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:17:04.081981+0000","last_undegraded":"2024-09-22T09:17:04.081981+0000","last_fullsized":"2024-09-22T09:17:04.081981+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:17:04.081866+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:17:04.081866+0000","last_clean_scrub_stamp":"2024-09-22T09:17:04.081866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:43.095868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.555004+0000","last_change":"2024-09-22T09:16:46.554920+0000","last_active":"2024-09-22T09:16:46.555004+0000","last_peered":"2024-09-22T09:16:46.555004+0000","last_clean":"2024-09-22T09:16:46.555004+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:16:46.555004+0000","last_undegraded":"2024-09-22T09:16:46.555004+0000","last_fullsized":"2024-09-22T09:16:46.555004+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.554816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:00.571695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.578268+0000","last_change":"2024-09-22T09:16:42.578200+0000","last_active":"2024-09-22T09:16:42.578268+0000","last_peered":"2024-09-22T09:16:42.578268+0000","last_clean":"2024-09-22T09:16:42.578268+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:16:42.578268+0000","last_undegraded":"2024-09-22T09:16:42.578268+0000","last_fullsized":"2024-09-22T09:16:42.578268+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.578116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:41:50.365456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.902693+0000","last_change":"2024-09-22T09:16:54.902693+0000","last_active":"2024-09-22T09:16:54.902693+0000","last_peered":"2024-09-22T09:16:54.902693+0000","last_clean":"2024-09-22T09:16:54.902693+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:16:54.902693+0000","last_undegraded":"2024-09-22T09:16:54.902693+0000","last_fullsized":"2024-09-22T09:16:54.902693+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:54.902579+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:54.902579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.902579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:06.998581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.574473+0000","last_change":"2024-09-22T09:16:50.574473+0000","last_active":"2024-09-22T09:16:50.574473+0000","last_peered":"2024-09-22T09:16:50.574473+0000","last_clean":"2024-09-22T09:16:50.574473+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:16:50.574473+0000","last_undegraded":"2024-09-22T09:16:50.574473+0000","last_fullsized":"2024-09-22T09:16:50.574473+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.574386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.574386+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.574386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:00.482425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":460,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.981777+0000","last_change":"2024-09-22T09:16:58.981777+0000","last_active":"2024-09-22T09:16:58.981777+0000","last_peered":"2024-09-22T09:16:58.981777+0000","last_clean":"2024-09-22T09:16:58.981777+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:16:58.981777+0000","last_undegraded":"2024-09-22T09:16:58.981777+0000","last_fullsized":"2024-09-22T09:16:58.981777+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-22T09:16:58.981679+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-22T09:16:58.981679+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.981679+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:10.000992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:01.870610+0000","last_change":"2024-09-22T09:17:01.870610+0000","last_active":"2024-09-22T09:17:01.870610+0000","last_peered":"2024-09-22T09:17:01.870610+0000","last_clean":"2024-09-22T09:17:01.870610+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:17:01.870610+0000","last_undegraded":"2024-09-22T09:17:01.870610+0000","last_fullsized":"2024-09-22T09:17:01.870610+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:01.870518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:01.870518+0000","last_clean_scrub_stamp":"2024-09-22T09:17:01.870518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:06.337864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.571123+0000","last_change":"2024-09-22T09:16:37.571123+0000","last_active":"2024-09-22T09:16:37.571123+0000","last_peered":"2024-09-22T09:16:37.571123+0000","last_clean":"2024-09-22T09:16:37.571123+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:16:37.571123+0000","last_undegraded":"2024-09-22T09:16:37.571123+0000","last_fullsized":"2024-09-22T09:16:37.571123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.571036+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:42.202289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.922201+0000","last_change":"2024-09-22T09:16:42.922201+0000","last_active":"2024-09-22T09:16:42.922201+0000","last_peered":"2024-09-22T09:16:42.922201+0000","last_clean":"2024-09-22T09:16:42.922201+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:16:42.922201+0000","last_undegraded":"2024-09-22T09:16:42.922201+0000","last_fullsized":"2024-09-22T09:16:42.922201+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.922112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:28.190183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.964395+0000","last_change":"2024-09-22T09:16:38.964395+0000","last_active":"2024-09-22T09:16:38.964395+0000","last_peered":"2024-09-22T09:16:38.964395+0000","last_clean":"2024-09-22T09:16:38.964395+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:16:38.964395+0000","last_undegraded":"2024-09-22T09:16:38.964395+0000","last_fullsized":"2024-09-22T09:16:38.964395+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.964315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:37.172303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:42.787274+0000","last_change":"2024-09-22T08:51:48.549231+0000","last_active":"2024-09-22T09:14:42.787274+0000","last_peered":"2024-09-22T09:14:42.787274+0000","last_clean":"2024-09-22T09:14:42.787274+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:14:42.787274+0000","last_undegraded":"2024-09-22T09:14:42.787274+0000","last_fullsized":"2024-09-22T09:14:42.787274+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:13:07.775012+0000","last_change":"2024-09-22T08:36:17.553742+0000","last_active":"2024-09-22T09:13:07.775012+0000","last_peered":"2024-09-22T09:13:07.775012+0000","last_clean":"2024-09-22T09:13:07.775012+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:13:07.775012+0000","last_undegraded":"2024-09-22T09:13:07.775012+0000","last_fullsized":"2024-09-22T09:13:07.775012+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:42.209270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":73,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:05.045354+0000","last_change":"2024-09-22T09:17:05.045354+0000","last_active":"2024-09-22T09:17:05.045354+0000","last_peered":"2024-09-22T09:17:05.045354+0000","last_clean":"2024-09-22T09:17:05.045354+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:17:05.045354+0000","last_undegraded":"2024-09-22T09:17:05.045354+0000","last_fullsized":"2024-09-22T09:17:05.045354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-22T09:17:05.045241+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-22T09:17:05.045241+0000","last_clean_scrub_stamp":"2024-09-22T09:17:05.045241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:48.872577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.828769+0000","last_change":"2024-09-22T09:16:36.828769+0000","last_active":"2024-09-22T09:16:36.828769+0000","last_peered":"2024-09-22T09:16:36.828769+0000","last_clean":"2024-09-22T09:16:36.828769+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:16:36.828769+0000","last_undegraded":"2024-09-22T09:16:36.828769+0000","last_fullsized":"2024-09-22T09:16:36.828769+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.828686+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:56.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.990799+0000","last_change":"2024-09-22T09:16:56.990799+0000","last_active":"2024-09-22T09:16:56.990799+0000","last_peered":"2024-09-22T09:16:56.990799+0000","last_clean":"2024-09-22T09:16:56.990799+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:16:56.990799+0000","last_undegraded":"2024-09-22T09:16:56.990799+0000","last_fullsized":"2024-09-22T09:16:56.990799+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:56.990710+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:56.990710+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.990710+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:07.776339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'5","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.537902+0000","last_change":"2024-09-22T09:16:51.537902+0000","last_active":"2024-09-22T09:16:51.537902+0000","last_peered":"2024-09-22T09:16:51.537902+0000","last_clean":"2024-09-22T09:16:51.537902+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:16:51.537902+0000","last_undegraded":"2024-09-22T09:16:51.537902+0000","last_fullsized":"2024-09-22T09:16:51.537902+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:51.537805+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:51.537805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.537805+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:09.569184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12859,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.898135+0000","last_change":"2024-09-22T09:16:41.898135+0000","last_active":"2024-09-22T09:16:41.898135+0000","last_peered":"2024-09-22T09:16:41.898135+0000","last_clean":"2024-09-22T09:16:41.898135+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:16:41.898135+0000","last_undegraded":"2024-09-22T09:16:41.898135+0000","last_fullsized":"2024-09-22T09:16:41.898135+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.898026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:27.564920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.964341+0000","last_change":"2024-09-22T09:16:36.964341+0000","last_active":"2024-09-22T09:16:36.964341+0000","last_peered":"2024-09-22T09:16:36.964341+0000","last_clean":"2024-09-22T09:16:36.964341+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:16:36.964341+0000","last_undegraded":"2024-09-22T09:16:36.964341+0000","last_fullsized":"2024-09-22T09:16:36.964341+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.964266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:27.066433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.587583+0000","last_change":"2024-09-22T09:16:52.587583+0000","last_active":"2024-09-22T09:16:52.587583+0000","last_peered":"2024-09-22T09:16:52.587583+0000","last_clean":"2024-09-22T09:16:52.587583+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:16:52.587583+0000","last_undegraded":"2024-09-22T09:16:52.587583+0000","last_fullsized":"2024-09-22T09:16:52.587583+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:52.587498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:52.587498+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.587498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:40.562272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:27.785272+0000","last_change":"2024-09-22T08:36:17.552954+0000","last_active":"2024-09-22T09:14:27.785272+0000","last_peered":"2024-09-22T09:14:27.785272+0000","last_clean":"2024-09-22T09:14:27.785272+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:14:27.785272+0000","last_undegraded":"2024-09-22T09:14:27.785272+0000","last_fullsized":"2024-09-22T09:14:27.785272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:36:16.526910+0000","last_clean_scrub_stamp":"2024-09-22T08:36:16.526910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:03.121041+0000","last_change":"2024-09-22T09:17:03.121041+0000","last_active":"2024-09-22T09:17:03.121041+0000","last_peered":"2024-09-22T09:17:03.121041+0000","last_clean":"2024-09-22T09:17:03.121041+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:17:03.121041+0000","last_undegraded":"2024-09-22T09:17:03.121041+0000","last_fullsized":"2024-09-22T09:17:03.121041+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:17:03.120949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:17:03.120949+0000","last_clean_scrub_stamp":"2024-09-22T09:17:03.120949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:14.326993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":291,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.980655+0000","last_change":"2024-09-22T09:16:57.980655+0000","last_active":"2024-09-22T09:16:57.980655+0000","last_peered":"2024-09-22T09:16:57.980655+0000","last_clean":"2024-09-22T09:16:57.980655+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:16:57.980655+0000","last_undegraded":"2024-09-22T09:16:57.980655+0000","last_fullsized":"2024-09-22T09:16:57.980655+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'81","last_scrub_stamp":"2024-09-22T09:16:57.980553+0000","last_deep_scrub":"261'81","last_deep_scrub_stamp":"2024-09-22T09:16:57.980553+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.980553+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:41.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:03.911838+0000","last_change":"2024-09-22T09:17:03.911838+0000","last_active":"2024-09-22T09:17:03.911838+0000","last_peered":"2024-09-22T09:17:03.911838+0000","last_clean":"2024-09-22T09:17:03.911838+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:17:03.911838+0000","last_undegraded":"2024-09-22T09:17:03.911838+0000","last_fullsized":"2024-09-22T09:17:03.911838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:03.911744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:03.911744+0000","last_clean_scrub_stamp":"2024-09-22T09:17:03.911744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:22.482761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.796777+0000","last_change":"2024-09-22T09:16:46.796777+0000","last_active":"2024-09-22T09:16:46.796777+0000","last_peered":"2024-09-22T09:16:46.796777+0000","last_clean":"2024-09-22T09:16:46.796777+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:16:46.796777+0000","last_undegraded":"2024-09-22T09:16:46.796777+0000","last_fullsized":"2024-09-22T09:16:46.796777+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.796697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:24.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.384345+0000","last_change":"2024-09-22T09:16:45.384345+0000","last_active":"2024-09-22T09:16:45.384345+0000","last_peered":"2024-09-22T09:16:45.384345+0000","last_clean":"2024-09-22T09:16:45.384345+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:16:45.384345+0000","last_undegraded":"2024-09-22T09:16:45.384345+0000","last_fullsized":"2024-09-22T09:16:45.384345+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.384229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:45.682719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":125,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.979686+0000","last_change":"2024-09-22T09:16:56.979686+0000","last_active":"2024-09-22T09:16:56.979686+0000","last_peered":"2024-09-22T09:16:56.979686+0000","last_clean":"2024-09-22T09:16:56.979686+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:16:56.979686+0000","last_undegraded":"2024-09-22T09:16:56.979686+0000","last_fullsized":"2024-09-22T09:16:56.979686+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-22T09:16:56.979606+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-22T09:16:56.979606+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.979606+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:39.181669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:14:47.788127+0000","last_change":"2024-09-22T08:51:48.552446+0000","last_active":"2024-09-22T09:14:47.788127+0000","last_peered":"2024-09-22T09:14:47.788127+0000","last_clean":"2024-09-22T09:14:47.788127+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:14:47.788127+0000","last_undegraded":"2024-09-22T09:14:47.788127+0000","last_fullsized":"2024-09-22T09:14:47.788127+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:51:47.520569+0000","last_clean_scrub_stamp":"2024-09-22T08:51:47.520569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.847390+0000","last_change":"2024-09-22T09:16:44.847390+0000","last_active":"2024-09-22T09:16:44.847390+0000","last_peered":"2024-09-22T09:16:44.847390+0000","last_clean":"2024-09-22T09:16:44.847390+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:16:44.847390+0000","last_undegraded":"2024-09-22T09:16:44.847390+0000","last_fullsized":"2024-09-22T09:16:44.847390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.847285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:48.377069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":62,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.145192+0000","last_change":"2024-09-22T09:16:40.145192+0000","last_active":"2024-09-22T09:16:40.145192+0000","last_peered":"2024-09-22T09:16:40.145192+0000","last_clean":"2024-09-22T09:16:40.145192+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:16:40.145192+0000","last_undegraded":"2024-09-22T09:16:40.145192+0000","last_fullsized":"2024-09-22T09:16:40.145192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.145086+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:02.203653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":95,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.012765+0000","last_change":"2024-09-22T09:16:38.012765+0000","last_active":"2024-09-22T09:16:38.012765+0000","last_peered":"2024-09-22T09:16:38.012765+0000","last_clean":"2024-09-22T09:16:38.012765+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:16:38.012765+0000","last_undegraded":"2024-09-22T09:16:38.012765+0000","last_fullsized":"2024-09-22T09:16:38.012765+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.012671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:31.079655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'395","reported_seq":1268,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.512963+0000","last_change":"2024-09-22T09:16:15.512963+0000","last_active":"2024-09-22T09:16:15.512963+0000","last_peered":"2024-09-22T09:16:15.512963+0000","last_clean":"2024-09-22T09:16:15.512963+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:15.512963+0000","last_undegraded":"2024-09-22T09:16:15.512963+0000","last_fullsized":"2024-09-22T09:16:15.512963+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.512820+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:16.248546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1437,"num_read_kb":46472,"num_write":1276,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'951","reported_seq":2510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.195229+0000","last_change":"2024-09-22T09:16:22.195229+0000","last_active":"2024-09-22T09:16:22.195229+0000","last_peered":"2024-09-22T09:16:22.195229+0000","last_clean":"2024-09-22T09:16:22.195229+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:16:22.195229+0000","last_undegraded":"2024-09-22T09:16:22.195229+0000","last_fullsized":"2024-09-22T09:16:22.195229+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'951","last_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_deep_scrub":"261'951","last_deep_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.195138+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:36.195944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'396","reported_seq":1093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.736969+0000","last_change":"2024-09-22T09:16:22.736969+0000","last_active":"2024-09-22T09:16:22.736969+0000","last_peered":"2024-09-22T09:16:22.736969+0000","last_clean":"2024-09-22T09:16:22.736969+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:22.736969+0000","last_undegraded":"2024-09-22T09:16:22.736969+0000","last_fullsized":"2024-09-22T09:16:22.736969+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.736820+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:22.398536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":784,"num_read_kb":45729,"num_write":1281,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'769","reported_seq":2195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.117657+0000","last_change":"2024-09-22T09:16:33.117657+0000","last_active":"2024-09-22T09:16:33.117657+0000","last_peered":"2024-09-22T09:16:33.117657+0000","last_clean":"2024-09-22T09:16:33.117657+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:16:33.117657+0000","last_undegraded":"2024-09-22T09:16:33.117657+0000","last_fullsized":"2024-09-22T09:16:33.117657+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'769","last_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_deep_scrub":"261'769","last_deep_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.117556+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:48.851231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.700568+0000","last_change":"2024-09-22T09:16:18.700568+0000","last_active":"2024-09-22T09:16:18.700568+0000","last_peered":"2024-09-22T09:16:18.700568+0000","last_clean":"2024-09-22T09:16:18.700568+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:18.700568+0000","last_undegraded":"2024-09-22T09:16:18.700568+0000","last_fullsized":"2024-09-22T09:16:18.700568+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'346","last_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_deep_scrub":"261'346","last_deep_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.700411+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:06.334626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":64388,"num_write":1226,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'499","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.084051+0000","last_change":"2024-09-22T09:16:34.084051+0000","last_active":"2024-09-22T09:16:34.084051+0000","last_peered":"2024-09-22T09:16:34.084051+0000","last_clean":"2024-09-22T09:16:34.084051+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:16:34.084051+0000","last_undegraded":"2024-09-22T09:16:34.084051+0000","last_fullsized":"2024-09-22T09:16:34.084051+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'499","last_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_deep_scrub":"261'499","last_deep_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.083973+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:29.818260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'394","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.909250+0000","last_change":"2024-09-22T09:16:15.909250+0000","last_active":"2024-09-22T09:16:15.909250+0000","last_peered":"2024-09-22T09:16:15.909250+0000","last_clean":"2024-09-22T09:16:15.909250+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:15.909250+0000","last_undegraded":"2024-09-22T09:16:15.909250+0000","last_fullsized":"2024-09-22T09:16:15.909250+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.909095+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:00.057217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":100163,"num_write":1151,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'536","reported_seq":2210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.721659+0000","last_change":"2024-09-22T09:16:25.721659+0000","last_active":"2024-09-22T09:16:25.721659+0000","last_peered":"2024-09-22T09:16:25.721659+0000","last_clean":"2024-09-22T09:16:25.721659+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:16:25.721659+0000","last_undegraded":"2024-09-22T09:16:25.721659+0000","last_fullsized":"2024-09-22T09:16:25.721659+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'536","last_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_deep_scrub":"261'536","last_deep_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.721574+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:07.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'374","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.484163+0000","last_change":"2024-09-22T09:16:16.484163+0000","last_active":"2024-09-22T09:16:16.484163+0000","last_peered":"2024-09-22T09:16:16.484163+0000","last_clean":"2024-09-22T09:16:16.484163+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:16.484163+0000","last_undegraded":"2024-09-22T09:16:16.484163+0000","last_fullsized":"2024-09-22T09:16:16.484163+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'374","last_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_deep_scrub":"261'374","last_deep_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.484052+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:58.010659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":101852,"num_write":1145,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'579","reported_seq":2244,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.486420+0000","last_change":"2024-09-22T09:16:21.486420+0000","last_active":"2024-09-22T09:16:21.486420+0000","last_peered":"2024-09-22T09:16:21.486420+0000","last_clean":"2024-09-22T09:16:21.486420+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:16:21.486420+0000","last_undegraded":"2024-09-22T09:16:21.486420+0000","last_fullsized":"2024-09-22T09:16:21.486420+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.486318+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.331269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'402","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.939126+0000","last_change":"2024-09-22T09:16:13.939126+0000","last_active":"2024-09-22T09:16:13.939126+0000","last_peered":"2024-09-22T09:16:13.939126+0000","last_clean":"2024-09-22T09:16:13.939126+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:13.939126+0000","last_undegraded":"2024-09-22T09:16:13.939126+0000","last_fullsized":"2024-09-22T09:16:13.939126+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.938974+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:23.382523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311674,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":20769,"num_write":1109,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1042","reported_seq":2592,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.481044+0000","last_change":"2024-09-22T09:16:22.481044+0000","last_active":"2024-09-22T09:16:22.481044+0000","last_peered":"2024-09-22T09:16:22.481044+0000","last_clean":"2024-09-22T09:16:22.481044+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:16:22.481044+0000","last_undegraded":"2024-09-22T09:16:22.481044+0000","last_fullsized":"2024-09-22T09:16:22.481044+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1042","last_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_deep_scrub":"261'1042","last_deep_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.480948+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:22.317236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'329","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.515526+0000","last_change":"2024-09-22T09:16:14.515526+0000","last_active":"2024-09-22T09:16:14.515526+0000","last_peered":"2024-09-22T09:16:14.515526+0000","last_clean":"2024-09-22T09:16:14.515526+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:14.515526+0000","last_undegraded":"2024-09-22T09:16:14.515526+0000","last_fullsized":"2024-09-22T09:16:14.515526+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.515318+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:36.695819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":9376,"num_write":1029,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'497","reported_seq":2098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.940307+0000","last_change":"2024-09-22T09:16:22.940307+0000","last_active":"2024-09-22T09:16:22.940307+0000","last_peered":"2024-09-22T09:16:22.940307+0000","last_clean":"2024-09-22T09:16:22.940307+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:16:22.940307+0000","last_undegraded":"2024-09-22T09:16:22.940307+0000","last_fullsized":"2024-09-22T09:16:22.940307+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'497","last_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_deep_scrub":"261'497","last_deep_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.940226+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:57.523147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'376","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.716405+0000","last_change":"2024-09-22T09:16:20.716405+0000","last_active":"2024-09-22T09:16:20.716405+0000","last_peered":"2024-09-22T09:16:20.716405+0000","last_clean":"2024-09-22T09:16:20.716405+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:20.716405+0000","last_undegraded":"2024-09-22T09:16:20.716405+0000","last_fullsized":"2024-09-22T09:16:20.716405+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.716279+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:27.920378+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":772,"num_read_kb":32992,"num_write":1092,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'641","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.692287+0000","last_change":"2024-09-22T09:16:31.692287+0000","last_active":"2024-09-22T09:16:31.692287+0000","last_peered":"2024-09-22T09:16:31.692287+0000","last_clean":"2024-09-22T09:16:31.692287+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:16:31.692287+0000","last_undegraded":"2024-09-22T09:16:31.692287+0000","last_fullsized":"2024-09-22T09:16:31.692287+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'641","last_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_deep_scrub":"261'641","last_deep_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.692200+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:29.079608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'403","reported_seq":1992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.153849+0000","last_change":"2024-09-22T09:16:32.153849+0000","last_active":"2024-09-22T09:16:32.153849+0000","last_peered":"2024-09-22T09:16:32.153849+0000","last_clean":"2024-09-22T09:16:32.153849+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:16:32.153849+0000","last_undegraded":"2024-09-22T09:16:32.153849+0000","last_fullsized":"2024-09-22T09:16:32.153849+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.153759+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:38.043677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'303","reported_seq":928,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207647+0000","last_change":"2024-09-22T09:16:13.207647+0000","last_active":"2024-09-22T09:16:13.207647+0000","last_peered":"2024-09-22T09:16:13.207647+0000","last_clean":"2024-09-22T09:16:13.207647+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:13.207647+0000","last_undegraded":"2024-09-22T09:16:13.207647+0000","last_fullsized":"2024-09-22T09:16:13.207647+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.207542+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:43.122476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947307,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":25983,"num_write":980,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'394","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.525921+0000","last_change":"2024-09-22T09:16:20.525921+0000","last_active":"2024-09-22T09:16:20.525921+0000","last_peered":"2024-09-22T09:16:20.525921+0000","last_clean":"2024-09-22T09:16:20.525921+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:16:20.525921+0000","last_undegraded":"2024-09-22T09:16:20.525921+0000","last_fullsized":"2024-09-22T09:16:20.525921+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.525816+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:17.576244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'287","reported_seq":876,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.499416+0000","last_change":"2024-09-22T09:16:13.499416+0000","last_active":"2024-09-22T09:16:13.499416+0000","last_peered":"2024-09-22T09:16:13.499416+0000","last_clean":"2024-09-22T09:16:13.499416+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:13.499416+0000","last_undegraded":"2024-09-22T09:16:13.499416+0000","last_fullsized":"2024-09-22T09:16:13.499416+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.499276+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:01.659857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":451,"num_read_kb":1407,"num_write":876,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'766","reported_seq":2327,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.200824+0000","last_change":"2024-09-22T09:16:19.200824+0000","last_active":"2024-09-22T09:16:19.200824+0000","last_peered":"2024-09-22T09:16:19.200824+0000","last_clean":"2024-09-22T09:16:19.200824+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:16:19.200824+0000","last_undegraded":"2024-09-22T09:16:19.200824+0000","last_fullsized":"2024-09-22T09:16:19.200824+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'766","last_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_deep_scrub":"261'766","last_deep_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.200744+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:48.695705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'305","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.529861+0000","last_change":"2024-09-22T09:16:11.529861+0000","last_active":"2024-09-22T09:16:11.529861+0000","last_peered":"2024-09-22T09:16:11.529861+0000","last_clean":"2024-09-22T09:16:11.529861+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:11.529861+0000","last_undegraded":"2024-09-22T09:16:11.529861+0000","last_fullsized":"2024-09-22T09:16:11.529861+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.529676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:25.488246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":31210,"num_write":1028,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'771","reported_seq":2408,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.151660+0000","last_change":"2024-09-22T09:16:22.151660+0000","last_active":"2024-09-22T09:16:22.151660+0000","last_peered":"2024-09-22T09:16:22.151660+0000","last_clean":"2024-09-22T09:16:22.151660+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:16:22.151660+0000","last_undegraded":"2024-09-22T09:16:22.151660+0000","last_fullsized":"2024-09-22T09:16:22.151660+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'771","last_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_deep_scrub":"261'771","last_deep_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.151579+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:39.550280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1777,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'326","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.538362+0000","last_change":"2024-09-22T09:16:12.538362+0000","last_active":"2024-09-22T09:16:12.538362+0000","last_peered":"2024-09-22T09:16:12.538362+0000","last_clean":"2024-09-22T09:16:12.538362+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:12.538362+0000","last_undegraded":"2024-09-22T09:16:12.538362+0000","last_fullsized":"2024-09-22T09:16:12.538362+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.538192+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:14.191967+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655876,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":639,"num_read_kb":14450,"num_write":1076,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.697183+0000","last_change":"2024-09-22T09:16:30.697183+0000","last_active":"2024-09-22T09:16:30.697183+0000","last_peered":"2024-09-22T09:16:30.697183+0000","last_clean":"2024-09-22T09:16:30.697183+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:16:30.697183+0000","last_undegraded":"2024-09-22T09:16:30.697183+0000","last_fullsized":"2024-09-22T09:16:30.697183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.697081+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:28.453426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'352","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.247778+0000","last_change":"2024-09-22T09:16:14.247778+0000","last_active":"2024-09-22T09:16:14.247778+0000","last_peered":"2024-09-22T09:16:14.247778+0000","last_clean":"2024-09-22T09:16:14.247778+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:14.247778+0000","last_undegraded":"2024-09-22T09:16:14.247778+0000","last_fullsized":"2024-09-22T09:16:14.247778+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.247594+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:36.776380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1523,"num_write":1216,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'583","reported_seq":2209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.184302+0000","last_change":"2024-09-22T09:16:20.184302+0000","last_active":"2024-09-22T09:16:20.184302+0000","last_peered":"2024-09-22T09:16:20.184302+0000","last_clean":"2024-09-22T09:16:20.184302+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:16:20.184302+0000","last_undegraded":"2024-09-22T09:16:20.184302+0000","last_fullsized":"2024-09-22T09:16:20.184302+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'583","last_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_deep_scrub":"261'583","last_deep_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.184210+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:24.340294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1226,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'419","reported_seq":1094,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.209011+0000","last_change":"2024-09-22T09:16:17.209011+0000","last_active":"2024-09-22T09:16:17.209011+0000","last_peered":"2024-09-22T09:16:17.209011+0000","last_clean":"2024-09-22T09:16:17.209011+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:17.209011+0000","last_undegraded":"2024-09-22T09:16:17.209011+0000","last_fullsized":"2024-09-22T09:16:17.209011+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.208816+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:49.867009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":782,"num_read_kb":14779,"num_write":1492,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'123","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.600494+0000","last_change":"2024-09-22T09:16:33.600494+0000","last_active":"2024-09-22T09:16:33.600494+0000","last_peered":"2024-09-22T09:16:33.600494+0000","last_clean":"2024-09-22T09:16:33.600494+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:16:33.600494+0000","last_undegraded":"2024-09-22T09:16:33.600494+0000","last_fullsized":"2024-09-22T09:16:33.600494+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.600393+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:39.719506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'998","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.196121+0000","last_change":"2024-09-22T09:16:21.196121+0000","last_active":"2024-09-22T09:16:21.196121+0000","last_peered":"2024-09-22T09:16:21.196121+0000","last_clean":"2024-09-22T09:16:21.196121+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:16:21.196121+0000","last_undegraded":"2024-09-22T09:16:21.196121+0000","last_fullsized":"2024-09-22T09:16:21.196121+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'998","last_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_deep_scrub":"261'998","last_deep_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.196028+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:20.279066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'370","reported_seq":1248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.233157+0000","last_change":"2024-09-22T09:16:16.233157+0000","last_active":"2024-09-22T09:16:16.233157+0000","last_peered":"2024-09-22T09:16:16.233157+0000","last_clean":"2024-09-22T09:16:16.233157+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:16.233157+0000","last_undegraded":"2024-09-22T09:16:16.233157+0000","last_fullsized":"2024-09-22T09:16:16.233157+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'370","last_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_deep_scrub":"261'370","last_deep_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.233008+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:54.584470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1344,"num_read_kb":67744,"num_write":1254,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.036882+0000","last_change":"2024-09-22T09:16:39.036882+0000","last_active":"2024-09-22T09:16:39.036882+0000","last_peered":"2024-09-22T09:16:39.036882+0000","last_clean":"2024-09-22T09:16:39.036882+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:16:39.036882+0000","last_undegraded":"2024-09-22T09:16:39.036882+0000","last_fullsized":"2024-09-22T09:16:39.036882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.036799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:34:43.889677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'349","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.645001+0000","last_change":"2024-09-22T09:16:36.645001+0000","last_active":"2024-09-22T09:16:36.645001+0000","last_peered":"2024-09-22T09:16:36.645001+0000","last_clean":"2024-09-22T09:16:36.645001+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:16:36.645001+0000","last_undegraded":"2024-09-22T09:16:36.645001+0000","last_fullsized":"2024-09-22T09:16:36.645001+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.644903+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.282957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1201,"num_write":446,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.193051+0000","last_change":"2024-09-22T09:16:34.193051+0000","last_active":"2024-09-22T09:16:34.193051+0000","last_peered":"2024-09-22T09:16:34.193051+0000","last_clean":"2024-09-22T09:16:34.193051+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:16:34.193051+0000","last_undegraded":"2024-09-22T09:16:34.193051+0000","last_fullsized":"2024-09-22T09:16:34.193051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.192958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:01.619450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'150","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.205571+0000","last_change":"2024-09-22T09:16:37.205571+0000","last_active":"2024-09-22T09:16:37.205571+0000","last_peered":"2024-09-22T09:16:37.205571+0000","last_clean":"2024-09-22T09:16:37.205571+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:16:37.205571+0000","last_undegraded":"2024-09-22T09:16:37.205571+0000","last_fullsized":"2024-09-22T09:16:37.205571+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'150","last_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_deep_scrub":"261'150","last_deep_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.205475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:37.338187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'467","reported_seq":2137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.208019+0000","last_change":"2024-09-22T09:16:29.208019+0000","last_active":"2024-09-22T09:16:29.208019+0000","last_peered":"2024-09-22T09:16:29.208019+0000","last_clean":"2024-09-22T09:16:29.208019+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:16:29.208019+0000","last_undegraded":"2024-09-22T09:16:29.208019+0000","last_fullsized":"2024-09-22T09:16:29.208019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.207926+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:10.096936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'376","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.202024+0000","last_change":"2024-09-22T09:16:15.202024+0000","last_active":"2024-09-22T09:16:15.202024+0000","last_peered":"2024-09-22T09:16:15.202024+0000","last_clean":"2024-09-22T09:16:15.202024+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:15.202024+0000","last_undegraded":"2024-09-22T09:16:15.202024+0000","last_fullsized":"2024-09-22T09:16:15.202024+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.201907+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:52.431996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":649,"num_read_kb":11781,"num_write":1236,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.676949+0000","last_change":"2024-09-22T09:16:28.676949+0000","last_active":"2024-09-22T09:16:28.676949+0000","last_peered":"2024-09-22T09:16:28.676949+0000","last_clean":"2024-09-22T09:16:28.676949+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:16:28.676949+0000","last_undegraded":"2024-09-22T09:16:28.676949+0000","last_fullsized":"2024-09-22T09:16:28.676949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.676822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:02.194477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'92","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.189670+0000","last_change":"2024-09-22T09:16:30.189670+0000","last_active":"2024-09-22T09:16:30.189670+0000","last_peered":"2024-09-22T09:16:30.189670+0000","last_clean":"2024-09-22T09:16:30.189670+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:16:30.189670+0000","last_undegraded":"2024-09-22T09:16:30.189670+0000","last_fullsized":"2024-09-22T09:16:30.189670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.189584+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:48.517209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.189325+0000","last_change":"2024-09-22T09:16:33.189325+0000","last_active":"2024-09-22T09:16:33.189325+0000","last_peered":"2024-09-22T09:16:33.189325+0000","last_clean":"2024-09-22T09:16:33.189325+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:16:33.189325+0000","last_undegraded":"2024-09-22T09:16:33.189325+0000","last_fullsized":"2024-09-22T09:16:33.189325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.189234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:09.142849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'142","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.315990+0000","last_change":"2024-09-22T09:16:36.315990+0000","last_active":"2024-09-22T09:16:36.315990+0000","last_peered":"2024-09-22T09:16:36.315990+0000","last_clean":"2024-09-22T09:16:36.315990+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:16:36.315990+0000","last_undegraded":"2024-09-22T09:16:36.315990+0000","last_fullsized":"2024-09-22T09:16:36.315990+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.315902+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:30.170908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.695681+0000","last_change":"2024-09-22T09:16:26.695681+0000","last_active":"2024-09-22T09:16:26.695681+0000","last_peered":"2024-09-22T09:16:26.695681+0000","last_clean":"2024-09-22T09:16:26.695681+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:16:26.695681+0000","last_undegraded":"2024-09-22T09:16:26.695681+0000","last_fullsized":"2024-09-22T09:16:26.695681+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.695595+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:50:56.527592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'316","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.273692+0000","last_change":"2024-09-22T09:16:18.273692+0000","last_active":"2024-09-22T09:16:18.273692+0000","last_peered":"2024-09-22T09:16:18.273692+0000","last_clean":"2024-09-22T09:16:18.273692+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:18.273692+0000","last_undegraded":"2024-09-22T09:16:18.273692+0000","last_fullsized":"2024-09-22T09:16:18.273692+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'316","last_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_deep_scrub":"261'316","last_deep_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.273530+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:43.936947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":672,"num_read_kb":483,"num_write":1016,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676439+0000","last_change":"2024-09-22T09:16:29.676439+0000","last_active":"2024-09-22T09:16:29.676439+0000","last_peered":"2024-09-22T09:16:29.676439+0000","last_clean":"2024-09-22T09:16:29.676439+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:16:29.676439+0000","last_undegraded":"2024-09-22T09:16:29.676439+0000","last_fullsized":"2024-09-22T09:16:29.676439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:03.918455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'127","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.660505+0000","last_change":"2024-09-22T09:16:35.660505+0000","last_active":"2024-09-22T09:16:35.660505+0000","last_peered":"2024-09-22T09:16:35.660505+0000","last_clean":"2024-09-22T09:16:35.660505+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:16:35.660505+0000","last_undegraded":"2024-09-22T09:16:35.660505+0000","last_fullsized":"2024-09-22T09:16:35.660505+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.660394+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:18.158723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'795","reported_seq":2576,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.054726+0000","last_change":"2024-09-22T09:16:50.054726+0000","last_active":"2024-09-22T09:16:50.054726+0000","last_peered":"2024-09-22T09:16:50.054726+0000","last_clean":"2024-09-22T09:16:50.054726+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:50.054726+0000","last_undegraded":"2024-09-22T09:16:50.054726+0000","last_fullsized":"2024-09-22T09:16:50.054726+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-22T09:16:50.054645+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-22T09:16:50.054645+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.054645+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:54.934659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'185","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.906240+0000","last_change":"2024-09-22T09:16:34.906240+0000","last_active":"2024-09-22T09:16:34.906240+0000","last_peered":"2024-09-22T09:16:34.906240+0000","last_clean":"2024-09-22T09:16:34.906240+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:16:34.906240+0000","last_undegraded":"2024-09-22T09:16:34.906240+0000","last_fullsized":"2024-09-22T09:16:34.906240+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'185","last_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_deep_scrub":"261'185","last_deep_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.906160+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:30.698172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'510","reported_seq":2224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.721488+0000","last_change":"2024-09-22T09:16:27.721488+0000","last_active":"2024-09-22T09:16:27.721488+0000","last_peered":"2024-09-22T09:16:27.721488+0000","last_clean":"2024-09-22T09:16:27.721488+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:16:27.721488+0000","last_undegraded":"2024-09-22T09:16:27.721488+0000","last_fullsized":"2024-09-22T09:16:27.721488+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.721372+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:34.833972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'402","reported_seq":1071,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.110814+0000","last_change":"2024-09-22T09:16:09.110814+0000","last_active":"2024-09-22T09:16:09.110814+0000","last_peered":"2024-09-22T09:16:09.110814+0000","last_clean":"2024-09-22T09:16:09.110814+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:09.110814+0000","last_undegraded":"2024-09-22T09:16:09.110814+0000","last_fullsized":"2024-09-22T09:16:09.110814+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.110739+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:11.343495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":777,"num_read_kb":8421,"num_write":1262,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.036919+0000","last_change":"2024-09-22T09:16:40.036919+0000","last_active":"2024-09-22T09:16:40.036919+0000","last_peered":"2024-09-22T09:16:40.036919+0000","last_clean":"2024-09-22T09:16:40.036919+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:16:40.036919+0000","last_undegraded":"2024-09-22T09:16:40.036919+0000","last_fullsized":"2024-09-22T09:16:40.036919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.036819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:53.136015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'298","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.992797+0000","last_change":"2024-09-22T09:16:26.992797+0000","last_active":"2024-09-22T09:16:26.992797+0000","last_peered":"2024-09-22T09:16:26.992797+0000","last_clean":"2024-09-22T09:16:26.992797+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:26.992797+0000","last_undegraded":"2024-09-22T09:16:26.992797+0000","last_fullsized":"2024-09-22T09:16:26.992797+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.992702+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:45.241158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'815","reported_seq":2616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.839128+0000","last_change":"2024-09-22T09:16:41.839128+0000","last_active":"2024-09-22T09:16:41.839128+0000","last_peered":"2024-09-22T09:16:41.839128+0000","last_clean":"2024-09-22T09:16:41.839128+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:41.839128+0000","last_undegraded":"2024-09-22T09:16:41.839128+0000","last_fullsized":"2024-09-22T09:16:41.839128+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.839029+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:42:06.512324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'412","reported_seq":1974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.254280+0000","last_change":"2024-09-22T09:16:25.254280+0000","last_active":"2024-09-22T09:16:25.254280+0000","last_peered":"2024-09-22T09:16:25.254280+0000","last_clean":"2024-09-22T09:16:25.254280+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:16:25.254280+0000","last_undegraded":"2024-09-22T09:16:25.254280+0000","last_fullsized":"2024-09-22T09:16:25.254280+0000","mapping_epoch":27,"log_start":"261'401","ondisk_log_start":"261'401","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'412","last_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_deep_scrub":"261'412","last_deep_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.254178+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:55.621599+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'375","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.571610+0000","last_change":"2024-09-22T09:16:10.571562+0000","last_active":"2024-09-22T09:16:10.571610+0000","last_peered":"2024-09-22T09:16:10.571610+0000","last_clean":"2024-09-22T09:16:10.571610+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:10.571610+0000","last_undegraded":"2024-09-22T09:16:10.571610+0000","last_fullsized":"2024-09-22T09:16:10.571610+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.571456+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:35.266733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":44787,"num_write":1101,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.216317+0000","last_change":"2024-09-22T09:16:23.216317+0000","last_active":"2024-09-22T09:16:23.216317+0000","last_peered":"2024-09-22T09:16:23.216317+0000","last_clean":"2024-09-22T09:16:23.216317+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:16:23.216317+0000","last_undegraded":"2024-09-22T09:16:23.216317+0000","last_fullsized":"2024-09-22T09:16:23.216317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.216231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:44.267586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'360","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.587861+0000","last_change":"2024-09-22T09:16:27.587861+0000","last_active":"2024-09-22T09:16:27.587861+0000","last_peered":"2024-09-22T09:16:27.587861+0000","last_clean":"2024-09-22T09:16:27.587861+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:27.587861+0000","last_undegraded":"2024-09-22T09:16:27.587861+0000","last_fullsized":"2024-09-22T09:16:27.587861+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'360","last_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_deep_scrub":"261'360","last_deep_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.587755+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:54.278181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.254294+0000","last_change":"2024-09-22T09:16:33.254294+0000","last_active":"2024-09-22T09:16:33.254294+0000","last_peered":"2024-09-22T09:16:33.254294+0000","last_clean":"2024-09-22T09:16:33.254294+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:16:33.254294+0000","last_undegraded":"2024-09-22T09:16:33.254294+0000","last_fullsized":"2024-09-22T09:16:33.254294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.254209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:27.817340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'561","reported_seq":1381,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.918170+0000","last_change":"2024-09-22T09:16:33.918170+0000","last_active":"2024-09-22T09:16:33.918170+0000","last_peered":"2024-09-22T09:16:33.918170+0000","last_clean":"2024-09-22T09:16:33.918170+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:16:33.918170+0000","last_undegraded":"2024-09-22T09:16:33.918170+0000","last_fullsized":"2024-09-22T09:16:33.918170+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'561","last_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_deep_scrub":"261'561","last_deep_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.918083+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:22.619736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'825","reported_seq":2462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.195453+0000","last_change":"2024-09-22T09:16:14.195453+0000","last_active":"2024-09-22T09:16:14.195453+0000","last_peered":"2024-09-22T09:16:14.195453+0000","last_clean":"2024-09-22T09:16:14.195453+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:16:14.195453+0000","last_undegraded":"2024-09-22T09:16:14.195453+0000","last_fullsized":"2024-09-22T09:16:14.195453+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'825","last_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_deep_scrub":"261'825","last_deep_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.195374+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:30.730771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'359","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.848770+0000","last_change":"2024-09-22T09:16:08.848770+0000","last_active":"2024-09-22T09:16:08.848770+0000","last_peered":"2024-09-22T09:16:08.848770+0000","last_clean":"2024-09-22T09:16:08.848770+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:08.848770+0000","last_undegraded":"2024-09-22T09:16:08.848770+0000","last_fullsized":"2024-09-22T09:16:08.848770+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.848662+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:01.073654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":29046,"num_write":1024,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.183966+0000","last_change":"2024-09-22T09:16:25.183966+0000","last_active":"2024-09-22T09:16:25.183966+0000","last_peered":"2024-09-22T09:16:25.183966+0000","last_clean":"2024-09-22T09:16:25.183966+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:16:25.183966+0000","last_undegraded":"2024-09-22T09:16:25.183966+0000","last_fullsized":"2024-09-22T09:16:25.183966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.183868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:41.982899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.660025+0000","last_change":"2024-09-22T09:16:33.660025+0000","last_active":"2024-09-22T09:16:33.660025+0000","last_peered":"2024-09-22T09:16:33.660025+0000","last_clean":"2024-09-22T09:16:33.660025+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:16:33.660025+0000","last_undegraded":"2024-09-22T09:16:33.660025+0000","last_fullsized":"2024-09-22T09:16:33.660025+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.659907+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:49.474414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45093,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":1000,"num_write":352,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.573049+0000","last_change":"2024-09-22T09:16:40.573049+0000","last_active":"2024-09-22T09:16:40.573049+0000","last_peered":"2024-09-22T09:16:40.573049+0000","last_clean":"2024-09-22T09:16:40.573049+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:16:40.573049+0000","last_undegraded":"2024-09-22T09:16:40.573049+0000","last_fullsized":"2024-09-22T09:16:40.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.572966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:43.876946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2491","reported_seq":4326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.158050+0000","last_change":"2024-09-22T09:16:35.158050+0000","last_active":"2024-09-22T09:16:35.158050+0000","last_peered":"2024-09-22T09:16:35.158050+0000","last_clean":"2024-09-22T09:16:35.158050+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:16:35.158050+0000","last_undegraded":"2024-09-22T09:16:35.158050+0000","last_fullsized":"2024-09-22T09:16:35.158050+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2491","last_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_deep_scrub":"261'2491","last_deep_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.157954+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:48.968960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'409","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.934530+0000","last_change":"2024-09-22T09:16:16.934474+0000","last_active":"2024-09-22T09:16:16.934530+0000","last_peered":"2024-09-22T09:16:16.934530+0000","last_clean":"2024-09-22T09:16:16.934530+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:16:16.934530+0000","last_undegraded":"2024-09-22T09:16:16.934530+0000","last_fullsized":"2024-09-22T09:16:16.934530+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.934388+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:53.392109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'366","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.276481+0000","last_change":"2024-09-22T09:16:17.276481+0000","last_active":"2024-09-22T09:16:17.276481+0000","last_peered":"2024-09-22T09:16:17.276481+0000","last_clean":"2024-09-22T09:16:17.276481+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:17.276481+0000","last_undegraded":"2024-09-22T09:16:17.276481+0000","last_fullsized":"2024-09-22T09:16:17.276481+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.276321+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:57.728982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":639,"num_read_kb":70122,"num_write":1105,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.640762+0000","last_change":"2024-09-22T09:16:32.640762+0000","last_active":"2024-09-22T09:16:32.640762+0000","last_peered":"2024-09-22T09:16:32.640762+0000","last_clean":"2024-09-22T09:16:32.640762+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:16:32.640762+0000","last_undegraded":"2024-09-22T09:16:32.640762+0000","last_fullsized":"2024-09-22T09:16:32.640762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.640677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:25.874693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'365","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.102662+0000","last_change":"2024-09-22T09:16:43.102662+0000","last_active":"2024-09-22T09:16:43.102662+0000","last_peered":"2024-09-22T09:16:43.102662+0000","last_clean":"2024-09-22T09:16:43.102662+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:16:43.102662+0000","last_undegraded":"2024-09-22T09:16:43.102662+0000","last_fullsized":"2024-09-22T09:16:43.102662+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.102571+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:22.471531+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1278,"num_write":480,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'815","reported_seq":4742,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.775015+0000","last_change":"2024-09-22T09:16:39.775015+0000","last_active":"2024-09-22T09:16:39.775015+0000","last_peered":"2024-09-22T09:16:39.775015+0000","last_clean":"2024-09-22T09:16:39.775015+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:39.775015+0000","last_undegraded":"2024-09-22T09:16:39.775015+0000","last_fullsized":"2024-09-22T09:16:39.775015+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.774931+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:35.874772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'123","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.264089+0000","last_change":"2024-09-22T09:16:35.264089+0000","last_active":"2024-09-22T09:16:35.264089+0000","last_peered":"2024-09-22T09:16:35.264089+0000","last_clean":"2024-09-22T09:16:35.264089+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:16:35.264089+0000","last_undegraded":"2024-09-22T09:16:35.264089+0000","last_fullsized":"2024-09-22T09:16:35.264089+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.263984+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:43.868350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1208","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.713666+0000","last_change":"2024-09-22T09:16:24.713666+0000","last_active":"2024-09-22T09:16:24.713666+0000","last_peered":"2024-09-22T09:16:24.713666+0000","last_clean":"2024-09-22T09:16:24.713666+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:16:24.713666+0000","last_undegraded":"2024-09-22T09:16:24.713666+0000","last_fullsized":"2024-09-22T09:16:24.713666+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1208","last_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_deep_scrub":"261'1208","last_deep_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.713578+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:01.700381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'358","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:07.592091+0000","last_change":"2024-09-22T09:16:07.591997+0000","last_active":"2024-09-22T09:16:07.592091+0000","last_peered":"2024-09-22T09:16:07.592091+0000","last_clean":"2024-09-22T09:16:07.592091+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:07.592091+0000","last_undegraded":"2024-09-22T09:16:07.592091+0000","last_fullsized":"2024-09-22T09:16:07.592091+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_clean_scrub_stamp":"2024-09-22T09:16:07.591858+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:25.904081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":651,"num_read_kb":2439,"num_write":1161,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.192204+0000","last_change":"2024-09-22T09:16:24.192204+0000","last_active":"2024-09-22T09:16:24.192204+0000","last_peered":"2024-09-22T09:16:24.192204+0000","last_clean":"2024-09-22T09:16:24.192204+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:16:24.192204+0000","last_undegraded":"2024-09-22T09:16:24.192204+0000","last_fullsized":"2024-09-22T09:16:24.192204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.192115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:19.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'503","reported_seq":1142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.613309+0000","last_change":"2024-09-22T09:16:32.613309+0000","last_active":"2024-09-22T09:16:32.613309+0000","last_peered":"2024-09-22T09:16:32.613309+0000","last_clean":"2024-09-22T09:16:32.613309+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:32.613309+0000","last_undegraded":"2024-09-22T09:16:32.613309+0000","last_fullsized":"2024-09-22T09:16:32.613309+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'503","last_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_deep_scrub":"261'503","last_deep_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.613214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:23.175984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":879,"num_read_kb":2151,"num_write":728,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.774927+0000","last_change":"2024-09-22T09:16:37.774927+0000","last_active":"2024-09-22T09:16:37.774927+0000","last_peered":"2024-09-22T09:16:37.774927+0000","last_clean":"2024-09-22T09:16:37.774927+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:16:37.774927+0000","last_undegraded":"2024-09-22T09:16:37.774927+0000","last_fullsized":"2024-09-22T09:16:37.774927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.774829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:35.076905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'133","reported_seq":635,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.813243+0000","last_change":"2024-09-22T09:16:32.813243+0000","last_active":"2024-09-22T09:16:32.813243+0000","last_peered":"2024-09-22T09:16:32.813243+0000","last_clean":"2024-09-22T09:16:32.813243+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:16:32.813243+0000","last_undegraded":"2024-09-22T09:16:32.813243+0000","last_fullsized":"2024-09-22T09:16:32.813243+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'133","last_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_deep_scrub":"261'133","last_deep_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.813146+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:05.926213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.443183+0000","last_change":"2024-09-22T09:16:17.443183+0000","last_active":"2024-09-22T09:16:17.443183+0000","last_peered":"2024-09-22T09:16:17.443183+0000","last_clean":"2024-09-22T09:16:17.443183+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:16:17.443183+0000","last_undegraded":"2024-09-22T09:16:17.443183+0000","last_fullsized":"2024-09-22T09:16:17.443183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'866","last_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_deep_scrub":"261'866","last_deep_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.443086+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:08.368887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'403","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.839046+0000","last_change":"2024-09-22T09:16:11.839046+0000","last_active":"2024-09-22T09:16:11.839046+0000","last_peered":"2024-09-22T09:16:11.839046+0000","last_clean":"2024-09-22T09:16:11.839046+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:11.839046+0000","last_undegraded":"2024-09-22T09:16:11.839046+0000","last_fullsized":"2024-09-22T09:16:11.839046+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.838921+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:56:29.399743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":12203,"num_write":1274,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.688842+0000","last_change":"2024-09-22T09:16:24.688842+0000","last_active":"2024-09-22T09:16:24.688842+0000","last_peered":"2024-09-22T09:16:24.688842+0000","last_clean":"2024-09-22T09:16:24.688842+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:16:24.688842+0000","last_undegraded":"2024-09-22T09:16:24.688842+0000","last_fullsized":"2024-09-22T09:16:24.688842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.688752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:06.256561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'307","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.144583+0000","last_change":"2024-09-22T09:16:28.144583+0000","last_active":"2024-09-22T09:16:28.144583+0000","last_peered":"2024-09-22T09:16:28.144583+0000","last_clean":"2024-09-22T09:16:28.144583+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:16:28.144583+0000","last_undegraded":"2024-09-22T09:16:28.144583+0000","last_fullsized":"2024-09-22T09:16:28.144583+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.144472+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:57.321893+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48624,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":466,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.679467+0000","last_change":"2024-09-22T09:16:28.679467+0000","last_active":"2024-09-22T09:16:28.679467+0000","last_peered":"2024-09-22T09:16:28.679467+0000","last_clean":"2024-09-22T09:16:28.679467+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:16:28.679467+0000","last_undegraded":"2024-09-22T09:16:28.679467+0000","last_fullsized":"2024-09-22T09:16:28.679467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.679355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:11.686705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'180","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.814844+0000","last_change":"2024-09-22T09:16:42.814844+0000","last_active":"2024-09-22T09:16:42.814844+0000","last_peered":"2024-09-22T09:16:42.814844+0000","last_clean":"2024-09-22T09:16:42.814844+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:16:42.814844+0000","last_undegraded":"2024-09-22T09:16:42.814844+0000","last_fullsized":"2024-09-22T09:16:42.814844+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'180","last_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_deep_scrub":"261'180","last_deep_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.814757+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:44.221228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'372","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.170508+0000","last_change":"2024-09-22T09:16:28.170508+0000","last_active":"2024-09-22T09:16:28.170508+0000","last_peered":"2024-09-22T09:16:28.170508+0000","last_clean":"2024-09-22T09:16:28.170508+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:16:28.170508+0000","last_undegraded":"2024-09-22T09:16:28.170508+0000","last_fullsized":"2024-09-22T09:16:28.170508+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.170412+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:09.100145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'472","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207139+0000","last_change":"2024-09-22T09:16:13.207072+0000","last_active":"2024-09-22T09:16:13.207139+0000","last_peered":"2024-09-22T09:16:13.207139+0000","last_clean":"2024-09-22T09:16:13.207139+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:13.207139+0000","last_undegraded":"2024-09-22T09:16:13.207139+0000","last_fullsized":"2024-09-22T09:16:13.207139+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'472","last_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_deep_scrub":"261'472","last_deep_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.206750+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:12.619430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311644,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1051,"num_read_kb":33703,"num_write":1406,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.683650+0000","last_change":"2024-09-22T09:16:33.683650+0000","last_active":"2024-09-22T09:16:33.683650+0000","last_peered":"2024-09-22T09:16:33.683650+0000","last_clean":"2024-09-22T09:16:33.683650+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:16:33.683650+0000","last_undegraded":"2024-09-22T09:16:33.683650+0000","last_fullsized":"2024-09-22T09:16:33.683650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.683559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:32.388730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'325","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.757279+0000","last_change":"2024-09-22T09:16:35.757279+0000","last_active":"2024-09-22T09:16:35.757279+0000","last_peered":"2024-09-22T09:16:35.757279+0000","last_clean":"2024-09-22T09:16:35.757279+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:16:35.757279+0000","last_undegraded":"2024-09-22T09:16:35.757279+0000","last_fullsized":"2024-09-22T09:16:35.757279+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.757181+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:50.937583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50318,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":418,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'795","reported_seq":4278,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.686198+0000","last_change":"2024-09-22T09:16:27.686198+0000","last_active":"2024-09-22T09:16:27.686198+0000","last_peered":"2024-09-22T09:16:27.686198+0000","last_clean":"2024-09-22T09:16:27.686198+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:27.686198+0000","last_undegraded":"2024-09-22T09:16:27.686198+0000","last_fullsized":"2024-09-22T09:16:27.686198+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.686099+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:44.296879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'144","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.217813+0000","last_change":"2024-09-22T09:16:34.217813+0000","last_active":"2024-09-22T09:16:34.217813+0000","last_peered":"2024-09-22T09:16:34.217813+0000","last_clean":"2024-09-22T09:16:34.217813+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:16:34.217813+0000","last_undegraded":"2024-09-22T09:16:34.217813+0000","last_fullsized":"2024-09-22T09:16:34.217813+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'144","last_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_deep_scrub":"261'144","last_deep_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.217722+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:32.109666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'507","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.890344+0000","last_change":"2024-09-22T09:16:17.890344+0000","last_active":"2024-09-22T09:16:17.890344+0000","last_peered":"2024-09-22T09:16:17.890344+0000","last_clean":"2024-09-22T09:16:17.890344+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:16:17.890344+0000","last_undegraded":"2024-09-22T09:16:17.890344+0000","last_fullsized":"2024-09-22T09:16:17.890344+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'507","last_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_deep_scrub":"261'507","last_deep_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.890235+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:42.972286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'323","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.215100+0000","last_change":"2024-09-22T09:16:15.215100+0000","last_active":"2024-09-22T09:16:15.215100+0000","last_peered":"2024-09-22T09:16:15.215100+0000","last_clean":"2024-09-22T09:16:15.215100+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:15.215100+0000","last_undegraded":"2024-09-22T09:16:15.215100+0000","last_fullsized":"2024-09-22T09:16:15.215100+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.214985+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:13.621351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":25990,"num_write":923,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1465,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.267481+0000","last_change":"2024-09-22T09:16:24.267481+0000","last_active":"2024-09-22T09:16:24.267481+0000","last_peered":"2024-09-22T09:16:24.267481+0000","last_clean":"2024-09-22T09:16:24.267481+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:24.267481+0000","last_undegraded":"2024-09-22T09:16:24.267481+0000","last_fullsized":"2024-09-22T09:16:24.267481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.267396+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:33.710111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'85","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.236549+0000","last_change":"2024-09-22T09:16:28.236549+0000","last_active":"2024-09-22T09:16:28.236549+0000","last_peered":"2024-09-22T09:16:28.236549+0000","last_clean":"2024-09-22T09:16:28.236549+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:16:28.236549+0000","last_undegraded":"2024-09-22T09:16:28.236549+0000","last_fullsized":"2024-09-22T09:16:28.236549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.236453+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:10.057889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'784","reported_seq":2577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.169047+0000","last_change":"2024-09-22T09:16:31.169047+0000","last_active":"2024-09-22T09:16:31.169047+0000","last_peered":"2024-09-22T09:16:31.169047+0000","last_clean":"2024-09-22T09:16:31.169047+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:31.169047+0000","last_undegraded":"2024-09-22T09:16:31.169047+0000","last_fullsized":"2024-09-22T09:16:31.169047+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.168981+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:33.186208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'111","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.922582+0000","last_change":"2024-09-22T09:16:32.922582+0000","last_active":"2024-09-22T09:16:32.922582+0000","last_peered":"2024-09-22T09:16:32.922582+0000","last_clean":"2024-09-22T09:16:32.922582+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:16:32.922582+0000","last_undegraded":"2024-09-22T09:16:32.922582+0000","last_fullsized":"2024-09-22T09:16:32.922582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'111","last_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_deep_scrub":"261'111","last_deep_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.922490+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:09.185881+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1180","reported_seq":2769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.786239+0000","last_change":"2024-09-22T09:16:14.786187+0000","last_active":"2024-09-22T09:16:14.786239+0000","last_peered":"2024-09-22T09:16:14.786239+0000","last_clean":"2024-09-22T09:16:14.786239+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:16:14.786239+0000","last_undegraded":"2024-09-22T09:16:14.786239+0000","last_fullsized":"2024-09-22T09:16:14.786239+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1180","last_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_deep_scrub":"261'1180","last_deep_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.786101+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:54.467939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'437","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.777822+0000","last_change":"2024-09-22T09:16:12.777822+0000","last_active":"2024-09-22T09:16:12.777822+0000","last_peered":"2024-09-22T09:16:12.777822+0000","last_clean":"2024-09-22T09:16:12.777822+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:12.777822+0000","last_undegraded":"2024-09-22T09:16:12.777822+0000","last_fullsized":"2024-09-22T09:16:12.777822+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'437","last_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_deep_scrub":"261'437","last_deep_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.777701+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:43.034360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":819,"num_read_kb":19795,"num_write":1316,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.057672+0000","last_change":"2024-09-22T09:16:38.057672+0000","last_active":"2024-09-22T09:16:38.057672+0000","last_peered":"2024-09-22T09:16:38.057672+0000","last_clean":"2024-09-22T09:16:38.057672+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:16:38.057672+0000","last_undegraded":"2024-09-22T09:16:38.057672+0000","last_fullsized":"2024-09-22T09:16:38.057672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.057570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:45.412670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'367","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.190390+0000","last_change":"2024-09-22T09:16:27.190390+0000","last_active":"2024-09-22T09:16:27.190390+0000","last_peered":"2024-09-22T09:16:27.190390+0000","last_clean":"2024-09-22T09:16:27.190390+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:27.190390+0000","last_undegraded":"2024-09-22T09:16:27.190390+0000","last_fullsized":"2024-09-22T09:16:27.190390+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.190267+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:44.961351+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.969489+0000","last_change":"2024-09-22T09:16:29.969489+0000","last_active":"2024-09-22T09:16:29.969489+0000","last_peered":"2024-09-22T09:16:29.969489+0000","last_clean":"2024-09-22T09:16:29.969489+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:16:29.969489+0000","last_undegraded":"2024-09-22T09:16:29.969489+0000","last_fullsized":"2024-09-22T09:16:29.969489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.969406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:51.421775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'176","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.824926+0000","last_change":"2024-09-22T09:16:33.824926+0000","last_active":"2024-09-22T09:16:33.824926+0000","last_peered":"2024-09-22T09:16:33.824926+0000","last_clean":"2024-09-22T09:16:33.824926+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:16:33.824926+0000","last_undegraded":"2024-09-22T09:16:33.824926+0000","last_fullsized":"2024-09-22T09:16:33.824926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'176","last_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_deep_scrub":"261'176","last_deep_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.824818+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:04.659434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'899","reported_seq":2557,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.219147+0000","last_change":"2024-09-22T09:16:26.219147+0000","last_active":"2024-09-22T09:16:26.219147+0000","last_peered":"2024-09-22T09:16:26.219147+0000","last_clean":"2024-09-22T09:16:26.219147+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:16:26.219147+0000","last_undegraded":"2024-09-22T09:16:26.219147+0000","last_fullsized":"2024-09-22T09:16:26.219147+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'899","last_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_deep_scrub":"261'899","last_deep_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.219043+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:44.422572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3769,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.146779+0000","last_change":"2024-09-22T09:16:08.146779+0000","last_active":"2024-09-22T09:16:08.146779+0000","last_peered":"2024-09-22T09:16:08.146779+0000","last_clean":"2024-09-22T09:16:08.146779+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:16:08.146779+0000","last_undegraded":"2024-09-22T09:16:08.146779+0000","last_fullsized":"2024-09-22T09:16:08.146779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.146708+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:12.109321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.130511+0000","last_change":"2024-09-22T09:16:11.130511+0000","last_active":"2024-09-22T09:16:11.130511+0000","last_peered":"2024-09-22T09:16:11.130511+0000","last_clean":"2024-09-22T09:16:11.130511+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:16:11.130511+0000","last_undegraded":"2024-09-22T09:16:11.130511+0000","last_fullsized":"2024-09-22T09:16:11.130511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.130438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:05.095794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.804878+0000","last_change":"2024-09-22T09:16:09.804878+0000","last_active":"2024-09-22T09:16:09.804878+0000","last_peered":"2024-09-22T09:16:09.804878+0000","last_clean":"2024-09-22T09:16:09.804878+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:09.804878+0000","last_undegraded":"2024-09-22T09:16:09.804878+0000","last_fullsized":"2024-09-22T09:16:09.804878+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.804702+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:57.406186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":613,"num_read_kb":39972,"num_write":1027,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.508606+0000","last_change":"2024-09-22T09:16:23.508606+0000","last_active":"2024-09-22T09:16:23.508606+0000","last_peered":"2024-09-22T09:16:23.508606+0000","last_clean":"2024-09-22T09:16:23.508606+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:16:23.508606+0000","last_undegraded":"2024-09-22T09:16:23.508606+0000","last_fullsized":"2024-09-22T09:16:23.508606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.508510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:25.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'748","reported_seq":1453,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.058576+0000","last_change":"2024-09-22T09:16:42.058576+0000","last_active":"2024-09-22T09:16:42.058576+0000","last_peered":"2024-09-22T09:16:42.058576+0000","last_clean":"2024-09-22T09:16:42.058576+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:42.058576+0000","last_undegraded":"2024-09-22T09:16:42.058576+0000","last_fullsized":"2024-09-22T09:16:42.058576+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'748","last_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_deep_scrub":"261'748","last_deep_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.058458+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:12.275343+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133117,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1419,"num_read_kb":3139,"num_write":1374,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106794,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.814431+0000","last_change":"2024-09-22T09:16:38.814431+0000","last_active":"2024-09-22T09:16:38.814431+0000","last_peered":"2024-09-22T09:16:38.814431+0000","last_clean":"2024-09-22T09:16:38.814431+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:16:38.814431+0000","last_undegraded":"2024-09-22T09:16:38.814431+0000","last_fullsized":"2024-09-22T09:16:38.814431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.814353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:07.223791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'207","reported_seq":911,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.553926+0000","last_change":"2024-09-22T09:16:31.553926+0000","last_active":"2024-09-22T09:16:31.553926+0000","last_peered":"2024-09-22T09:16:31.553926+0000","last_clean":"2024-09-22T09:16:31.553926+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:16:31.553926+0000","last_undegraded":"2024-09-22T09:16:31.553926+0000","last_fullsized":"2024-09-22T09:16:31.553926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'207","last_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_deep_scrub":"261'207","last_deep_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.553843+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:22.975099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.696665+0000","last_change":"2024-09-22T09:16:23.696665+0000","last_active":"2024-09-22T09:16:23.696665+0000","last_peered":"2024-09-22T09:16:23.696665+0000","last_clean":"2024-09-22T09:16:23.696665+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:16:23.696665+0000","last_undegraded":"2024-09-22T09:16:23.696665+0000","last_fullsized":"2024-09-22T09:16:23.696665+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'882","last_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_deep_scrub":"261'882","last_deep_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.696577+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:38.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.103337+0000","last_change":"2024-09-22T09:16:09.103337+0000","last_active":"2024-09-22T09:16:09.103337+0000","last_peered":"2024-09-22T09:16:09.103337+0000","last_clean":"2024-09-22T09:16:09.103337+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:16:09.103337+0000","last_undegraded":"2024-09-22T09:16:09.103337+0000","last_fullsized":"2024-09-22T09:16:09.103337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.103256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:48.650934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'335","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.221035+0000","last_change":"2024-09-22T09:16:10.221035+0000","last_active":"2024-09-22T09:16:10.221035+0000","last_peered":"2024-09-22T09:16:10.221035+0000","last_clean":"2024-09-22T09:16:10.221035+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:10.221035+0000","last_undegraded":"2024-09-22T09:16:10.221035+0000","last_fullsized":"2024-09-22T09:16:10.221035+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'335","last_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_deep_scrub":"261'335","last_deep_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.220912+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:01.000745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":6730,"num_write":1066,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.032114+0000","last_change":"2024-09-22T09:16:36.032114+0000","last_active":"2024-09-22T09:16:36.032114+0000","last_peered":"2024-09-22T09:16:36.032114+0000","last_clean":"2024-09-22T09:16:36.032114+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:16:36.032114+0000","last_undegraded":"2024-09-22T09:16:36.032114+0000","last_fullsized":"2024-09-22T09:16:36.032114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.032028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:58.714746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1343","reported_seq":2972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.741413+0000","last_change":"2024-09-22T09:16:25.741413+0000","last_active":"2024-09-22T09:16:25.741413+0000","last_peered":"2024-09-22T09:16:25.741413+0000","last_clean":"2024-09-22T09:16:25.741413+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:25.741413+0000","last_undegraded":"2024-09-22T09:16:25.741413+0000","last_fullsized":"2024-09-22T09:16:25.741413+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1343","last_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_deep_scrub":"261'1343","last_deep_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.741309+0000","objects_scrubbed":12,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:15.738101+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141570,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3855,"num_write":1170,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.059685+0000","last_change":"2024-09-22T09:16:47.059685+0000","last_active":"2024-09-22T09:16:47.059685+0000","last_peered":"2024-09-22T09:16:47.059685+0000","last_clean":"2024-09-22T09:16:47.059685+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:16:47.059685+0000","last_undegraded":"2024-09-22T09:16:47.059685+0000","last_fullsized":"2024-09-22T09:16:47.059685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.059597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:03.787983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'124","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.863516+0000","last_change":"2024-09-22T09:16:43.863516+0000","last_active":"2024-09-22T09:16:43.863516+0000","last_peered":"2024-09-22T09:16:43.863516+0000","last_clean":"2024-09-22T09:16:43.863516+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:16:43.863516+0000","last_undegraded":"2024-09-22T09:16:43.863516+0000","last_fullsized":"2024-09-22T09:16:43.863516+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.863424+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:49.790428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'467","reported_seq":2081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.232945+0000","last_change":"2024-09-22T09:16:19.232945+0000","last_active":"2024-09-22T09:16:19.232945+0000","last_peered":"2024-09-22T09:16:19.232945+0000","last_clean":"2024-09-22T09:16:19.232945+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:16:19.232945+0000","last_undegraded":"2024-09-22T09:16:19.232945+0000","last_fullsized":"2024-09-22T09:16:19.232945+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.232833+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:17.313258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.820588+0000","last_change":"2024-09-22T09:16:10.820588+0000","last_active":"2024-09-22T09:16:10.820588+0000","last_peered":"2024-09-22T09:16:10.820588+0000","last_clean":"2024-09-22T09:16:10.820588+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:16:10.820588+0000","last_undegraded":"2024-09-22T09:16:10.820588+0000","last_fullsized":"2024-09-22T09:16:10.820588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.820505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:43.185792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'324","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.734585+0000","last_change":"2024-09-22T09:16:09.734585+0000","last_active":"2024-09-22T09:16:09.734585+0000","last_peered":"2024-09-22T09:16:09.734585+0000","last_clean":"2024-09-22T09:16:09.734585+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:09.734585+0000","last_undegraded":"2024-09-22T09:16:09.734585+0000","last_fullsized":"2024-09-22T09:16:09.734585+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.734427+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:44.034840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174880,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":1785,"num_write":1090,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'8","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.725370+0000","last_change":"2024-09-22T09:16:20.725370+0000","last_active":"2024-09-22T09:16:20.725370+0000","last_peered":"2024-09-22T09:16:20.725370+0000","last_clean":"2024-09-22T09:16:20.725370+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:20.725370+0000","last_undegraded":"2024-09-22T09:16:20.725370+0000","last_fullsized":"2024-09-22T09:16:20.725370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.725286+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:56.727213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'268","reported_seq":1503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.569532+0000","last_change":"2024-09-22T09:16:26.569532+0000","last_active":"2024-09-22T09:16:26.569532+0000","last_peered":"2024-09-22T09:16:26.569532+0000","last_clean":"2024-09-22T09:16:26.569532+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:16:26.569532+0000","last_undegraded":"2024-09-22T09:16:26.569532+0000","last_fullsized":"2024-09-22T09:16:26.569532+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'268","last_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_deep_scrub":"261'268","last_deep_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.569422+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:23.239715+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.554267+0000","last_change":"2024-09-22T09:16:39.554267+0000","last_active":"2024-09-22T09:16:39.554267+0000","last_peered":"2024-09-22T09:16:39.554267+0000","last_clean":"2024-09-22T09:16:39.554267+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:16:39.554267+0000","last_undegraded":"2024-09-22T09:16:39.554267+0000","last_fullsized":"2024-09-22T09:16:39.554267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.554148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:40.126687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.647850+0000","last_change":"2024-09-22T09:16:43.647850+0000","last_active":"2024-09-22T09:16:43.647850+0000","last_peered":"2024-09-22T09:16:43.647850+0000","last_clean":"2024-09-22T09:16:43.647850+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:16:43.647850+0000","last_undegraded":"2024-09-22T09:16:43.647850+0000","last_fullsized":"2024-09-22T09:16:43.647850+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.647767+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:03.889824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'776","reported_seq":2214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.202744+0000","last_change":"2024-09-22T09:16:18.202744+0000","last_active":"2024-09-22T09:16:18.202744+0000","last_peered":"2024-09-22T09:16:18.202744+0000","last_clean":"2024-09-22T09:16:18.202744+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:16:18.202744+0000","last_undegraded":"2024-09-22T09:16:18.202744+0000","last_fullsized":"2024-09-22T09:16:18.202744+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'776","last_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_deep_scrub":"261'776","last_deep_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.202607+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:20.032816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":528,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.098720+0000","last_change":"2024-09-22T09:16:10.098720+0000","last_active":"2024-09-22T09:16:10.098720+0000","last_peered":"2024-09-22T09:16:10.098720+0000","last_clean":"2024-09-22T09:16:10.098720+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:16:10.098720+0000","last_undegraded":"2024-09-22T09:16:10.098720+0000","last_fullsized":"2024-09-22T09:16:10.098720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.098658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:32.867298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'390","reported_seq":1009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.778066+0000","last_change":"2024-09-22T09:16:13.778005+0000","last_active":"2024-09-22T09:16:13.778066+0000","last_peered":"2024-09-22T09:16:13.778066+0000","last_clean":"2024-09-22T09:16:13.778066+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:13.778066+0000","last_undegraded":"2024-09-22T09:16:13.778066+0000","last_fullsized":"2024-09-22T09:16:13.778066+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'390","last_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_deep_scrub":"261'390","last_deep_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.777834+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:00.884220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":48326,"num_write":1184,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.706486+0000","last_change":"2024-09-22T09:16:21.706486+0000","last_active":"2024-09-22T09:16:21.706486+0000","last_peered":"2024-09-22T09:16:21.706486+0000","last_clean":"2024-09-22T09:16:21.706486+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:16:21.706486+0000","last_undegraded":"2024-09-22T09:16:21.706486+0000","last_fullsized":"2024-09-22T09:16:21.706486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.706389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:33.368571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'148","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.720118+0000","last_change":"2024-09-22T09:16:34.720118+0000","last_active":"2024-09-22T09:16:34.720118+0000","last_peered":"2024-09-22T09:16:34.720118+0000","last_clean":"2024-09-22T09:16:34.720118+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:16:34.720118+0000","last_undegraded":"2024-09-22T09:16:34.720118+0000","last_fullsized":"2024-09-22T09:16:34.720118+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'148","last_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_deep_scrub":"261'148","last_deep_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.720023+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:59.789283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.087919+0000","last_change":"2024-09-22T09:16:48.087919+0000","last_active":"2024-09-22T09:16:48.087919+0000","last_peered":"2024-09-22T09:16:48.087919+0000","last_clean":"2024-09-22T09:16:48.087919+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:16:48.087919+0000","last_undegraded":"2024-09-22T09:16:48.087919+0000","last_fullsized":"2024-09-22T09:16:48.087919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:48.087798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:48.087798+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.087798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:48.607073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.154869+0000","last_change":"2024-09-22T09:16:36.154869+0000","last_active":"2024-09-22T09:16:36.154869+0000","last_peered":"2024-09-22T09:16:36.154869+0000","last_clean":"2024-09-22T09:16:36.154869+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:16:36.154869+0000","last_undegraded":"2024-09-22T09:16:36.154869+0000","last_fullsized":"2024-09-22T09:16:36.154869+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.154767+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:34.821467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'373","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.204350+0000","last_change":"2024-09-22T09:16:20.204350+0000","last_active":"2024-09-22T09:16:20.204350+0000","last_peered":"2024-09-22T09:16:20.204350+0000","last_clean":"2024-09-22T09:16:20.204350+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:16:20.204350+0000","last_undegraded":"2024-09-22T09:16:20.204350+0000","last_fullsized":"2024-09-22T09:16:20.204350+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'373","last_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_deep_scrub":"261'373","last_deep_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.204251+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:02.514748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'389","reported_seq":1095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.883341+0000","last_change":"2024-09-22T09:16:09.883341+0000","last_active":"2024-09-22T09:16:09.883341+0000","last_peered":"2024-09-22T09:16:09.883341+0000","last_clean":"2024-09-22T09:16:09.883341+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:09.883341+0000","last_undegraded":"2024-09-22T09:16:09.883341+0000","last_fullsized":"2024-09-22T09:16:09.883341+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'389","last_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_deep_scrub":"261'389","last_deep_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.883202+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.123770+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6919332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":45053,"num_write":1379,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.781614+0000","last_change":"2024-09-22T09:16:10.781614+0000","last_active":"2024-09-22T09:16:10.781614+0000","last_peered":"2024-09-22T09:16:10.781614+0000","last_clean":"2024-09-22T09:16:10.781614+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:16:10.781614+0000","last_undegraded":"2024-09-22T09:16:10.781614+0000","last_fullsized":"2024-09-22T09:16:10.781614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.781523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:03.872420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.698988+0000","last_change":"2024-09-22T09:16:26.698988+0000","last_active":"2024-09-22T09:16:26.698988+0000","last_peered":"2024-09-22T09:16:26.698988+0000","last_clean":"2024-09-22T09:16:26.698988+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:16:26.698988+0000","last_undegraded":"2024-09-22T09:16:26.698988+0000","last_fullsized":"2024-09-22T09:16:26.698988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.698863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:05.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'596","reported_seq":1264,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.701953+0000","last_change":"2024-09-22T09:16:23.701953+0000","last_active":"2024-09-22T09:16:23.701953+0000","last_peered":"2024-09-22T09:16:23.701953+0000","last_clean":"2024-09-22T09:16:23.701953+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:23.701953+0000","last_undegraded":"2024-09-22T09:16:23.701953+0000","last_fullsized":"2024-09-22T09:16:23.701953+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'596","last_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_deep_scrub":"261'596","last_deep_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.701817+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:20.394276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1681,"num_read_kb":2863,"num_write":2226,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.977574+0000","last_change":"2024-09-22T09:16:27.977574+0000","last_active":"2024-09-22T09:16:27.977574+0000","last_peered":"2024-09-22T09:16:27.977574+0000","last_clean":"2024-09-22T09:16:27.977574+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:16:27.977574+0000","last_undegraded":"2024-09-22T09:16:27.977574+0000","last_fullsized":"2024-09-22T09:16:27.977574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.977483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:36.365474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'132","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.837395+0000","last_change":"2024-09-22T09:16:45.837395+0000","last_active":"2024-09-22T09:16:45.837395+0000","last_peered":"2024-09-22T09:16:45.837395+0000","last_clean":"2024-09-22T09:16:45.837395+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:16:45.837395+0000","last_undegraded":"2024-09-22T09:16:45.837395+0000","last_fullsized":"2024-09-22T09:16:45.837395+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.837304+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:39.433815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'438","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.211439+0000","last_change":"2024-09-22T09:16:16.211439+0000","last_active":"2024-09-22T09:16:16.211439+0000","last_peered":"2024-09-22T09:16:16.211439+0000","last_clean":"2024-09-22T09:16:16.211439+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:16:16.211439+0000","last_undegraded":"2024-09-22T09:16:16.211439+0000","last_fullsized":"2024-09-22T09:16:16.211439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'438","last_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_deep_scrub":"261'438","last_deep_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.211353+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:12.204748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'404","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.216484+0000","last_change":"2024-09-22T09:16:11.216484+0000","last_active":"2024-09-22T09:16:11.216484+0000","last_peered":"2024-09-22T09:16:11.216484+0000","last_clean":"2024-09-22T09:16:11.216484+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:11.216484+0000","last_undegraded":"2024-09-22T09:16:11.216484+0000","last_fullsized":"2024-09-22T09:16:11.216484+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.216383+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:43.556741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":42178,"num_write":1167,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.243905+0000","last_change":"2024-09-22T09:16:14.243905+0000","last_active":"2024-09-22T09:16:14.243905+0000","last_peered":"2024-09-22T09:16:14.243905+0000","last_clean":"2024-09-22T09:16:14.243905+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:16:14.243905+0000","last_undegraded":"2024-09-22T09:16:14.243905+0000","last_fullsized":"2024-09-22T09:16:14.243905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.243805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:17.107629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"261'4","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.547087+0000","last_change":"2024-09-22T09:16:24.547087+0000","last_active":"2024-09-22T09:16:24.547087+0000","last_peered":"2024-09-22T09:16:24.547087+0000","last_clean":"2024-09-22T09:16:24.547087+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:24.547087+0000","last_undegraded":"2024-09-22T09:16:24.547087+0000","last_fullsized":"2024-09-22T09:16:24.547087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.546984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:57.779533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'175","reported_seq":738,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.202111+0000","last_change":"2024-09-22T09:16:27.202111+0000","last_active":"2024-09-22T09:16:27.202111+0000","last_peered":"2024-09-22T09:16:27.202111+0000","last_clean":"2024-09-22T09:16:27.202111+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:16:27.202111+0000","last_undegraded":"2024-09-22T09:16:27.202111+0000","last_fullsized":"2024-09-22T09:16:27.202111+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'175","last_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_deep_scrub":"261'175","last_deep_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.202023+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:39.841272+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'784","reported_seq":2607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.183448+0000","last_change":"2024-09-22T09:16:29.183448+0000","last_active":"2024-09-22T09:16:29.183448+0000","last_peered":"2024-09-22T09:16:29.183448+0000","last_clean":"2024-09-22T09:16:29.183448+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:29.183448+0000","last_undegraded":"2024-09-22T09:16:29.183448+0000","last_fullsized":"2024-09-22T09:16:29.183448+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.183343+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:58.686649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'131","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.864391+0000","last_change":"2024-09-22T09:16:34.864391+0000","last_active":"2024-09-22T09:16:34.864391+0000","last_peered":"2024-09-22T09:16:34.864391+0000","last_clean":"2024-09-22T09:16:34.864391+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:16:34.864391+0000","last_undegraded":"2024-09-22T09:16:34.864391+0000","last_fullsized":"2024-09-22T09:16:34.864391+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.864290+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:29.499370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'481","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.772601+0000","last_change":"2024-09-22T09:16:14.772601+0000","last_active":"2024-09-22T09:16:14.772601+0000","last_peered":"2024-09-22T09:16:14.772601+0000","last_clean":"2024-09-22T09:16:14.772601+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:16:14.772601+0000","last_undegraded":"2024-09-22T09:16:14.772601+0000","last_fullsized":"2024-09-22T09:16:14.772601+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'481","last_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_deep_scrub":"261'481","last_deep_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.772519+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:51.207310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'410","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.807161+0000","last_change":"2024-09-22T09:16:11.807161+0000","last_active":"2024-09-22T09:16:11.807161+0000","last_peered":"2024-09-22T09:16:11.807161+0000","last_clean":"2024-09-22T09:16:11.807161+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:11.807161+0000","last_undegraded":"2024-09-22T09:16:11.807161+0000","last_fullsized":"2024-09-22T09:16:11.807161+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'410","last_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_deep_scrub":"261'410","last_deep_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.807026+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:44.619900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":945,"num_read_kb":43241,"num_write":1287,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.823207+0000","last_change":"2024-09-22T09:16:08.823207+0000","last_active":"2024-09-22T09:16:08.823207+0000","last_peered":"2024-09-22T09:16:08.823207+0000","last_clean":"2024-09-22T09:16:08.823207+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:16:08.823207+0000","last_undegraded":"2024-09-22T09:16:08.823207+0000","last_fullsized":"2024-09-22T09:16:08.823207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.823085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:31.913983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.075573+0000","last_change":"2024-09-22T09:16:35.075573+0000","last_active":"2024-09-22T09:16:35.075573+0000","last_peered":"2024-09-22T09:16:35.075573+0000","last_clean":"2024-09-22T09:16:35.075573+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:16:35.075573+0000","last_undegraded":"2024-09-22T09:16:35.075573+0000","last_fullsized":"2024-09-22T09:16:35.075573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.075486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:55.025811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'116","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.036796+0000","last_change":"2024-09-22T09:16:41.036796+0000","last_active":"2024-09-22T09:16:41.036796+0000","last_peered":"2024-09-22T09:16:41.036796+0000","last_clean":"2024-09-22T09:16:41.036796+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:16:41.036796+0000","last_undegraded":"2024-09-22T09:16:41.036796+0000","last_fullsized":"2024-09-22T09:16:41.036796+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.036697+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:59.620262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'814","reported_seq":2532,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.793997+0000","last_change":"2024-09-22T09:16:36.793997+0000","last_active":"2024-09-22T09:16:36.793997+0000","last_peered":"2024-09-22T09:16:36.793997+0000","last_clean":"2024-09-22T09:16:36.793997+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:36.793997+0000","last_undegraded":"2024-09-22T09:16:36.793997+0000","last_fullsized":"2024-09-22T09:16:36.793997+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'814","last_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_deep_scrub":"261'814","last_deep_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.793904+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:46.387778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'291","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.885417+0000","last_change":"2024-09-22T09:16:44.885417+0000","last_active":"2024-09-22T09:16:44.885417+0000","last_peered":"2024-09-22T09:16:44.885417+0000","last_clean":"2024-09-22T09:16:44.885417+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:16:44.885417+0000","last_undegraded":"2024-09-22T09:16:44.885417+0000","last_fullsized":"2024-09-22T09:16:44.885417+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.885302+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:47.087058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.919376+0000","last_change":"2024-09-22T09:16:14.919376+0000","last_active":"2024-09-22T09:16:14.919376+0000","last_peered":"2024-09-22T09:16:14.919376+0000","last_clean":"2024-09-22T09:16:14.919376+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:16:14.919376+0000","last_undegraded":"2024-09-22T09:16:14.919376+0000","last_fullsized":"2024-09-22T09:16:14.919376+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.919282+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:08.650486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'327","reported_seq":1056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.772366+0000","last_change":"2024-09-22T09:16:10.772280+0000","last_active":"2024-09-22T09:16:10.772366+0000","last_peered":"2024-09-22T09:16:10.772366+0000","last_clean":"2024-09-22T09:16:10.772366+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:10.772366+0000","last_undegraded":"2024-09-22T09:16:10.772366+0000","last_fullsized":"2024-09-22T09:16:10.772366+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.772122+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:38.919070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048951,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":907,"num_read_kb":63310,"num_write":970,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.152744+0000","last_change":"2024-09-22T09:16:12.152744+0000","last_active":"2024-09-22T09:16:12.152744+0000","last_peered":"2024-09-22T09:16:12.152744+0000","last_clean":"2024-09-22T09:16:12.152744+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:16:12.152744+0000","last_undegraded":"2024-09-22T09:16:12.152744+0000","last_fullsized":"2024-09-22T09:16:12.152744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.152652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:42.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.748080+0000","last_change":"2024-09-22T09:16:24.748080+0000","last_active":"2024-09-22T09:16:24.748080+0000","last_peered":"2024-09-22T09:16:24.748080+0000","last_clean":"2024-09-22T09:16:24.748080+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:16:24.748080+0000","last_undegraded":"2024-09-22T09:16:24.748080+0000","last_fullsized":"2024-09-22T09:16:24.748080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.748000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:33.241849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'747","reported_seq":1467,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.563522+0000","last_change":"2024-09-22T09:16:25.563522+0000","last_active":"2024-09-22T09:16:25.563522+0000","last_peered":"2024-09-22T09:16:25.563522+0000","last_clean":"2024-09-22T09:16:25.563522+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:25.563522+0000","last_undegraded":"2024-09-22T09:16:25.563522+0000","last_fullsized":"2024-09-22T09:16:25.563522+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'747","last_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_deep_scrub":"261'747","last_deep_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.563415+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:22.893620+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1336,"num_read_kb":3141,"num_write":1092,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.576127+0000","last_change":"2024-09-22T09:16:38.576127+0000","last_active":"2024-09-22T09:16:38.576127+0000","last_peered":"2024-09-22T09:16:38.576127+0000","last_clean":"2024-09-22T09:16:38.576127+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:16:38.576127+0000","last_undegraded":"2024-09-22T09:16:38.576127+0000","last_fullsized":"2024-09-22T09:16:38.576127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.576031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:05.576920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'102","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.929801+0000","last_change":"2024-09-22T09:16:35.929801+0000","last_active":"2024-09-22T09:16:35.929801+0000","last_peered":"2024-09-22T09:16:35.929801+0000","last_clean":"2024-09-22T09:16:35.929801+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:16:35.929801+0000","last_undegraded":"2024-09-22T09:16:35.929801+0000","last_fullsized":"2024-09-22T09:16:35.929801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.929698+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:53.295003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'124","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.611669+0000","last_change":"2024-09-22T09:16:44.611669+0000","last_active":"2024-09-22T09:16:44.611669+0000","last_peered":"2024-09-22T09:16:44.611669+0000","last_clean":"2024-09-22T09:16:44.611669+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:16:44.611669+0000","last_undegraded":"2024-09-22T09:16:44.611669+0000","last_fullsized":"2024-09-22T09:16:44.611669+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.611578+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:35.821865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'413","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.864884+0000","last_change":"2024-09-22T09:16:18.864884+0000","last_active":"2024-09-22T09:16:18.864884+0000","last_peered":"2024-09-22T09:16:18.864884+0000","last_clean":"2024-09-22T09:16:18.864884+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:16:18.864884+0000","last_undegraded":"2024-09-22T09:16:18.864884+0000","last_fullsized":"2024-09-22T09:16:18.864884+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'413","last_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_deep_scrub":"261'413","last_deep_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.864732+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:46.218753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'314","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.295818+0000","last_change":"2024-09-22T09:16:19.295818+0000","last_active":"2024-09-22T09:16:19.295818+0000","last_peered":"2024-09-22T09:16:19.295818+0000","last_clean":"2024-09-22T09:16:19.295818+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:19.295818+0000","last_undegraded":"2024-09-22T09:16:19.295818+0000","last_fullsized":"2024-09-22T09:16:19.295818+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.295694+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:01.794130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":48776,"num_write":1072,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.245928+0000","last_change":"2024-09-22T09:16:29.245928+0000","last_active":"2024-09-22T09:16:29.245928+0000","last_peered":"2024-09-22T09:16:29.245928+0000","last_clean":"2024-09-22T09:16:29.245928+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:16:29.245928+0000","last_undegraded":"2024-09-22T09:16:29.245928+0000","last_fullsized":"2024-09-22T09:16:29.245928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.245818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:25.499134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'303","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.218828+0000","last_change":"2024-09-22T09:16:31.218828+0000","last_active":"2024-09-22T09:16:31.218828+0000","last_peered":"2024-09-22T09:16:31.218828+0000","last_clean":"2024-09-22T09:16:31.218828+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:16:31.218828+0000","last_undegraded":"2024-09-22T09:16:31.218828+0000","last_fullsized":"2024-09-22T09:16:31.218828+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.218740+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:12.818326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44144,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1008,"num_write":380,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676808+0000","last_change":"2024-09-22T09:16:29.676808+0000","last_active":"2024-09-22T09:16:29.676808+0000","last_peered":"2024-09-22T09:16:29.676808+0000","last_clean":"2024-09-22T09:16:29.676808+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:16:29.676808+0000","last_undegraded":"2024-09-22T09:16:29.676808+0000","last_fullsized":"2024-09-22T09:16:29.676808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:07.042343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'157","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.824503+0000","last_change":"2024-09-22T09:16:35.824503+0000","last_active":"2024-09-22T09:16:35.824503+0000","last_peered":"2024-09-22T09:16:35.824503+0000","last_clean":"2024-09-22T09:16:35.824503+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:16:35.824503+0000","last_undegraded":"2024-09-22T09:16:35.824503+0000","last_fullsized":"2024-09-22T09:16:35.824503+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.824415+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:46.659184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'479","reported_seq":2028,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.799222+0000","last_change":"2024-09-22T09:16:18.799222+0000","last_active":"2024-09-22T09:16:18.799222+0000","last_peered":"2024-09-22T09:16:18.799222+0000","last_clean":"2024-09-22T09:16:18.799222+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:16:18.799222+0000","last_undegraded":"2024-09-22T09:16:18.799222+0000","last_fullsized":"2024-09-22T09:16:18.799222+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'479","last_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_deep_scrub":"261'479","last_deep_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.799137+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:41:01.860838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'343","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.582742+0000","last_change":"2024-09-22T09:16:08.582742+0000","last_active":"2024-09-22T09:16:08.582742+0000","last_peered":"2024-09-22T09:16:08.582742+0000","last_clean":"2024-09-22T09:16:08.582742+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:08.582742+0000","last_undegraded":"2024-09-22T09:16:08.582742+0000","last_fullsized":"2024-09-22T09:16:08.582742+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.582637+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:51.839030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":615,"num_read_kb":26096,"num_write":1031,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.712354+0000","last_change":"2024-09-22T09:16:27.712354+0000","last_active":"2024-09-22T09:16:27.712354+0000","last_peered":"2024-09-22T09:16:27.712354+0000","last_clean":"2024-09-22T09:16:27.712354+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:16:27.712354+0000","last_undegraded":"2024-09-22T09:16:27.712354+0000","last_fullsized":"2024-09-22T09:16:27.712354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.712273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:11.133342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'52","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.657575+0000","last_change":"2024-09-22T09:16:34.657575+0000","last_active":"2024-09-22T09:16:34.657575+0000","last_peered":"2024-09-22T09:16:34.657575+0000","last_clean":"2024-09-22T09:16:34.657575+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:16:34.657575+0000","last_undegraded":"2024-09-22T09:16:34.657575+0000","last_fullsized":"2024-09-22T09:16:34.657575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'52","last_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_deep_scrub":"261'52","last_deep_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.657484+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.772569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.955597+0000","last_change":"2024-09-22T09:16:30.955597+0000","last_active":"2024-09-22T09:16:30.955597+0000","last_peered":"2024-09-22T09:16:30.955597+0000","last_clean":"2024-09-22T09:16:30.955597+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:16:30.955597+0000","last_undegraded":"2024-09-22T09:16:30.955597+0000","last_fullsized":"2024-09-22T09:16:30.955597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.955526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:58.716890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'170","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.297985+0000","last_change":"2024-09-22T09:16:40.297985+0000","last_active":"2024-09-22T09:16:40.297985+0000","last_peered":"2024-09-22T09:16:40.297985+0000","last_clean":"2024-09-22T09:16:40.297985+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:16:40.297985+0000","last_undegraded":"2024-09-22T09:16:40.297985+0000","last_fullsized":"2024-09-22T09:16:40.297985+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'170","last_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_deep_scrub":"261'170","last_deep_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.297900+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:20.684874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1114","reported_seq":2661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.752191+0000","last_change":"2024-09-22T09:16:17.752191+0000","last_active":"2024-09-22T09:16:17.752191+0000","last_peered":"2024-09-22T09:16:17.752191+0000","last_clean":"2024-09-22T09:16:17.752191+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:16:17.752191+0000","last_undegraded":"2024-09-22T09:16:17.752191+0000","last_fullsized":"2024-09-22T09:16:17.752191+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1114","last_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_deep_scrub":"261'1114","last_deep_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.752078+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":1100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:39.851809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'345","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.909478+0000","last_change":"2024-09-22T09:16:10.909478+0000","last_active":"2024-09-22T09:16:10.909478+0000","last_peered":"2024-09-22T09:16:10.909478+0000","last_clean":"2024-09-22T09:16:10.909478+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:10.909478+0000","last_undegraded":"2024-09-22T09:16:10.909478+0000","last_fullsized":"2024-09-22T09:16:10.909478+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.909398+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:48.269092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":10746,"num_write":1198,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.961164+0000","last_change":"2024-09-22T09:16:23.961164+0000","last_active":"2024-09-22T09:16:23.961164+0000","last_peered":"2024-09-22T09:16:23.961164+0000","last_clean":"2024-09-22T09:16:23.961164+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:16:23.961164+0000","last_undegraded":"2024-09-22T09:16:23.961164+0000","last_fullsized":"2024-09-22T09:16:23.961164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.961072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:18.031550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'300","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.702560+0000","last_change":"2024-09-22T09:16:26.702560+0000","last_active":"2024-09-22T09:16:26.702560+0000","last_peered":"2024-09-22T09:16:26.702560+0000","last_clean":"2024-09-22T09:16:26.702560+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:26.702560+0000","last_undegraded":"2024-09-22T09:16:26.702560+0000","last_fullsized":"2024-09-22T09:16:26.702560+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.702460+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:52:00.189471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51577,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1040,"num_write":388,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.193361+0000","last_change":"2024-09-22T09:16:32.193361+0000","last_active":"2024-09-22T09:16:32.193361+0000","last_peered":"2024-09-22T09:16:32.193361+0000","last_clean":"2024-09-22T09:16:32.193361+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:16:32.193361+0000","last_undegraded":"2024-09-22T09:16:32.193361+0000","last_fullsized":"2024-09-22T09:16:32.193361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.193280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:23.876371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'112","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.015992+0000","last_change":"2024-09-22T09:16:56.015992+0000","last_active":"2024-09-22T09:16:56.015992+0000","last_peered":"2024-09-22T09:16:56.015992+0000","last_clean":"2024-09-22T09:16:56.015992+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:16:56.015992+0000","last_undegraded":"2024-09-22T09:16:56.015992+0000","last_fullsized":"2024-09-22T09:16:56.015992+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'112","last_scrub_stamp":"2024-09-22T09:16:56.015869+0000","last_deep_scrub":"261'112","last_deep_scrub_stamp":"2024-09-22T09:16:56.015869+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.015869+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:15.825355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'673","reported_seq":2226,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.783102+0000","last_change":"2024-09-22T09:16:15.783102+0000","last_active":"2024-09-22T09:16:15.783102+0000","last_peered":"2024-09-22T09:16:15.783102+0000","last_clean":"2024-09-22T09:16:15.783102+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:16:15.783102+0000","last_undegraded":"2024-09-22T09:16:15.783102+0000","last_fullsized":"2024-09-22T09:16:15.783102+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'673","last_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_deep_scrub":"261'673","last_deep_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.783012+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:05.838865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'398","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.720596+0000","last_change":"2024-09-22T09:16:15.720596+0000","last_active":"2024-09-22T09:16:15.720596+0000","last_peered":"2024-09-22T09:16:15.720596+0000","last_clean":"2024-09-22T09:16:15.720596+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:15.720596+0000","last_undegraded":"2024-09-22T09:16:15.720596+0000","last_fullsized":"2024-09-22T09:16:15.720596+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'398","last_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_deep_scrub":"261'398","last_deep_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.720482+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:21.561411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":91878,"num_write":1336,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.056882+0000","last_change":"2024-09-22T09:16:37.056882+0000","last_active":"2024-09-22T09:16:37.056882+0000","last_peered":"2024-09-22T09:16:37.056882+0000","last_clean":"2024-09-22T09:16:37.056882+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:16:37.056882+0000","last_undegraded":"2024-09-22T09:16:37.056882+0000","last_fullsized":"2024-09-22T09:16:37.056882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.056786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:18.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'291","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.628841+0000","last_change":"2024-09-22T09:16:28.628841+0000","last_active":"2024-09-22T09:16:28.628841+0000","last_peered":"2024-09-22T09:16:28.628841+0000","last_clean":"2024-09-22T09:16:28.628841+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:28.628841+0000","last_undegraded":"2024-09-22T09:16:28.628841+0000","last_fullsized":"2024-09-22T09:16:28.628841+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.628749+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.456602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.722816+0000","last_change":"2024-09-22T09:16:30.722816+0000","last_active":"2024-09-22T09:16:30.722816+0000","last_peered":"2024-09-22T09:16:30.722816+0000","last_clean":"2024-09-22T09:16:30.722816+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:16:30.722816+0000","last_undegraded":"2024-09-22T09:16:30.722816+0000","last_fullsized":"2024-09-22T09:16:30.722816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.722700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:40.178403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'815","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.228476+0000","last_change":"2024-09-22T09:16:30.228476+0000","last_active":"2024-09-22T09:16:30.228476+0000","last_peered":"2024-09-22T09:16:30.228476+0000","last_clean":"2024-09-22T09:16:30.228476+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:16:30.228476+0000","last_undegraded":"2024-09-22T09:16:30.228476+0000","last_fullsized":"2024-09-22T09:16:30.228476+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.228380+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:24.948927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'342","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.809805+0000","last_change":"2024-09-22T09:16:11.809805+0000","last_active":"2024-09-22T09:16:11.809805+0000","last_peered":"2024-09-22T09:16:11.809805+0000","last_clean":"2024-09-22T09:16:11.809805+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:11.809805+0000","last_undegraded":"2024-09-22T09:16:11.809805+0000","last_fullsized":"2024-09-22T09:16:11.809805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.809676+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:44.292039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":11716,"num_write":1078,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.206946+0000","last_change":"2024-09-22T09:16:26.206946+0000","last_active":"2024-09-22T09:16:26.206946+0000","last_peered":"2024-09-22T09:16:26.206946+0000","last_clean":"2024-09-22T09:16:26.206946+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:16:26.206946+0000","last_undegraded":"2024-09-22T09:16:26.206946+0000","last_fullsized":"2024-09-22T09:16:26.206946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.206849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:28.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'473","reported_seq":1098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.253512+0000","last_change":"2024-09-22T09:16:32.253512+0000","last_active":"2024-09-22T09:16:32.253512+0000","last_peered":"2024-09-22T09:16:32.253512+0000","last_clean":"2024-09-22T09:16:32.253512+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:32.253512+0000","last_undegraded":"2024-09-22T09:16:32.253512+0000","last_fullsized":"2024-09-22T09:16:32.253512+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'473","last_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_deep_scrub":"261'473","last_deep_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.253410+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:29.449772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91839,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1972,"num_write":726,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.923928+0000","last_change":"2024-09-22T09:16:31.923928+0000","last_active":"2024-09-22T09:16:31.923928+0000","last_peered":"2024-09-22T09:16:31.923928+0000","last_clean":"2024-09-22T09:16:31.923928+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:16:31.923928+0000","last_undegraded":"2024-09-22T09:16:31.923928+0000","last_fullsized":"2024-09-22T09:16:31.923928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.923838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:11.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'208","reported_seq":718,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.812336+0000","last_change":"2024-09-22T09:16:46.812336+0000","last_active":"2024-09-22T09:16:46.812336+0000","last_peered":"2024-09-22T09:16:46.812336+0000","last_clean":"2024-09-22T09:16:46.812336+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:16:46.812336+0000","last_undegraded":"2024-09-22T09:16:46.812336+0000","last_fullsized":"2024-09-22T09:16:46.812336+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'208","last_scrub_stamp":"2024-09-22T09:16:46.812252+0000","last_deep_scrub":"261'208","last_deep_scrub_stamp":"2024-09-22T09:16:46.812252+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.812252+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:29.531702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.783099+0000","last_change":"2024-09-22T09:16:20.783099+0000","last_active":"2024-09-22T09:16:20.783099+0000","last_peered":"2024-09-22T09:16:20.783099+0000","last_clean":"2024-09-22T09:16:20.783099+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:16:20.783099+0000","last_undegraded":"2024-09-22T09:16:20.783099+0000","last_fullsized":"2024-09-22T09:16:20.783099+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'441","last_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_deep_scrub":"261'441","last_deep_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.783016+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.329227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'392","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.796464+0000","last_change":"2024-09-22T09:16:13.796464+0000","last_active":"2024-09-22T09:16:13.796464+0000","last_peered":"2024-09-22T09:16:13.796464+0000","last_clean":"2024-09-22T09:16:13.796464+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:13.796464+0000","last_undegraded":"2024-09-22T09:16:13.796464+0000","last_fullsized":"2024-09-22T09:16:13.796464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'392","last_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_deep_scrub":"261'392","last_deep_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.796344+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:33.961247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":782,"num_read_kb":2508,"num_write":1241,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.007305+0000","last_change":"2024-09-22T09:16:29.007305+0000","last_active":"2024-09-22T09:16:29.007305+0000","last_peered":"2024-09-22T09:16:29.007305+0000","last_clean":"2024-09-22T09:16:29.007305+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:16:29.007305+0000","last_undegraded":"2024-09-22T09:16:29.007305+0000","last_fullsized":"2024-09-22T09:16:29.007305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.007163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:12.241599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'308","reported_seq":895,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.123193+0000","last_change":"2024-09-22T09:16:45.123193+0000","last_active":"2024-09-22T09:16:45.123193+0000","last_peered":"2024-09-22T09:16:45.123193+0000","last_clean":"2024-09-22T09:16:45.123193+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:45.123193+0000","last_undegraded":"2024-09-22T09:16:45.123193+0000","last_fullsized":"2024-09-22T09:16:45.123193+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'308","last_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_deep_scrub":"261'308","last_deep_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.123088+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:15.176307+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.813683+0000","last_change":"2024-09-22T09:16:40.813683+0000","last_active":"2024-09-22T09:16:40.813683+0000","last_peered":"2024-09-22T09:16:40.813683+0000","last_clean":"2024-09-22T09:16:40.813683+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:16:40.813683+0000","last_undegraded":"2024-09-22T09:16:40.813683+0000","last_fullsized":"2024-09-22T09:16:40.813683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.813564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:49.900112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'206","reported_seq":716,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.994748+0000","last_change":"2024-09-22T09:16:53.994748+0000","last_active":"2024-09-22T09:16:53.994748+0000","last_peered":"2024-09-22T09:16:53.994748+0000","last_clean":"2024-09-22T09:16:53.994748+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:16:53.994748+0000","last_undegraded":"2024-09-22T09:16:53.994748+0000","last_fullsized":"2024-09-22T09:16:53.994748+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'206","last_scrub_stamp":"2024-09-22T09:16:53.994649+0000","last_deep_scrub":"261'206","last_deep_scrub_stamp":"2024-09-22T09:16:53.994649+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.994649+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.921961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1249","reported_seq":2882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.747497+0000","last_change":"2024-09-22T09:16:16.747497+0000","last_active":"2024-09-22T09:16:16.747497+0000","last_peered":"2024-09-22T09:16:16.747497+0000","last_clean":"2024-09-22T09:16:16.747497+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:16:16.747497+0000","last_undegraded":"2024-09-22T09:16:16.747497+0000","last_fullsized":"2024-09-22T09:16:16.747497+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1249","last_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_deep_scrub":"261'1249","last_deep_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.747413+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:40.709656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'364","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.160466+0000","last_change":"2024-09-22T09:16:10.160466+0000","last_active":"2024-09-22T09:16:10.160466+0000","last_peered":"2024-09-22T09:16:10.160466+0000","last_clean":"2024-09-22T09:16:10.160466+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:10.160466+0000","last_undegraded":"2024-09-22T09:16:10.160466+0000","last_fullsized":"2024-09-22T09:16:10.160466+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.160369+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:26.305948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":701,"num_read_kb":11614,"num_write":1118,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.997725+0000","last_change":"2024-09-22T09:16:25.997725+0000","last_active":"2024-09-22T09:16:25.997725+0000","last_peered":"2024-09-22T09:16:25.997725+0000","last_clean":"2024-09-22T09:16:25.997725+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:16:25.997725+0000","last_undegraded":"2024-09-22T09:16:25.997725+0000","last_fullsized":"2024-09-22T09:16:25.997725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:27.550802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'297","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.293457+0000","last_change":"2024-09-22T09:16:37.293457+0000","last_active":"2024-09-22T09:16:37.293457+0000","last_peered":"2024-09-22T09:16:37.293457+0000","last_clean":"2024-09-22T09:16:37.293457+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:16:37.293457+0000","last_undegraded":"2024-09-22T09:16:37.293457+0000","last_fullsized":"2024-09-22T09:16:37.293457+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.293351+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:56.164258+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1154,"num_write":408,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.767167+0000","last_change":"2024-09-22T09:16:31.767167+0000","last_active":"2024-09-22T09:16:31.767167+0000","last_peered":"2024-09-22T09:16:31.767167+0000","last_clean":"2024-09-22T09:16:31.767167+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:16:31.767167+0000","last_undegraded":"2024-09-22T09:16:31.767167+0000","last_fullsized":"2024-09-22T09:16:31.767167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.767068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:32.629069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'157","reported_seq":653,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.984684+0000","last_change":"2024-09-22T09:16:51.984684+0000","last_active":"2024-09-22T09:16:51.984684+0000","last_peered":"2024-09-22T09:16:51.984684+0000","last_clean":"2024-09-22T09:16:51.984684+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:16:51.984684+0000","last_undegraded":"2024-09-22T09:16:51.984684+0000","last_fullsized":"2024-09-22T09:16:51.984684+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-22T09:16:51.984609+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-22T09:16:51.984609+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.984609+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:44.218370+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'671","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.771617+0000","last_change":"2024-09-22T09:16:19.771617+0000","last_active":"2024-09-22T09:16:19.771617+0000","last_peered":"2024-09-22T09:16:19.771617+0000","last_clean":"2024-09-22T09:16:19.771617+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:16:19.771617+0000","last_undegraded":"2024-09-22T09:16:19.771617+0000","last_fullsized":"2024-09-22T09:16:19.771617+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'671","last_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_deep_scrub":"261'671","last_deep_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.771511+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:54.246211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'302","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.735731+0000","last_change":"2024-09-22T09:16:15.735731+0000","last_active":"2024-09-22T09:16:15.735731+0000","last_peered":"2024-09-22T09:16:15.735731+0000","last_clean":"2024-09-22T09:16:15.735731+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:15.735731+0000","last_undegraded":"2024-09-22T09:16:15.735731+0000","last_fullsized":"2024-09-22T09:16:15.735731+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'302","last_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_deep_scrub":"261'302","last_deep_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.735596+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:46.178060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655841,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":50029,"num_write":1017,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.637101+0000","last_change":"2024-09-22T09:16:31.637101+0000","last_active":"2024-09-22T09:16:31.637101+0000","last_peered":"2024-09-22T09:16:31.637101+0000","last_clean":"2024-09-22T09:16:31.637101+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:16:31.637101+0000","last_undegraded":"2024-09-22T09:16:31.637101+0000","last_fullsized":"2024-09-22T09:16:31.637101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.637013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:17.159451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'95","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.090331+0000","last_change":"2024-09-22T09:16:46.090331+0000","last_active":"2024-09-22T09:16:46.090331+0000","last_peered":"2024-09-22T09:16:46.090331+0000","last_clean":"2024-09-22T09:16:46.090331+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:16:46.090331+0000","last_undegraded":"2024-09-22T09:16:46.090331+0000","last_fullsized":"2024-09-22T09:16:46.090331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.090230+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:28.048688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'780","reported_seq":2599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.596983+0000","last_change":"2024-09-22T09:16:30.596983+0000","last_active":"2024-09-22T09:16:30.596983+0000","last_peered":"2024-09-22T09:16:30.596983+0000","last_clean":"2024-09-22T09:16:30.596983+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:30.596983+0000","last_undegraded":"2024-09-22T09:16:30.596983+0000","last_fullsized":"2024-09-22T09:16:30.596983+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.596880+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:46.027022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":690,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.963074+0000","last_change":"2024-09-22T09:16:52.963074+0000","last_active":"2024-09-22T09:16:52.963074+0000","last_peered":"2024-09-22T09:16:52.963074+0000","last_clean":"2024-09-22T09:16:52.963074+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:16:52.963074+0000","last_undegraded":"2024-09-22T09:16:52.963074+0000","last_fullsized":"2024-09-22T09:16:52.963074+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'168","last_scrub_stamp":"2024-09-22T09:16:52.962994+0000","last_deep_scrub":"261'168","last_deep_scrub_stamp":"2024-09-22T09:16:52.962994+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.962994+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:53.207528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'509","reported_seq":2223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.919171+0000","last_change":"2024-09-22T09:16:21.919171+0000","last_active":"2024-09-22T09:16:21.919171+0000","last_peered":"2024-09-22T09:16:21.919171+0000","last_clean":"2024-09-22T09:16:21.919171+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:16:21.919171+0000","last_undegraded":"2024-09-22T09:16:21.919171+0000","last_fullsized":"2024-09-22T09:16:21.919171+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'509","last_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_deep_scrub":"261'509","last_deep_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.919066+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:06.667960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'372","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.163050+0000","last_change":"2024-09-22T09:16:11.163050+0000","last_active":"2024-09-22T09:16:11.163050+0000","last_peered":"2024-09-22T09:16:11.163050+0000","last_clean":"2024-09-22T09:16:11.163050+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:11.163050+0000","last_undegraded":"2024-09-22T09:16:11.163050+0000","last_fullsized":"2024-09-22T09:16:11.163050+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.162937+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:59.374048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":33741,"num_write":1117,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.202193+0000","last_change":"2024-09-22T09:16:26.202193+0000","last_active":"2024-09-22T09:16:26.202193+0000","last_peered":"2024-09-22T09:16:26.202193+0000","last_clean":"2024-09-22T09:16:26.202193+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:16:26.202193+0000","last_undegraded":"2024-09-22T09:16:26.202193+0000","last_fullsized":"2024-09-22T09:16:26.202193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.202094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:26.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.648190+0000","last_change":"2024-09-22T09:16:29.648190+0000","last_active":"2024-09-22T09:16:29.648190+0000","last_peered":"2024-09-22T09:16:29.648190+0000","last_clean":"2024-09-22T09:16:29.648190+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:16:29.648190+0000","last_undegraded":"2024-09-22T09:16:29.648190+0000","last_fullsized":"2024-09-22T09:16:29.648190+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.648057+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:58.062115+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53474,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1042,"num_write":392,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.575584+0000","last_change":"2024-09-22T09:16:41.575584+0000","last_active":"2024-09-22T09:16:41.575584+0000","last_peered":"2024-09-22T09:16:41.575584+0000","last_clean":"2024-09-22T09:16:41.575584+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:16:41.575584+0000","last_undegraded":"2024-09-22T09:16:41.575584+0000","last_fullsized":"2024-09-22T09:16:41.575584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.575466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:56.385870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'134","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.214251+0000","last_change":"2024-09-22T09:16:38.214251+0000","last_active":"2024-09-22T09:16:38.214251+0000","last_peered":"2024-09-22T09:16:38.214251+0000","last_clean":"2024-09-22T09:16:38.214251+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:16:38.214251+0000","last_undegraded":"2024-09-22T09:16:38.214251+0000","last_fullsized":"2024-09-22T09:16:38.214251+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.214150+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:12.089725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1511","reported_seq":3232,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.894120+0000","last_change":"2024-09-22T09:16:20.894120+0000","last_active":"2024-09-22T09:16:20.894120+0000","last_peered":"2024-09-22T09:16:20.894120+0000","last_clean":"2024-09-22T09:16:20.894120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:16:20.894120+0000","last_undegraded":"2024-09-22T09:16:20.894120+0000","last_fullsized":"2024-09-22T09:16:20.894120+0000","mapping_epoch":27,"log_start":"261'1500","ondisk_log_start":"261'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1511","last_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_deep_scrub":"261'1511","last_deep_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.894035+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":1500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.749939+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'336","reported_seq":1087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.280118+0000","last_change":"2024-09-22T09:16:20.280118+0000","last_active":"2024-09-22T09:16:20.280118+0000","last_peered":"2024-09-22T09:16:20.280118+0000","last_clean":"2024-09-22T09:16:20.280118+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:20.280118+0000","last_undegraded":"2024-09-22T09:16:20.280118+0000","last_fullsized":"2024-09-22T09:16:20.280118+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.279952+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:57.092613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":31338,"num_write":1035,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.006452+0000","last_change":"2024-09-22T09:16:25.006452+0000","last_active":"2024-09-22T09:16:25.006452+0000","last_peered":"2024-09-22T09:16:25.006452+0000","last_clean":"2024-09-22T09:16:25.006452+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:16:25.006452+0000","last_undegraded":"2024-09-22T09:16:25.006452+0000","last_fullsized":"2024-09-22T09:16:25.006452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.006360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:22.141389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'314","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.622472+0000","last_change":"2024-09-22T09:16:37.622472+0000","last_active":"2024-09-22T09:16:37.622472+0000","last_peered":"2024-09-22T09:16:37.622472+0000","last_clean":"2024-09-22T09:16:37.622472+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:16:37.622472+0000","last_undegraded":"2024-09-22T09:16:37.622472+0000","last_fullsized":"2024-09-22T09:16:37.622472+0000","mapping_epoch":31,"log_start":"261'301","ondisk_log_start":"261'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.622379+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:59.309829+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148291,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1361,"num_write":420,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.058916+0000","last_change":"2024-09-22T09:16:49.058916+0000","last_active":"2024-09-22T09:16:49.058916+0000","last_peered":"2024-09-22T09:16:49.058916+0000","last_clean":"2024-09-22T09:16:49.058916+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:16:49.058916+0000","last_undegraded":"2024-09-22T09:16:49.058916+0000","last_fullsized":"2024-09-22T09:16:49.058916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:49.058805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:49.058805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.058805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:24.017149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'132","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.811452+0000","last_change":"2024-09-22T09:16:47.811452+0000","last_active":"2024-09-22T09:16:47.811452+0000","last_peered":"2024-09-22T09:16:47.811452+0000","last_clean":"2024-09-22T09:16:47.811452+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:16:47.811452+0000","last_undegraded":"2024-09-22T09:16:47.811452+0000","last_fullsized":"2024-09-22T09:16:47.811452+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-22T09:16:47.811358+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-22T09:16:47.811358+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.811358+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:00.388141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'510","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.743151+0000","last_change":"2024-09-22T09:16:17.743151+0000","last_active":"2024-09-22T09:16:17.743151+0000","last_peered":"2024-09-22T09:16:17.743151+0000","last_clean":"2024-09-22T09:16:17.743151+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:16:17.743151+0000","last_undegraded":"2024-09-22T09:16:17.743151+0000","last_fullsized":"2024-09-22T09:16:17.743151+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.743028+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:54.091402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'380","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.809942+0000","last_change":"2024-09-22T09:16:12.809942+0000","last_active":"2024-09-22T09:16:12.809942+0000","last_peered":"2024-09-22T09:16:12.809942+0000","last_clean":"2024-09-22T09:16:12.809942+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:12.809942+0000","last_undegraded":"2024-09-22T09:16:12.809942+0000","last_fullsized":"2024-09-22T09:16:12.809942+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.809787+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:23.365576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":50427,"num_write":1201,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.227143+0000","last_change":"2024-09-22T09:16:25.227143+0000","last_active":"2024-09-22T09:16:25.227143+0000","last_peered":"2024-09-22T09:16:25.227143+0000","last_clean":"2024-09-22T09:16:25.227143+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:16:25.227143+0000","last_undegraded":"2024-09-22T09:16:25.227143+0000","last_fullsized":"2024-09-22T09:16:25.227143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.227042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'249","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.205123+0000","last_change":"2024-09-22T09:16:30.205123+0000","last_active":"2024-09-22T09:16:30.205123+0000","last_peered":"2024-09-22T09:16:30.205123+0000","last_clean":"2024-09-22T09:16:30.205123+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:16:30.205123+0000","last_undegraded":"2024-09-22T09:16:30.205123+0000","last_fullsized":"2024-09-22T09:16:30.205123+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.205028+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:12.680661+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43840,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":1016,"num_write":348,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.022708+0000","last_change":"2024-09-22T09:16:51.022708+0000","last_active":"2024-09-22T09:16:51.022708+0000","last_peered":"2024-09-22T09:16:51.022708+0000","last_clean":"2024-09-22T09:16:51.022708+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:16:51.022708+0000","last_undegraded":"2024-09-22T09:16:51.022708+0000","last_fullsized":"2024-09-22T09:16:51.022708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:51.022620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:51.022620+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.022620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:40.269124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'192","reported_seq":1652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.010457+0000","last_change":"2024-09-22T09:16:55.010457+0000","last_active":"2024-09-22T09:16:55.010457+0000","last_peered":"2024-09-22T09:16:55.010457+0000","last_clean":"2024-09-22T09:16:55.010457+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:16:55.010457+0000","last_undegraded":"2024-09-22T09:16:55.010457+0000","last_fullsized":"2024-09-22T09:16:55.010457+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-22T09:16:55.010356+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-22T09:16:55.010356+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.010356+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:04.923573+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'431","reported_seq":2007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.853453+0000","last_change":"2024-09-22T09:16:19.853453+0000","last_active":"2024-09-22T09:16:19.853453+0000","last_peered":"2024-09-22T09:16:19.853453+0000","last_clean":"2024-09-22T09:16:19.853453+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:16:19.853453+0000","last_undegraded":"2024-09-22T09:16:19.853453+0000","last_fullsized":"2024-09-22T09:16:19.853453+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'431","last_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_deep_scrub":"261'431","last_deep_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.853368+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:53.654543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'350","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.739492+0000","last_change":"2024-09-22T09:16:16.739492+0000","last_active":"2024-09-22T09:16:16.739492+0000","last_peered":"2024-09-22T09:16:16.739492+0000","last_clean":"2024-09-22T09:16:16.739492+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:16.739492+0000","last_undegraded":"2024-09-22T09:16:16.739492+0000","last_fullsized":"2024-09-22T09:16:16.739492+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'350","last_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_deep_scrub":"261'350","last_deep_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.739368+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:59.971534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":43723,"num_write":1129,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.658377+0000","last_change":"2024-09-22T09:16:30.658377+0000","last_active":"2024-09-22T09:16:30.658377+0000","last_peered":"2024-09-22T09:16:30.658377+0000","last_clean":"2024-09-22T09:16:30.658377+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:16:30.658377+0000","last_undegraded":"2024-09-22T09:16:30.658377+0000","last_fullsized":"2024-09-22T09:16:30.658377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.658291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:13.543896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'318","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.113220+0000","last_change":"2024-09-22T09:16:44.113220+0000","last_active":"2024-09-22T09:16:44.113220+0000","last_peered":"2024-09-22T09:16:44.113220+0000","last_clean":"2024-09-22T09:16:44.113220+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:16:44.113220+0000","last_undegraded":"2024-09-22T09:16:44.113220+0000","last_fullsized":"2024-09-22T09:16:44.113220+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.113127+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:18.587541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":1187,"num_write":420,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.621967+0000","last_change":"2024-09-22T09:16:42.621967+0000","last_active":"2024-09-22T09:16:42.621967+0000","last_peered":"2024-09-22T09:16:42.621967+0000","last_clean":"2024-09-22T09:16:42.621967+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:16:42.621967+0000","last_undegraded":"2024-09-22T09:16:42.621967+0000","last_fullsized":"2024-09-22T09:16:42.621967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.621829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:16.010558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'142","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.574857+0000","last_change":"2024-09-22T09:16:32.574857+0000","last_active":"2024-09-22T09:16:32.574857+0000","last_peered":"2024-09-22T09:16:32.574857+0000","last_clean":"2024-09-22T09:16:32.574857+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:16:32.574857+0000","last_undegraded":"2024-09-22T09:16:32.574857+0000","last_fullsized":"2024-09-22T09:16:32.574857+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.574766+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:40.930130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'515","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.759180+0000","last_change":"2024-09-22T09:16:21.759180+0000","last_active":"2024-09-22T09:16:21.759180+0000","last_peered":"2024-09-22T09:16:21.759180+0000","last_clean":"2024-09-22T09:16:21.759180+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:16:21.759180+0000","last_undegraded":"2024-09-22T09:16:21.759180+0000","last_fullsized":"2024-09-22T09:16:21.759180+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'515","last_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_deep_scrub":"261'515","last_deep_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.759089+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:02.438247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'327","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.872831+0000","last_change":"2024-09-22T09:16:11.872831+0000","last_active":"2024-09-22T09:16:11.872831+0000","last_peered":"2024-09-22T09:16:11.872831+0000","last_clean":"2024-09-22T09:16:11.872831+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:11.872831+0000","last_undegraded":"2024-09-22T09:16:11.872831+0000","last_fullsized":"2024-09-22T09:16:11.872831+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.872713+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:43.753796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":538,"num_read_kb":33852,"num_write":961,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'420","reported_seq":1887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.764056+0000","last_change":"2024-09-22T09:16:19.764056+0000","last_active":"2024-09-22T09:16:19.764056+0000","last_peered":"2024-09-22T09:16:19.764056+0000","last_clean":"2024-09-22T09:16:19.764056+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:16:19.764056+0000","last_undegraded":"2024-09-22T09:16:19.764056+0000","last_fullsized":"2024-09-22T09:16:19.764056+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'420","last_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_deep_scrub":"261'420","last_deep_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.763959+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:20.402662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'329","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.806176+0000","last_change":"2024-09-22T09:16:12.806176+0000","last_active":"2024-09-22T09:16:12.806176+0000","last_peered":"2024-09-22T09:16:12.806176+0000","last_clean":"2024-09-22T09:16:12.806176+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:12.806176+0000","last_undegraded":"2024-09-22T09:16:12.806176+0000","last_fullsized":"2024-09-22T09:16:12.806176+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.806058+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:03.340195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":555,"num_read_kb":87971,"num_write":959,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.189423+0000","last_change":"2024-09-22T09:16:31.189423+0000","last_active":"2024-09-22T09:16:31.189423+0000","last_peered":"2024-09-22T09:16:31.189423+0000","last_clean":"2024-09-22T09:16:31.189423+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:16:31.189423+0000","last_undegraded":"2024-09-22T09:16:31.189423+0000","last_fullsized":"2024-09-22T09:16:31.189423+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'828","last_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_deep_scrub":"261'828","last_deep_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.189355+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:13.809990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'408","reported_seq":1113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.276787+0000","last_change":"2024-09-22T09:16:21.276787+0000","last_active":"2024-09-22T09:16:21.276787+0000","last_peered":"2024-09-22T09:16:21.276787+0000","last_clean":"2024-09-22T09:16:21.276787+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:21.276787+0000","last_undegraded":"2024-09-22T09:16:21.276787+0000","last_fullsized":"2024-09-22T09:16:21.276787+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.276682+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:18.486550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":902,"num_read_kb":34719,"num_write":1272,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'749","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.677305+0000","last_change":"2024-09-22T09:16:28.677305+0000","last_active":"2024-09-22T09:16:28.677305+0000","last_peered":"2024-09-22T09:16:28.677305+0000","last_clean":"2024-09-22T09:16:28.677305+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:16:28.677305+0000","last_undegraded":"2024-09-22T09:16:28.677305+0000","last_fullsized":"2024-09-22T09:16:28.677305+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'749","last_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_deep_scrub":"261'749","last_deep_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.677182+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:57.444450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.763130+0000","last_change":"2024-09-22T09:16:14.763130+0000","last_active":"2024-09-22T09:16:14.763130+0000","last_peered":"2024-09-22T09:16:14.763130+0000","last_clean":"2024-09-22T09:16:14.763130+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:14.763130+0000","last_undegraded":"2024-09-22T09:16:14.763130+0000","last_fullsized":"2024-09-22T09:16:14.763130+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.762983+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:17.416002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":20346,"num_write":1128,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'501","reported_seq":2082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.679439+0000","last_change":"2024-09-22T09:16:25.679439+0000","last_active":"2024-09-22T09:16:25.679439+0000","last_peered":"2024-09-22T09:16:25.679439+0000","last_clean":"2024-09-22T09:16:25.679439+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:16:25.679439+0000","last_undegraded":"2024-09-22T09:16:25.679439+0000","last_fullsized":"2024-09-22T09:16:25.679439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'501","last_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_deep_scrub":"261'501","last_deep_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.679334+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:06:59.317670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'326","reported_seq":949,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.224569+0000","last_change":"2024-09-22T09:16:13.224569+0000","last_active":"2024-09-22T09:16:13.224569+0000","last_peered":"2024-09-22T09:16:13.224569+0000","last_clean":"2024-09-22T09:16:13.224569+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:13.224569+0000","last_undegraded":"2024-09-22T09:16:13.224569+0000","last_fullsized":"2024-09-22T09:16:13.224569+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.224470+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:14.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26435,"num_write":1053,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'719","reported_seq":2230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.439057+0000","last_change":"2024-09-22T09:16:18.439057+0000","last_active":"2024-09-22T09:16:18.439057+0000","last_peered":"2024-09-22T09:16:18.439057+0000","last_clean":"2024-09-22T09:16:18.439057+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:16:18.439057+0000","last_undegraded":"2024-09-22T09:16:18.439057+0000","last_fullsized":"2024-09-22T09:16:18.439057+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'719","last_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_deep_scrub":"261'719","last_deep_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.438942+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:24.048331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'356","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.218832+0000","last_change":"2024-09-22T09:16:12.218832+0000","last_active":"2024-09-22T09:16:12.218832+0000","last_peered":"2024-09-22T09:16:12.218832+0000","last_clean":"2024-09-22T09:16:12.218832+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:12.218832+0000","last_undegraded":"2024-09-22T09:16:12.218832+0000","last_fullsized":"2024-09-22T09:16:12.218832+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.218723+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:55.208712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":911,"num_write":1065,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'463","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.152371+0000","last_change":"2024-09-22T09:16:23.152371+0000","last_active":"2024-09-22T09:16:23.152371+0000","last_peered":"2024-09-22T09:16:23.152371+0000","last_clean":"2024-09-22T09:16:23.152371+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:16:23.152371+0000","last_undegraded":"2024-09-22T09:16:23.152371+0000","last_fullsized":"2024-09-22T09:16:23.152371+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'463","last_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_deep_scrub":"261'463","last_deep_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.152260+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:19.327801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'445","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.895888+0000","last_change":"2024-09-22T09:16:12.895888+0000","last_active":"2024-09-22T09:16:12.895888+0000","last_peered":"2024-09-22T09:16:12.895888+0000","last_clean":"2024-09-22T09:16:12.895888+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:12.895888+0000","last_undegraded":"2024-09-22T09:16:12.895888+0000","last_fullsized":"2024-09-22T09:16:12.895888+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.895757+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:49.967455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":934,"num_read_kb":31165,"num_write":1662,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'491","reported_seq":2219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.166984+0000","last_change":"2024-09-22T09:16:15.166984+0000","last_active":"2024-09-22T09:16:15.166984+0000","last_peered":"2024-09-22T09:16:15.166984+0000","last_clean":"2024-09-22T09:16:15.166984+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:16:15.166984+0000","last_undegraded":"2024-09-22T09:16:15.166984+0000","last_fullsized":"2024-09-22T09:16:15.166984+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'491","last_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_deep_scrub":"261'491","last_deep_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.166903+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:58.210857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'323","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.737155+0000","last_change":"2024-09-22T09:16:19.737155+0000","last_active":"2024-09-22T09:16:19.737155+0000","last_peered":"2024-09-22T09:16:19.737155+0000","last_clean":"2024-09-22T09:16:19.737155+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:19.737155+0000","last_undegraded":"2024-09-22T09:16:19.737155+0000","last_fullsized":"2024-09-22T09:16:19.737155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.737050+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:20.503931+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":8118,"num_write":1009,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'854","reported_seq":2603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.673418+0000","last_change":"2024-09-22T09:16:22.673418+0000","last_active":"2024-09-22T09:16:22.673418+0000","last_peered":"2024-09-22T09:16:22.673418+0000","last_clean":"2024-09-22T09:16:22.673418+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:16:22.673418+0000","last_undegraded":"2024-09-22T09:16:22.673418+0000","last_fullsized":"2024-09-22T09:16:22.673418+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'854","last_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_deep_scrub":"261'854","last_deep_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.673327+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:44.554979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'407","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.286192+0000","last_change":"2024-09-22T09:16:22.286115+0000","last_active":"2024-09-22T09:16:22.286192+0000","last_peered":"2024-09-22T09:16:22.286192+0000","last_clean":"2024-09-22T09:16:22.286192+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:22.286192+0000","last_undegraded":"2024-09-22T09:16:22.286192+0000","last_fullsized":"2024-09-22T09:16:22.286192+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'407","last_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_deep_scrub":"261'407","last_deep_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.285976+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:01:50.371655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":152949,"num_write":1317,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'442","reported_seq":2080,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.482793+0000","last_change":"2024-09-22T09:16:19.482793+0000","last_active":"2024-09-22T09:16:19.482793+0000","last_peered":"2024-09-22T09:16:19.482793+0000","last_clean":"2024-09-22T09:16:19.482793+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:16:19.482793+0000","last_undegraded":"2024-09-22T09:16:19.482793+0000","last_fullsized":"2024-09-22T09:16:19.482793+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'442","last_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_deep_scrub":"261'442","last_deep_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.482692+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:42.895660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'344","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.751453+0000","last_change":"2024-09-22T09:16:17.751453+0000","last_active":"2024-09-22T09:16:17.751453+0000","last_peered":"2024-09-22T09:16:17.751453+0000","last_clean":"2024-09-22T09:16:17.751453+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:17.751453+0000","last_undegraded":"2024-09-22T09:16:17.751453+0000","last_fullsized":"2024-09-22T09:16:17.751453+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.751277+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:30.489888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":609,"num_read_kb":9331,"num_write":1190,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'930","reported_seq":2517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.699494+0000","last_change":"2024-09-22T09:16:29.699494+0000","last_active":"2024-09-22T09:16:29.699494+0000","last_peered":"2024-09-22T09:16:29.699494+0000","last_clean":"2024-09-22T09:16:29.699494+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:16:29.699494+0000","last_undegraded":"2024-09-22T09:16:29.699494+0000","last_fullsized":"2024-09-22T09:16:29.699494+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'930","last_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_deep_scrub":"261'930","last_deep_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.699399+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:20.466619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'357","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.200735+0000","last_change":"2024-09-22T09:16:12.200735+0000","last_active":"2024-09-22T09:16:12.200735+0000","last_peered":"2024-09-22T09:16:12.200735+0000","last_clean":"2024-09-22T09:16:12.200735+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:12.200735+0000","last_undegraded":"2024-09-22T09:16:12.200735+0000","last_fullsized":"2024-09-22T09:16:12.200735+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.200550+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:39.553247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":484,"num_write":1192,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'831","reported_seq":2470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.203293+0000","last_change":"2024-09-22T09:16:18.203293+0000","last_active":"2024-09-22T09:16:18.203293+0000","last_peered":"2024-09-22T09:16:18.203293+0000","last_clean":"2024-09-22T09:16:18.203293+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:16:18.203293+0000","last_undegraded":"2024-09-22T09:16:18.203293+0000","last_fullsized":"2024-09-22T09:16:18.203293+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.203194+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:46.422305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'455","reported_seq":1183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.719575+0000","last_change":"2024-09-22T09:16:16.719575+0000","last_active":"2024-09-22T09:16:16.719575+0000","last_peered":"2024-09-22T09:16:16.719575+0000","last_clean":"2024-09-22T09:16:16.719575+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:16.719575+0000","last_undegraded":"2024-09-22T09:16:16.719575+0000","last_fullsized":"2024-09-22T09:16:16.719575+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'455","last_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_deep_scrub":"261'455","last_deep_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.719441+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:32.637454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":882,"num_read_kb":67486,"num_write":1537,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.178525+0000","last_change":"2024-09-22T09:16:17.178525+0000","last_active":"2024-09-22T09:16:17.178525+0000","last_peered":"2024-09-22T09:16:17.178525+0000","last_clean":"2024-09-22T09:16:17.178525+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:16:17.178525+0000","last_undegraded":"2024-09-22T09:16:17.178525+0000","last_fullsized":"2024-09-22T09:16:17.178525+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'443","last_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_deep_scrub":"261'443","last_deep_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.178441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.703833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'315","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.578353+0000","last_change":"2024-09-22T09:16:09.578353+0000","last_active":"2024-09-22T09:16:09.578353+0000","last_peered":"2024-09-22T09:16:09.578353+0000","last_clean":"2024-09-22T09:16:09.578353+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:09.578353+0000","last_undegraded":"2024-09-22T09:16:09.578353+0000","last_fullsized":"2024-09-22T09:16:09.578353+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.578247+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:57.589765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":4113,"num_write":1035,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1344","reported_seq":3021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.754474+0000","last_change":"2024-09-22T09:16:18.754474+0000","last_active":"2024-09-22T09:16:18.754474+0000","last_peered":"2024-09-22T09:16:18.754474+0000","last_clean":"2024-09-22T09:16:18.754474+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:16:18.754474+0000","last_undegraded":"2024-09-22T09:16:18.754474+0000","last_fullsized":"2024-09-22T09:16:18.754474+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1344","last_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_deep_scrub":"261'1344","last_deep_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.754381+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":1300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:57.272268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'330","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.246155+0000","last_change":"2024-09-22T09:16:23.246155+0000","last_active":"2024-09-22T09:16:23.246155+0000","last_peered":"2024-09-22T09:16:23.246155+0000","last_clean":"2024-09-22T09:16:23.246155+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:23.246155+0000","last_undegraded":"2024-09-22T09:16:23.246155+0000","last_fullsized":"2024-09-22T09:16:23.246155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.246014+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:58.979313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515353,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":7532,"num_write":972,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'880","reported_seq":2372,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.746082+0000","last_change":"2024-09-22T09:16:22.746082+0000","last_active":"2024-09-22T09:16:22.746082+0000","last_peered":"2024-09-22T09:16:22.746082+0000","last_clean":"2024-09-22T09:16:22.746082+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:16:22.746082+0000","last_undegraded":"2024-09-22T09:16:22.746082+0000","last_fullsized":"2024-09-22T09:16:22.746082+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'880","last_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_deep_scrub":"261'880","last_deep_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.745990+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:18.063674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'315","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.799122+0000","last_change":"2024-09-22T09:16:13.799122+0000","last_active":"2024-09-22T09:16:13.799122+0000","last_peered":"2024-09-22T09:16:13.799122+0000","last_clean":"2024-09-22T09:16:13.799122+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:13.799122+0000","last_undegraded":"2024-09-22T09:16:13.799122+0000","last_fullsized":"2024-09-22T09:16:13.799122+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.799007+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:31.530684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263494,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":814,"num_read_kb":1206,"num_write":1027,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'589","reported_seq":2176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.155968+0000","last_change":"2024-09-22T09:16:16.155915+0000","last_active":"2024-09-22T09:16:16.155968+0000","last_peered":"2024-09-22T09:16:16.155968+0000","last_clean":"2024-09-22T09:16:16.155968+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:16:16.155968+0000","last_undegraded":"2024-09-22T09:16:16.155968+0000","last_fullsized":"2024-09-22T09:16:16.155968+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'589","last_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_deep_scrub":"261'589","last_deep_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.155810+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:42.833807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'352","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.237090+0000","last_change":"2024-09-22T09:16:24.237090+0000","last_active":"2024-09-22T09:16:24.237090+0000","last_peered":"2024-09-22T09:16:24.237090+0000","last_clean":"2024-09-22T09:16:24.237090+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:24.237090+0000","last_undegraded":"2024-09-22T09:16:24.237090+0000","last_fullsized":"2024-09-22T09:16:24.237090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.236968+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:37.139334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":65832,"num_write":1085,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.212752+0000","last_change":"2024-09-22T09:16:27.212752+0000","last_active":"2024-09-22T09:16:27.212752+0000","last_peered":"2024-09-22T09:16:27.212752+0000","last_clean":"2024-09-22T09:16:27.212752+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:27.212752+0000","last_undegraded":"2024-09-22T09:16:27.212752+0000","last_fullsized":"2024-09-22T09:16:27.212752+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.212631+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:44.538803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":15571,"num_write":1043,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'504","reported_seq":2200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.792932+0000","last_change":"2024-09-22T09:16:23.792932+0000","last_active":"2024-09-22T09:16:23.792932+0000","last_peered":"2024-09-22T09:16:23.792932+0000","last_clean":"2024-09-22T09:16:23.792932+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:16:23.792932+0000","last_undegraded":"2024-09-22T09:16:23.792932+0000","last_fullsized":"2024-09-22T09:16:23.792932+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'504","last_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_deep_scrub":"261'504","last_deep_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.792820+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:41.074747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.712012+0000","last_change":"2024-09-22T09:16:21.712012+0000","last_active":"2024-09-22T09:16:21.712012+0000","last_peered":"2024-09-22T09:16:21.712012+0000","last_clean":"2024-09-22T09:16:21.712012+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:21.712012+0000","last_undegraded":"2024-09-22T09:16:21.712012+0000","last_fullsized":"2024-09-22T09:16:21.712012+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.711897+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:26.256735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":80287,"num_write":1039,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'505","reported_seq":2183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.178089+0000","last_change":"2024-09-22T09:16:21.178089+0000","last_active":"2024-09-22T09:16:21.178089+0000","last_peered":"2024-09-22T09:16:21.178089+0000","last_clean":"2024-09-22T09:16:21.178089+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:16:21.178089+0000","last_undegraded":"2024-09-22T09:16:21.178089+0000","last_fullsized":"2024-09-22T09:16:21.178089+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'505","last_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_deep_scrub":"261'505","last_deep_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.177984+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:26.746505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637503,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18076,"num_read_kb":37621,"num_write":15217,"num_write_kb":11954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714578,"num_omap_keys":1636,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2200,"ondisk_log_size":2200,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36520,"num_omap_keys":148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4073,"ondisk_log_size":4073,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":51675961,"num_objects":284,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":44405,"num_read_kb":2189102,"num_write":73344,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70811648,"data_stored":70811648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3860,"ondisk_log_size":3860,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":207543,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198277,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510161,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276108,"kb_used_data":15868,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94095732,"statfs":{"total":96636764160,"available":96354029568,"internally_reserved":0,"allocated":16248832,"data_stored":14279973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510161,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172824,"kb_used_data":15304,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":94199016,"statfs":{"total":96636764160,"available":96459792384,"internally_reserved":0,"allocated":15671296,"data_stored":13729926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510164,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333156,"kb_used_data":13204,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038684,"statfs":{"total":96636764160,"available":96295612416,"internally_reserved":0,"allocated":13520896,"data_stored":11543840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510163,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142640,"kb_used_data":12896,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94229200,"statfs":{"total":96636764160,"available":96490700800,"internally_reserved":0,"allocated":13205504,"data_stored":11218915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542866,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253924,"kb_used_data":11796,"kb_used_omap":1,"kb_used_meta":242110,"kb_avail":94117916,"statfs":{"total":96636764160,"available":96376745984,"internally_reserved":0,"allocated":12079104,"data_stored":10115731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":247921098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542868,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116748,"kb_used_data":9212,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255092,"statfs":{"total":96636764160,"available":96517214208,"internally_reserved":0,"allocated":9433088,"data_stored":7445675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542867,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290332,"kb_used_data":12044,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94081508,"statfs":{"total":96636764160,"available":96339464192,"internally_reserved":0,"allocated":12333056,"data_stored":10357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542865,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224148,"kb_used_data":12548,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147692,"statfs":{"total":96636764160,"available":96407236608,"internally_reserved":0,"allocated":12849152,"data_stored":10882684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8757248,"data_stored":8757248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":12083200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7569408,"data_stored":7569408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7917568,"data_stored":7917568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:17:11.788 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.788 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.788 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T08:36:13.491552+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.789 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.789 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.789 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.789 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.789 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.790 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.790 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.790 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T08:36:16.526910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=36, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.790 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T08:51:47.520569+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=16, tm_sec=5, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:17:11.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:17:31.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:17:32.130 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-22T09:17:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-22T09:17:32.143 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":2061,"stamp":"2024-09-22T09:17:31.891262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53921399,"num_objects":751,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":313725,"num_read_kb":2862731,"num_write":165438,"num_write_kb":2483177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":754989,"num_omap_keys":1814,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13824,"ondisk_log_size":13824,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1809880,"kb_used_data":102872,"kb_used_omap":12,"kb_used_meta":1706867,"kb_avail":753164840,"statfs":{"total":773094113280,"available":771240796160,"internally_reserved":0,"allocated":105340928,"data_stored":89574178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1747832368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005289"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.526809+0000","last_change":"2024-09-22T09:16:45.526760+0000","last_active":"2024-09-22T09:16:45.526809+0000","last_peered":"2024-09-22T09:16:45.526809+0000","last_clean":"2024-09-22T09:16:45.526809+0000","last_became_active":"2024-09-22T08:51:48.551556+0000","last_became_peered":"2024-09-22T08:51:48.551556+0000","last_unstale":"2024-09-22T09:16:45.526809+0000","last_undegraded":"2024-09-22T09:16:45.526809+0000","last_fullsized":"2024-09-22T09:16:45.526809+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:45.526682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.526682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:00.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.256414+0000","last_change":"2024-09-22T09:16:45.256414+0000","last_active":"2024-09-22T09:16:45.256414+0000","last_peered":"2024-09-22T09:16:45.256414+0000","last_clean":"2024-09-22T09:16:45.256414+0000","last_became_active":"2024-09-22T08:36:17.554016+0000","last_became_peered":"2024-09-22T08:36:17.554016+0000","last_unstale":"2024-09-22T09:16:45.256414+0000","last_undegraded":"2024-09-22T09:16:45.256414+0000","last_fullsized":"2024-09-22T09:16:45.256414+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.256321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.256321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:18.445322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"258'2","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.879873+0000","last_change":"2024-09-22T09:16:47.879873+0000","last_active":"2024-09-22T09:16:47.879873+0000","last_peered":"2024-09-22T09:16:47.879873+0000","last_clean":"2024-09-22T09:16:47.879873+0000","last_became_active":"2024-09-22T08:36:14.528233+0000","last_became_peered":"2024-09-22T08:36:14.528233+0000","last_unstale":"2024-09-22T09:16:47.879873+0000","last_undegraded":"2024-09-22T09:16:47.879873+0000","last_fullsized":"2024-09-22T09:16:47.879873+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-22T09:16:47.879780+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-22T09:16:47.879780+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.879780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:22.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'43","reported_seq":178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.568326+0000","last_change":"2024-09-22T09:16:49.568274+0000","last_active":"2024-09-22T09:16:49.568326+0000","last_peered":"2024-09-22T09:16:49.568326+0000","last_clean":"2024-09-22T09:16:49.568326+0000","last_became_active":"2024-09-22T08:33:33.306493+0000","last_became_peered":"2024-09-22T08:33:33.306493+0000","last_unstale":"2024-09-22T09:16:49.568326+0000","last_undegraded":"2024-09-22T09:16:49.568326+0000","last_fullsized":"2024-09-22T09:16:49.568326+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'43","last_scrub_stamp":"2024-09-22T09:16:49.568189+0000","last_deep_scrub":"261'43","last_deep_scrub_stamp":"2024-09-22T09:16:49.568189+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.568189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:40.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":218,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.558026+0000","last_change":"2024-09-22T09:16:52.558026+0000","last_active":"2024-09-22T09:16:52.558026+0000","last_peered":"2024-09-22T09:16:52.558026+0000","last_clean":"2024-09-22T09:16:52.558026+0000","last_became_active":"2024-09-22T08:51:48.553459+0000","last_became_peered":"2024-09-22T08:51:48.553459+0000","last_unstale":"2024-09-22T09:16:52.558026+0000","last_undegraded":"2024-09-22T09:16:52.558026+0000","last_fullsized":"2024-09-22T09:16:52.558026+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:52.557928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:52.557928+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.557928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:01.275674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'11","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.733327+0000","last_change":"2024-09-22T09:16:49.733327+0000","last_active":"2024-09-22T09:16:49.733327+0000","last_peered":"2024-09-22T09:16:49.733327+0000","last_clean":"2024-09-22T09:16:49.733327+0000","last_became_active":"2024-09-22T08:36:17.552649+0000","last_became_peered":"2024-09-22T08:36:17.552649+0000","last_unstale":"2024-09-22T09:16:49.733327+0000","last_undegraded":"2024-09-22T09:16:49.733327+0000","last_fullsized":"2024-09-22T09:16:49.733327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-22T09:16:49.733234+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-22T09:16:49.733234+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.733234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:15.541853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":31746,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"258'3","reported_seq":55,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.872662+0000","last_change":"2024-09-22T09:16:53.872662+0000","last_active":"2024-09-22T09:16:53.872662+0000","last_peered":"2024-09-22T09:16:53.872662+0000","last_clean":"2024-09-22T09:16:53.872662+0000","last_became_active":"2024-09-22T08:36:14.522819+0000","last_became_peered":"2024-09-22T08:36:14.522819+0000","last_unstale":"2024-09-22T09:16:53.872662+0000","last_undegraded":"2024-09-22T09:16:53.872662+0000","last_fullsized":"2024-09-22T09:16:53.872662+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:53.872563+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:53.872563+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.872563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:10.368268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'33","reported_seq":147,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.555038+0000","last_change":"2024-09-22T09:16:48.555038+0000","last_active":"2024-09-22T09:16:48.555038+0000","last_peered":"2024-09-22T09:16:48.555038+0000","last_clean":"2024-09-22T09:16:48.555038+0000","last_became_active":"2024-09-22T08:33:33.314750+0000","last_became_peered":"2024-09-22T08:33:33.314750+0000","last_unstale":"2024-09-22T09:16:48.555038+0000","last_undegraded":"2024-09-22T09:16:48.555038+0000","last_fullsized":"2024-09-22T09:16:48.555038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-22T09:16:48.554939+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-22T09:16:48.554939+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.554939+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:03.639890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":159,"num_write":86,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.308570+0000","last_change":"2024-09-22T09:16:48.308570+0000","last_active":"2024-09-22T09:16:48.308570+0000","last_peered":"2024-09-22T09:16:48.308570+0000","last_clean":"2024-09-22T09:16:48.308570+0000","last_became_active":"2024-09-22T08:51:48.552547+0000","last_became_peered":"2024-09-22T08:51:48.552547+0000","last_unstale":"2024-09-22T09:16:48.308570+0000","last_undegraded":"2024-09-22T09:16:48.308570+0000","last_fullsized":"2024-09-22T09:16:48.308570+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:48.308484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:48.308484+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.308484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:18.776448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:02.916019+0000","last_change":"2024-09-22T09:17:02.916019+0000","last_active":"2024-09-22T09:17:02.916019+0000","last_peered":"2024-09-22T09:17:02.916019+0000","last_clean":"2024-09-22T09:17:02.916019+0000","last_became_active":"2024-09-22T08:36:17.555526+0000","last_became_peered":"2024-09-22T08:36:17.555526+0000","last_unstale":"2024-09-22T09:17:02.916019+0000","last_undegraded":"2024-09-22T09:17:02.916019+0000","last_fullsized":"2024-09-22T09:17:02.916019+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:17:02.915901+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:17:02.915901+0000","last_clean_scrub_stamp":"2024-09-22T09:17:02.915901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:40.923605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'3","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.886434+0000","last_change":"2024-09-22T09:16:48.886434+0000","last_active":"2024-09-22T09:16:48.886434+0000","last_peered":"2024-09-22T09:16:48.886434+0000","last_clean":"2024-09-22T09:16:48.886434+0000","last_became_active":"2024-09-22T08:36:14.522867+0000","last_became_peered":"2024-09-22T08:36:14.522867+0000","last_unstale":"2024-09-22T09:16:48.886434+0000","last_undegraded":"2024-09-22T09:16:48.886434+0000","last_fullsized":"2024-09-22T09:16:48.886434+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:48.886351+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:48.886351+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.886351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:16.817854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'62","reported_seq":223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.382373+0000","last_change":"2024-09-22T09:16:44.382373+0000","last_active":"2024-09-22T09:16:44.382373+0000","last_peered":"2024-09-22T09:16:44.382373+0000","last_clean":"2024-09-22T09:16:44.382373+0000","last_became_active":"2024-09-22T08:33:33.306615+0000","last_became_peered":"2024-09-22T08:33:33.306615+0000","last_unstale":"2024-09-22T09:16:44.382373+0000","last_undegraded":"2024-09-22T09:16:44.382373+0000","last_fullsized":"2024-09-22T09:16:44.382373+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'62","last_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_deep_scrub":"261'62","last_deep_scrub_stamp":"2024-09-22T09:16:44.382287+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.382287+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:32.719724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":333,"num_write":165,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:07.936646+0000","last_change":"2024-09-22T09:17:07.936646+0000","last_active":"2024-09-22T09:17:07.936646+0000","last_peered":"2024-09-22T09:17:07.936646+0000","last_clean":"2024-09-22T09:17:07.936646+0000","last_became_active":"2024-09-22T08:51:48.552888+0000","last_became_peered":"2024-09-22T08:51:48.552888+0000","last_unstale":"2024-09-22T09:17:07.936646+0000","last_undegraded":"2024-09-22T09:17:07.936646+0000","last_fullsized":"2024-09-22T09:17:07.936646+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:07.936403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:07.936403+0000","last_clean_scrub_stamp":"2024-09-22T09:17:07.936403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:02:56.852807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:00.874163+0000","last_change":"2024-09-22T09:17:00.874163+0000","last_active":"2024-09-22T09:17:00.874163+0000","last_peered":"2024-09-22T09:17:00.874163+0000","last_clean":"2024-09-22T09:17:00.874163+0000","last_became_active":"2024-09-22T08:36:17.557718+0000","last_became_peered":"2024-09-22T08:36:17.557718+0000","last_unstale":"2024-09-22T09:17:00.874163+0000","last_undegraded":"2024-09-22T09:17:00.874163+0000","last_fullsized":"2024-09-22T09:17:00.874163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:00.874073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:00.874073+0000","last_clean_scrub_stamp":"2024-09-22T09:17:00.874073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:27.404252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"261'7","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.240389+0000","last_change":"2024-09-22T09:16:44.240389+0000","last_active":"2024-09-22T09:16:44.240389+0000","last_peered":"2024-09-22T09:16:44.240389+0000","last_clean":"2024-09-22T09:16:44.240389+0000","last_became_active":"2024-09-22T08:36:14.521526+0000","last_became_peered":"2024-09-22T08:36:14.521526+0000","last_unstale":"2024-09-22T09:16:44.240389+0000","last_undegraded":"2024-09-22T09:16:44.240389+0000","last_fullsized":"2024-09-22T09:16:44.240389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-22T09:16:44.240305+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.240305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:21:11.694952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'22","reported_seq":116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.365856+0000","last_change":"2024-09-22T09:16:43.365856+0000","last_active":"2024-09-22T09:16:43.365856+0000","last_peered":"2024-09-22T09:16:43.365856+0000","last_clean":"2024-09-22T09:16:43.365856+0000","last_became_active":"2024-09-22T08:33:33.299273+0000","last_became_peered":"2024-09-22T08:33:33.299273+0000","last_unstale":"2024-09-22T09:16:43.365856+0000","last_undegraded":"2024-09-22T09:16:43.365856+0000","last_fullsized":"2024-09-22T09:16:43.365856+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:43.365756+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.365756+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:43.604511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":122,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.987897+0000","last_change":"2024-09-22T09:16:58.987897+0000","last_active":"2024-09-22T09:16:58.987897+0000","last_peered":"2024-09-22T09:16:58.987897+0000","last_clean":"2024-09-22T09:16:58.987897+0000","last_became_active":"2024-09-22T08:51:48.551941+0000","last_became_peered":"2024-09-22T08:51:48.551941+0000","last_unstale":"2024-09-22T09:16:58.987897+0000","last_undegraded":"2024-09-22T09:16:58.987897+0000","last_fullsized":"2024-09-22T09:16:58.987897+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:58.987803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:58.987803+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.987803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:56.778479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.598317+0000","last_change":"2024-09-22T09:16:40.598266+0000","last_active":"2024-09-22T09:16:40.598317+0000","last_peered":"2024-09-22T09:16:40.598317+0000","last_clean":"2024-09-22T09:16:40.598317+0000","last_became_active":"2024-09-22T08:36:17.551937+0000","last_became_peered":"2024-09-22T08:36:17.551937+0000","last_unstale":"2024-09-22T09:16:40.598317+0000","last_undegraded":"2024-09-22T09:16:40.598317+0000","last_fullsized":"2024-09-22T09:16:40.598317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:40.598158+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.598158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:01.390559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.887053+0000","last_change":"2024-09-22T09:16:52.886948+0000","last_active":"2024-09-22T09:16:52.887053+0000","last_peered":"2024-09-22T09:16:52.887053+0000","last_clean":"2024-09-22T09:16:52.887053+0000","last_became_active":"2024-09-22T08:36:14.527003+0000","last_became_peered":"2024-09-22T08:36:14.527003+0000","last_unstale":"2024-09-22T09:16:52.887053+0000","last_undegraded":"2024-09-22T09:16:52.887053+0000","last_fullsized":"2024-09-22T09:16:52.887053+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:52.886838+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:52.886838+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.886838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:26.738065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'16","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.308367+0000","last_change":"2024-09-22T09:16:41.308367+0000","last_active":"2024-09-22T09:16:41.308367+0000","last_peered":"2024-09-22T09:16:41.308367+0000","last_clean":"2024-09-22T09:16:41.308367+0000","last_became_active":"2024-09-22T08:33:33.312361+0000","last_became_peered":"2024-09-22T08:33:33.312361+0000","last_unstale":"2024-09-22T09:16:41.308367+0000","last_undegraded":"2024-09-22T09:16:41.308367+0000","last_fullsized":"2024-09-22T09:16:41.308367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-22T09:16:41.308277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.308277+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:23.833047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":77,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.601217+0000","last_change":"2024-09-22T09:16:53.601217+0000","last_active":"2024-09-22T09:16:53.601217+0000","last_peered":"2024-09-22T09:16:53.601217+0000","last_clean":"2024-09-22T09:16:53.601217+0000","last_became_active":"2024-09-22T08:51:48.545381+0000","last_became_peered":"2024-09-22T08:51:48.545381+0000","last_unstale":"2024-09-22T09:16:53.601217+0000","last_undegraded":"2024-09-22T09:16:53.601217+0000","last_fullsized":"2024-09-22T09:16:53.601217+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:53.601126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:53.601126+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.601126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:15.700619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:13.030426+0000","last_change":"2024-09-22T09:17:13.030373+0000","last_active":"2024-09-22T09:17:13.030426+0000","last_peered":"2024-09-22T09:17:13.030426+0000","last_clean":"2024-09-22T09:17:13.030426+0000","last_became_active":"2024-09-22T08:36:17.551805+0000","last_became_peered":"2024-09-22T08:36:17.551805+0000","last_unstale":"2024-09-22T09:17:13.030426+0000","last_undegraded":"2024-09-22T09:17:13.030426+0000","last_fullsized":"2024-09-22T09:17:13.030426+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:13.030270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:13.030270+0000","last_clean_scrub_stamp":"2024-09-22T09:17:13.030270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:14.237817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"261'3","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:07.996594+0000","last_change":"2024-09-22T09:17:07.996594+0000","last_active":"2024-09-22T09:17:07.996594+0000","last_peered":"2024-09-22T09:17:07.996594+0000","last_clean":"2024-09-22T09:17:07.996594+0000","last_became_active":"2024-09-22T08:36:14.525313+0000","last_became_peered":"2024-09-22T08:36:14.525313+0000","last_unstale":"2024-09-22T09:17:07.996594+0000","last_undegraded":"2024-09-22T09:17:07.996594+0000","last_fullsized":"2024-09-22T09:17:07.996594+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:17:07.996500+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:17:07.996500+0000","last_clean_scrub_stamp":"2024-09-22T09:17:07.996500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:59.849327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'48","reported_seq":190,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.921997+0000","last_change":"2024-09-22T09:16:40.921997+0000","last_active":"2024-09-22T09:16:40.921997+0000","last_peered":"2024-09-22T09:16:40.921997+0000","last_clean":"2024-09-22T09:16:40.921997+0000","last_became_active":"2024-09-22T08:33:33.314124+0000","last_became_peered":"2024-09-22T08:33:33.314124+0000","last_unstale":"2024-09-22T09:16:40.921997+0000","last_undegraded":"2024-09-22T09:16:40.921997+0000","last_fullsized":"2024-09-22T09:16:40.921997+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-22T09:16:40.921882+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.921882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:35.683665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":259,"num_write":133,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.700715+0000","last_change":"2024-09-22T09:16:52.700715+0000","last_active":"2024-09-22T09:16:52.700715+0000","last_peered":"2024-09-22T09:16:52.700715+0000","last_clean":"2024-09-22T09:16:52.700715+0000","last_became_active":"2024-09-22T08:51:48.548863+0000","last_became_peered":"2024-09-22T08:51:48.548863+0000","last_unstale":"2024-09-22T09:16:52.700715+0000","last_undegraded":"2024-09-22T09:16:52.700715+0000","last_fullsized":"2024-09-22T09:16:52.700715+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:52.700629+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:52.700629+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.700629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:15.661021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"258'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.757277+0000","last_change":"2024-09-22T09:16:48.757277+0000","last_active":"2024-09-22T09:16:48.757277+0000","last_peered":"2024-09-22T09:16:48.757277+0000","last_clean":"2024-09-22T09:16:48.757277+0000","last_became_active":"2024-09-22T08:36:17.548365+0000","last_became_peered":"2024-09-22T08:36:17.548365+0000","last_unstale":"2024-09-22T09:16:48.757277+0000","last_undegraded":"2024-09-22T09:16:48.757277+0000","last_fullsized":"2024-09-22T09:16:48.757277+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:48.757177+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:48.757177+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.757177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:36.202816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.558532+0000","last_change":"2024-09-22T09:16:36.558532+0000","last_active":"2024-09-22T09:16:36.558532+0000","last_peered":"2024-09-22T09:16:36.558532+0000","last_clean":"2024-09-22T09:16:36.558532+0000","last_became_active":"2024-09-22T08:36:14.521941+0000","last_became_peered":"2024-09-22T08:36:14.521941+0000","last_unstale":"2024-09-22T09:16:36.558532+0000","last_undegraded":"2024-09-22T09:16:36.558532+0000","last_fullsized":"2024-09-22T09:16:36.558532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:36.558400+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.558400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:20.467650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"258'231","reported_seq":756,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.837952+0000","last_change":"2024-09-22T09:16:41.837862+0000","last_active":"2024-09-22T09:16:41.837952+0000","last_peered":"2024-09-22T09:16:41.837952+0000","last_clean":"2024-09-22T09:16:41.837952+0000","last_became_active":"2024-09-22T08:33:33.306084+0000","last_became_peered":"2024-09-22T08:33:33.306084+0000","last_unstale":"2024-09-22T09:16:41.837952+0000","last_undegraded":"2024-09-22T09:16:41.837952+0000","last_fullsized":"2024-09-22T09:16:41.837952+0000","mapping_epoch":250,"log_start":"258'200","ondisk_log_start":"258'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'231","last_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_deep_scrub":"258'231","last_deep_scrub_stamp":"2024-09-22T09:16:41.837741+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.837741+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:20.560690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2220,"num_read_kb":2878,"num_write":435,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.557169+0000","last_change":"2024-09-22T09:16:46.557103+0000","last_active":"2024-09-22T09:16:46.557169+0000","last_peered":"2024-09-22T09:16:46.557169+0000","last_clean":"2024-09-22T09:16:46.557169+0000","last_became_active":"2024-09-22T08:51:48.550441+0000","last_became_peered":"2024-09-22T08:51:48.550441+0000","last_unstale":"2024-09-22T09:16:46.557169+0000","last_undegraded":"2024-09-22T09:16:46.557169+0000","last_fullsized":"2024-09-22T09:16:46.557169+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.557012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.557012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.050098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.973634+0000","last_change":"2024-09-22T09:16:55.973634+0000","last_active":"2024-09-22T09:16:55.973634+0000","last_peered":"2024-09-22T09:16:55.973634+0000","last_clean":"2024-09-22T09:16:55.973634+0000","last_became_active":"2024-09-22T08:36:17.558948+0000","last_became_peered":"2024-09-22T08:36:17.558948+0000","last_unstale":"2024-09-22T09:16:55.973634+0000","last_undegraded":"2024-09-22T09:16:55.973634+0000","last_fullsized":"2024-09-22T09:16:55.973634+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:55.973521+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:55.973521+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.973521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:25.588102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.407425+0000","last_change":"2024-09-22T09:16:47.407425+0000","last_active":"2024-09-22T09:16:47.407425+0000","last_peered":"2024-09-22T09:16:47.407425+0000","last_clean":"2024-09-22T09:16:47.407425+0000","last_became_active":"2024-09-22T08:36:14.520862+0000","last_became_peered":"2024-09-22T08:36:14.520862+0000","last_unstale":"2024-09-22T09:16:47.407425+0000","last_undegraded":"2024-09-22T09:16:47.407425+0000","last_fullsized":"2024-09-22T09:16:47.407425+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:47.407346+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:47.407346+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.407346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:42.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'31","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.321769+0000","last_change":"2024-09-22T09:16:42.321672+0000","last_active":"2024-09-22T09:16:42.321769+0000","last_peered":"2024-09-22T09:16:42.321769+0000","last_clean":"2024-09-22T09:16:42.321769+0000","last_became_active":"2024-09-22T08:33:33.303666+0000","last_became_peered":"2024-09-22T08:33:33.303666+0000","last_unstale":"2024-09-22T09:16:42.321769+0000","last_undegraded":"2024-09-22T09:16:42.321769+0000","last_fullsized":"2024-09-22T09:16:42.321769+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-22T09:16:42.321561+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.321561+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:44.112776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":140,"num_write":79,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:05.887870+0000","last_change":"2024-09-22T09:17:05.887807+0000","last_active":"2024-09-22T09:17:05.887870+0000","last_peered":"2024-09-22T09:17:05.887870+0000","last_clean":"2024-09-22T09:17:05.887870+0000","last_became_active":"2024-09-22T08:51:48.551080+0000","last_became_peered":"2024-09-22T08:51:48.551080+0000","last_unstale":"2024-09-22T09:17:05.887870+0000","last_undegraded":"2024-09-22T09:17:05.887870+0000","last_fullsized":"2024-09-22T09:17:05.887870+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:05.887716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:05.887716+0000","last_clean_scrub_stamp":"2024-09-22T09:17:05.887716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:01.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.992387+0000","last_change":"2024-09-22T09:16:52.992310+0000","last_active":"2024-09-22T09:16:52.992387+0000","last_peered":"2024-09-22T09:16:52.992387+0000","last_clean":"2024-09-22T09:16:52.992387+0000","last_became_active":"2024-09-22T08:36:17.558876+0000","last_became_peered":"2024-09-22T08:36:17.558876+0000","last_unstale":"2024-09-22T09:16:52.992387+0000","last_undegraded":"2024-09-22T09:16:52.992387+0000","last_fullsized":"2024-09-22T09:16:52.992387+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:52.992201+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:52.992201+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.992201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:25:08.516951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'5","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:07.025572+0000","last_change":"2024-09-22T09:17:07.025572+0000","last_active":"2024-09-22T09:17:07.025572+0000","last_peered":"2024-09-22T09:17:07.025572+0000","last_clean":"2024-09-22T09:17:07.025572+0000","last_became_active":"2024-09-22T08:36:14.527220+0000","last_became_peered":"2024-09-22T08:36:14.527220+0000","last_unstale":"2024-09-22T09:17:07.025572+0000","last_undegraded":"2024-09-22T09:17:07.025572+0000","last_fullsized":"2024-09-22T09:17:07.025572+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:17:07.025470+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:17:07.025470+0000","last_clean_scrub_stamp":"2024-09-22T09:17:07.025470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:27.423097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'58","reported_seq":219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.511483+0000","last_change":"2024-09-22T09:16:47.511423+0000","last_active":"2024-09-22T09:16:47.511483+0000","last_peered":"2024-09-22T09:16:47.511483+0000","last_clean":"2024-09-22T09:16:47.511483+0000","last_became_active":"2024-09-22T08:33:33.307597+0000","last_became_peered":"2024-09-22T08:33:33.307597+0000","last_unstale":"2024-09-22T09:16:47.511483+0000","last_undegraded":"2024-09-22T09:16:47.511483+0000","last_fullsized":"2024-09-22T09:16:47.511483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'58","last_scrub_stamp":"2024-09-22T09:16:47.511333+0000","last_deep_scrub":"261'58","last_deep_scrub_stamp":"2024-09-22T09:16:47.511333+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.511333+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:17.649586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":338,"num_write":143,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.463380+0000","last_change":"2024-09-22T09:16:49.463304+0000","last_active":"2024-09-22T09:16:49.463380+0000","last_peered":"2024-09-22T09:16:49.463380+0000","last_clean":"2024-09-22T09:16:49.463380+0000","last_became_active":"2024-09-22T08:51:48.549583+0000","last_became_peered":"2024-09-22T08:51:48.549583+0000","last_unstale":"2024-09-22T09:16:49.463380+0000","last_undegraded":"2024-09-22T09:16:49.463380+0000","last_fullsized":"2024-09-22T09:16:49.463380+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:49.463214+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:49.463214+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.463214+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:24.961549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:59.823917+0000","last_change":"2024-09-22T09:16:59.823917+0000","last_active":"2024-09-22T09:16:59.823917+0000","last_peered":"2024-09-22T09:16:59.823917+0000","last_clean":"2024-09-22T09:16:59.823917+0000","last_became_active":"2024-09-22T08:36:17.560175+0000","last_became_peered":"2024-09-22T08:36:17.560175+0000","last_unstale":"2024-09-22T09:16:59.823917+0000","last_undegraded":"2024-09-22T09:16:59.823917+0000","last_fullsized":"2024-09-22T09:16:59.823917+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:59.823819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:59.823819+0000","last_clean_scrub_stamp":"2024-09-22T09:16:59.823819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:36:25.981552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.575180+0000","last_change":"2024-09-22T09:16:35.575100+0000","last_active":"2024-09-22T09:16:35.575180+0000","last_peered":"2024-09-22T09:16:35.575180+0000","last_clean":"2024-09-22T09:16:35.575180+0000","last_became_active":"2024-09-22T08:36:14.525344+0000","last_became_peered":"2024-09-22T08:36:14.525344+0000","last_unstale":"2024-09-22T09:16:35.575180+0000","last_undegraded":"2024-09-22T09:16:35.575180+0000","last_fullsized":"2024-09-22T09:16:35.575180+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:35.574995+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.574995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:47.143313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'6","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.563426+0000","last_change":"2024-09-22T09:16:45.563359+0000","last_active":"2024-09-22T09:16:45.563426+0000","last_peered":"2024-09-22T09:16:45.563426+0000","last_clean":"2024-09-22T09:16:45.563426+0000","last_became_active":"2024-09-22T08:33:33.314685+0000","last_became_peered":"2024-09-22T08:33:33.314685+0000","last_unstale":"2024-09-22T09:16:45.563426+0000","last_undegraded":"2024-09-22T09:16:45.563426+0000","last_fullsized":"2024-09-22T09:16:45.563426+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:45.563268+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.563268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:15.508239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.653348+0000","last_change":"2024-09-22T09:16:51.653289+0000","last_active":"2024-09-22T09:16:51.653348+0000","last_peered":"2024-09-22T09:16:51.653348+0000","last_clean":"2024-09-22T09:16:51.653348+0000","last_became_active":"2024-09-22T08:51:48.544613+0000","last_became_peered":"2024-09-22T08:51:48.544613+0000","last_unstale":"2024-09-22T09:16:51.653348+0000","last_undegraded":"2024-09-22T09:16:51.653348+0000","last_fullsized":"2024-09-22T09:16:51.653348+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:51.653217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:51.653217+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.653217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:34.074491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'8","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.958700+0000","last_change":"2024-09-22T09:16:54.958630+0000","last_active":"2024-09-22T09:16:54.958700+0000","last_peered":"2024-09-22T09:16:54.958700+0000","last_clean":"2024-09-22T09:16:54.958700+0000","last_became_active":"2024-09-22T08:36:17.551518+0000","last_became_peered":"2024-09-22T08:36:17.551518+0000","last_unstale":"2024-09-22T09:16:54.958700+0000","last_undegraded":"2024-09-22T09:16:54.958700+0000","last_fullsized":"2024-09-22T09:16:54.958700+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:54.958540+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:54.958540+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.958540+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:21.344147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":55,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.900288+0000","last_change":"2024-09-22T09:16:46.900201+0000","last_active":"2024-09-22T09:16:46.900288+0000","last_peered":"2024-09-22T09:16:46.900288+0000","last_clean":"2024-09-22T09:16:46.900288+0000","last_became_active":"2024-09-22T08:36:14.526106+0000","last_became_peered":"2024-09-22T08:36:14.526106+0000","last_unstale":"2024-09-22T09:16:46.900288+0000","last_undegraded":"2024-09-22T09:16:46.900288+0000","last_fullsized":"2024-09-22T09:16:46.900288+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:46.900109+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:46.900109+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.900109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:36.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'5","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.818121+0000","last_change":"2024-09-22T09:16:40.818045+0000","last_active":"2024-09-22T09:16:40.818121+0000","last_peered":"2024-09-22T09:16:40.818121+0000","last_clean":"2024-09-22T09:16:40.818121+0000","last_became_active":"2024-09-22T08:33:33.311063+0000","last_became_peered":"2024-09-22T08:33:33.311063+0000","last_unstale":"2024-09-22T09:16:40.818121+0000","last_undegraded":"2024-09-22T09:16:40.818121+0000","last_fullsized":"2024-09-22T09:16:40.818121+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.817964+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.817964+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:14.856963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.565426+0000","last_change":"2024-09-22T09:16:43.565348+0000","last_active":"2024-09-22T09:16:43.565426+0000","last_peered":"2024-09-22T09:16:43.565426+0000","last_clean":"2024-09-22T09:16:43.565426+0000","last_became_active":"2024-09-22T08:51:48.549577+0000","last_became_peered":"2024-09-22T08:51:48.549577+0000","last_unstale":"2024-09-22T09:16:43.565426+0000","last_undegraded":"2024-09-22T09:16:43.565426+0000","last_fullsized":"2024-09-22T09:16:43.565426+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.565209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.565209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:13.820778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.585961+0000","last_change":"2024-09-22T09:16:39.585871+0000","last_active":"2024-09-22T09:16:39.585961+0000","last_peered":"2024-09-22T09:16:39.585961+0000","last_clean":"2024-09-22T09:16:39.585961+0000","last_became_active":"2024-09-22T08:36:17.553478+0000","last_became_peered":"2024-09-22T08:36:17.553478+0000","last_unstale":"2024-09-22T09:16:39.585961+0000","last_undegraded":"2024-09-22T09:16:39.585961+0000","last_fullsized":"2024-09-22T09:16:39.585961+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:39.585774+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.585774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:19.267444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'8","reported_seq":65,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.873033+0000","last_change":"2024-09-22T09:16:51.872943+0000","last_active":"2024-09-22T09:16:51.873033+0000","last_peered":"2024-09-22T09:16:51.873033+0000","last_clean":"2024-09-22T09:16:51.873033+0000","last_became_active":"2024-09-22T08:36:14.523704+0000","last_became_peered":"2024-09-22T08:36:14.523704+0000","last_unstale":"2024-09-22T09:16:51.873033+0000","last_undegraded":"2024-09-22T09:16:51.873033+0000","last_fullsized":"2024-09-22T09:16:51.873033+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:51.872813+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:51.872813+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.872813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:22.724278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11314,"num_write":8,"num_write_kb":11314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'68","reported_seq":236,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:02.083231+0000","last_change":"2024-09-22T09:17:02.083231+0000","last_active":"2024-09-22T09:17:02.083231+0000","last_peered":"2024-09-22T09:17:02.083231+0000","last_clean":"2024-09-22T09:17:02.083231+0000","last_became_active":"2024-09-22T08:33:33.311501+0000","last_became_peered":"2024-09-22T08:33:33.311501+0000","last_unstale":"2024-09-22T09:17:02.083231+0000","last_undegraded":"2024-09-22T09:17:02.083231+0000","last_fullsized":"2024-09-22T09:17:02.083231+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-22T09:17:02.083150+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-22T09:17:02.083150+0000","last_clean_scrub_stamp":"2024-09-22T09:17:02.083150+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:17.076118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":515,"num_read_kb":350,"num_write":172,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:08.909266+0000","last_change":"2024-09-22T09:17:08.909266+0000","last_active":"2024-09-22T09:17:08.909266+0000","last_peered":"2024-09-22T09:17:08.909266+0000","last_clean":"2024-09-22T09:17:08.909266+0000","last_became_active":"2024-09-22T08:51:48.551361+0000","last_became_peered":"2024-09-22T08:51:48.551361+0000","last_unstale":"2024-09-22T09:17:08.909266+0000","last_undegraded":"2024-09-22T09:17:08.909266+0000","last_fullsized":"2024-09-22T09:17:08.909266+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:08.909177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:08.909177+0000","last_clean_scrub_stamp":"2024-09-22T09:17:08.909177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:10.212478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.873571+0000","last_change":"2024-09-22T09:16:58.873571+0000","last_active":"2024-09-22T09:16:58.873571+0000","last_peered":"2024-09-22T09:16:58.873571+0000","last_clean":"2024-09-22T09:16:58.873571+0000","last_became_active":"2024-09-22T08:36:17.549635+0000","last_became_peered":"2024-09-22T08:36:17.549635+0000","last_unstale":"2024-09-22T09:16:58.873571+0000","last_undegraded":"2024-09-22T09:16:58.873571+0000","last_fullsized":"2024-09-22T09:16:58.873571+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:58.873479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:58.873479+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.873479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:18.176271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.174488+0000","last_change":"2024-09-22T09:16:41.174488+0000","last_active":"2024-09-22T09:16:41.174488+0000","last_peered":"2024-09-22T09:16:41.174488+0000","last_clean":"2024-09-22T09:16:41.174488+0000","last_became_active":"2024-09-22T08:36:14.520470+0000","last_became_peered":"2024-09-22T08:36:14.520470+0000","last_unstale":"2024-09-22T09:16:41.174488+0000","last_undegraded":"2024-09-22T09:16:41.174488+0000","last_fullsized":"2024-09-22T09:16:41.174488+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.174406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.174406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:18.069254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'18","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:01.059417+0000","last_change":"2024-09-22T09:17:01.059417+0000","last_active":"2024-09-22T09:17:01.059417+0000","last_peered":"2024-09-22T09:17:01.059417+0000","last_clean":"2024-09-22T09:17:01.059417+0000","last_became_active":"2024-09-22T08:33:33.311241+0000","last_became_peered":"2024-09-22T08:33:33.311241+0000","last_unstale":"2024-09-22T09:17:01.059417+0000","last_undegraded":"2024-09-22T09:17:01.059417+0000","last_fullsized":"2024-09-22T09:17:01.059417+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:17:01.059326+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:17:01.059326+0000","last_clean_scrub_stamp":"2024-09-22T09:17:01.059326+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:03.110912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":95,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.509412+0000","last_change":"2024-09-22T09:16:50.509412+0000","last_active":"2024-09-22T09:16:50.509412+0000","last_peered":"2024-09-22T09:16:50.509412+0000","last_clean":"2024-09-22T09:16:50.509412+0000","last_became_active":"2024-09-22T08:51:48.545705+0000","last_became_peered":"2024-09-22T08:51:48.545705+0000","last_unstale":"2024-09-22T09:16:50.509412+0000","last_undegraded":"2024-09-22T09:16:50.509412+0000","last_fullsized":"2024-09-22T09:16:50.509412+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.509287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.509287+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.509287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:28.291726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"258'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.888511+0000","last_change":"2024-09-22T09:16:57.888511+0000","last_active":"2024-09-22T09:16:57.888511+0000","last_peered":"2024-09-22T09:16:57.888511+0000","last_clean":"2024-09-22T09:16:57.888511+0000","last_became_active":"2024-09-22T08:36:17.550283+0000","last_became_peered":"2024-09-22T08:36:17.550283+0000","last_unstale":"2024-09-22T09:16:57.888511+0000","last_undegraded":"2024-09-22T09:16:57.888511+0000","last_fullsized":"2024-09-22T09:16:57.888511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:57.888420+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:57.888420+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.888420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:37.008048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.887860+0000","last_change":"2024-09-22T09:16:50.887860+0000","last_active":"2024-09-22T09:16:50.887860+0000","last_peered":"2024-09-22T09:16:50.887860+0000","last_clean":"2024-09-22T09:16:50.887860+0000","last_became_active":"2024-09-22T08:36:14.517734+0000","last_became_peered":"2024-09-22T08:36:14.517734+0000","last_unstale":"2024-09-22T09:16:50.887860+0000","last_undegraded":"2024-09-22T09:16:50.887860+0000","last_fullsized":"2024-09-22T09:16:50.887860+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.887764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.887764+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.887764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:41.284980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'22","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.776787+0000","last_change":"2024-09-22T09:16:39.776787+0000","last_active":"2024-09-22T09:16:39.776787+0000","last_peered":"2024-09-22T09:16:39.776787+0000","last_clean":"2024-09-22T09:16:39.776787+0000","last_became_active":"2024-09-22T08:33:33.309835+0000","last_became_peered":"2024-09-22T08:33:33.309835+0000","last_unstale":"2024-09-22T09:16:39.776787+0000","last_undegraded":"2024-09-22T09:16:39.776787+0000","last_fullsized":"2024-09-22T09:16:39.776787+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-22T09:16:39.776702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.776702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:50.757487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":113,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.649439+0000","last_change":"2024-09-22T09:16:54.649439+0000","last_active":"2024-09-22T09:16:54.649439+0000","last_peered":"2024-09-22T09:16:54.649439+0000","last_clean":"2024-09-22T09:16:54.649439+0000","last_became_active":"2024-09-22T08:51:48.543732+0000","last_became_peered":"2024-09-22T08:51:48.543732+0000","last_unstale":"2024-09-22T09:16:54.649439+0000","last_undegraded":"2024-09-22T09:16:54.649439+0000","last_fullsized":"2024-09-22T09:16:54.649439+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:54.649350+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:54.649350+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.649350+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:30.206964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.976779+0000","last_change":"2024-09-22T09:16:53.976779+0000","last_active":"2024-09-22T09:16:53.976779+0000","last_peered":"2024-09-22T09:16:53.976779+0000","last_clean":"2024-09-22T09:16:53.976779+0000","last_became_active":"2024-09-22T08:36:17.551620+0000","last_became_peered":"2024-09-22T08:36:17.551620+0000","last_unstale":"2024-09-22T09:16:53.976779+0000","last_undegraded":"2024-09-22T09:16:53.976779+0000","last_fullsized":"2024-09-22T09:16:53.976779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:53.976683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:53.976683+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.976683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:41:15.342300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"258'2","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.164637+0000","last_change":"2024-09-22T09:16:42.164637+0000","last_active":"2024-09-22T09:16:42.164637+0000","last_peered":"2024-09-22T09:16:42.164637+0000","last_clean":"2024-09-22T09:16:42.164637+0000","last_became_active":"2024-09-22T08:36:14.521068+0000","last_became_peered":"2024-09-22T08:36:14.521068+0000","last_unstale":"2024-09-22T09:16:42.164637+0000","last_undegraded":"2024-09-22T09:16:42.164637+0000","last_fullsized":"2024-09-22T09:16:42.164637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-22T09:16:42.164533+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.164533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:07.065385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"261'8","reported_seq":79,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.930369+0000","last_change":"2024-09-22T09:16:39.930369+0000","last_active":"2024-09-22T09:16:39.930369+0000","last_peered":"2024-09-22T09:16:39.930369+0000","last_clean":"2024-09-22T09:16:39.930369+0000","last_became_active":"2024-09-22T08:33:33.304697+0000","last_became_peered":"2024-09-22T08:33:33.304697+0000","last_unstale":"2024-09-22T09:16:39.930369+0000","last_undegraded":"2024-09-22T09:16:39.930369+0000","last_fullsized":"2024-09-22T09:16:39.930369+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:39.930265+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.930265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:36.946812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.528627+0000","last_change":"2024-09-22T09:16:51.528627+0000","last_active":"2024-09-22T09:16:51.528627+0000","last_peered":"2024-09-22T09:16:51.528627+0000","last_clean":"2024-09-22T09:16:51.528627+0000","last_became_active":"2024-09-22T08:51:48.546524+0000","last_became_peered":"2024-09-22T08:51:48.546524+0000","last_unstale":"2024-09-22T09:16:51.528627+0000","last_undegraded":"2024-09-22T09:16:51.528627+0000","last_fullsized":"2024-09-22T09:16:51.528627+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:51.528520+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:51.528520+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.528520+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:18.169637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"261'10","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:11.990418+0000","last_change":"2024-09-22T09:17:11.990418+0000","last_active":"2024-09-22T09:17:11.990418+0000","last_peered":"2024-09-22T09:17:11.990418+0000","last_clean":"2024-09-22T09:17:11.990418+0000","last_became_active":"2024-09-22T08:36:17.556672+0000","last_became_peered":"2024-09-22T08:36:17.556672+0000","last_unstale":"2024-09-22T09:17:11.990418+0000","last_undegraded":"2024-09-22T09:17:11.990418+0000","last_fullsized":"2024-09-22T09:17:11.990418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-22T09:17:11.990346+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-22T09:17:11.990346+0000","last_clean_scrub_stamp":"2024-09-22T09:17:11.990346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:41.226720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":26642,"num_write":15,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.211955+0000","last_change":"2024-09-22T09:16:43.211955+0000","last_active":"2024-09-22T09:16:43.211955+0000","last_peered":"2024-09-22T09:16:43.211955+0000","last_clean":"2024-09-22T09:16:43.211955+0000","last_became_active":"2024-09-22T08:36:14.514692+0000","last_became_peered":"2024-09-22T08:36:14.514692+0000","last_unstale":"2024-09-22T09:16:43.211955+0000","last_undegraded":"2024-09-22T09:16:43.211955+0000","last_fullsized":"2024-09-22T09:16:43.211955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.211856+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.211856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:30.934538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'24","reported_seq":121,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.776115+0000","last_change":"2024-09-22T09:16:38.776115+0000","last_active":"2024-09-22T09:16:38.776115+0000","last_peered":"2024-09-22T09:16:38.776115+0000","last_clean":"2024-09-22T09:16:38.776115+0000","last_became_active":"2024-09-22T08:33:33.306542+0000","last_became_peered":"2024-09-22T08:33:33.306542+0000","last_unstale":"2024-09-22T09:16:38.776115+0000","last_undegraded":"2024-09-22T09:16:38.776115+0000","last_fullsized":"2024-09-22T09:16:38.776115+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-22T09:16:38.776008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.776008+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:55.501761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":133,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:04.925451+0000","last_change":"2024-09-22T09:17:04.925451+0000","last_active":"2024-09-22T09:17:04.925451+0000","last_peered":"2024-09-22T09:17:04.925451+0000","last_clean":"2024-09-22T09:17:04.925451+0000","last_became_active":"2024-09-22T08:51:48.549716+0000","last_became_peered":"2024-09-22T08:51:48.549716+0000","last_unstale":"2024-09-22T09:17:04.925451+0000","last_undegraded":"2024-09-22T09:17:04.925451+0000","last_fullsized":"2024-09-22T09:17:04.925451+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:04.925360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:04.925360+0000","last_clean_scrub_stamp":"2024-09-22T09:17:04.925360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:08:42.706766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.961150+0000","last_change":"2024-09-22T09:16:50.961150+0000","last_active":"2024-09-22T09:16:50.961150+0000","last_peered":"2024-09-22T09:16:50.961150+0000","last_clean":"2024-09-22T09:16:50.961150+0000","last_became_active":"2024-09-22T08:36:17.544427+0000","last_became_peered":"2024-09-22T08:36:17.544427+0000","last_unstale":"2024-09-22T09:16:50.961150+0000","last_undegraded":"2024-09-22T09:16:50.961150+0000","last_fullsized":"2024-09-22T09:16:50.961150+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.961057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.961057+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.961057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:10.645656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.875900+0000","last_change":"2024-09-22T09:16:43.875827+0000","last_active":"2024-09-22T09:16:43.875900+0000","last_peered":"2024-09-22T09:16:43.875900+0000","last_clean":"2024-09-22T09:16:43.875900+0000","last_became_active":"2024-09-22T08:36:14.524297+0000","last_became_peered":"2024-09-22T08:36:14.524297+0000","last_unstale":"2024-09-22T09:16:43.875900+0000","last_undegraded":"2024-09-22T09:16:43.875900+0000","last_fullsized":"2024-09-22T09:16:43.875900+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:43.875715+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.875715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:54.884470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'49","reported_seq":182,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.808080+0000","last_change":"2024-09-22T09:16:37.808080+0000","last_active":"2024-09-22T09:16:37.808080+0000","last_peered":"2024-09-22T09:16:37.808080+0000","last_clean":"2024-09-22T09:16:37.808080+0000","last_became_active":"2024-09-22T08:33:33.310217+0000","last_became_peered":"2024-09-22T08:33:33.310217+0000","last_unstale":"2024-09-22T09:16:37.808080+0000","last_undegraded":"2024-09-22T09:16:37.808080+0000","last_fullsized":"2024-09-22T09:16:37.808080+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'49","last_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_deep_scrub":"261'49","last_deep_scrub_stamp":"2024-09-22T09:16:37.807991+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.807991+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:47.897618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":241,"num_write":123,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.276431+0000","last_change":"2024-09-22T09:16:46.276431+0000","last_active":"2024-09-22T09:16:46.276431+0000","last_peered":"2024-09-22T09:16:46.276431+0000","last_clean":"2024-09-22T09:16:46.276431+0000","last_became_active":"2024-09-22T08:51:48.553662+0000","last_became_peered":"2024-09-22T08:51:48.553662+0000","last_unstale":"2024-09-22T09:16:46.276431+0000","last_undegraded":"2024-09-22T09:16:46.276431+0000","last_fullsized":"2024-09-22T09:16:46.276431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.276347+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.276347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:50:06.468881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.926299+0000","last_change":"2024-09-22T09:16:49.926299+0000","last_active":"2024-09-22T09:16:49.926299+0000","last_peered":"2024-09-22T09:16:49.926299+0000","last_clean":"2024-09-22T09:16:49.926299+0000","last_became_active":"2024-09-22T08:36:17.559759+0000","last_became_peered":"2024-09-22T08:36:17.559759+0000","last_unstale":"2024-09-22T09:16:49.926299+0000","last_undegraded":"2024-09-22T09:16:49.926299+0000","last_fullsized":"2024-09-22T09:16:49.926299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:49.926211+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:49.926211+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.926211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:12.465662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.363098+0000","last_change":"2024-09-22T09:16:46.363035+0000","last_active":"2024-09-22T09:16:46.363098+0000","last_peered":"2024-09-22T09:16:46.363098+0000","last_clean":"2024-09-22T09:16:46.363098+0000","last_became_active":"2024-09-22T08:36:14.523066+0000","last_became_peered":"2024-09-22T08:36:14.523066+0000","last_unstale":"2024-09-22T09:16:46.363098+0000","last_undegraded":"2024-09-22T09:16:46.363098+0000","last_fullsized":"2024-09-22T09:16:46.363098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:46.362946+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.362946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:20.934618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'13","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:00.017393+0000","last_change":"2024-09-22T09:17:00.017393+0000","last_active":"2024-09-22T09:17:00.017393+0000","last_peered":"2024-09-22T09:17:00.017393+0000","last_clean":"2024-09-22T09:17:00.017393+0000","last_became_active":"2024-09-22T08:33:33.313890+0000","last_became_peered":"2024-09-22T08:33:33.313890+0000","last_unstale":"2024-09-22T09:17:00.017393+0000","last_undegraded":"2024-09-22T09:17:00.017393+0000","last_fullsized":"2024-09-22T09:17:00.017393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-22T09:17:00.017284+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-22T09:17:00.017284+0000","last_clean_scrub_stamp":"2024-09-22T09:17:00.017284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:24.191460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":49,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:15.056977+0000","last_change":"2024-09-22T09:17:15.056977+0000","last_active":"2024-09-22T09:17:15.056977+0000","last_peered":"2024-09-22T09:17:15.056977+0000","last_clean":"2024-09-22T09:17:15.056977+0000","last_became_active":"2024-09-22T08:51:48.550044+0000","last_became_peered":"2024-09-22T08:51:48.550044+0000","last_unstale":"2024-09-22T09:17:15.056977+0000","last_undegraded":"2024-09-22T09:17:15.056977+0000","last_fullsized":"2024-09-22T09:17:15.056977+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:15.056867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:15.056867+0000","last_clean_scrub_stamp":"2024-09-22T09:17:15.056867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:40.021679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"258'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.964269+0000","last_change":"2024-09-22T09:16:51.964269+0000","last_active":"2024-09-22T09:16:51.964269+0000","last_peered":"2024-09-22T09:16:51.964269+0000","last_clean":"2024-09-22T09:16:51.964269+0000","last_became_active":"2024-09-22T08:36:17.552745+0000","last_became_peered":"2024-09-22T08:36:17.552745+0000","last_unstale":"2024-09-22T09:16:51.964269+0000","last_undegraded":"2024-09-22T09:16:51.964269+0000","last_fullsized":"2024-09-22T09:16:51.964269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:51.964173+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:51.964173+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.964173+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:34.879220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"258'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.926965+0000","last_change":"2024-09-22T09:16:44.926898+0000","last_active":"2024-09-22T09:16:44.926965+0000","last_peered":"2024-09-22T09:16:44.926965+0000","last_clean":"2024-09-22T09:16:44.926965+0000","last_became_active":"2024-09-22T08:36:14.521566+0000","last_became_peered":"2024-09-22T08:36:14.521566+0000","last_unstale":"2024-09-22T09:16:44.926965+0000","last_undegraded":"2024-09-22T09:16:44.926965+0000","last_fullsized":"2024-09-22T09:16:44.926965+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:44.926806+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.926806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:19.408134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'41","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.176625+0000","last_change":"2024-09-22T09:16:39.176625+0000","last_active":"2024-09-22T09:16:39.176625+0000","last_peered":"2024-09-22T09:16:39.176625+0000","last_clean":"2024-09-22T09:16:39.176625+0000","last_became_active":"2024-09-22T08:33:33.301153+0000","last_became_peered":"2024-09-22T08:33:33.301153+0000","last_unstale":"2024-09-22T09:16:39.176625+0000","last_undegraded":"2024-09-22T09:16:39.176625+0000","last_fullsized":"2024-09-22T09:16:39.176625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'41","last_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_deep_scrub":"261'41","last_deep_scrub_stamp":"2024-09-22T09:16:39.176539+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.176539+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:01.618435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":203,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.264010+0000","last_change":"2024-09-22T09:16:47.264010+0000","last_active":"2024-09-22T09:16:47.264010+0000","last_peered":"2024-09-22T09:16:47.264010+0000","last_clean":"2024-09-22T09:16:47.264010+0000","last_became_active":"2024-09-22T08:51:48.546717+0000","last_became_peered":"2024-09-22T08:51:48.546717+0000","last_unstale":"2024-09-22T09:16:47.264010+0000","last_undegraded":"2024-09-22T09:16:47.264010+0000","last_fullsized":"2024-09-22T09:16:47.264010+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.263928+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.263928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:18.442999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.910086+0000","last_change":"2024-09-22T09:16:56.910086+0000","last_active":"2024-09-22T09:16:56.910086+0000","last_peered":"2024-09-22T09:16:56.910086+0000","last_clean":"2024-09-22T09:16:56.910086+0000","last_became_active":"2024-09-22T08:36:17.556292+0000","last_became_peered":"2024-09-22T08:36:17.556292+0000","last_unstale":"2024-09-22T09:16:56.910086+0000","last_undegraded":"2024-09-22T09:16:56.910086+0000","last_fullsized":"2024-09-22T09:16:56.910086+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:56.909984+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:56.909984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.909984+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:38.678346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.913153+0000","last_change":"2024-09-22T09:16:45.913056+0000","last_active":"2024-09-22T09:16:45.913153+0000","last_peered":"2024-09-22T09:16:45.913153+0000","last_clean":"2024-09-22T09:16:45.913153+0000","last_became_active":"2024-09-22T08:36:14.525349+0000","last_became_peered":"2024-09-22T08:36:14.525349+0000","last_unstale":"2024-09-22T09:16:45.913153+0000","last_undegraded":"2024-09-22T09:16:45.913153+0000","last_fullsized":"2024-09-22T09:16:45.913153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:45.912961+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.912961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:19.445927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'25","reported_seq":124,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.290252+0000","last_change":"2024-09-22T09:16:39.290252+0000","last_active":"2024-09-22T09:16:39.290252+0000","last_peered":"2024-09-22T09:16:39.290252+0000","last_clean":"2024-09-22T09:16:39.290252+0000","last_became_active":"2024-09-22T08:33:33.305790+0000","last_became_peered":"2024-09-22T08:33:33.305790+0000","last_unstale":"2024-09-22T09:16:39.290252+0000","last_undegraded":"2024-09-22T09:16:39.290252+0000","last_fullsized":"2024-09-22T09:16:39.290252+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'25","last_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_deep_scrub":"261'25","last_deep_scrub_stamp":"2024-09-22T09:16:39.290151+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.290151+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:25.985106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":127,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:06.892684+0000","last_change":"2024-09-22T09:17:06.892684+0000","last_active":"2024-09-22T09:17:06.892684+0000","last_peered":"2024-09-22T09:17:06.892684+0000","last_clean":"2024-09-22T09:17:06.892684+0000","last_became_active":"2024-09-22T08:51:48.550652+0000","last_became_peered":"2024-09-22T08:51:48.550652+0000","last_unstale":"2024-09-22T09:17:06.892684+0000","last_undegraded":"2024-09-22T09:17:06.892684+0000","last_fullsized":"2024-09-22T09:17:06.892684+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:06.892596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:06.892596+0000","last_clean_scrub_stamp":"2024-09-22T09:17:06.892596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:24.374058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:10.947666+0000","last_change":"2024-09-22T09:17:10.947588+0000","last_active":"2024-09-22T09:17:10.947666+0000","last_peered":"2024-09-22T09:17:10.947666+0000","last_clean":"2024-09-22T09:17:10.947666+0000","last_became_active":"2024-09-22T08:36:17.554928+0000","last_became_peered":"2024-09-22T08:36:17.554928+0000","last_unstale":"2024-09-22T09:17:10.947666+0000","last_undegraded":"2024-09-22T09:17:10.947666+0000","last_fullsized":"2024-09-22T09:17:10.947666+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:10.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:10.947500+0000","last_clean_scrub_stamp":"2024-09-22T09:17:10.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:24.674317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.877138+0000","last_change":"2024-09-22T09:16:42.877066+0000","last_active":"2024-09-22T09:16:42.877138+0000","last_peered":"2024-09-22T09:16:42.877138+0000","last_clean":"2024-09-22T09:16:42.877138+0000","last_became_active":"2024-09-22T08:36:14.520518+0000","last_became_peered":"2024-09-22T08:36:14.520518+0000","last_unstale":"2024-09-22T09:16:42.877138+0000","last_undegraded":"2024-09-22T09:16:42.877138+0000","last_fullsized":"2024-09-22T09:16:42.877138+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.876983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.876983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.724829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"261'44","reported_seq":175,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.280628+0000","last_change":"2024-09-22T09:16:38.280628+0000","last_active":"2024-09-22T09:16:38.280628+0000","last_peered":"2024-09-22T09:16:38.280628+0000","last_clean":"2024-09-22T09:16:38.280628+0000","last_became_active":"2024-09-22T08:33:33.312352+0000","last_became_peered":"2024-09-22T08:33:33.312352+0000","last_unstale":"2024-09-22T09:16:38.280628+0000","last_undegraded":"2024-09-22T09:16:38.280628+0000","last_fullsized":"2024-09-22T09:16:38.280628+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-22T09:16:38.280538+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.280538+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:26.277335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":229,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.697669+0000","last_change":"2024-09-22T09:16:50.697669+0000","last_active":"2024-09-22T09:16:50.697669+0000","last_peered":"2024-09-22T09:16:50.697669+0000","last_clean":"2024-09-22T09:16:50.697669+0000","last_became_active":"2024-09-22T08:51:48.553788+0000","last_became_peered":"2024-09-22T08:51:48.553788+0000","last_unstale":"2024-09-22T09:16:50.697669+0000","last_undegraded":"2024-09-22T09:16:50.697669+0000","last_fullsized":"2024-09-22T09:16:50.697669+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.697582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.697582+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.697582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:30.836313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'2","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.774975+0000","last_change":"2024-09-22T09:16:47.774887+0000","last_active":"2024-09-22T09:16:47.774975+0000","last_peered":"2024-09-22T09:16:47.774975+0000","last_clean":"2024-09-22T09:16:47.774975+0000","last_became_active":"2024-09-22T08:36:17.552964+0000","last_became_peered":"2024-09-22T08:36:17.552964+0000","last_unstale":"2024-09-22T09:16:47.774975+0000","last_undegraded":"2024-09-22T09:16:47.774975+0000","last_fullsized":"2024-09-22T09:16:47.774975+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:47.774799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.774799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:50.971915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'5","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.877342+0000","last_change":"2024-09-22T09:16:49.877276+0000","last_active":"2024-09-22T09:16:49.877342+0000","last_peered":"2024-09-22T09:16:49.877342+0000","last_clean":"2024-09-22T09:16:49.877342+0000","last_became_active":"2024-09-22T08:36:14.516466+0000","last_became_peered":"2024-09-22T08:36:14.516466+0000","last_unstale":"2024-09-22T09:16:49.877342+0000","last_undegraded":"2024-09-22T09:16:49.877342+0000","last_fullsized":"2024-09-22T09:16:49.877342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:49.877189+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:49.877189+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.877189+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:00.356025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'73","reported_seq":258,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.812362+0000","last_change":"2024-09-22T09:16:45.812257+0000","last_active":"2024-09-22T09:16:45.812362+0000","last_peered":"2024-09-22T09:16:45.812362+0000","last_clean":"2024-09-22T09:16:45.812362+0000","last_became_active":"2024-09-22T08:33:33.305998+0000","last_became_peered":"2024-09-22T08:33:33.305998+0000","last_unstale":"2024-09-22T09:16:45.812362+0000","last_undegraded":"2024-09-22T09:16:45.812362+0000","last_fullsized":"2024-09-22T09:16:45.812362+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'73","last_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_deep_scrub":"261'73","last_deep_scrub_stamp":"2024-09-22T09:16:45.812164+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.812164+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:45.301719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":580,"num_read_kb":397,"num_write":189,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.544634+0000","last_change":"2024-09-22T09:16:44.544634+0000","last_active":"2024-09-22T09:16:44.544634+0000","last_peered":"2024-09-22T09:16:44.544634+0000","last_clean":"2024-09-22T09:16:44.544634+0000","last_became_active":"2024-09-22T08:51:48.549538+0000","last_became_peered":"2024-09-22T08:51:48.549538+0000","last_unstale":"2024-09-22T09:16:44.544634+0000","last_undegraded":"2024-09-22T09:16:44.544634+0000","last_fullsized":"2024-09-22T09:16:44.544634+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.544540+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.544540+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:05.655088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.436813+0000","last_change":"2024-09-22T09:16:48.436813+0000","last_active":"2024-09-22T09:16:48.436813+0000","last_peered":"2024-09-22T09:16:48.436813+0000","last_clean":"2024-09-22T09:16:48.436813+0000","last_became_active":"2024-09-22T08:36:17.557534+0000","last_became_peered":"2024-09-22T08:36:17.557534+0000","last_unstale":"2024-09-22T09:16:48.436813+0000","last_undegraded":"2024-09-22T09:16:48.436813+0000","last_fullsized":"2024-09-22T09:16:48.436813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:48.436725+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:48.436725+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.436725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:31.963757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.894671+0000","last_change":"2024-09-22T09:16:43.894615+0000","last_active":"2024-09-22T09:16:43.894671+0000","last_peered":"2024-09-22T09:16:43.894671+0000","last_clean":"2024-09-22T09:16:43.894671+0000","last_became_active":"2024-09-22T08:36:14.519871+0000","last_became_peered":"2024-09-22T08:36:14.519871+0000","last_unstale":"2024-09-22T09:16:43.894671+0000","last_undegraded":"2024-09-22T09:16:43.894671+0000","last_fullsized":"2024-09-22T09:16:43.894671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:16:43.894526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.894526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:57.633983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'18","reported_seq":105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.853268+0000","last_change":"2024-09-22T09:16:48.853214+0000","last_active":"2024-09-22T09:16:48.853268+0000","last_peered":"2024-09-22T09:16:48.853268+0000","last_clean":"2024-09-22T09:16:48.853268+0000","last_became_active":"2024-09-22T08:33:33.305408+0000","last_became_peered":"2024-09-22T08:33:33.305408+0000","last_unstale":"2024-09-22T09:16:48.853268+0000","last_undegraded":"2024-09-22T09:16:48.853268+0000","last_fullsized":"2024-09-22T09:16:48.853268+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:16:48.853131+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:16:48.853131+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.853131+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:49.353422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.953526+0000","last_change":"2024-09-22T09:16:57.953526+0000","last_active":"2024-09-22T09:16:57.953526+0000","last_peered":"2024-09-22T09:16:57.953526+0000","last_clean":"2024-09-22T09:16:57.953526+0000","last_became_active":"2024-09-22T08:51:48.554308+0000","last_became_peered":"2024-09-22T08:51:48.554308+0000","last_unstale":"2024-09-22T09:16:57.953526+0000","last_undegraded":"2024-09-22T09:16:57.953526+0000","last_fullsized":"2024-09-22T09:16:57.953526+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:57.953434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:57.953434+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.953434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:22.223134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.593440+0000","last_change":"2024-09-22T09:16:38.593440+0000","last_active":"2024-09-22T09:16:38.593440+0000","last_peered":"2024-09-22T09:16:38.593440+0000","last_clean":"2024-09-22T09:16:38.593440+0000","last_became_active":"2024-09-22T08:36:17.557591+0000","last_became_peered":"2024-09-22T08:36:17.557591+0000","last_unstale":"2024-09-22T09:16:38.593440+0000","last_undegraded":"2024-09-22T09:16:38.593440+0000","last_fullsized":"2024-09-22T09:16:38.593440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.593354+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.593354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:07.670762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:06.049353+0000","last_change":"2024-09-22T09:17:06.049353+0000","last_active":"2024-09-22T09:17:06.049353+0000","last_peered":"2024-09-22T09:17:06.049353+0000","last_clean":"2024-09-22T09:17:06.049353+0000","last_became_active":"2024-09-22T08:36:14.523370+0000","last_became_peered":"2024-09-22T08:36:14.523370+0000","last_unstale":"2024-09-22T09:17:06.049353+0000","last_undegraded":"2024-09-22T09:17:06.049353+0000","last_fullsized":"2024-09-22T09:17:06.049353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:06.049244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:06.049244+0000","last_clean_scrub_stamp":"2024-09-22T09:17:06.049244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:09.875472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'27","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.607265+0000","last_change":"2024-09-22T09:16:34.607201+0000","last_active":"2024-09-22T09:16:34.607265+0000","last_peered":"2024-09-22T09:16:34.607265+0000","last_clean":"2024-09-22T09:16:34.607265+0000","last_became_active":"2024-09-22T08:33:33.314614+0000","last_became_peered":"2024-09-22T08:33:33.314614+0000","last_unstale":"2024-09-22T09:16:34.607265+0000","last_undegraded":"2024-09-22T09:16:34.607265+0000","last_fullsized":"2024-09-22T09:16:34.607265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:34.607103+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.607103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:48.367495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":120,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.618385+0000","last_change":"2024-09-22T09:16:41.618333+0000","last_active":"2024-09-22T09:16:41.618385+0000","last_peered":"2024-09-22T09:16:41.618385+0000","last_clean":"2024-09-22T09:16:41.618385+0000","last_became_active":"2024-09-22T08:51:48.548594+0000","last_became_peered":"2024-09-22T08:51:48.548594+0000","last_unstale":"2024-09-22T09:16:41.618385+0000","last_undegraded":"2024-09-22T09:16:41.618385+0000","last_fullsized":"2024-09-22T09:16:41.618385+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.618245+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.618245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:52.513592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.916622+0000","last_change":"2024-09-22T09:16:55.916622+0000","last_active":"2024-09-22T09:16:55.916622+0000","last_peered":"2024-09-22T09:16:55.916622+0000","last_clean":"2024-09-22T09:16:55.916622+0000","last_became_active":"2024-09-22T08:36:17.549786+0000","last_became_peered":"2024-09-22T08:36:17.549786+0000","last_unstale":"2024-09-22T09:16:55.916622+0000","last_undegraded":"2024-09-22T09:16:55.916622+0000","last_fullsized":"2024-09-22T09:16:55.916622+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-22T09:16:55.916512+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-22T09:16:55.916512+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.916512+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:38.215866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4198,"num_write":12,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"261'8","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:04.081981+0000","last_change":"2024-09-22T09:17:04.081981+0000","last_active":"2024-09-22T09:17:04.081981+0000","last_peered":"2024-09-22T09:17:04.081981+0000","last_clean":"2024-09-22T09:17:04.081981+0000","last_became_active":"2024-09-22T08:36:14.528414+0000","last_became_peered":"2024-09-22T08:36:14.528414+0000","last_unstale":"2024-09-22T09:17:04.081981+0000","last_undegraded":"2024-09-22T09:17:04.081981+0000","last_fullsized":"2024-09-22T09:17:04.081981+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:17:04.081866+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:17:04.081866+0000","last_clean_scrub_stamp":"2024-09-22T09:17:04.081866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:43.095868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.555004+0000","last_change":"2024-09-22T09:16:46.554920+0000","last_active":"2024-09-22T09:16:46.555004+0000","last_peered":"2024-09-22T09:16:46.555004+0000","last_clean":"2024-09-22T09:16:46.555004+0000","last_became_active":"2024-09-22T08:33:33.310285+0000","last_became_peered":"2024-09-22T08:33:33.310285+0000","last_unstale":"2024-09-22T09:16:46.555004+0000","last_undegraded":"2024-09-22T09:16:46.555004+0000","last_fullsized":"2024-09-22T09:16:46.555004+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:46.554816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.554816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:00.571695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.578268+0000","last_change":"2024-09-22T09:16:42.578200+0000","last_active":"2024-09-22T09:16:42.578268+0000","last_peered":"2024-09-22T09:16:42.578268+0000","last_clean":"2024-09-22T09:16:42.578268+0000","last_became_active":"2024-09-22T08:51:48.549366+0000","last_became_peered":"2024-09-22T08:51:48.549366+0000","last_unstale":"2024-09-22T09:16:42.578268+0000","last_undegraded":"2024-09-22T09:16:42.578268+0000","last_fullsized":"2024-09-22T09:16:42.578268+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.578116+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.578116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:41:50.365456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:54.902693+0000","last_change":"2024-09-22T09:16:54.902693+0000","last_active":"2024-09-22T09:16:54.902693+0000","last_peered":"2024-09-22T09:16:54.902693+0000","last_clean":"2024-09-22T09:16:54.902693+0000","last_became_active":"2024-09-22T08:36:17.559544+0000","last_became_peered":"2024-09-22T08:36:17.559544+0000","last_unstale":"2024-09-22T09:16:54.902693+0000","last_undegraded":"2024-09-22T09:16:54.902693+0000","last_fullsized":"2024-09-22T09:16:54.902693+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:54.902579+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:54.902579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:54.902579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:06.998581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.574473+0000","last_change":"2024-09-22T09:16:50.574473+0000","last_active":"2024-09-22T09:16:50.574473+0000","last_peered":"2024-09-22T09:16:50.574473+0000","last_clean":"2024-09-22T09:16:50.574473+0000","last_became_active":"2024-09-22T08:36:14.522917+0000","last_became_peered":"2024-09-22T08:36:14.522917+0000","last_unstale":"2024-09-22T09:16:50.574473+0000","last_undegraded":"2024-09-22T09:16:50.574473+0000","last_fullsized":"2024-09-22T09:16:50.574473+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:50.574386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:50.574386+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.574386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:41:00.482425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'136","reported_seq":460,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:58.981777+0000","last_change":"2024-09-22T09:16:58.981777+0000","last_active":"2024-09-22T09:16:58.981777+0000","last_peered":"2024-09-22T09:16:58.981777+0000","last_clean":"2024-09-22T09:16:58.981777+0000","last_became_active":"2024-09-22T08:33:33.313389+0000","last_became_peered":"2024-09-22T08:33:33.313389+0000","last_unstale":"2024-09-22T09:16:58.981777+0000","last_undegraded":"2024-09-22T09:16:58.981777+0000","last_fullsized":"2024-09-22T09:16:58.981777+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-22T09:16:58.981679+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-22T09:16:58.981679+0000","last_clean_scrub_stamp":"2024-09-22T09:16:58.981679+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:10.000992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1240,"num_read_kb":940,"num_write":277,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:01.870610+0000","last_change":"2024-09-22T09:17:01.870610+0000","last_active":"2024-09-22T09:17:01.870610+0000","last_peered":"2024-09-22T09:17:01.870610+0000","last_clean":"2024-09-22T09:17:01.870610+0000","last_became_active":"2024-09-22T08:51:48.549674+0000","last_became_peered":"2024-09-22T08:51:48.549674+0000","last_unstale":"2024-09-22T09:17:01.870610+0000","last_undegraded":"2024-09-22T09:17:01.870610+0000","last_fullsized":"2024-09-22T09:17:01.870610+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:01.870518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:01.870518+0000","last_clean_scrub_stamp":"2024-09-22T09:17:01.870518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:06.337864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.571186+0000","last_change":"2024-09-22T09:16:37.571123+0000","last_active":"2024-09-22T09:16:37.571186+0000","last_peered":"2024-09-22T09:16:37.571186+0000","last_clean":"2024-09-22T09:16:37.571186+0000","last_became_active":"2024-09-22T08:36:17.549187+0000","last_became_peered":"2024-09-22T08:36:17.549187+0000","last_unstale":"2024-09-22T09:16:37.571186+0000","last_undegraded":"2024-09-22T09:16:37.571186+0000","last_fullsized":"2024-09-22T09:16:37.571186+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:37.571036+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.571036+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:42.202289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.922252+0000","last_change":"2024-09-22T09:16:42.922201+0000","last_active":"2024-09-22T09:16:42.922252+0000","last_peered":"2024-09-22T09:16:42.922252+0000","last_clean":"2024-09-22T09:16:42.922252+0000","last_became_active":"2024-09-22T08:36:14.518557+0000","last_became_peered":"2024-09-22T08:36:14.518557+0000","last_unstale":"2024-09-22T09:16:42.922252+0000","last_undegraded":"2024-09-22T09:16:42.922252+0000","last_fullsized":"2024-09-22T09:16:42.922252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.922112+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.922112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:28.190183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'27","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.964447+0000","last_change":"2024-09-22T09:16:38.964395+0000","last_active":"2024-09-22T09:16:38.964447+0000","last_peered":"2024-09-22T09:16:38.964447+0000","last_clean":"2024-09-22T09:16:38.964447+0000","last_became_active":"2024-09-22T08:33:33.310563+0000","last_became_peered":"2024-09-22T08:33:33.310563+0000","last_unstale":"2024-09-22T09:16:38.964447+0000","last_undegraded":"2024-09-22T09:16:38.964447+0000","last_fullsized":"2024-09-22T09:16:38.964447+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-22T09:16:38.964315+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.964315+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:37.172303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":126,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:16.054387+0000","last_change":"2024-09-22T09:17:16.054387+0000","last_active":"2024-09-22T09:17:16.054387+0000","last_peered":"2024-09-22T09:17:16.054387+0000","last_clean":"2024-09-22T09:17:16.054387+0000","last_became_active":"2024-09-22T08:51:48.548171+0000","last_became_peered":"2024-09-22T08:51:48.548171+0000","last_unstale":"2024-09-22T09:17:16.054387+0000","last_undegraded":"2024-09-22T09:17:16.054387+0000","last_fullsized":"2024-09-22T09:17:16.054387+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:16.054294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:16.054294+0000","last_clean_scrub_stamp":"2024-09-22T09:17:16.054294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:55.263960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:09.991597+0000","last_change":"2024-09-22T09:17:09.991538+0000","last_active":"2024-09-22T09:17:09.991597+0000","last_peered":"2024-09-22T09:17:09.991597+0000","last_clean":"2024-09-22T09:17:09.991597+0000","last_became_active":"2024-09-22T08:36:17.553465+0000","last_became_peered":"2024-09-22T08:36:17.553465+0000","last_unstale":"2024-09-22T09:17:09.991597+0000","last_undegraded":"2024-09-22T09:17:09.991597+0000","last_fullsized":"2024-09-22T09:17:09.991597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:09.991434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:09.991434+0000","last_clean_scrub_stamp":"2024-09-22T09:17:09.991434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:51.118871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'11","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:05.045422+0000","last_change":"2024-09-22T09:17:05.045354+0000","last_active":"2024-09-22T09:17:05.045422+0000","last_peered":"2024-09-22T09:17:05.045422+0000","last_clean":"2024-09-22T09:17:05.045422+0000","last_became_active":"2024-09-22T08:36:14.522821+0000","last_became_peered":"2024-09-22T08:36:14.522821+0000","last_unstale":"2024-09-22T09:17:05.045422+0000","last_undegraded":"2024-09-22T09:17:05.045422+0000","last_fullsized":"2024-09-22T09:17:05.045422+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-22T09:17:05.045241+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-22T09:17:05.045241+0000","last_clean_scrub_stamp":"2024-09-22T09:17:05.045241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:48.872577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'18","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.828822+0000","last_change":"2024-09-22T09:16:36.828769+0000","last_active":"2024-09-22T09:16:36.828822+0000","last_peered":"2024-09-22T09:16:36.828822+0000","last_clean":"2024-09-22T09:16:36.828822+0000","last_became_active":"2024-09-22T08:33:33.308859+0000","last_became_peered":"2024-09-22T08:33:33.308859+0000","last_unstale":"2024-09-22T09:16:36.828822+0000","last_undegraded":"2024-09-22T09:16:36.828822+0000","last_fullsized":"2024-09-22T09:16:36.828822+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-22T09:16:36.828686+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.828686+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:56.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":93,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.990799+0000","last_change":"2024-09-22T09:16:56.990799+0000","last_active":"2024-09-22T09:16:56.990799+0000","last_peered":"2024-09-22T09:16:56.990799+0000","last_clean":"2024-09-22T09:16:56.990799+0000","last_became_active":"2024-09-22T08:51:48.551855+0000","last_became_peered":"2024-09-22T08:51:48.551855+0000","last_unstale":"2024-09-22T09:16:56.990799+0000","last_undegraded":"2024-09-22T09:16:56.990799+0000","last_fullsized":"2024-09-22T09:16:56.990799+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:56.990710+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:56.990710+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.990710+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:07.776339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"261'5","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.537902+0000","last_change":"2024-09-22T09:16:51.537902+0000","last_active":"2024-09-22T09:16:51.537902+0000","last_peered":"2024-09-22T09:16:51.537902+0000","last_clean":"2024-09-22T09:16:51.537902+0000","last_became_active":"2024-09-22T08:36:17.552750+0000","last_became_peered":"2024-09-22T08:36:17.552750+0000","last_unstale":"2024-09-22T09:16:51.537902+0000","last_undegraded":"2024-09-22T09:16:51.537902+0000","last_fullsized":"2024-09-22T09:16:51.537902+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:51.537805+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:51.537805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.537805+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:09.569184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12859,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"258'5","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.898135+0000","last_change":"2024-09-22T09:16:41.898135+0000","last_active":"2024-09-22T09:16:41.898135+0000","last_peered":"2024-09-22T09:16:41.898135+0000","last_clean":"2024-09-22T09:16:41.898135+0000","last_became_active":"2024-09-22T08:36:14.517615+0000","last_became_peered":"2024-09-22T08:36:14.517615+0000","last_unstale":"2024-09-22T09:16:41.898135+0000","last_undegraded":"2024-09-22T09:16:41.898135+0000","last_fullsized":"2024-09-22T09:16:41.898135+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-22T09:16:41.898026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.898026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:27.564920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'20","reported_seq":109,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.964421+0000","last_change":"2024-09-22T09:16:36.964341+0000","last_active":"2024-09-22T09:16:36.964421+0000","last_peered":"2024-09-22T09:16:36.964421+0000","last_clean":"2024-09-22T09:16:36.964421+0000","last_became_active":"2024-09-22T08:33:33.305110+0000","last_became_peered":"2024-09-22T08:33:33.305110+0000","last_unstale":"2024-09-22T09:16:36.964421+0000","last_undegraded":"2024-09-22T09:16:36.964421+0000","last_fullsized":"2024-09-22T09:16:36.964421+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-22T09:16:36.964266+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.964266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:27.066433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":87,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.587583+0000","last_change":"2024-09-22T09:16:52.587583+0000","last_active":"2024-09-22T09:16:52.587583+0000","last_peered":"2024-09-22T09:16:52.587583+0000","last_clean":"2024-09-22T09:16:52.587583+0000","last_became_active":"2024-09-22T08:51:48.547336+0000","last_became_peered":"2024-09-22T08:51:48.547336+0000","last_unstale":"2024-09-22T09:16:52.587583+0000","last_undegraded":"2024-09-22T09:16:52.587583+0000","last_fullsized":"2024-09-22T09:16:52.587583+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:52.587498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:52.587498+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.587498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:40.562272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"258'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:09.030760+0000","last_change":"2024-09-22T09:17:09.030760+0000","last_active":"2024-09-22T09:17:09.030760+0000","last_peered":"2024-09-22T09:17:09.030760+0000","last_clean":"2024-09-22T09:17:09.030760+0000","last_became_active":"2024-09-22T08:36:17.552684+0000","last_became_peered":"2024-09-22T08:36:17.552684+0000","last_unstale":"2024-09-22T09:17:09.030760+0000","last_undegraded":"2024-09-22T09:17:09.030760+0000","last_fullsized":"2024-09-22T09:17:09.030760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-22T09:17:09.030645+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-22T09:17:09.030645+0000","last_clean_scrub_stamp":"2024-09-22T09:17:09.030645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:17.492300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:03.121041+0000","last_change":"2024-09-22T09:17:03.121041+0000","last_active":"2024-09-22T09:17:03.121041+0000","last_peered":"2024-09-22T09:17:03.121041+0000","last_clean":"2024-09-22T09:17:03.121041+0000","last_became_active":"2024-09-22T08:36:14.522249+0000","last_became_peered":"2024-09-22T08:36:14.522249+0000","last_unstale":"2024-09-22T09:17:03.121041+0000","last_undegraded":"2024-09-22T09:17:03.121041+0000","last_fullsized":"2024-09-22T09:17:03.121041+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:17:03.120949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:17:03.120949+0000","last_clean_scrub_stamp":"2024-09-22T09:17:03.120949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:14.326993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'81","reported_seq":292,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:57.980718+0000","last_change":"2024-09-22T09:16:57.980655+0000","last_active":"2024-09-22T09:16:57.980718+0000","last_peered":"2024-09-22T09:16:57.980718+0000","last_clean":"2024-09-22T09:16:57.980718+0000","last_became_active":"2024-09-22T08:33:33.311738+0000","last_became_peered":"2024-09-22T08:33:33.311738+0000","last_unstale":"2024-09-22T09:16:57.980718+0000","last_undegraded":"2024-09-22T09:16:57.980718+0000","last_fullsized":"2024-09-22T09:16:57.980718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'81","last_scrub_stamp":"2024-09-22T09:16:57.980553+0000","last_deep_scrub":"261'81","last_deep_scrub_stamp":"2024-09-22T09:16:57.980553+0000","last_clean_scrub_stamp":"2024-09-22T09:16:57.980553+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:41.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":518,"num_write":183,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:03.911838+0000","last_change":"2024-09-22T09:17:03.911838+0000","last_active":"2024-09-22T09:17:03.911838+0000","last_peered":"2024-09-22T09:17:03.911838+0000","last_clean":"2024-09-22T09:17:03.911838+0000","last_became_active":"2024-09-22T08:51:48.550561+0000","last_became_peered":"2024-09-22T08:51:48.550561+0000","last_unstale":"2024-09-22T09:17:03.911838+0000","last_undegraded":"2024-09-22T09:17:03.911838+0000","last_fullsized":"2024-09-22T09:17:03.911838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:03.911744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:03.911744+0000","last_clean_scrub_stamp":"2024-09-22T09:17:03.911744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:22.482761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.796777+0000","last_change":"2024-09-22T09:16:46.796777+0000","last_active":"2024-09-22T09:16:46.796777+0000","last_peered":"2024-09-22T09:16:46.796777+0000","last_clean":"2024-09-22T09:16:46.796777+0000","last_became_active":"2024-09-22T08:36:17.552713+0000","last_became_peered":"2024-09-22T08:36:17.552713+0000","last_unstale":"2024-09-22T09:16:46.796777+0000","last_undegraded":"2024-09-22T09:16:46.796777+0000","last_fullsized":"2024-09-22T09:16:46.796777+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-22T09:16:46.796697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.796697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:07:24.309321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'3","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.384345+0000","last_change":"2024-09-22T09:16:45.384345+0000","last_active":"2024-09-22T09:16:45.384345+0000","last_peered":"2024-09-22T09:16:45.384345+0000","last_clean":"2024-09-22T09:16:45.384345+0000","last_became_active":"2024-09-22T08:36:14.520202+0000","last_became_peered":"2024-09-22T08:36:14.520202+0000","last_unstale":"2024-09-22T09:16:45.384345+0000","last_undegraded":"2024-09-22T09:16:45.384345+0000","last_fullsized":"2024-09-22T09:16:45.384345+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:45.384229+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.384229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:45.682719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.979749+0000","last_change":"2024-09-22T09:16:56.979686+0000","last_active":"2024-09-22T09:16:56.979749+0000","last_peered":"2024-09-22T09:16:56.979749+0000","last_clean":"2024-09-22T09:16:56.979749+0000","last_became_active":"2024-09-22T08:33:33.311121+0000","last_became_peered":"2024-09-22T08:33:33.311121+0000","last_unstale":"2024-09-22T09:16:56.979749+0000","last_undegraded":"2024-09-22T09:16:56.979749+0000","last_fullsized":"2024-09-22T09:16:56.979749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-22T09:16:56.979606+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-22T09:16:56.979606+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.979606+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:39.181669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":118,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:17:14.011584+0000","last_change":"2024-09-22T09:17:14.011584+0000","last_active":"2024-09-22T09:17:14.011584+0000","last_peered":"2024-09-22T09:17:14.011584+0000","last_clean":"2024-09-22T09:17:14.011584+0000","last_became_active":"2024-09-22T08:51:48.552118+0000","last_became_peered":"2024-09-22T08:51:48.552118+0000","last_unstale":"2024-09-22T09:17:14.011584+0000","last_undegraded":"2024-09-22T09:17:14.011584+0000","last_fullsized":"2024-09-22T09:17:14.011584+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:17:14.011455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:17:14.011455+0000","last_clean_scrub_stamp":"2024-09-22T09:17:14.011455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:52.949114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.847390+0000","last_change":"2024-09-22T09:16:44.847390+0000","last_active":"2024-09-22T09:16:44.847390+0000","last_peered":"2024-09-22T09:16:44.847390+0000","last_clean":"2024-09-22T09:16:44.847390+0000","last_became_active":"2024-09-22T08:36:17.548248+0000","last_became_peered":"2024-09-22T08:36:17.548248+0000","last_unstale":"2024-09-22T09:16:44.847390+0000","last_undegraded":"2024-09-22T09:16:44.847390+0000","last_fullsized":"2024-09-22T09:16:44.847390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:44.847285+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.847285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:48.377069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":62,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.145192+0000","last_change":"2024-09-22T09:16:40.145192+0000","last_active":"2024-09-22T09:16:40.145192+0000","last_peered":"2024-09-22T09:16:40.145192+0000","last_clean":"2024-09-22T09:16:40.145192+0000","last_became_active":"2024-09-22T08:36:14.523978+0000","last_became_peered":"2024-09-22T08:36:14.523978+0000","last_unstale":"2024-09-22T09:16:40.145192+0000","last_undegraded":"2024-09-22T09:16:40.145192+0000","last_fullsized":"2024-09-22T09:16:40.145192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-22T09:16:40.145086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.145086+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:02.203653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'13","reported_seq":95,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.012765+0000","last_change":"2024-09-22T09:16:38.012765+0000","last_active":"2024-09-22T09:16:38.012765+0000","last_peered":"2024-09-22T09:16:38.012765+0000","last_clean":"2024-09-22T09:16:38.012765+0000","last_became_active":"2024-09-22T08:33:33.312633+0000","last_became_peered":"2024-09-22T08:33:33.312633+0000","last_unstale":"2024-09-22T09:16:38.012765+0000","last_undegraded":"2024-09-22T09:16:38.012765+0000","last_fullsized":"2024-09-22T09:16:38.012765+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-22T09:16:38.012671+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.012671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:51:31.079655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":68,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'395","reported_seq":1268,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.512963+0000","last_change":"2024-09-22T09:16:15.512963+0000","last_active":"2024-09-22T09:16:15.512963+0000","last_peered":"2024-09-22T09:16:15.512963+0000","last_clean":"2024-09-22T09:16:15.512963+0000","last_became_active":"2024-09-22T08:17:38.305011+0000","last_became_peered":"2024-09-22T08:17:38.305011+0000","last_unstale":"2024-09-22T09:16:15.512963+0000","last_undegraded":"2024-09-22T09:16:15.512963+0000","last_fullsized":"2024-09-22T09:16:15.512963+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-22T09:16:15.512820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.512820+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:16.248546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1437,"num_read_kb":46472,"num_write":1276,"num_write_kb":51492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'951","reported_seq":2510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.195229+0000","last_change":"2024-09-22T09:16:22.195229+0000","last_active":"2024-09-22T09:16:22.195229+0000","last_peered":"2024-09-22T09:16:22.195229+0000","last_clean":"2024-09-22T09:16:22.195229+0000","last_became_active":"2024-09-22T08:17:40.306610+0000","last_became_peered":"2024-09-22T08:17:40.306610+0000","last_unstale":"2024-09-22T09:16:22.195229+0000","last_undegraded":"2024-09-22T09:16:22.195229+0000","last_fullsized":"2024-09-22T09:16:22.195229+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'951","last_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_deep_scrub":"261'951","last_deep_scrub_stamp":"2024-09-22T09:16:22.195138+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.195138+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:36.195944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":3962,"num_write":1308,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'396","reported_seq":1093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.736969+0000","last_change":"2024-09-22T09:16:22.736969+0000","last_active":"2024-09-22T09:16:22.736969+0000","last_peered":"2024-09-22T09:16:22.736969+0000","last_clean":"2024-09-22T09:16:22.736969+0000","last_became_active":"2024-09-22T08:17:38.302065+0000","last_became_peered":"2024-09-22T08:17:38.302065+0000","last_unstale":"2024-09-22T09:16:22.736969+0000","last_undegraded":"2024-09-22T09:16:22.736969+0000","last_fullsized":"2024-09-22T09:16:22.736969+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-22T09:16:22.736820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.736820+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:22.398536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":784,"num_read_kb":45729,"num_write":1281,"num_write_kb":46379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'769","reported_seq":2195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.117657+0000","last_change":"2024-09-22T09:16:33.117657+0000","last_active":"2024-09-22T09:16:33.117657+0000","last_peered":"2024-09-22T09:16:33.117657+0000","last_clean":"2024-09-22T09:16:33.117657+0000","last_became_active":"2024-09-22T08:17:40.311482+0000","last_became_peered":"2024-09-22T08:17:40.311482+0000","last_unstale":"2024-09-22T09:16:33.117657+0000","last_undegraded":"2024-09-22T09:16:33.117657+0000","last_fullsized":"2024-09-22T09:16:33.117657+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'769","last_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_deep_scrub":"261'769","last_deep_scrub_stamp":"2024-09-22T09:16:33.117556+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.117556+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:48.851231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3564,"num_read_kb":3221,"num_write":1015,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.700568+0000","last_change":"2024-09-22T09:16:18.700568+0000","last_active":"2024-09-22T09:16:18.700568+0000","last_peered":"2024-09-22T09:16:18.700568+0000","last_clean":"2024-09-22T09:16:18.700568+0000","last_became_active":"2024-09-22T08:17:38.306523+0000","last_became_peered":"2024-09-22T08:17:38.306523+0000","last_unstale":"2024-09-22T09:16:18.700568+0000","last_undegraded":"2024-09-22T09:16:18.700568+0000","last_fullsized":"2024-09-22T09:16:18.700568+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'346","last_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_deep_scrub":"261'346","last_deep_scrub_stamp":"2024-09-22T09:16:18.700411+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.700411+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:06.334626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":64388,"num_write":1226,"num_write_kb":29500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'499","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.084051+0000","last_change":"2024-09-22T09:16:34.084051+0000","last_active":"2024-09-22T09:16:34.084051+0000","last_peered":"2024-09-22T09:16:34.084051+0000","last_clean":"2024-09-22T09:16:34.084051+0000","last_became_active":"2024-09-22T08:17:40.313933+0000","last_became_peered":"2024-09-22T08:17:40.313933+0000","last_unstale":"2024-09-22T09:16:34.084051+0000","last_undegraded":"2024-09-22T09:16:34.084051+0000","last_fullsized":"2024-09-22T09:16:34.084051+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'499","last_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_deep_scrub":"261'499","last_deep_scrub_stamp":"2024-09-22T09:16:34.083973+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.083973+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:29.818260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2395,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'394","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.909250+0000","last_change":"2024-09-22T09:16:15.909250+0000","last_active":"2024-09-22T09:16:15.909250+0000","last_peered":"2024-09-22T09:16:15.909250+0000","last_clean":"2024-09-22T09:16:15.909250+0000","last_became_active":"2024-09-22T08:17:38.306263+0000","last_became_peered":"2024-09-22T08:17:38.306263+0000","last_unstale":"2024-09-22T09:16:15.909250+0000","last_undegraded":"2024-09-22T09:16:15.909250+0000","last_fullsized":"2024-09-22T09:16:15.909250+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:15.909095+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.909095+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:00.057217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":100163,"num_write":1151,"num_write_kb":47320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'536","reported_seq":2210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.721659+0000","last_change":"2024-09-22T09:16:25.721659+0000","last_active":"2024-09-22T09:16:25.721659+0000","last_peered":"2024-09-22T09:16:25.721659+0000","last_clean":"2024-09-22T09:16:25.721659+0000","last_became_active":"2024-09-22T08:17:40.313308+0000","last_became_peered":"2024-09-22T08:17:40.313308+0000","last_unstale":"2024-09-22T09:16:25.721659+0000","last_undegraded":"2024-09-22T09:16:25.721659+0000","last_fullsized":"2024-09-22T09:16:25.721659+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'536","last_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_deep_scrub":"261'536","last_deep_scrub_stamp":"2024-09-22T09:16:25.721574+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.721574+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:07.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2994,"num_read_kb":2789,"num_write":699,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'374","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.484163+0000","last_change":"2024-09-22T09:16:16.484163+0000","last_active":"2024-09-22T09:16:16.484163+0000","last_peered":"2024-09-22T09:16:16.484163+0000","last_clean":"2024-09-22T09:16:16.484163+0000","last_became_active":"2024-09-22T08:17:38.308050+0000","last_became_peered":"2024-09-22T08:17:38.308050+0000","last_unstale":"2024-09-22T09:16:16.484163+0000","last_undegraded":"2024-09-22T09:16:16.484163+0000","last_fullsized":"2024-09-22T09:16:16.484163+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'374","last_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_deep_scrub":"261'374","last_deep_scrub_stamp":"2024-09-22T09:16:16.484052+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.484052+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:58.010659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":611,"num_read_kb":101852,"num_write":1145,"num_write_kb":47370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'579","reported_seq":2244,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.486420+0000","last_change":"2024-09-22T09:16:21.486420+0000","last_active":"2024-09-22T09:16:21.486420+0000","last_peered":"2024-09-22T09:16:21.486420+0000","last_clean":"2024-09-22T09:16:21.486420+0000","last_became_active":"2024-09-22T08:17:40.307776+0000","last_became_peered":"2024-09-22T08:17:40.307776+0000","last_unstale":"2024-09-22T09:16:21.486420+0000","last_undegraded":"2024-09-22T09:16:21.486420+0000","last_fullsized":"2024-09-22T09:16:21.486420+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-22T09:16:21.486318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.486318+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:58.331269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3195,"num_read_kb":2955,"num_write":764,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'402","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.939126+0000","last_change":"2024-09-22T09:16:13.939126+0000","last_active":"2024-09-22T09:16:13.939126+0000","last_peered":"2024-09-22T09:16:13.939126+0000","last_clean":"2024-09-22T09:16:13.939126+0000","last_became_active":"2024-09-22T08:17:38.311387+0000","last_became_peered":"2024-09-22T08:17:38.311387+0000","last_unstale":"2024-09-22T09:16:13.939126+0000","last_undegraded":"2024-09-22T09:16:13.939126+0000","last_fullsized":"2024-09-22T09:16:13.939126+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:13.938974+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.938974+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:23.382523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311674,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":20769,"num_write":1109,"num_write_kb":41674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'1042","reported_seq":2592,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.481044+0000","last_change":"2024-09-22T09:16:22.481044+0000","last_active":"2024-09-22T09:16:22.481044+0000","last_peered":"2024-09-22T09:16:22.481044+0000","last_clean":"2024-09-22T09:16:22.481044+0000","last_became_active":"2024-09-22T08:17:40.316168+0000","last_became_peered":"2024-09-22T08:17:40.316168+0000","last_unstale":"2024-09-22T09:16:22.481044+0000","last_undegraded":"2024-09-22T09:16:22.481044+0000","last_fullsized":"2024-09-22T09:16:22.481044+0000","mapping_epoch":27,"log_start":"261'1000","ondisk_log_start":"261'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1042","last_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_deep_scrub":"261'1042","last_deep_scrub_stamp":"2024-09-22T09:16:22.480948+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.480948+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:22.317236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4914,"num_read_kb":4285,"num_write":1501,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'329","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.515526+0000","last_change":"2024-09-22T09:16:14.515526+0000","last_active":"2024-09-22T09:16:14.515526+0000","last_peered":"2024-09-22T09:16:14.515526+0000","last_clean":"2024-09-22T09:16:14.515526+0000","last_became_active":"2024-09-22T08:17:38.301525+0000","last_became_peered":"2024-09-22T08:17:38.301525+0000","last_unstale":"2024-09-22T09:16:14.515526+0000","last_undegraded":"2024-09-22T09:16:14.515526+0000","last_fullsized":"2024-09-22T09:16:14.515526+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:14.515318+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.515318+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:36.695819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":9376,"num_write":1029,"num_write_kb":17390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'497","reported_seq":2098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.940307+0000","last_change":"2024-09-22T09:16:22.940307+0000","last_active":"2024-09-22T09:16:22.940307+0000","last_peered":"2024-09-22T09:16:22.940307+0000","last_clean":"2024-09-22T09:16:22.940307+0000","last_became_active":"2024-09-22T08:17:40.318006+0000","last_became_peered":"2024-09-22T08:17:40.318006+0000","last_unstale":"2024-09-22T09:16:22.940307+0000","last_undegraded":"2024-09-22T09:16:22.940307+0000","last_fullsized":"2024-09-22T09:16:22.940307+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'497","last_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_deep_scrub":"261'497","last_deep_scrub_stamp":"2024-09-22T09:16:22.940226+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.940226+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:57.523147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2852,"num_read_kb":2657,"num_write":669,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'376","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.716405+0000","last_change":"2024-09-22T09:16:20.716405+0000","last_active":"2024-09-22T09:16:20.716405+0000","last_peered":"2024-09-22T09:16:20.716405+0000","last_clean":"2024-09-22T09:16:20.716405+0000","last_became_active":"2024-09-22T08:17:38.311816+0000","last_became_peered":"2024-09-22T08:17:38.311816+0000","last_unstale":"2024-09-22T09:16:20.716405+0000","last_undegraded":"2024-09-22T09:16:20.716405+0000","last_fullsized":"2024-09-22T09:16:20.716405+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:20.716279+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.716279+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:58:27.920378+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":772,"num_read_kb":32992,"num_write":1092,"num_write_kb":32086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'641","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.692287+0000","last_change":"2024-09-22T09:16:31.692287+0000","last_active":"2024-09-22T09:16:31.692287+0000","last_peered":"2024-09-22T09:16:31.692287+0000","last_clean":"2024-09-22T09:16:31.692287+0000","last_became_active":"2024-09-22T08:17:40.319197+0000","last_became_peered":"2024-09-22T08:17:40.319197+0000","last_unstale":"2024-09-22T09:16:31.692287+0000","last_undegraded":"2024-09-22T09:16:31.692287+0000","last_fullsized":"2024-09-22T09:16:31.692287+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'641","last_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_deep_scrub":"261'641","last_deep_scrub_stamp":"2024-09-22T09:16:31.692200+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.692200+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:29.079608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3218,"num_read_kb":2917,"num_write":855,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'403","reported_seq":1992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.153849+0000","last_change":"2024-09-22T09:16:32.153849+0000","last_active":"2024-09-22T09:16:32.153849+0000","last_peered":"2024-09-22T09:16:32.153849+0000","last_clean":"2024-09-22T09:16:32.153849+0000","last_became_active":"2024-09-22T08:17:40.313520+0000","last_became_peered":"2024-09-22T08:17:40.313520+0000","last_unstale":"2024-09-22T09:16:32.153849+0000","last_undegraded":"2024-09-22T09:16:32.153849+0000","last_fullsized":"2024-09-22T09:16:32.153849+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:32.153759+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.153759+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:38.043677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2212,"num_read_kb":2126,"num_write":440,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'303","reported_seq":928,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207647+0000","last_change":"2024-09-22T09:16:13.207647+0000","last_active":"2024-09-22T09:16:13.207647+0000","last_peered":"2024-09-22T09:16:13.207647+0000","last_clean":"2024-09-22T09:16:13.207647+0000","last_became_active":"2024-09-22T08:17:38.303704+0000","last_became_peered":"2024-09-22T08:17:38.303704+0000","last_unstale":"2024-09-22T09:16:13.207647+0000","last_undegraded":"2024-09-22T09:16:13.207647+0000","last_fullsized":"2024-09-22T09:16:13.207647+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:13.207542+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.207542+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:43.122476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947307,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":25983,"num_write":980,"num_write_kb":37088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'394","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.525921+0000","last_change":"2024-09-22T09:16:20.525921+0000","last_active":"2024-09-22T09:16:20.525921+0000","last_peered":"2024-09-22T09:16:20.525921+0000","last_clean":"2024-09-22T09:16:20.525921+0000","last_became_active":"2024-09-22T08:17:40.314150+0000","last_became_peered":"2024-09-22T08:17:40.314150+0000","last_unstale":"2024-09-22T09:16:20.525921+0000","last_undegraded":"2024-09-22T09:16:20.525921+0000","last_fullsized":"2024-09-22T09:16:20.525921+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'394","last_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_deep_scrub":"261'394","last_deep_scrub_stamp":"2024-09-22T09:16:20.525816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.525816+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:17.576244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2127,"num_read_kb":2043,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'287","reported_seq":876,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.499416+0000","last_change":"2024-09-22T09:16:13.499416+0000","last_active":"2024-09-22T09:16:13.499416+0000","last_peered":"2024-09-22T09:16:13.499416+0000","last_clean":"2024-09-22T09:16:13.499416+0000","last_became_active":"2024-09-22T08:17:38.308080+0000","last_became_peered":"2024-09-22T08:17:38.308080+0000","last_unstale":"2024-09-22T09:16:13.499416+0000","last_undegraded":"2024-09-22T09:16:13.499416+0000","last_fullsized":"2024-09-22T09:16:13.499416+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-22T09:16:13.499276+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.499276+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:01.659857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":451,"num_read_kb":1407,"num_write":876,"num_write_kb":18295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'766","reported_seq":2327,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.200824+0000","last_change":"2024-09-22T09:16:19.200824+0000","last_active":"2024-09-22T09:16:19.200824+0000","last_peered":"2024-09-22T09:16:19.200824+0000","last_clean":"2024-09-22T09:16:19.200824+0000","last_became_active":"2024-09-22T08:17:40.313715+0000","last_became_peered":"2024-09-22T08:17:40.313715+0000","last_unstale":"2024-09-22T09:16:19.200824+0000","last_undegraded":"2024-09-22T09:16:19.200824+0000","last_fullsized":"2024-09-22T09:16:19.200824+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'766","last_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_deep_scrub":"261'766","last_deep_scrub_stamp":"2024-09-22T09:16:19.200744+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.200744+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:48.695705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3696,"num_read_kb":3352,"num_write":1008,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'305","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.529861+0000","last_change":"2024-09-22T09:16:11.529861+0000","last_active":"2024-09-22T09:16:11.529861+0000","last_peered":"2024-09-22T09:16:11.529861+0000","last_clean":"2024-09-22T09:16:11.529861+0000","last_became_active":"2024-09-22T08:17:38.303766+0000","last_became_peered":"2024-09-22T08:17:38.303766+0000","last_unstale":"2024-09-22T09:16:11.529861+0000","last_undegraded":"2024-09-22T09:16:11.529861+0000","last_fullsized":"2024-09-22T09:16:11.529861+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-22T09:16:11.529676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.529676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:25.488246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":542,"num_read_kb":31210,"num_write":1028,"num_write_kb":11363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'771","reported_seq":2408,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.151660+0000","last_change":"2024-09-22T09:16:22.151660+0000","last_active":"2024-09-22T09:16:22.151660+0000","last_peered":"2024-09-22T09:16:22.151660+0000","last_clean":"2024-09-22T09:16:22.151660+0000","last_became_active":"2024-09-22T08:17:40.320617+0000","last_became_peered":"2024-09-22T08:17:40.320617+0000","last_unstale":"2024-09-22T09:16:22.151660+0000","last_undegraded":"2024-09-22T09:16:22.151660+0000","last_fullsized":"2024-09-22T09:16:22.151660+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'771","last_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_deep_scrub":"261'771","last_deep_scrub_stamp":"2024-09-22T09:16:22.151579+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.151579+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:32:39.550280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3904,"num_read_kb":3560,"num_write":1001,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1777,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'326","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.538362+0000","last_change":"2024-09-22T09:16:12.538362+0000","last_active":"2024-09-22T09:16:12.538362+0000","last_peered":"2024-09-22T09:16:12.538362+0000","last_clean":"2024-09-22T09:16:12.538362+0000","last_became_active":"2024-09-22T08:17:38.302745+0000","last_became_peered":"2024-09-22T08:17:38.302745+0000","last_unstale":"2024-09-22T09:16:12.538362+0000","last_undegraded":"2024-09-22T09:16:12.538362+0000","last_fullsized":"2024-09-22T09:16:12.538362+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:12.538192+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.538192+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:05:14.191967+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655876,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":639,"num_read_kb":14450,"num_write":1076,"num_write_kb":30916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'831","reported_seq":2361,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.697183+0000","last_change":"2024-09-22T09:16:30.697183+0000","last_active":"2024-09-22T09:16:30.697183+0000","last_peered":"2024-09-22T09:16:30.697183+0000","last_clean":"2024-09-22T09:16:30.697183+0000","last_became_active":"2024-09-22T08:17:40.319159+0000","last_became_peered":"2024-09-22T08:17:40.319159+0000","last_unstale":"2024-09-22T09:16:30.697183+0000","last_undegraded":"2024-09-22T09:16:30.697183+0000","last_fullsized":"2024-09-22T09:16:30.697183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:30.697081+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.697081+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:28.453426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3968,"num_read_kb":3566,"num_write":1120,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'352","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.247778+0000","last_change":"2024-09-22T09:16:14.247778+0000","last_active":"2024-09-22T09:16:14.247778+0000","last_peered":"2024-09-22T09:16:14.247778+0000","last_clean":"2024-09-22T09:16:14.247778+0000","last_became_active":"2024-09-22T08:17:38.301241+0000","last_became_peered":"2024-09-22T08:17:38.301241+0000","last_unstale":"2024-09-22T09:16:14.247778+0000","last_undegraded":"2024-09-22T09:16:14.247778+0000","last_fullsized":"2024-09-22T09:16:14.247778+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:14.247594+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.247594+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:36.776380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1523,"num_write":1216,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'583","reported_seq":2209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.184302+0000","last_change":"2024-09-22T09:16:20.184302+0000","last_active":"2024-09-22T09:16:20.184302+0000","last_peered":"2024-09-22T09:16:20.184302+0000","last_clean":"2024-09-22T09:16:20.184302+0000","last_became_active":"2024-09-22T08:17:40.305942+0000","last_became_peered":"2024-09-22T08:17:40.305942+0000","last_unstale":"2024-09-22T09:16:20.184302+0000","last_undegraded":"2024-09-22T09:16:20.184302+0000","last_fullsized":"2024-09-22T09:16:20.184302+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'583","last_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_deep_scrub":"261'583","last_deep_scrub_stamp":"2024-09-22T09:16:20.184210+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.184210+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:24.340294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2914,"num_read_kb":2675,"num_write":717,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1226,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'419","reported_seq":1094,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.209011+0000","last_change":"2024-09-22T09:16:17.209011+0000","last_active":"2024-09-22T09:16:17.209011+0000","last_peered":"2024-09-22T09:16:17.209011+0000","last_clean":"2024-09-22T09:16:17.209011+0000","last_became_active":"2024-09-22T08:17:38.296989+0000","last_became_peered":"2024-09-22T08:17:38.296989+0000","last_unstale":"2024-09-22T09:16:17.209011+0000","last_undegraded":"2024-09-22T09:16:17.209011+0000","last_fullsized":"2024-09-22T09:16:17.209011+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-22T09:16:17.208816+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.208816+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:49.867009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":782,"num_read_kb":14779,"num_write":1492,"num_write_kb":30334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'123","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.600494+0000","last_change":"2024-09-22T09:16:33.600494+0000","last_active":"2024-09-22T09:16:33.600494+0000","last_peered":"2024-09-22T09:16:33.600494+0000","last_clean":"2024-09-22T09:16:33.600494+0000","last_became_active":"2024-09-22T08:17:48.369297+0000","last_became_peered":"2024-09-22T08:17:48.369297+0000","last_unstale":"2024-09-22T09:16:33.600494+0000","last_undegraded":"2024-09-22T09:16:33.600494+0000","last_fullsized":"2024-09-22T09:16:33.600494+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:33.600393+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.600393+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:39.719506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":189,"num_write":282,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'998","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.196121+0000","last_change":"2024-09-22T09:16:21.196121+0000","last_active":"2024-09-22T09:16:21.196121+0000","last_peered":"2024-09-22T09:16:21.196121+0000","last_clean":"2024-09-22T09:16:21.196121+0000","last_became_active":"2024-09-22T08:17:40.315958+0000","last_became_peered":"2024-09-22T08:17:40.315958+0000","last_unstale":"2024-09-22T09:16:21.196121+0000","last_undegraded":"2024-09-22T09:16:21.196121+0000","last_fullsized":"2024-09-22T09:16:21.196121+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'998","last_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_deep_scrub":"261'998","last_deep_scrub_stamp":"2024-09-22T09:16:21.196028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.196028+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:20.279066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5089,"num_read_kb":4532,"num_write":1395,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'370","reported_seq":1248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.233157+0000","last_change":"2024-09-22T09:16:16.233157+0000","last_active":"2024-09-22T09:16:16.233157+0000","last_peered":"2024-09-22T09:16:16.233157+0000","last_clean":"2024-09-22T09:16:16.233157+0000","last_became_active":"2024-09-22T08:17:38.317766+0000","last_became_peered":"2024-09-22T08:17:38.317766+0000","last_unstale":"2024-09-22T09:16:16.233157+0000","last_undegraded":"2024-09-22T09:16:16.233157+0000","last_fullsized":"2024-09-22T09:16:16.233157+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'370","last_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_deep_scrub":"261'370","last_deep_scrub_stamp":"2024-09-22T09:16:16.233008+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.233008+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:54.584470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1344,"num_read_kb":67744,"num_write":1254,"num_write_kb":35831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.036882+0000","last_change":"2024-09-22T09:16:39.036882+0000","last_active":"2024-09-22T09:16:39.036882+0000","last_peered":"2024-09-22T09:16:39.036882+0000","last_clean":"2024-09-22T09:16:39.036882+0000","last_became_active":"2024-09-22T08:17:42.313032+0000","last_became_peered":"2024-09-22T08:17:42.313032+0000","last_unstale":"2024-09-22T09:16:39.036882+0000","last_undegraded":"2024-09-22T09:16:39.036882+0000","last_fullsized":"2024-09-22T09:16:39.036882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.036799+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.036799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:34:43.889677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'349","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.645001+0000","last_change":"2024-09-22T09:16:36.645001+0000","last_active":"2024-09-22T09:16:36.645001+0000","last_peered":"2024-09-22T09:16:36.645001+0000","last_clean":"2024-09-22T09:16:36.645001+0000","last_became_active":"2024-09-22T08:17:44.340052+0000","last_became_peered":"2024-09-22T08:17:44.340052+0000","last_unstale":"2024-09-22T09:16:36.645001+0000","last_undegraded":"2024-09-22T09:16:36.645001+0000","last_fullsized":"2024-09-22T09:16:36.645001+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-22T09:16:36.644903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.644903+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.282957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1201,"num_write":446,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.193051+0000","last_change":"2024-09-22T09:16:34.193051+0000","last_active":"2024-09-22T09:16:34.193051+0000","last_peered":"2024-09-22T09:16:34.193051+0000","last_clean":"2024-09-22T09:16:34.193051+0000","last_became_active":"2024-09-22T08:17:46.352119+0000","last_became_peered":"2024-09-22T08:17:46.352119+0000","last_unstale":"2024-09-22T09:16:34.193051+0000","last_undegraded":"2024-09-22T09:16:34.193051+0000","last_fullsized":"2024-09-22T09:16:34.193051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:34.192958+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.192958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:59:01.619450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'150","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.205571+0000","last_change":"2024-09-22T09:16:37.205571+0000","last_active":"2024-09-22T09:16:37.205571+0000","last_peered":"2024-09-22T09:16:37.205571+0000","last_clean":"2024-09-22T09:16:37.205571+0000","last_became_active":"2024-09-22T08:17:48.369204+0000","last_became_peered":"2024-09-22T08:17:48.369204+0000","last_unstale":"2024-09-22T09:16:37.205571+0000","last_undegraded":"2024-09-22T09:16:37.205571+0000","last_fullsized":"2024-09-22T09:16:37.205571+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'150","last_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_deep_scrub":"261'150","last_deep_scrub_stamp":"2024-09-22T09:16:37.205475+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.205475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:37.338187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":230,"num_write":369,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'467","reported_seq":2137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.208019+0000","last_change":"2024-09-22T09:16:29.208019+0000","last_active":"2024-09-22T09:16:29.208019+0000","last_peered":"2024-09-22T09:16:29.208019+0000","last_clean":"2024-09-22T09:16:29.208019+0000","last_became_active":"2024-09-22T08:17:40.312287+0000","last_became_peered":"2024-09-22T08:17:40.312287+0000","last_unstale":"2024-09-22T09:16:29.208019+0000","last_undegraded":"2024-09-22T09:16:29.208019+0000","last_fullsized":"2024-09-22T09:16:29.208019+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:29.207926+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.207926+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:14:10.096936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2585,"num_read_kb":2452,"num_write":535,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'376","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.202024+0000","last_change":"2024-09-22T09:16:15.202024+0000","last_active":"2024-09-22T09:16:15.202024+0000","last_peered":"2024-09-22T09:16:15.202024+0000","last_clean":"2024-09-22T09:16:15.202024+0000","last_became_active":"2024-09-22T08:17:38.302020+0000","last_became_peered":"2024-09-22T08:17:38.302020+0000","last_unstale":"2024-09-22T09:16:15.202024+0000","last_undegraded":"2024-09-22T09:16:15.202024+0000","last_fullsized":"2024-09-22T09:16:15.202024+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'376","last_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_deep_scrub":"261'376","last_deep_scrub_stamp":"2024-09-22T09:16:15.201907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.201907+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:52.431996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":649,"num_read_kb":11781,"num_write":1236,"num_write_kb":42693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.676949+0000","last_change":"2024-09-22T09:16:28.676949+0000","last_active":"2024-09-22T09:16:28.676949+0000","last_peered":"2024-09-22T09:16:28.676949+0000","last_clean":"2024-09-22T09:16:28.676949+0000","last_became_active":"2024-09-22T08:17:42.314605+0000","last_became_peered":"2024-09-22T08:17:42.314605+0000","last_unstale":"2024-09-22T09:16:28.676949+0000","last_undegraded":"2024-09-22T09:16:28.676949+0000","last_fullsized":"2024-09-22T09:16:28.676949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.676822+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.676822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:02.194477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'92","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.189670+0000","last_change":"2024-09-22T09:16:30.189670+0000","last_active":"2024-09-22T09:16:30.189670+0000","last_peered":"2024-09-22T09:16:30.189670+0000","last_clean":"2024-09-22T09:16:30.189670+0000","last_became_active":"2024-09-22T08:17:44.340017+0000","last_became_peered":"2024-09-22T08:17:44.340017+0000","last_unstale":"2024-09-22T09:16:30.189670+0000","last_undegraded":"2024-09-22T09:16:30.189670+0000","last_fullsized":"2024-09-22T09:16:30.189670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-22T09:16:30.189584+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.189584+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:48.517209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":95,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.189325+0000","last_change":"2024-09-22T09:16:33.189325+0000","last_active":"2024-09-22T09:16:33.189325+0000","last_peered":"2024-09-22T09:16:33.189325+0000","last_clean":"2024-09-22T09:16:33.189325+0000","last_became_active":"2024-09-22T08:17:46.351604+0000","last_became_peered":"2024-09-22T08:17:46.351604+0000","last_unstale":"2024-09-22T09:16:33.189325+0000","last_undegraded":"2024-09-22T09:16:33.189325+0000","last_fullsized":"2024-09-22T09:16:33.189325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.189234+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.189234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:09.142849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'142","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.315990+0000","last_change":"2024-09-22T09:16:36.315990+0000","last_active":"2024-09-22T09:16:36.315990+0000","last_peered":"2024-09-22T09:16:36.315990+0000","last_clean":"2024-09-22T09:16:36.315990+0000","last_became_active":"2024-09-22T08:17:48.367431+0000","last_became_peered":"2024-09-22T08:17:48.367431+0000","last_unstale":"2024-09-22T09:16:36.315990+0000","last_undegraded":"2024-09-22T09:16:36.315990+0000","last_fullsized":"2024-09-22T09:16:36.315990+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:36.315902+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.315902+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:30.170908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":238,"num_read_kb":222,"num_write":335,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.695681+0000","last_change":"2024-09-22T09:16:26.695681+0000","last_active":"2024-09-22T09:16:26.695681+0000","last_peered":"2024-09-22T09:16:26.695681+0000","last_clean":"2024-09-22T09:16:26.695681+0000","last_became_active":"2024-09-22T08:17:40.317529+0000","last_became_peered":"2024-09-22T08:17:40.317529+0000","last_unstale":"2024-09-22T09:16:26.695681+0000","last_undegraded":"2024-09-22T09:16:26.695681+0000","last_fullsized":"2024-09-22T09:16:26.695681+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-22T09:16:26.695595+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.695595+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:50:56.527592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2563,"num_read_kb":2443,"num_write":488,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'316","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.273692+0000","last_change":"2024-09-22T09:16:18.273692+0000","last_active":"2024-09-22T09:16:18.273692+0000","last_peered":"2024-09-22T09:16:18.273692+0000","last_clean":"2024-09-22T09:16:18.273692+0000","last_became_active":"2024-09-22T08:17:38.317157+0000","last_became_peered":"2024-09-22T08:17:38.317157+0000","last_unstale":"2024-09-22T09:16:18.273692+0000","last_undegraded":"2024-09-22T09:16:18.273692+0000","last_fullsized":"2024-09-22T09:16:18.273692+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'316","last_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_deep_scrub":"261'316","last_deep_scrub_stamp":"2024-09-22T09:16:18.273530+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.273530+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:43.936947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":672,"num_read_kb":483,"num_write":1016,"num_write_kb":17021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676439+0000","last_change":"2024-09-22T09:16:29.676439+0000","last_active":"2024-09-22T09:16:29.676439+0000","last_peered":"2024-09-22T09:16:29.676439+0000","last_clean":"2024-09-22T09:16:29.676439+0000","last_became_active":"2024-09-22T08:17:42.318355+0000","last_became_peered":"2024-09-22T08:17:42.318355+0000","last_unstale":"2024-09-22T09:16:29.676439+0000","last_undegraded":"2024-09-22T09:16:29.676439+0000","last_fullsized":"2024-09-22T09:16:29.676439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676358+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:03.918455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'127","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.660505+0000","last_change":"2024-09-22T09:16:35.660505+0000","last_active":"2024-09-22T09:16:35.660505+0000","last_peered":"2024-09-22T09:16:35.660505+0000","last_clean":"2024-09-22T09:16:35.660505+0000","last_became_active":"2024-09-22T08:17:44.337449+0000","last_became_peered":"2024-09-22T08:17:44.337449+0000","last_unstale":"2024-09-22T09:16:35.660505+0000","last_undegraded":"2024-09-22T09:16:35.660505+0000","last_fullsized":"2024-09-22T09:16:35.660505+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-22T09:16:35.660394+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.660394+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:18.158723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'795","reported_seq":2576,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:50.054726+0000","last_change":"2024-09-22T09:16:50.054726+0000","last_active":"2024-09-22T09:16:50.054726+0000","last_peered":"2024-09-22T09:16:50.054726+0000","last_clean":"2024-09-22T09:16:50.054726+0000","last_became_active":"2024-09-22T08:17:46.353389+0000","last_became_peered":"2024-09-22T08:17:46.353389+0000","last_unstale":"2024-09-22T09:16:50.054726+0000","last_undegraded":"2024-09-22T09:16:50.054726+0000","last_fullsized":"2024-09-22T09:16:50.054726+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-22T09:16:50.054645+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-22T09:16:50.054645+0000","last_clean_scrub_stamp":"2024-09-22T09:16:50.054645+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:54.934659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'185","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.906240+0000","last_change":"2024-09-22T09:16:34.906240+0000","last_active":"2024-09-22T09:16:34.906240+0000","last_peered":"2024-09-22T09:16:34.906240+0000","last_clean":"2024-09-22T09:16:34.906240+0000","last_became_active":"2024-09-22T08:17:48.367802+0000","last_became_peered":"2024-09-22T08:17:48.367802+0000","last_unstale":"2024-09-22T09:16:34.906240+0000","last_undegraded":"2024-09-22T09:16:34.906240+0000","last_fullsized":"2024-09-22T09:16:34.906240+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'185","last_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_deep_scrub":"261'185","last_deep_scrub_stamp":"2024-09-22T09:16:34.906160+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.906160+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:25:30.698172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":600,"num_write":385,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'510","reported_seq":2224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.721488+0000","last_change":"2024-09-22T09:16:27.721488+0000","last_active":"2024-09-22T09:16:27.721488+0000","last_peered":"2024-09-22T09:16:27.721488+0000","last_clean":"2024-09-22T09:16:27.721488+0000","last_became_active":"2024-09-22T08:17:40.319212+0000","last_became_peered":"2024-09-22T08:17:40.319212+0000","last_unstale":"2024-09-22T09:16:27.721488+0000","last_undegraded":"2024-09-22T09:16:27.721488+0000","last_fullsized":"2024-09-22T09:16:27.721488+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:27.721372+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.721372+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:34.833972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2929,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'402","reported_seq":1071,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.110814+0000","last_change":"2024-09-22T09:16:09.110814+0000","last_active":"2024-09-22T09:16:09.110814+0000","last_peered":"2024-09-22T09:16:09.110814+0000","last_clean":"2024-09-22T09:16:09.110814+0000","last_became_active":"2024-09-22T08:17:38.304702+0000","last_became_peered":"2024-09-22T08:17:38.304702+0000","last_unstale":"2024-09-22T09:16:09.110814+0000","last_undegraded":"2024-09-22T09:16:09.110814+0000","last_fullsized":"2024-09-22T09:16:09.110814+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-22T09:16:09.110739+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.110739+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:11.343495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":777,"num_read_kb":8421,"num_write":1262,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.036919+0000","last_change":"2024-09-22T09:16:40.036919+0000","last_active":"2024-09-22T09:16:40.036919+0000","last_peered":"2024-09-22T09:16:40.036919+0000","last_clean":"2024-09-22T09:16:40.036919+0000","last_became_active":"2024-09-22T08:17:42.314614+0000","last_became_peered":"2024-09-22T08:17:42.314614+0000","last_unstale":"2024-09-22T09:16:40.036919+0000","last_undegraded":"2024-09-22T09:16:40.036919+0000","last_fullsized":"2024-09-22T09:16:40.036919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.036819+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.036819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:53.136015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'298","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.992797+0000","last_change":"2024-09-22T09:16:26.992797+0000","last_active":"2024-09-22T09:16:26.992797+0000","last_peered":"2024-09-22T09:16:26.992797+0000","last_clean":"2024-09-22T09:16:26.992797+0000","last_became_active":"2024-09-22T08:17:44.330714+0000","last_became_peered":"2024-09-22T08:17:44.330714+0000","last_unstale":"2024-09-22T09:16:26.992797+0000","last_undegraded":"2024-09-22T09:16:26.992797+0000","last_fullsized":"2024-09-22T09:16:26.992797+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-22T09:16:26.992702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.992702+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:45.241158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":1172,"num_write":406,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'815","reported_seq":2616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.839128+0000","last_change":"2024-09-22T09:16:41.839128+0000","last_active":"2024-09-22T09:16:41.839128+0000","last_peered":"2024-09-22T09:16:41.839128+0000","last_clean":"2024-09-22T09:16:41.839128+0000","last_became_active":"2024-09-22T08:17:46.353992+0000","last_became_peered":"2024-09-22T08:17:46.353992+0000","last_unstale":"2024-09-22T09:16:41.839128+0000","last_undegraded":"2024-09-22T09:16:41.839128+0000","last_fullsized":"2024-09-22T09:16:41.839128+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:41.839029+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.839029+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:42:06.512324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'412","reported_seq":1974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.254280+0000","last_change":"2024-09-22T09:16:25.254280+0000","last_active":"2024-09-22T09:16:25.254280+0000","last_peered":"2024-09-22T09:16:25.254280+0000","last_clean":"2024-09-22T09:16:25.254280+0000","last_became_active":"2024-09-22T08:17:40.312312+0000","last_became_peered":"2024-09-22T08:17:40.312312+0000","last_unstale":"2024-09-22T09:16:25.254280+0000","last_undegraded":"2024-09-22T09:16:25.254280+0000","last_fullsized":"2024-09-22T09:16:25.254280+0000","mapping_epoch":27,"log_start":"261'401","ondisk_log_start":"261'401","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'412","last_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_deep_scrub":"261'412","last_deep_scrub_stamp":"2024-09-22T09:16:25.254178+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.254178+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:55.621599+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2266,"num_read_kb":2158,"num_write":453,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'375","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.571610+0000","last_change":"2024-09-22T09:16:10.571562+0000","last_active":"2024-09-22T09:16:10.571610+0000","last_peered":"2024-09-22T09:16:10.571610+0000","last_clean":"2024-09-22T09:16:10.571610+0000","last_became_active":"2024-09-22T08:17:38.306856+0000","last_became_peered":"2024-09-22T08:17:38.306856+0000","last_unstale":"2024-09-22T09:16:10.571610+0000","last_undegraded":"2024-09-22T09:16:10.571610+0000","last_fullsized":"2024-09-22T09:16:10.571610+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-22T09:16:10.571456+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.571456+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:35.266733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":44787,"num_write":1101,"num_write_kb":29781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.216317+0000","last_change":"2024-09-22T09:16:23.216317+0000","last_active":"2024-09-22T09:16:23.216317+0000","last_peered":"2024-09-22T09:16:23.216317+0000","last_clean":"2024-09-22T09:16:23.216317+0000","last_became_active":"2024-09-22T08:17:42.318361+0000","last_became_peered":"2024-09-22T08:17:42.318361+0000","last_unstale":"2024-09-22T09:16:23.216317+0000","last_undegraded":"2024-09-22T09:16:23.216317+0000","last_fullsized":"2024-09-22T09:16:23.216317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.216231+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.216231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:44.267586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'360","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.587861+0000","last_change":"2024-09-22T09:16:27.587861+0000","last_active":"2024-09-22T09:16:27.587861+0000","last_peered":"2024-09-22T09:16:27.587861+0000","last_clean":"2024-09-22T09:16:27.587861+0000","last_became_active":"2024-09-22T08:17:44.337221+0000","last_became_peered":"2024-09-22T08:17:44.337221+0000","last_unstale":"2024-09-22T09:16:27.587861+0000","last_undegraded":"2024-09-22T09:16:27.587861+0000","last_fullsized":"2024-09-22T09:16:27.587861+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'360","last_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_deep_scrub":"261'360","last_deep_scrub_stamp":"2024-09-22T09:16:27.587755+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.587755+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:54.278181+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":1166,"num_write":444,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.254294+0000","last_change":"2024-09-22T09:16:33.254294+0000","last_active":"2024-09-22T09:16:33.254294+0000","last_peered":"2024-09-22T09:16:33.254294+0000","last_clean":"2024-09-22T09:16:33.254294+0000","last_became_active":"2024-09-22T08:17:46.352370+0000","last_became_peered":"2024-09-22T08:17:46.352370+0000","last_unstale":"2024-09-22T09:16:33.254294+0000","last_undegraded":"2024-09-22T09:16:33.254294+0000","last_fullsized":"2024-09-22T09:16:33.254294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.254209+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.254209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:27.817340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'561","reported_seq":1381,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.918170+0000","last_change":"2024-09-22T09:16:33.918170+0000","last_active":"2024-09-22T09:16:33.918170+0000","last_peered":"2024-09-22T09:16:33.918170+0000","last_clean":"2024-09-22T09:16:33.918170+0000","last_became_active":"2024-09-22T08:17:48.367228+0000","last_became_peered":"2024-09-22T08:17:48.367228+0000","last_unstale":"2024-09-22T09:16:33.918170+0000","last_undegraded":"2024-09-22T09:16:33.918170+0000","last_fullsized":"2024-09-22T09:16:33.918170+0000","mapping_epoch":35,"log_start":"261'500","ondisk_log_start":"261'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'561","last_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_deep_scrub":"261'561","last_deep_scrub_stamp":"2024-09-22T09:16:33.918083+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.918083+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:22.619736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1344,"num_read_kb":1335,"num_write":1159,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'825","reported_seq":2462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.195453+0000","last_change":"2024-09-22T09:16:14.195453+0000","last_active":"2024-09-22T09:16:14.195453+0000","last_peered":"2024-09-22T09:16:14.195453+0000","last_clean":"2024-09-22T09:16:14.195453+0000","last_became_active":"2024-09-22T08:17:40.312851+0000","last_became_peered":"2024-09-22T08:17:40.312851+0000","last_unstale":"2024-09-22T09:16:14.195453+0000","last_undegraded":"2024-09-22T09:16:14.195453+0000","last_fullsized":"2024-09-22T09:16:14.195453+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'825","last_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_deep_scrub":"261'825","last_deep_scrub_stamp":"2024-09-22T09:16:14.195374+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.195374+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:30.730771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4056,"num_read_kb":3661,"num_write":1081,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'359","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.848770+0000","last_change":"2024-09-22T09:16:08.848770+0000","last_active":"2024-09-22T09:16:08.848770+0000","last_peered":"2024-09-22T09:16:08.848770+0000","last_clean":"2024-09-22T09:16:08.848770+0000","last_became_active":"2024-09-22T08:17:38.306356+0000","last_became_peered":"2024-09-22T08:17:38.306356+0000","last_unstale":"2024-09-22T09:16:08.848770+0000","last_undegraded":"2024-09-22T09:16:08.848770+0000","last_fullsized":"2024-09-22T09:16:08.848770+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-22T09:16:08.848662+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.848662+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:01.073654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":29046,"num_write":1024,"num_write_kb":36962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.183966+0000","last_change":"2024-09-22T09:16:25.183966+0000","last_active":"2024-09-22T09:16:25.183966+0000","last_peered":"2024-09-22T09:16:25.183966+0000","last_clean":"2024-09-22T09:16:25.183966+0000","last_became_active":"2024-09-22T08:17:42.311972+0000","last_became_peered":"2024-09-22T08:17:42.311972+0000","last_unstale":"2024-09-22T09:16:25.183966+0000","last_undegraded":"2024-09-22T09:16:25.183966+0000","last_fullsized":"2024-09-22T09:16:25.183966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.183868+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.183868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:41.982899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.660025+0000","last_change":"2024-09-22T09:16:33.660025+0000","last_active":"2024-09-22T09:16:33.660025+0000","last_peered":"2024-09-22T09:16:33.660025+0000","last_clean":"2024-09-22T09:16:33.660025+0000","last_became_active":"2024-09-22T08:17:44.340863+0000","last_became_peered":"2024-09-22T08:17:44.340863+0000","last_unstale":"2024-09-22T09:16:33.660025+0000","last_undegraded":"2024-09-22T09:16:33.660025+0000","last_fullsized":"2024-09-22T09:16:33.660025+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-22T09:16:33.659907+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.659907+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:31:49.474414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45093,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":1000,"num_write":352,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.573049+0000","last_change":"2024-09-22T09:16:40.573049+0000","last_active":"2024-09-22T09:16:40.573049+0000","last_peered":"2024-09-22T09:16:40.573049+0000","last_clean":"2024-09-22T09:16:40.573049+0000","last_became_active":"2024-09-22T08:17:46.353202+0000","last_became_peered":"2024-09-22T08:17:46.353202+0000","last_unstale":"2024-09-22T09:16:40.573049+0000","last_undegraded":"2024-09-22T09:16:40.573049+0000","last_fullsized":"2024-09-22T09:16:40.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.572966+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.572966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:43.876946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2491","reported_seq":4326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.158050+0000","last_change":"2024-09-22T09:16:35.158050+0000","last_active":"2024-09-22T09:16:35.158050+0000","last_peered":"2024-09-22T09:16:35.158050+0000","last_clean":"2024-09-22T09:16:35.158050+0000","last_became_active":"2024-09-22T08:17:48.369837+0000","last_became_peered":"2024-09-22T08:17:48.369837+0000","last_unstale":"2024-09-22T09:16:35.158050+0000","last_undegraded":"2024-09-22T09:16:35.158050+0000","last_fullsized":"2024-09-22T09:16:35.158050+0000","mapping_epoch":35,"log_start":"261'2400","ondisk_log_start":"261'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2491","last_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_deep_scrub":"261'2491","last_deep_scrub_stamp":"2024-09-22T09:16:35.157954+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.157954+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:48.968960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6259,"num_read_kb":6252,"num_write":5027,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'409","reported_seq":1963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.934530+0000","last_change":"2024-09-22T09:16:16.934474+0000","last_active":"2024-09-22T09:16:16.934530+0000","last_peered":"2024-09-22T09:16:16.934530+0000","last_clean":"2024-09-22T09:16:16.934530+0000","last_became_active":"2024-09-22T08:17:40.317750+0000","last_became_peered":"2024-09-22T08:17:40.317750+0000","last_unstale":"2024-09-22T09:16:16.934530+0000","last_undegraded":"2024-09-22T09:16:16.934530+0000","last_fullsized":"2024-09-22T09:16:16.934530+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-22T09:16:16.934388+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.934388+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:53.392109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2383,"num_read_kb":2270,"num_write":468,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'366","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.276481+0000","last_change":"2024-09-22T09:16:17.276481+0000","last_active":"2024-09-22T09:16:17.276481+0000","last_peered":"2024-09-22T09:16:17.276481+0000","last_clean":"2024-09-22T09:16:17.276481+0000","last_became_active":"2024-09-22T08:17:38.308335+0000","last_became_peered":"2024-09-22T08:17:38.308335+0000","last_unstale":"2024-09-22T09:16:17.276481+0000","last_undegraded":"2024-09-22T09:16:17.276481+0000","last_fullsized":"2024-09-22T09:16:17.276481+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-22T09:16:17.276321+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.276321+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:57.728982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":639,"num_read_kb":70122,"num_write":1105,"num_write_kb":42930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.640762+0000","last_change":"2024-09-22T09:16:32.640762+0000","last_active":"2024-09-22T09:16:32.640762+0000","last_peered":"2024-09-22T09:16:32.640762+0000","last_clean":"2024-09-22T09:16:32.640762+0000","last_became_active":"2024-09-22T08:17:42.319238+0000","last_became_peered":"2024-09-22T08:17:42.319238+0000","last_unstale":"2024-09-22T09:16:32.640762+0000","last_undegraded":"2024-09-22T09:16:32.640762+0000","last_fullsized":"2024-09-22T09:16:32.640762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.640677+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.640677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:25.874693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'365","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.102662+0000","last_change":"2024-09-22T09:16:43.102662+0000","last_active":"2024-09-22T09:16:43.102662+0000","last_peered":"2024-09-22T09:16:43.102662+0000","last_clean":"2024-09-22T09:16:43.102662+0000","last_became_active":"2024-09-22T08:17:44.337361+0000","last_became_peered":"2024-09-22T08:17:44.337361+0000","last_unstale":"2024-09-22T09:16:43.102662+0000","last_undegraded":"2024-09-22T09:16:43.102662+0000","last_fullsized":"2024-09-22T09:16:43.102662+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-22T09:16:43.102571+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.102571+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:22.471531+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53521,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1278,"num_write":480,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'815","reported_seq":4742,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.775015+0000","last_change":"2024-09-22T09:16:39.775015+0000","last_active":"2024-09-22T09:16:39.775015+0000","last_peered":"2024-09-22T09:16:39.775015+0000","last_clean":"2024-09-22T09:16:39.775015+0000","last_became_active":"2024-09-22T08:17:46.356659+0000","last_became_peered":"2024-09-22T08:17:46.356659+0000","last_unstale":"2024-09-22T09:16:39.775015+0000","last_undegraded":"2024-09-22T09:16:39.775015+0000","last_fullsized":"2024-09-22T09:16:39.775015+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:39.774931+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.774931+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:55:35.874772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'123","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.264089+0000","last_change":"2024-09-22T09:16:35.264089+0000","last_active":"2024-09-22T09:16:35.264089+0000","last_peered":"2024-09-22T09:16:35.264089+0000","last_clean":"2024-09-22T09:16:35.264089+0000","last_became_active":"2024-09-22T08:17:48.365836+0000","last_became_peered":"2024-09-22T08:17:48.365836+0000","last_unstale":"2024-09-22T09:16:35.264089+0000","last_undegraded":"2024-09-22T09:16:35.264089+0000","last_fullsized":"2024-09-22T09:16:35.264089+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-22T09:16:35.263984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.263984+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:43.868350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1008,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'1208","reported_seq":2873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.713666+0000","last_change":"2024-09-22T09:16:24.713666+0000","last_active":"2024-09-22T09:16:24.713666+0000","last_peered":"2024-09-22T09:16:24.713666+0000","last_clean":"2024-09-22T09:16:24.713666+0000","last_became_active":"2024-09-22T08:17:40.315564+0000","last_became_peered":"2024-09-22T08:17:40.315564+0000","last_unstale":"2024-09-22T09:16:24.713666+0000","last_undegraded":"2024-09-22T09:16:24.713666+0000","last_fullsized":"2024-09-22T09:16:24.713666+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1208","last_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_deep_scrub":"261'1208","last_deep_scrub_stamp":"2024-09-22T09:16:24.713578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.713578+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:01.700381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5580,"num_read_kb":4947,"num_write":1654,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'358","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:07.592091+0000","last_change":"2024-09-22T09:16:07.591997+0000","last_active":"2024-09-22T09:16:07.592091+0000","last_peered":"2024-09-22T09:16:07.592091+0000","last_clean":"2024-09-22T09:16:07.592091+0000","last_became_active":"2024-09-22T08:17:38.299638+0000","last_became_peered":"2024-09-22T08:17:38.299638+0000","last_unstale":"2024-09-22T09:16:07.592091+0000","last_undegraded":"2024-09-22T09:16:07.592091+0000","last_fullsized":"2024-09-22T09:16:07.592091+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-22T09:16:07.591858+0000","last_clean_scrub_stamp":"2024-09-22T09:16:07.591858+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:25.904081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":651,"num_read_kb":2439,"num_write":1161,"num_write_kb":39849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.192204+0000","last_change":"2024-09-22T09:16:24.192204+0000","last_active":"2024-09-22T09:16:24.192204+0000","last_peered":"2024-09-22T09:16:24.192204+0000","last_clean":"2024-09-22T09:16:24.192204+0000","last_became_active":"2024-09-22T08:17:42.313402+0000","last_became_peered":"2024-09-22T08:17:42.313402+0000","last_unstale":"2024-09-22T09:16:24.192204+0000","last_undegraded":"2024-09-22T09:16:24.192204+0000","last_fullsized":"2024-09-22T09:16:24.192204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.192115+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.192115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:19.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'503","reported_seq":1142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.613309+0000","last_change":"2024-09-22T09:16:32.613309+0000","last_active":"2024-09-22T09:16:32.613309+0000","last_peered":"2024-09-22T09:16:32.613309+0000","last_clean":"2024-09-22T09:16:32.613309+0000","last_became_active":"2024-09-22T08:17:44.340072+0000","last_became_peered":"2024-09-22T08:17:44.340072+0000","last_unstale":"2024-09-22T09:16:32.613309+0000","last_undegraded":"2024-09-22T09:16:32.613309+0000","last_fullsized":"2024-09-22T09:16:32.613309+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'503","last_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_deep_scrub":"261'503","last_deep_scrub_stamp":"2024-09-22T09:16:32.613214+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.613214+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:23.175984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":879,"num_read_kb":2151,"num_write":728,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.774927+0000","last_change":"2024-09-22T09:16:37.774927+0000","last_active":"2024-09-22T09:16:37.774927+0000","last_peered":"2024-09-22T09:16:37.774927+0000","last_clean":"2024-09-22T09:16:37.774927+0000","last_became_active":"2024-09-22T08:17:46.349575+0000","last_became_peered":"2024-09-22T08:17:46.349575+0000","last_unstale":"2024-09-22T09:16:37.774927+0000","last_undegraded":"2024-09-22T09:16:37.774927+0000","last_fullsized":"2024-09-22T09:16:37.774927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.774829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.774829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:35.076905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'133","reported_seq":635,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.813243+0000","last_change":"2024-09-22T09:16:32.813243+0000","last_active":"2024-09-22T09:16:32.813243+0000","last_peered":"2024-09-22T09:16:32.813243+0000","last_clean":"2024-09-22T09:16:32.813243+0000","last_became_active":"2024-09-22T08:17:48.367808+0000","last_became_peered":"2024-09-22T08:17:48.367808+0000","last_unstale":"2024-09-22T09:16:32.813243+0000","last_undegraded":"2024-09-22T09:16:32.813243+0000","last_fullsized":"2024-09-22T09:16:32.813243+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'133","last_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_deep_scrub":"261'133","last_deep_scrub_stamp":"2024-09-22T09:16:32.813146+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.813146+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:05.926213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":153,"num_write":281,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'866","reported_seq":2525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.443183+0000","last_change":"2024-09-22T09:16:17.443183+0000","last_active":"2024-09-22T09:16:17.443183+0000","last_peered":"2024-09-22T09:16:17.443183+0000","last_clean":"2024-09-22T09:16:17.443183+0000","last_became_active":"2024-09-22T08:17:40.315269+0000","last_became_peered":"2024-09-22T08:17:40.315269+0000","last_unstale":"2024-09-22T09:16:17.443183+0000","last_undegraded":"2024-09-22T09:16:17.443183+0000","last_fullsized":"2024-09-22T09:16:17.443183+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'866","last_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_deep_scrub":"261'866","last_deep_scrub_stamp":"2024-09-22T09:16:17.443086+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.443086+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:08.368887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4298,"num_read_kb":3886,"num_write":1143,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'403","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.839046+0000","last_change":"2024-09-22T09:16:11.839046+0000","last_active":"2024-09-22T09:16:11.839046+0000","last_peered":"2024-09-22T09:16:11.839046+0000","last_clean":"2024-09-22T09:16:11.839046+0000","last_became_active":"2024-09-22T08:17:38.301424+0000","last_became_peered":"2024-09-22T08:17:38.301424+0000","last_unstale":"2024-09-22T09:16:11.839046+0000","last_undegraded":"2024-09-22T09:16:11.839046+0000","last_fullsized":"2024-09-22T09:16:11.839046+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-22T09:16:11.838921+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.838921+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:56:29.399743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":12203,"num_write":1274,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.688842+0000","last_change":"2024-09-22T09:16:24.688842+0000","last_active":"2024-09-22T09:16:24.688842+0000","last_peered":"2024-09-22T09:16:24.688842+0000","last_clean":"2024-09-22T09:16:24.688842+0000","last_became_active":"2024-09-22T08:17:42.317444+0000","last_became_peered":"2024-09-22T08:17:42.317444+0000","last_unstale":"2024-09-22T09:16:24.688842+0000","last_undegraded":"2024-09-22T09:16:24.688842+0000","last_fullsized":"2024-09-22T09:16:24.688842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.688752+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.688752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:06.256561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'307","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.144583+0000","last_change":"2024-09-22T09:16:28.144583+0000","last_active":"2024-09-22T09:16:28.144583+0000","last_peered":"2024-09-22T09:16:28.144583+0000","last_clean":"2024-09-22T09:16:28.144583+0000","last_became_active":"2024-09-22T08:17:44.340079+0000","last_became_peered":"2024-09-22T08:17:44.340079+0000","last_unstale":"2024-09-22T09:16:28.144583+0000","last_undegraded":"2024-09-22T09:16:28.144583+0000","last_fullsized":"2024-09-22T09:16:28.144583+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-22T09:16:28.144472+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.144472+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:57.321893+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48624,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":466,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.679467+0000","last_change":"2024-09-22T09:16:28.679467+0000","last_active":"2024-09-22T09:16:28.679467+0000","last_peered":"2024-09-22T09:16:28.679467+0000","last_clean":"2024-09-22T09:16:28.679467+0000","last_became_active":"2024-09-22T08:17:46.357451+0000","last_became_peered":"2024-09-22T08:17:46.357451+0000","last_unstale":"2024-09-22T09:16:28.679467+0000","last_undegraded":"2024-09-22T09:16:28.679467+0000","last_fullsized":"2024-09-22T09:16:28.679467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:28.679355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.679355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:11.686705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'180","reported_seq":672,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.814844+0000","last_change":"2024-09-22T09:16:42.814844+0000","last_active":"2024-09-22T09:16:42.814844+0000","last_peered":"2024-09-22T09:16:42.814844+0000","last_clean":"2024-09-22T09:16:42.814844+0000","last_became_active":"2024-09-22T08:17:48.368904+0000","last_became_peered":"2024-09-22T08:17:48.368904+0000","last_unstale":"2024-09-22T09:16:42.814844+0000","last_undegraded":"2024-09-22T09:16:42.814844+0000","last_fullsized":"2024-09-22T09:16:42.814844+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'180","last_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_deep_scrub":"261'180","last_deep_scrub_stamp":"2024-09-22T09:16:42.814757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.814757+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:44.221228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":385,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'372","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.170508+0000","last_change":"2024-09-22T09:16:28.170508+0000","last_active":"2024-09-22T09:16:28.170508+0000","last_peered":"2024-09-22T09:16:28.170508+0000","last_clean":"2024-09-22T09:16:28.170508+0000","last_became_active":"2024-09-22T08:17:40.317712+0000","last_became_peered":"2024-09-22T08:17:40.317712+0000","last_unstale":"2024-09-22T09:16:28.170508+0000","last_undegraded":"2024-09-22T09:16:28.170508+0000","last_fullsized":"2024-09-22T09:16:28.170508+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:28.170412+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.170412+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:09.100145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2017,"num_read_kb":1941,"num_write":406,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'472","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.207139+0000","last_change":"2024-09-22T09:16:13.207072+0000","last_active":"2024-09-22T09:16:13.207139+0000","last_peered":"2024-09-22T09:16:13.207139+0000","last_clean":"2024-09-22T09:16:13.207139+0000","last_became_active":"2024-09-22T08:17:38.322386+0000","last_became_peered":"2024-09-22T08:17:38.322386+0000","last_unstale":"2024-09-22T09:16:13.207139+0000","last_undegraded":"2024-09-22T09:16:13.207139+0000","last_fullsized":"2024-09-22T09:16:13.207139+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'472","last_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_deep_scrub":"261'472","last_deep_scrub_stamp":"2024-09-22T09:16:13.206750+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.206750+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:12.619430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311644,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1051,"num_read_kb":33703,"num_write":1406,"num_write_kb":44486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.683650+0000","last_change":"2024-09-22T09:16:33.683650+0000","last_active":"2024-09-22T09:16:33.683650+0000","last_peered":"2024-09-22T09:16:33.683650+0000","last_clean":"2024-09-22T09:16:33.683650+0000","last_became_active":"2024-09-22T08:17:42.317251+0000","last_became_peered":"2024-09-22T08:17:42.317251+0000","last_unstale":"2024-09-22T09:16:33.683650+0000","last_undegraded":"2024-09-22T09:16:33.683650+0000","last_fullsized":"2024-09-22T09:16:33.683650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:33.683559+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.683559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:32.388730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'325","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.757279+0000","last_change":"2024-09-22T09:16:35.757279+0000","last_active":"2024-09-22T09:16:35.757279+0000","last_peered":"2024-09-22T09:16:35.757279+0000","last_clean":"2024-09-22T09:16:35.757279+0000","last_became_active":"2024-09-22T08:17:44.331169+0000","last_became_peered":"2024-09-22T08:17:44.331169+0000","last_unstale":"2024-09-22T09:16:35.757279+0000","last_undegraded":"2024-09-22T09:16:35.757279+0000","last_fullsized":"2024-09-22T09:16:35.757279+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:35.757181+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.757181+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:28:50.937583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50318,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":1151,"num_write":418,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'795","reported_seq":4278,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.686198+0000","last_change":"2024-09-22T09:16:27.686198+0000","last_active":"2024-09-22T09:16:27.686198+0000","last_peered":"2024-09-22T09:16:27.686198+0000","last_clean":"2024-09-22T09:16:27.686198+0000","last_became_active":"2024-09-22T08:17:46.353129+0000","last_became_peered":"2024-09-22T08:17:46.353129+0000","last_unstale":"2024-09-22T09:16:27.686198+0000","last_undegraded":"2024-09-22T09:16:27.686198+0000","last_fullsized":"2024-09-22T09:16:27.686198+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-22T09:16:27.686099+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.686099+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:44.296879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'144","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.217813+0000","last_change":"2024-09-22T09:16:34.217813+0000","last_active":"2024-09-22T09:16:34.217813+0000","last_peered":"2024-09-22T09:16:34.217813+0000","last_clean":"2024-09-22T09:16:34.217813+0000","last_became_active":"2024-09-22T08:17:48.367975+0000","last_became_peered":"2024-09-22T08:17:48.367975+0000","last_unstale":"2024-09-22T09:16:34.217813+0000","last_undegraded":"2024-09-22T09:16:34.217813+0000","last_fullsized":"2024-09-22T09:16:34.217813+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'144","last_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_deep_scrub":"261'144","last_deep_scrub_stamp":"2024-09-22T09:16:34.217722+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.217722+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:34:32.109666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":210,"num_write":365,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'507","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.890344+0000","last_change":"2024-09-22T09:16:17.890344+0000","last_active":"2024-09-22T09:16:17.890344+0000","last_peered":"2024-09-22T09:16:17.890344+0000","last_clean":"2024-09-22T09:16:17.890344+0000","last_became_active":"2024-09-22T08:17:40.319422+0000","last_became_peered":"2024-09-22T08:17:40.319422+0000","last_unstale":"2024-09-22T09:16:17.890344+0000","last_undegraded":"2024-09-22T09:16:17.890344+0000","last_fullsized":"2024-09-22T09:16:17.890344+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'507","last_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_deep_scrub":"261'507","last_deep_scrub_stamp":"2024-09-22T09:16:17.890235+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.890235+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:42.972286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2691,"num_write":566,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'323","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.215100+0000","last_change":"2024-09-22T09:16:15.215100+0000","last_active":"2024-09-22T09:16:15.215100+0000","last_peered":"2024-09-22T09:16:15.215100+0000","last_clean":"2024-09-22T09:16:15.215100+0000","last_became_active":"2024-09-22T08:17:38.304339+0000","last_became_peered":"2024-09-22T08:17:38.304339+0000","last_unstale":"2024-09-22T09:16:15.215100+0000","last_undegraded":"2024-09-22T09:16:15.215100+0000","last_fullsized":"2024-09-22T09:16:15.215100+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:15.214985+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.214985+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:13.621351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":25990,"num_write":923,"num_write_kb":15970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1465,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.267481+0000","last_change":"2024-09-22T09:16:24.267481+0000","last_active":"2024-09-22T09:16:24.267481+0000","last_peered":"2024-09-22T09:16:24.267481+0000","last_clean":"2024-09-22T09:16:24.267481+0000","last_became_active":"2024-09-22T08:17:42.319119+0000","last_became_peered":"2024-09-22T08:17:42.319119+0000","last_unstale":"2024-09-22T09:16:24.267481+0000","last_undegraded":"2024-09-22T09:16:24.267481+0000","last_fullsized":"2024-09-22T09:16:24.267481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.267396+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.267396+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:47:33.710111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'85","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.236549+0000","last_change":"2024-09-22T09:16:28.236549+0000","last_active":"2024-09-22T09:16:28.236549+0000","last_peered":"2024-09-22T09:16:28.236549+0000","last_clean":"2024-09-22T09:16:28.236549+0000","last_became_active":"2024-09-22T08:17:44.340338+0000","last_became_peered":"2024-09-22T08:17:44.340338+0000","last_unstale":"2024-09-22T09:16:28.236549+0000","last_undegraded":"2024-09-22T09:16:28.236549+0000","last_fullsized":"2024-09-22T09:16:28.236549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-22T09:16:28.236453+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.236453+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:10.057889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'784","reported_seq":2577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.169047+0000","last_change":"2024-09-22T09:16:31.169047+0000","last_active":"2024-09-22T09:16:31.169047+0000","last_peered":"2024-09-22T09:16:31.169047+0000","last_clean":"2024-09-22T09:16:31.169047+0000","last_became_active":"2024-09-22T08:17:46.355886+0000","last_became_peered":"2024-09-22T08:17:46.355886+0000","last_unstale":"2024-09-22T09:16:31.169047+0000","last_undegraded":"2024-09-22T09:16:31.169047+0000","last_fullsized":"2024-09-22T09:16:31.169047+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:31.168981+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.168981+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:33.186208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'111","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.922582+0000","last_change":"2024-09-22T09:16:32.922582+0000","last_active":"2024-09-22T09:16:32.922582+0000","last_peered":"2024-09-22T09:16:32.922582+0000","last_clean":"2024-09-22T09:16:32.922582+0000","last_became_active":"2024-09-22T08:17:48.366068+0000","last_became_peered":"2024-09-22T08:17:48.366068+0000","last_unstale":"2024-09-22T09:16:32.922582+0000","last_undegraded":"2024-09-22T09:16:32.922582+0000","last_fullsized":"2024-09-22T09:16:32.922582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'111","last_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_deep_scrub":"261'111","last_deep_scrub_stamp":"2024-09-22T09:16:32.922490+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.922490+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:09.185881+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'1180","reported_seq":2769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.786239+0000","last_change":"2024-09-22T09:16:14.786187+0000","last_active":"2024-09-22T09:16:14.786239+0000","last_peered":"2024-09-22T09:16:14.786239+0000","last_clean":"2024-09-22T09:16:14.786239+0000","last_became_active":"2024-09-22T08:17:40.315905+0000","last_became_peered":"2024-09-22T08:17:40.315905+0000","last_unstale":"2024-09-22T09:16:14.786239+0000","last_undegraded":"2024-09-22T09:16:14.786239+0000","last_fullsized":"2024-09-22T09:16:14.786239+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1180","last_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_deep_scrub":"261'1180","last_deep_scrub_stamp":"2024-09-22T09:16:14.786101+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.786101+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:54.467939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5551,"num_read_kb":4934,"num_write":1646,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'437","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.777822+0000","last_change":"2024-09-22T09:16:12.777822+0000","last_active":"2024-09-22T09:16:12.777822+0000","last_peered":"2024-09-22T09:16:12.777822+0000","last_clean":"2024-09-22T09:16:12.777822+0000","last_became_active":"2024-09-22T08:17:38.307623+0000","last_became_peered":"2024-09-22T08:17:38.307623+0000","last_unstale":"2024-09-22T09:16:12.777822+0000","last_undegraded":"2024-09-22T09:16:12.777822+0000","last_fullsized":"2024-09-22T09:16:12.777822+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'437","last_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_deep_scrub":"261'437","last_deep_scrub_stamp":"2024-09-22T09:16:12.777701+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.777701+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:43.034360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":819,"num_read_kb":19795,"num_write":1316,"num_write_kb":49231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.057672+0000","last_change":"2024-09-22T09:16:38.057672+0000","last_active":"2024-09-22T09:16:38.057672+0000","last_peered":"2024-09-22T09:16:38.057672+0000","last_clean":"2024-09-22T09:16:38.057672+0000","last_became_active":"2024-09-22T08:17:42.312947+0000","last_became_peered":"2024-09-22T08:17:42.312947+0000","last_unstale":"2024-09-22T09:16:38.057672+0000","last_undegraded":"2024-09-22T09:16:38.057672+0000","last_fullsized":"2024-09-22T09:16:38.057672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.057570+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.057570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:45.412670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'367","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.190390+0000","last_change":"2024-09-22T09:16:27.190390+0000","last_active":"2024-09-22T09:16:27.190390+0000","last_peered":"2024-09-22T09:16:27.190390+0000","last_clean":"2024-09-22T09:16:27.190390+0000","last_became_active":"2024-09-22T08:17:44.340028+0000","last_became_peered":"2024-09-22T08:17:44.340028+0000","last_unstale":"2024-09-22T09:16:27.190390+0000","last_undegraded":"2024-09-22T09:16:27.190390+0000","last_fullsized":"2024-09-22T09:16:27.190390+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-22T09:16:27.190267+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.190267+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:44.961351+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1221,"num_write":462,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.969489+0000","last_change":"2024-09-22T09:16:29.969489+0000","last_active":"2024-09-22T09:16:29.969489+0000","last_peered":"2024-09-22T09:16:29.969489+0000","last_clean":"2024-09-22T09:16:29.969489+0000","last_became_active":"2024-09-22T08:17:46.346297+0000","last_became_peered":"2024-09-22T08:17:46.346297+0000","last_unstale":"2024-09-22T09:16:29.969489+0000","last_undegraded":"2024-09-22T09:16:29.969489+0000","last_fullsized":"2024-09-22T09:16:29.969489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.969406+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.969406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:51.421775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'176","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:33.824926+0000","last_change":"2024-09-22T09:16:33.824926+0000","last_active":"2024-09-22T09:16:33.824926+0000","last_peered":"2024-09-22T09:16:33.824926+0000","last_clean":"2024-09-22T09:16:33.824926+0000","last_became_active":"2024-09-22T08:17:48.365723+0000","last_became_peered":"2024-09-22T08:17:48.365723+0000","last_unstale":"2024-09-22T09:16:33.824926+0000","last_undegraded":"2024-09-22T09:16:33.824926+0000","last_fullsized":"2024-09-22T09:16:33.824926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'176","last_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_deep_scrub":"261'176","last_deep_scrub_stamp":"2024-09-22T09:16:33.824818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:33.824818+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:04.659434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":347,"num_write":422,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'899","reported_seq":2557,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.219147+0000","last_change":"2024-09-22T09:16:26.219147+0000","last_active":"2024-09-22T09:16:26.219147+0000","last_peered":"2024-09-22T09:16:26.219147+0000","last_clean":"2024-09-22T09:16:26.219147+0000","last_became_active":"2024-09-22T08:17:40.314945+0000","last_became_peered":"2024-09-22T08:17:40.314945+0000","last_unstale":"2024-09-22T09:16:26.219147+0000","last_undegraded":"2024-09-22T09:16:26.219147+0000","last_fullsized":"2024-09-22T09:16:26.219147+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'899","last_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_deep_scrub":"261'899","last_deep_scrub_stamp":"2024-09-22T09:16:26.219043+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.219043+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:44.422572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4458,"num_read_kb":4002,"num_write":1198,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3769,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.146833+0000","last_change":"2024-09-22T09:16:08.146779+0000","last_active":"2024-09-22T09:16:08.146833+0000","last_peered":"2024-09-22T09:16:08.146833+0000","last_clean":"2024-09-22T09:16:08.146833+0000","last_became_active":"2024-09-22T08:17:19.065923+0000","last_became_peered":"2024-09-22T08:17:19.065923+0000","last_unstale":"2024-09-22T09:16:08.146833+0000","last_undegraded":"2024-09-22T09:16:08.146833+0000","last_fullsized":"2024-09-22T09:16:08.146833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-22T09:16:08.146708+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.146708+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:12.109321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.130511+0000","last_change":"2024-09-22T09:16:11.130511+0000","last_active":"2024-09-22T09:16:11.130511+0000","last_peered":"2024-09-22T09:16:11.130511+0000","last_clean":"2024-09-22T09:16:11.130511+0000","last_became_active":"2024-09-22T08:17:25.236434+0000","last_became_peered":"2024-09-22T08:17:25.236434+0000","last_unstale":"2024-09-22T09:16:11.130511+0000","last_undegraded":"2024-09-22T09:16:11.130511+0000","last_fullsized":"2024-09-22T09:16:11.130511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:11.130438+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.130438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:05.095794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00053394200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.804878+0000","last_change":"2024-09-22T09:16:09.804878+0000","last_active":"2024-09-22T09:16:09.804878+0000","last_peered":"2024-09-22T09:16:09.804878+0000","last_clean":"2024-09-22T09:16:09.804878+0000","last_became_active":"2024-09-22T08:17:38.309998+0000","last_became_peered":"2024-09-22T08:17:38.309998+0000","last_unstale":"2024-09-22T09:16:09.804878+0000","last_undegraded":"2024-09-22T09:16:09.804878+0000","last_fullsized":"2024-09-22T09:16:09.804878+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-22T09:16:09.804702+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.804702+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:57.406186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655877,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":613,"num_read_kb":39972,"num_write":1027,"num_write_kb":38404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.508606+0000","last_change":"2024-09-22T09:16:23.508606+0000","last_active":"2024-09-22T09:16:23.508606+0000","last_peered":"2024-09-22T09:16:23.508606+0000","last_clean":"2024-09-22T09:16:23.508606+0000","last_became_active":"2024-09-22T08:17:42.318719+0000","last_became_peered":"2024-09-22T08:17:42.318719+0000","last_unstale":"2024-09-22T09:16:23.508606+0000","last_undegraded":"2024-09-22T09:16:23.508606+0000","last_fullsized":"2024-09-22T09:16:23.508606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.508510+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.508510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:25.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'748","reported_seq":1453,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.058576+0000","last_change":"2024-09-22T09:16:42.058576+0000","last_active":"2024-09-22T09:16:42.058576+0000","last_peered":"2024-09-22T09:16:42.058576+0000","last_clean":"2024-09-22T09:16:42.058576+0000","last_became_active":"2024-09-22T08:17:44.340257+0000","last_became_peered":"2024-09-22T08:17:44.340257+0000","last_unstale":"2024-09-22T09:16:42.058576+0000","last_undegraded":"2024-09-22T09:16:42.058576+0000","last_fullsized":"2024-09-22T09:16:42.058576+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'748","last_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_deep_scrub":"261'748","last_deep_scrub_stamp":"2024-09-22T09:16:42.058458+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.058458+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:12.275343+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133117,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1419,"num_read_kb":3139,"num_write":1374,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106794,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.814431+0000","last_change":"2024-09-22T09:16:38.814431+0000","last_active":"2024-09-22T09:16:38.814431+0000","last_peered":"2024-09-22T09:16:38.814431+0000","last_clean":"2024-09-22T09:16:38.814431+0000","last_became_active":"2024-09-22T08:17:46.350424+0000","last_became_peered":"2024-09-22T08:17:46.350424+0000","last_unstale":"2024-09-22T09:16:38.814431+0000","last_undegraded":"2024-09-22T09:16:38.814431+0000","last_fullsized":"2024-09-22T09:16:38.814431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.814353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.814353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:07.223791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'207","reported_seq":911,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.553926+0000","last_change":"2024-09-22T09:16:31.553926+0000","last_active":"2024-09-22T09:16:31.553926+0000","last_peered":"2024-09-22T09:16:31.553926+0000","last_clean":"2024-09-22T09:16:31.553926+0000","last_became_active":"2024-09-22T08:17:48.371101+0000","last_became_peered":"2024-09-22T08:17:48.371101+0000","last_unstale":"2024-09-22T09:16:31.553926+0000","last_undegraded":"2024-09-22T09:16:31.553926+0000","last_fullsized":"2024-09-22T09:16:31.553926+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'207","last_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_deep_scrub":"261'207","last_deep_scrub_stamp":"2024-09-22T09:16:31.553843+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.553843+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:22.975099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":510,"num_write":441,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'882","reported_seq":2477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.696665+0000","last_change":"2024-09-22T09:16:23.696665+0000","last_active":"2024-09-22T09:16:23.696665+0000","last_peered":"2024-09-22T09:16:23.696665+0000","last_clean":"2024-09-22T09:16:23.696665+0000","last_became_active":"2024-09-22T08:17:40.317776+0000","last_became_peered":"2024-09-22T08:17:40.317776+0000","last_unstale":"2024-09-22T09:16:23.696665+0000","last_undegraded":"2024-09-22T09:16:23.696665+0000","last_fullsized":"2024-09-22T09:16:23.696665+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'882","last_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_deep_scrub":"261'882","last_deep_scrub_stamp":"2024-09-22T09:16:23.696577+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.696577+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:38.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4255,"num_read_kb":3803,"num_write":1224,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.103337+0000","last_change":"2024-09-22T09:16:09.103337+0000","last_active":"2024-09-22T09:16:09.103337+0000","last_peered":"2024-09-22T09:16:09.103337+0000","last_clean":"2024-09-22T09:16:09.103337+0000","last_became_active":"2024-09-22T08:17:25.230597+0000","last_became_peered":"2024-09-22T08:17:25.230597+0000","last_unstale":"2024-09-22T09:16:09.103337+0000","last_undegraded":"2024-09-22T09:16:09.103337+0000","last_fullsized":"2024-09-22T09:16:09.103337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:09.103256+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.103256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:48.650934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001211375,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'335","reported_seq":956,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.221035+0000","last_change":"2024-09-22T09:16:10.221035+0000","last_active":"2024-09-22T09:16:10.221035+0000","last_peered":"2024-09-22T09:16:10.221035+0000","last_clean":"2024-09-22T09:16:10.221035+0000","last_became_active":"2024-09-22T08:17:38.308658+0000","last_became_peered":"2024-09-22T08:17:38.308658+0000","last_unstale":"2024-09-22T09:16:10.221035+0000","last_undegraded":"2024-09-22T09:16:10.221035+0000","last_fullsized":"2024-09-22T09:16:10.221035+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'335","last_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_deep_scrub":"261'335","last_deep_scrub_stamp":"2024-09-22T09:16:10.220912+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.220912+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:01.000745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":6730,"num_write":1066,"num_write_kb":34396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.032114+0000","last_change":"2024-09-22T09:16:36.032114+0000","last_active":"2024-09-22T09:16:36.032114+0000","last_peered":"2024-09-22T09:16:36.032114+0000","last_clean":"2024-09-22T09:16:36.032114+0000","last_became_active":"2024-09-22T08:17:42.319688+0000","last_became_peered":"2024-09-22T08:17:42.319688+0000","last_unstale":"2024-09-22T09:16:36.032114+0000","last_undegraded":"2024-09-22T09:16:36.032114+0000","last_fullsized":"2024-09-22T09:16:36.032114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:36.032028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.032028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:58.714746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1343","reported_seq":2972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.741413+0000","last_change":"2024-09-22T09:16:25.741413+0000","last_active":"2024-09-22T09:16:25.741413+0000","last_peered":"2024-09-22T09:16:25.741413+0000","last_clean":"2024-09-22T09:16:25.741413+0000","last_became_active":"2024-09-22T08:17:44.340287+0000","last_became_peered":"2024-09-22T08:17:44.340287+0000","last_unstale":"2024-09-22T09:16:25.741413+0000","last_undegraded":"2024-09-22T09:16:25.741413+0000","last_fullsized":"2024-09-22T09:16:25.741413+0000","mapping_epoch":31,"log_start":"261'1300","ondisk_log_start":"261'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1343","last_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_deep_scrub":"261'1343","last_deep_scrub_stamp":"2024-09-22T09:16:25.741309+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.741309+0000","objects_scrubbed":12,"log_size":43,"log_dups_size":1300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:15.738101+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141570,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3855,"num_write":1170,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.059685+0000","last_change":"2024-09-22T09:16:47.059685+0000","last_active":"2024-09-22T09:16:47.059685+0000","last_peered":"2024-09-22T09:16:47.059685+0000","last_clean":"2024-09-22T09:16:47.059685+0000","last_became_active":"2024-09-22T08:17:46.355279+0000","last_became_peered":"2024-09-22T08:17:46.355279+0000","last_unstale":"2024-09-22T09:16:47.059685+0000","last_undegraded":"2024-09-22T09:16:47.059685+0000","last_fullsized":"2024-09-22T09:16:47.059685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:47.059597+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.059597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:03.787983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'124","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.863516+0000","last_change":"2024-09-22T09:16:43.863516+0000","last_active":"2024-09-22T09:16:43.863516+0000","last_peered":"2024-09-22T09:16:43.863516+0000","last_clean":"2024-09-22T09:16:43.863516+0000","last_became_active":"2024-09-22T08:17:48.368146+0000","last_became_peered":"2024-09-22T08:17:48.368146+0000","last_unstale":"2024-09-22T09:16:43.863516+0000","last_undegraded":"2024-09-22T09:16:43.863516+0000","last_fullsized":"2024-09-22T09:16:43.863516+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:43.863424+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.863424+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:49.790428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":227,"num_write":291,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'467","reported_seq":2081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.232945+0000","last_change":"2024-09-22T09:16:19.232945+0000","last_active":"2024-09-22T09:16:19.232945+0000","last_peered":"2024-09-22T09:16:19.232945+0000","last_clean":"2024-09-22T09:16:19.232945+0000","last_became_active":"2024-09-22T08:17:40.309768+0000","last_became_peered":"2024-09-22T08:17:40.309768+0000","last_unstale":"2024-09-22T09:16:19.232945+0000","last_undegraded":"2024-09-22T09:16:19.232945+0000","last_fullsized":"2024-09-22T09:16:19.232945+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'467","last_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_deep_scrub":"261'467","last_deep_scrub_stamp":"2024-09-22T09:16:19.232833+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.232833+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:17.313258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2744,"num_read_kb":2595,"num_write":590,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.820588+0000","last_change":"2024-09-22T09:16:10.820588+0000","last_active":"2024-09-22T09:16:10.820588+0000","last_peered":"2024-09-22T09:16:10.820588+0000","last_clean":"2024-09-22T09:16:10.820588+0000","last_became_active":"2024-09-22T08:17:25.237084+0000","last_became_peered":"2024-09-22T08:17:25.237084+0000","last_unstale":"2024-09-22T09:16:10.820588+0000","last_undegraded":"2024-09-22T09:16:10.820588+0000","last_fullsized":"2024-09-22T09:16:10.820588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.820505+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.820505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:43.185792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037506600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'324","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.734585+0000","last_change":"2024-09-22T09:16:09.734585+0000","last_active":"2024-09-22T09:16:09.734585+0000","last_peered":"2024-09-22T09:16:09.734585+0000","last_clean":"2024-09-22T09:16:09.734585+0000","last_became_active":"2024-09-22T08:17:38.321390+0000","last_became_peered":"2024-09-22T08:17:38.321390+0000","last_unstale":"2024-09-22T09:16:09.734585+0000","last_undegraded":"2024-09-22T09:16:09.734585+0000","last_fullsized":"2024-09-22T09:16:09.734585+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-22T09:16:09.734427+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.734427+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:44.034840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174880,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":1785,"num_write":1090,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'8","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.725370+0000","last_change":"2024-09-22T09:16:20.725370+0000","last_active":"2024-09-22T09:16:20.725370+0000","last_peered":"2024-09-22T09:16:20.725370+0000","last_clean":"2024-09-22T09:16:20.725370+0000","last_became_active":"2024-09-22T08:17:42.318511+0000","last_became_peered":"2024-09-22T08:17:42.318511+0000","last_unstale":"2024-09-22T09:16:20.725370+0000","last_undegraded":"2024-09-22T09:16:20.725370+0000","last_fullsized":"2024-09-22T09:16:20.725370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-22T09:16:20.725286+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.725286+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:56.727213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'268","reported_seq":1503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.569532+0000","last_change":"2024-09-22T09:16:26.569532+0000","last_active":"2024-09-22T09:16:26.569532+0000","last_peered":"2024-09-22T09:16:26.569532+0000","last_clean":"2024-09-22T09:16:26.569532+0000","last_became_active":"2024-09-22T08:17:44.340189+0000","last_became_peered":"2024-09-22T08:17:44.340189+0000","last_unstale":"2024-09-22T09:16:26.569532+0000","last_undegraded":"2024-09-22T09:16:26.569532+0000","last_fullsized":"2024-09-22T09:16:26.569532+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'268","last_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_deep_scrub":"261'268","last_deep_scrub_stamp":"2024-09-22T09:16:26.569422+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.569422+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:23.239715+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":210,"num_read_kb":202,"num_write":187,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:39.554267+0000","last_change":"2024-09-22T09:16:39.554267+0000","last_active":"2024-09-22T09:16:39.554267+0000","last_peered":"2024-09-22T09:16:39.554267+0000","last_clean":"2024-09-22T09:16:39.554267+0000","last_became_active":"2024-09-22T08:17:46.355257+0000","last_became_peered":"2024-09-22T08:17:46.355257+0000","last_unstale":"2024-09-22T09:16:39.554267+0000","last_undegraded":"2024-09-22T09:16:39.554267+0000","last_fullsized":"2024-09-22T09:16:39.554267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:39.554148+0000","last_clean_scrub_stamp":"2024-09-22T09:16:39.554148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:40.126687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:43.647850+0000","last_change":"2024-09-22T09:16:43.647850+0000","last_active":"2024-09-22T09:16:43.647850+0000","last_peered":"2024-09-22T09:16:43.647850+0000","last_clean":"2024-09-22T09:16:43.647850+0000","last_became_active":"2024-09-22T08:17:48.369955+0000","last_became_peered":"2024-09-22T08:17:48.369955+0000","last_unstale":"2024-09-22T09:16:43.647850+0000","last_undegraded":"2024-09-22T09:16:43.647850+0000","last_fullsized":"2024-09-22T09:16:43.647850+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-22T09:16:43.647767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:43.647767+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:03.889824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":551,"num_write":572,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'776","reported_seq":2214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.202744+0000","last_change":"2024-09-22T09:16:18.202744+0000","last_active":"2024-09-22T09:16:18.202744+0000","last_peered":"2024-09-22T09:16:18.202744+0000","last_clean":"2024-09-22T09:16:18.202744+0000","last_became_active":"2024-09-22T08:17:40.310436+0000","last_became_peered":"2024-09-22T08:17:40.310436+0000","last_unstale":"2024-09-22T09:16:18.202744+0000","last_undegraded":"2024-09-22T09:16:18.202744+0000","last_fullsized":"2024-09-22T09:16:18.202744+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'776","last_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_deep_scrub":"261'776","last_deep_scrub_stamp":"2024-09-22T09:16:18.202607+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.202607+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:20.032816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3698,"num_read_kb":3334,"num_write":1029,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":528,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.098720+0000","last_change":"2024-09-22T09:16:10.098720+0000","last_active":"2024-09-22T09:16:10.098720+0000","last_peered":"2024-09-22T09:16:10.098720+0000","last_clean":"2024-09-22T09:16:10.098720+0000","last_became_active":"2024-09-22T08:17:25.240066+0000","last_became_peered":"2024-09-22T08:17:25.240066+0000","last_unstale":"2024-09-22T09:16:10.098720+0000","last_undegraded":"2024-09-22T09:16:10.098720+0000","last_fullsized":"2024-09-22T09:16:10.098720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-22T09:16:10.098658+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.098658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:32.867298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097377100000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'390","reported_seq":1009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.778066+0000","last_change":"2024-09-22T09:16:13.778005+0000","last_active":"2024-09-22T09:16:13.778066+0000","last_peered":"2024-09-22T09:16:13.778066+0000","last_clean":"2024-09-22T09:16:13.778066+0000","last_became_active":"2024-09-22T08:18:09.819231+0000","last_became_peered":"2024-09-22T08:18:09.819231+0000","last_unstale":"2024-09-22T09:16:13.778066+0000","last_undegraded":"2024-09-22T09:16:13.778066+0000","last_fullsized":"2024-09-22T09:16:13.778066+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'390","last_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_deep_scrub":"261'390","last_deep_scrub_stamp":"2024-09-22T09:16:13.777834+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.777834+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:00.884220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":48326,"num_write":1184,"num_write_kb":45596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4,7],"acting":[5,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.706486+0000","last_change":"2024-09-22T09:16:21.706486+0000","last_active":"2024-09-22T09:16:21.706486+0000","last_peered":"2024-09-22T09:16:21.706486+0000","last_clean":"2024-09-22T09:16:21.706486+0000","last_became_active":"2024-09-22T08:17:42.321010+0000","last_became_peered":"2024-09-22T08:17:42.321010+0000","last_unstale":"2024-09-22T09:16:21.706486+0000","last_undegraded":"2024-09-22T09:16:21.706486+0000","last_fullsized":"2024-09-22T09:16:21.706486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:21.706389+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.706389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:33.368571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'148","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.720118+0000","last_change":"2024-09-22T09:16:34.720118+0000","last_active":"2024-09-22T09:16:34.720118+0000","last_peered":"2024-09-22T09:16:34.720118+0000","last_clean":"2024-09-22T09:16:34.720118+0000","last_became_active":"2024-09-22T08:17:44.338441+0000","last_became_peered":"2024-09-22T08:17:44.338441+0000","last_unstale":"2024-09-22T09:16:34.720118+0000","last_undegraded":"2024-09-22T09:16:34.720118+0000","last_fullsized":"2024-09-22T09:16:34.720118+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'148","last_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_deep_scrub":"261'148","last_deep_scrub_stamp":"2024-09-22T09:16:34.720023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.720023+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:59.789283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":154,"num_write":116,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:48.087919+0000","last_change":"2024-09-22T09:16:48.087919+0000","last_active":"2024-09-22T09:16:48.087919+0000","last_peered":"2024-09-22T09:16:48.087919+0000","last_clean":"2024-09-22T09:16:48.087919+0000","last_became_active":"2024-09-22T08:17:46.350842+0000","last_became_peered":"2024-09-22T08:17:46.350842+0000","last_unstale":"2024-09-22T09:16:48.087919+0000","last_undegraded":"2024-09-22T09:16:48.087919+0000","last_fullsized":"2024-09-22T09:16:48.087919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:48.087798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:48.087798+0000","last_clean_scrub_stamp":"2024-09-22T09:16:48.087798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:48.607073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.154869+0000","last_change":"2024-09-22T09:16:36.154869+0000","last_active":"2024-09-22T09:16:36.154869+0000","last_peered":"2024-09-22T09:16:36.154869+0000","last_clean":"2024-09-22T09:16:36.154869+0000","last_became_active":"2024-09-22T08:17:48.366086+0000","last_became_peered":"2024-09-22T08:17:48.366086+0000","last_unstale":"2024-09-22T09:16:36.154869+0000","last_undegraded":"2024-09-22T09:16:36.154869+0000","last_fullsized":"2024-09-22T09:16:36.154869+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-22T09:16:36.154767+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.154767+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:34.821467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":276,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'373","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.204350+0000","last_change":"2024-09-22T09:16:20.204350+0000","last_active":"2024-09-22T09:16:20.204350+0000","last_peered":"2024-09-22T09:16:20.204350+0000","last_clean":"2024-09-22T09:16:20.204350+0000","last_became_active":"2024-09-22T08:17:40.314136+0000","last_became_peered":"2024-09-22T08:17:40.314136+0000","last_unstale":"2024-09-22T09:16:20.204350+0000","last_undegraded":"2024-09-22T09:16:20.204350+0000","last_fullsized":"2024-09-22T09:16:20.204350+0000","mapping_epoch":27,"log_start":"261'300","ondisk_log_start":"261'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'373","last_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_deep_scrub":"261'373","last_deep_scrub_stamp":"2024-09-22T09:16:20.204251+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.204251+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:02.514748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2317,"num_read_kb":2236,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'389","reported_seq":1095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.883341+0000","last_change":"2024-09-22T09:16:09.883341+0000","last_active":"2024-09-22T09:16:09.883341+0000","last_peered":"2024-09-22T09:16:09.883341+0000","last_clean":"2024-09-22T09:16:09.883341+0000","last_became_active":"2024-09-22T08:17:38.310908+0000","last_became_peered":"2024-09-22T08:17:38.310908+0000","last_unstale":"2024-09-22T09:16:09.883341+0000","last_undegraded":"2024-09-22T09:16:09.883341+0000","last_fullsized":"2024-09-22T09:16:09.883341+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'389","last_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_deep_scrub":"261'389","last_deep_scrub_stamp":"2024-09-22T09:16:09.883202+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.883202+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:38.123770+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6919332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":45053,"num_write":1379,"num_write_kb":38653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.781614+0000","last_change":"2024-09-22T09:16:10.781614+0000","last_active":"2024-09-22T09:16:10.781614+0000","last_peered":"2024-09-22T09:16:10.781614+0000","last_clean":"2024-09-22T09:16:10.781614+0000","last_became_active":"2024-09-22T08:17:25.240110+0000","last_became_peered":"2024-09-22T08:17:25.240110+0000","last_unstale":"2024-09-22T09:16:10.781614+0000","last_undegraded":"2024-09-22T09:16:10.781614+0000","last_fullsized":"2024-09-22T09:16:10.781614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:10.781523+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.781523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:03.872420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041186499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.698988+0000","last_change":"2024-09-22T09:16:26.698988+0000","last_active":"2024-09-22T09:16:26.698988+0000","last_peered":"2024-09-22T09:16:26.698988+0000","last_clean":"2024-09-22T09:16:26.698988+0000","last_became_active":"2024-09-22T08:17:42.315057+0000","last_became_peered":"2024-09-22T08:17:42.315057+0000","last_unstale":"2024-09-22T09:16:26.698988+0000","last_undegraded":"2024-09-22T09:16:26.698988+0000","last_fullsized":"2024-09-22T09:16:26.698988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.698863+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.698863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:05.741525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'596","reported_seq":1264,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.701953+0000","last_change":"2024-09-22T09:16:23.701953+0000","last_active":"2024-09-22T09:16:23.701953+0000","last_peered":"2024-09-22T09:16:23.701953+0000","last_clean":"2024-09-22T09:16:23.701953+0000","last_became_active":"2024-09-22T08:17:44.331664+0000","last_became_peered":"2024-09-22T08:17:44.331664+0000","last_unstale":"2024-09-22T09:16:23.701953+0000","last_undegraded":"2024-09-22T09:16:23.701953+0000","last_fullsized":"2024-09-22T09:16:23.701953+0000","mapping_epoch":31,"log_start":"261'500","ondisk_log_start":"261'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'596","last_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_deep_scrub":"261'596","last_deep_scrub_stamp":"2024-09-22T09:16:23.701817+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.701817+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:20.394276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1681,"num_read_kb":2863,"num_write":2226,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.977574+0000","last_change":"2024-09-22T09:16:27.977574+0000","last_active":"2024-09-22T09:16:27.977574+0000","last_peered":"2024-09-22T09:16:27.977574+0000","last_clean":"2024-09-22T09:16:27.977574+0000","last_became_active":"2024-09-22T08:17:46.352832+0000","last_became_peered":"2024-09-22T08:17:46.352832+0000","last_unstale":"2024-09-22T09:16:27.977574+0000","last_undegraded":"2024-09-22T09:16:27.977574+0000","last_fullsized":"2024-09-22T09:16:27.977574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.977483+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.977483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:36.365474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'132","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.837395+0000","last_change":"2024-09-22T09:16:45.837395+0000","last_active":"2024-09-22T09:16:45.837395+0000","last_peered":"2024-09-22T09:16:45.837395+0000","last_clean":"2024-09-22T09:16:45.837395+0000","last_became_active":"2024-09-22T08:17:48.371548+0000","last_became_peered":"2024-09-22T08:17:48.371548+0000","last_unstale":"2024-09-22T09:16:45.837395+0000","last_undegraded":"2024-09-22T09:16:45.837395+0000","last_fullsized":"2024-09-22T09:16:45.837395+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-22T09:16:45.837304+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.837304+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:39.433815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":165,"num_write":295,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'438","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.211439+0000","last_change":"2024-09-22T09:16:16.211439+0000","last_active":"2024-09-22T09:16:16.211439+0000","last_peered":"2024-09-22T09:16:16.211439+0000","last_clean":"2024-09-22T09:16:16.211439+0000","last_became_active":"2024-09-22T08:17:40.310445+0000","last_became_peered":"2024-09-22T08:17:40.310445+0000","last_unstale":"2024-09-22T09:16:16.211439+0000","last_undegraded":"2024-09-22T09:16:16.211439+0000","last_fullsized":"2024-09-22T09:16:16.211439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'438","last_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_deep_scrub":"261'438","last_deep_scrub_stamp":"2024-09-22T09:16:16.211353+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.211353+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:12.204748+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2556,"num_read_kb":2432,"num_write":506,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'404","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.216484+0000","last_change":"2024-09-22T09:16:11.216484+0000","last_active":"2024-09-22T09:16:11.216484+0000","last_peered":"2024-09-22T09:16:11.216484+0000","last_clean":"2024-09-22T09:16:11.216484+0000","last_became_active":"2024-09-22T08:17:38.314077+0000","last_became_peered":"2024-09-22T08:17:38.314077+0000","last_unstale":"2024-09-22T09:16:11.216484+0000","last_undegraded":"2024-09-22T09:16:11.216484+0000","last_fullsized":"2024-09-22T09:16:11.216484+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-22T09:16:11.216383+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.216383+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:43.556741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":42178,"num_write":1167,"num_write_kb":49907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.243905+0000","last_change":"2024-09-22T09:16:14.243905+0000","last_active":"2024-09-22T09:16:14.243905+0000","last_peered":"2024-09-22T09:16:14.243905+0000","last_clean":"2024-09-22T09:16:14.243905+0000","last_became_active":"2024-09-22T08:17:25.229052+0000","last_became_peered":"2024-09-22T08:17:25.229052+0000","last_unstale":"2024-09-22T09:16:14.243905+0000","last_undegraded":"2024-09-22T09:16:14.243905+0000","last_fullsized":"2024-09-22T09:16:14.243905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:14.243805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.243805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:17.107629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00078860400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"261'4","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.547087+0000","last_change":"2024-09-22T09:16:24.547087+0000","last_active":"2024-09-22T09:16:24.547087+0000","last_peered":"2024-09-22T09:16:24.547087+0000","last_clean":"2024-09-22T09:16:24.547087+0000","last_became_active":"2024-09-22T08:17:42.318756+0000","last_became_peered":"2024-09-22T08:17:42.318756+0000","last_unstale":"2024-09-22T09:16:24.547087+0000","last_undegraded":"2024-09-22T09:16:24.547087+0000","last_fullsized":"2024-09-22T09:16:24.547087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-22T09:16:24.546984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.546984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:06:57.779533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'175","reported_seq":738,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.202111+0000","last_change":"2024-09-22T09:16:27.202111+0000","last_active":"2024-09-22T09:16:27.202111+0000","last_peered":"2024-09-22T09:16:27.202111+0000","last_clean":"2024-09-22T09:16:27.202111+0000","last_became_active":"2024-09-22T08:17:44.337428+0000","last_became_peered":"2024-09-22T08:17:44.337428+0000","last_unstale":"2024-09-22T09:16:27.202111+0000","last_undegraded":"2024-09-22T09:16:27.202111+0000","last_fullsized":"2024-09-22T09:16:27.202111+0000","mapping_epoch":31,"log_start":"258'100","ondisk_log_start":"258'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'175","last_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_deep_scrub":"261'175","last_deep_scrub_stamp":"2024-09-22T09:16:27.202023+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.202023+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:39.841272+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":207,"num_write":140,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'784","reported_seq":2607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.183448+0000","last_change":"2024-09-22T09:16:29.183448+0000","last_active":"2024-09-22T09:16:29.183448+0000","last_peered":"2024-09-22T09:16:29.183448+0000","last_clean":"2024-09-22T09:16:29.183448+0000","last_became_active":"2024-09-22T08:17:46.352650+0000","last_became_peered":"2024-09-22T08:17:46.352650+0000","last_unstale":"2024-09-22T09:16:29.183448+0000","last_undegraded":"2024-09-22T09:16:29.183448+0000","last_fullsized":"2024-09-22T09:16:29.183448+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'784","last_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_deep_scrub":"261'784","last_deep_scrub_stamp":"2024-09-22T09:16:29.183343+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.183343+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:58.686649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'131","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.864391+0000","last_change":"2024-09-22T09:16:34.864391+0000","last_active":"2024-09-22T09:16:34.864391+0000","last_peered":"2024-09-22T09:16:34.864391+0000","last_clean":"2024-09-22T09:16:34.864391+0000","last_became_active":"2024-09-22T08:17:48.370301+0000","last_became_peered":"2024-09-22T08:17:48.370301+0000","last_unstale":"2024-09-22T09:16:34.864391+0000","last_undegraded":"2024-09-22T09:16:34.864391+0000","last_fullsized":"2024-09-22T09:16:34.864391+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-22T09:16:34.864290+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.864290+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:29.499370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":183,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'481","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.772601+0000","last_change":"2024-09-22T09:16:14.772601+0000","last_active":"2024-09-22T09:16:14.772601+0000","last_peered":"2024-09-22T09:16:14.772601+0000","last_clean":"2024-09-22T09:16:14.772601+0000","last_became_active":"2024-09-22T08:17:40.313746+0000","last_became_peered":"2024-09-22T08:17:40.313746+0000","last_unstale":"2024-09-22T09:16:14.772601+0000","last_undegraded":"2024-09-22T09:16:14.772601+0000","last_fullsized":"2024-09-22T09:16:14.772601+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'481","last_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_deep_scrub":"261'481","last_deep_scrub_stamp":"2024-09-22T09:16:14.772519+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.772519+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:51.207310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2409,"num_read_kb":2246,"num_write":532,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'410","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.807161+0000","last_change":"2024-09-22T09:16:11.807161+0000","last_active":"2024-09-22T09:16:11.807161+0000","last_peered":"2024-09-22T09:16:11.807161+0000","last_clean":"2024-09-22T09:16:11.807161+0000","last_became_active":"2024-09-22T08:17:38.301793+0000","last_became_peered":"2024-09-22T08:17:38.301793+0000","last_unstale":"2024-09-22T09:16:11.807161+0000","last_undegraded":"2024-09-22T09:16:11.807161+0000","last_fullsized":"2024-09-22T09:16:11.807161+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'410","last_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_deep_scrub":"261'410","last_deep_scrub_stamp":"2024-09-22T09:16:11.807026+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.807026+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:44.619900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":945,"num_read_kb":43241,"num_write":1287,"num_write_kb":32189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.823207+0000","last_change":"2024-09-22T09:16:08.823207+0000","last_active":"2024-09-22T09:16:08.823207+0000","last_peered":"2024-09-22T09:16:08.823207+0000","last_clean":"2024-09-22T09:16:08.823207+0000","last_became_active":"2024-09-22T08:17:25.236444+0000","last_became_peered":"2024-09-22T08:17:25.236444+0000","last_unstale":"2024-09-22T09:16:08.823207+0000","last_undegraded":"2024-09-22T09:16:08.823207+0000","last_fullsized":"2024-09-22T09:16:08.823207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:08.823085+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.823085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:31.913983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043787399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.075573+0000","last_change":"2024-09-22T09:16:35.075573+0000","last_active":"2024-09-22T09:16:35.075573+0000","last_peered":"2024-09-22T09:16:35.075573+0000","last_clean":"2024-09-22T09:16:35.075573+0000","last_became_active":"2024-09-22T08:17:42.315743+0000","last_became_peered":"2024-09-22T08:17:42.315743+0000","last_unstale":"2024-09-22T09:16:35.075573+0000","last_undegraded":"2024-09-22T09:16:35.075573+0000","last_fullsized":"2024-09-22T09:16:35.075573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:35.075486+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.075486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:16:55.025811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'116","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.036796+0000","last_change":"2024-09-22T09:16:41.036796+0000","last_active":"2024-09-22T09:16:41.036796+0000","last_peered":"2024-09-22T09:16:41.036796+0000","last_clean":"2024-09-22T09:16:41.036796+0000","last_became_active":"2024-09-22T08:17:44.337878+0000","last_became_peered":"2024-09-22T08:17:44.337878+0000","last_unstale":"2024-09-22T09:16:41.036796+0000","last_undegraded":"2024-09-22T09:16:41.036796+0000","last_fullsized":"2024-09-22T09:16:41.036796+0000","mapping_epoch":31,"log_start":"261'100","ondisk_log_start":"261'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-22T09:16:41.036697+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.036697+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:59.620262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'814","reported_seq":2532,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:36.793997+0000","last_change":"2024-09-22T09:16:36.793997+0000","last_active":"2024-09-22T09:16:36.793997+0000","last_peered":"2024-09-22T09:16:36.793997+0000","last_clean":"2024-09-22T09:16:36.793997+0000","last_became_active":"2024-09-22T08:17:46.352078+0000","last_became_peered":"2024-09-22T08:17:46.352078+0000","last_unstale":"2024-09-22T09:16:36.793997+0000","last_undegraded":"2024-09-22T09:16:36.793997+0000","last_fullsized":"2024-09-22T09:16:36.793997+0000","mapping_epoch":33,"log_start":"261'800","ondisk_log_start":"261'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'814","last_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_deep_scrub":"261'814","last_deep_scrub_stamp":"2024-09-22T09:16:36.793904+0000","last_clean_scrub_stamp":"2024-09-22T09:16:36.793904+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:46.387778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'291","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.885417+0000","last_change":"2024-09-22T09:16:44.885417+0000","last_active":"2024-09-22T09:16:44.885417+0000","last_peered":"2024-09-22T09:16:44.885417+0000","last_clean":"2024-09-22T09:16:44.885417+0000","last_became_active":"2024-09-22T08:17:48.370973+0000","last_became_peered":"2024-09-22T08:17:48.370973+0000","last_unstale":"2024-09-22T09:16:44.885417+0000","last_undegraded":"2024-09-22T09:16:44.885417+0000","last_fullsized":"2024-09-22T09:16:44.885417+0000","mapping_epoch":35,"log_start":"261'200","ondisk_log_start":"261'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:44.885302+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.885302+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:47.087058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":415,"num_write":638,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.919376+0000","last_change":"2024-09-22T09:16:14.919376+0000","last_active":"2024-09-22T09:16:14.919376+0000","last_peered":"2024-09-22T09:16:14.919376+0000","last_clean":"2024-09-22T09:16:14.919376+0000","last_became_active":"2024-09-22T08:17:40.315883+0000","last_became_peered":"2024-09-22T08:17:40.315883+0000","last_unstale":"2024-09-22T09:16:14.919376+0000","last_undegraded":"2024-09-22T09:16:14.919376+0000","last_fullsized":"2024-09-22T09:16:14.919376+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-22T09:16:14.919282+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.919282+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:08.650486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3699,"num_read_kb":3356,"num_write":994,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'327","reported_seq":1056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.772366+0000","last_change":"2024-09-22T09:16:10.772280+0000","last_active":"2024-09-22T09:16:10.772366+0000","last_peered":"2024-09-22T09:16:10.772366+0000","last_clean":"2024-09-22T09:16:10.772366+0000","last_became_active":"2024-09-22T08:17:38.299826+0000","last_became_peered":"2024-09-22T08:17:38.299826+0000","last_unstale":"2024-09-22T09:16:10.772366+0000","last_undegraded":"2024-09-22T09:16:10.772366+0000","last_fullsized":"2024-09-22T09:16:10.772366+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:10.772122+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.772122+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:38.919070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048951,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":907,"num_read_kb":63310,"num_write":970,"num_write_kb":40522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.152744+0000","last_change":"2024-09-22T09:16:12.152744+0000","last_active":"2024-09-22T09:16:12.152744+0000","last_peered":"2024-09-22T09:16:12.152744+0000","last_clean":"2024-09-22T09:16:12.152744+0000","last_became_active":"2024-09-22T08:17:25.236105+0000","last_became_peered":"2024-09-22T08:17:25.236105+0000","last_unstale":"2024-09-22T09:16:12.152744+0000","last_undegraded":"2024-09-22T09:16:12.152744+0000","last_fullsized":"2024-09-22T09:16:12.152744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:12.152652+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.152652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:42.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001060299,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.748080+0000","last_change":"2024-09-22T09:16:24.748080+0000","last_active":"2024-09-22T09:16:24.748080+0000","last_peered":"2024-09-22T09:16:24.748080+0000","last_clean":"2024-09-22T09:16:24.748080+0000","last_became_active":"2024-09-22T08:17:42.310629+0000","last_became_peered":"2024-09-22T08:17:42.310629+0000","last_unstale":"2024-09-22T09:16:24.748080+0000","last_undegraded":"2024-09-22T09:16:24.748080+0000","last_fullsized":"2024-09-22T09:16:24.748080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:24.748000+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.748000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:33.241849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'747","reported_seq":1467,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.563522+0000","last_change":"2024-09-22T09:16:25.563522+0000","last_active":"2024-09-22T09:16:25.563522+0000","last_peered":"2024-09-22T09:16:25.563522+0000","last_clean":"2024-09-22T09:16:25.563522+0000","last_became_active":"2024-09-22T08:17:44.333260+0000","last_became_peered":"2024-09-22T08:17:44.333260+0000","last_unstale":"2024-09-22T09:16:25.563522+0000","last_undegraded":"2024-09-22T09:16:25.563522+0000","last_fullsized":"2024-09-22T09:16:25.563522+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'747","last_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_deep_scrub":"261'747","last_deep_scrub_stamp":"2024-09-22T09:16:25.563415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.563415+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:22.893620+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1336,"num_read_kb":3141,"num_write":1092,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.576127+0000","last_change":"2024-09-22T09:16:38.576127+0000","last_active":"2024-09-22T09:16:38.576127+0000","last_peered":"2024-09-22T09:16:38.576127+0000","last_clean":"2024-09-22T09:16:38.576127+0000","last_became_active":"2024-09-22T08:17:46.355105+0000","last_became_peered":"2024-09-22T08:17:46.355105+0000","last_unstale":"2024-09-22T09:16:38.576127+0000","last_undegraded":"2024-09-22T09:16:38.576127+0000","last_fullsized":"2024-09-22T09:16:38.576127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:38.576031+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.576031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:05.576920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'102","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.929801+0000","last_change":"2024-09-22T09:16:35.929801+0000","last_active":"2024-09-22T09:16:35.929801+0000","last_peered":"2024-09-22T09:16:35.929801+0000","last_clean":"2024-09-22T09:16:35.929801+0000","last_became_active":"2024-09-22T08:17:48.366997+0000","last_became_peered":"2024-09-22T08:17:48.366997+0000","last_unstale":"2024-09-22T09:16:35.929801+0000","last_undegraded":"2024-09-22T09:16:35.929801+0000","last_fullsized":"2024-09-22T09:16:35.929801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-22T09:16:35.929698+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.929698+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:53.295003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":231,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'124","reported_seq":701,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.611669+0000","last_change":"2024-09-22T09:16:44.611669+0000","last_active":"2024-09-22T09:16:44.611669+0000","last_peered":"2024-09-22T09:16:44.611669+0000","last_clean":"2024-09-22T09:16:44.611669+0000","last_became_active":"2024-09-22T08:17:48.366184+0000","last_became_peered":"2024-09-22T08:17:48.366184+0000","last_unstale":"2024-09-22T09:16:44.611669+0000","last_undegraded":"2024-09-22T09:16:44.611669+0000","last_fullsized":"2024-09-22T09:16:44.611669+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'124","last_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_deep_scrub":"261'124","last_deep_scrub_stamp":"2024-09-22T09:16:44.611578+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.611578+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:35.821865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":302,"num_read_kb":282,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'413","reported_seq":1982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.864884+0000","last_change":"2024-09-22T09:16:18.864884+0000","last_active":"2024-09-22T09:16:18.864884+0000","last_peered":"2024-09-22T09:16:18.864884+0000","last_clean":"2024-09-22T09:16:18.864884+0000","last_became_active":"2024-09-22T08:17:40.312094+0000","last_became_peered":"2024-09-22T08:17:40.312094+0000","last_unstale":"2024-09-22T09:16:18.864884+0000","last_undegraded":"2024-09-22T09:16:18.864884+0000","last_fullsized":"2024-09-22T09:16:18.864884+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'413","last_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_deep_scrub":"261'413","last_deep_scrub_stamp":"2024-09-22T09:16:18.864732+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.864732+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:46.218753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2274,"num_read_kb":2166,"num_write":473,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'314","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.295818+0000","last_change":"2024-09-22T09:16:19.295818+0000","last_active":"2024-09-22T09:16:19.295818+0000","last_peered":"2024-09-22T09:16:19.295818+0000","last_clean":"2024-09-22T09:16:19.295818+0000","last_became_active":"2024-09-22T08:18:09.816323+0000","last_became_peered":"2024-09-22T08:18:09.816323+0000","last_unstale":"2024-09-22T09:16:19.295818+0000","last_undegraded":"2024-09-22T09:16:19.295818+0000","last_fullsized":"2024-09-22T09:16:19.295818+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:19.295694+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.295694+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:35:01.794130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":48776,"num_write":1072,"num_write_kb":36980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.245928+0000","last_change":"2024-09-22T09:16:29.245928+0000","last_active":"2024-09-22T09:16:29.245928+0000","last_peered":"2024-09-22T09:16:29.245928+0000","last_clean":"2024-09-22T09:16:29.245928+0000","last_became_active":"2024-09-22T08:17:42.317202+0000","last_became_peered":"2024-09-22T08:17:42.317202+0000","last_unstale":"2024-09-22T09:16:29.245928+0000","last_undegraded":"2024-09-22T09:16:29.245928+0000","last_fullsized":"2024-09-22T09:16:29.245928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.245818+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.245818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:25.499134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'303","reported_seq":874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.218828+0000","last_change":"2024-09-22T09:16:31.218828+0000","last_active":"2024-09-22T09:16:31.218828+0000","last_peered":"2024-09-22T09:16:31.218828+0000","last_clean":"2024-09-22T09:16:31.218828+0000","last_became_active":"2024-09-22T08:17:44.340458+0000","last_became_peered":"2024-09-22T08:17:44.340458+0000","last_unstale":"2024-09-22T09:16:31.218828+0000","last_undegraded":"2024-09-22T09:16:31.218828+0000","last_fullsized":"2024-09-22T09:16:31.218828+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-22T09:16:31.218740+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.218740+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:12.818326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44144,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1008,"num_write":380,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.676808+0000","last_change":"2024-09-22T09:16:29.676808+0000","last_active":"2024-09-22T09:16:29.676808+0000","last_peered":"2024-09-22T09:16:29.676808+0000","last_clean":"2024-09-22T09:16:29.676808+0000","last_became_active":"2024-09-22T08:17:46.357506+0000","last_became_peered":"2024-09-22T08:17:46.357506+0000","last_unstale":"2024-09-22T09:16:29.676808+0000","last_undegraded":"2024-09-22T09:16:29.676808+0000","last_fullsized":"2024-09-22T09:16:29.676808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.676707+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.676707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:07.042343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'157","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:35.824503+0000","last_change":"2024-09-22T09:16:35.824503+0000","last_active":"2024-09-22T09:16:35.824503+0000","last_peered":"2024-09-22T09:16:35.824503+0000","last_clean":"2024-09-22T09:16:35.824503+0000","last_became_active":"2024-09-22T08:17:48.369847+0000","last_became_peered":"2024-09-22T08:17:48.369847+0000","last_unstale":"2024-09-22T09:16:35.824503+0000","last_undegraded":"2024-09-22T09:16:35.824503+0000","last_fullsized":"2024-09-22T09:16:35.824503+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-22T09:16:35.824415+0000","last_clean_scrub_stamp":"2024-09-22T09:16:35.824415+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:46.659184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":173,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'479","reported_seq":2028,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.799222+0000","last_change":"2024-09-22T09:16:18.799222+0000","last_active":"2024-09-22T09:16:18.799222+0000","last_peered":"2024-09-22T09:16:18.799222+0000","last_clean":"2024-09-22T09:16:18.799222+0000","last_became_active":"2024-09-22T08:17:40.313039+0000","last_became_peered":"2024-09-22T08:17:40.313039+0000","last_unstale":"2024-09-22T09:16:18.799222+0000","last_undegraded":"2024-09-22T09:16:18.799222+0000","last_fullsized":"2024-09-22T09:16:18.799222+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'479","last_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_deep_scrub":"261'479","last_deep_scrub_stamp":"2024-09-22T09:16:18.799137+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.799137+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:41:01.860838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2441,"num_write":574,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'343","reported_seq":981,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:08.582742+0000","last_change":"2024-09-22T09:16:08.582742+0000","last_active":"2024-09-22T09:16:08.582742+0000","last_peered":"2024-09-22T09:16:08.582742+0000","last_clean":"2024-09-22T09:16:08.582742+0000","last_became_active":"2024-09-22T08:17:38.308501+0000","last_became_peered":"2024-09-22T08:17:38.308501+0000","last_unstale":"2024-09-22T09:16:08.582742+0000","last_undegraded":"2024-09-22T09:16:08.582742+0000","last_fullsized":"2024-09-22T09:16:08.582742+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-22T09:16:08.582637+0000","last_clean_scrub_stamp":"2024-09-22T09:16:08.582637+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:51.839030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":615,"num_read_kb":26096,"num_write":1031,"num_write_kb":29650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.712354+0000","last_change":"2024-09-22T09:16:27.712354+0000","last_active":"2024-09-22T09:16:27.712354+0000","last_peered":"2024-09-22T09:16:27.712354+0000","last_clean":"2024-09-22T09:16:27.712354+0000","last_became_active":"2024-09-22T08:17:42.315021+0000","last_became_peered":"2024-09-22T08:17:42.315021+0000","last_unstale":"2024-09-22T09:16:27.712354+0000","last_undegraded":"2024-09-22T09:16:27.712354+0000","last_fullsized":"2024-09-22T09:16:27.712354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:27.712273+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.712273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:11.133342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'52","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:34.657575+0000","last_change":"2024-09-22T09:16:34.657575+0000","last_active":"2024-09-22T09:16:34.657575+0000","last_peered":"2024-09-22T09:16:34.657575+0000","last_clean":"2024-09-22T09:16:34.657575+0000","last_became_active":"2024-09-22T08:17:44.333812+0000","last_became_peered":"2024-09-22T08:17:44.333812+0000","last_unstale":"2024-09-22T09:16:34.657575+0000","last_undegraded":"2024-09-22T09:16:34.657575+0000","last_fullsized":"2024-09-22T09:16:34.657575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'52","last_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_deep_scrub":"261'52","last_deep_scrub_stamp":"2024-09-22T09:16:34.657484+0000","last_clean_scrub_stamp":"2024-09-22T09:16:34.657484+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.772569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.955597+0000","last_change":"2024-09-22T09:16:30.955597+0000","last_active":"2024-09-22T09:16:30.955597+0000","last_peered":"2024-09-22T09:16:30.955597+0000","last_clean":"2024-09-22T09:16:30.955597+0000","last_became_active":"2024-09-22T08:17:46.350143+0000","last_became_peered":"2024-09-22T08:17:46.350143+0000","last_unstale":"2024-09-22T09:16:30.955597+0000","last_undegraded":"2024-09-22T09:16:30.955597+0000","last_fullsized":"2024-09-22T09:16:30.955597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.955526+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.955526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:58.716890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'170","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.297985+0000","last_change":"2024-09-22T09:16:40.297985+0000","last_active":"2024-09-22T09:16:40.297985+0000","last_peered":"2024-09-22T09:16:40.297985+0000","last_clean":"2024-09-22T09:16:40.297985+0000","last_became_active":"2024-09-22T08:17:48.364087+0000","last_became_peered":"2024-09-22T08:17:48.364087+0000","last_unstale":"2024-09-22T09:16:40.297985+0000","last_undegraded":"2024-09-22T09:16:40.297985+0000","last_fullsized":"2024-09-22T09:16:40.297985+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'170","last_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_deep_scrub":"261'170","last_deep_scrub_stamp":"2024-09-22T09:16:40.297900+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.297900+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:20.684874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":372,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'1114","reported_seq":2661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.752191+0000","last_change":"2024-09-22T09:16:17.752191+0000","last_active":"2024-09-22T09:16:17.752191+0000","last_peered":"2024-09-22T09:16:17.752191+0000","last_clean":"2024-09-22T09:16:17.752191+0000","last_became_active":"2024-09-22T08:17:40.310649+0000","last_became_peered":"2024-09-22T08:17:40.310649+0000","last_unstale":"2024-09-22T09:16:17.752191+0000","last_undegraded":"2024-09-22T09:16:17.752191+0000","last_fullsized":"2024-09-22T09:16:17.752191+0000","mapping_epoch":27,"log_start":"261'1100","ondisk_log_start":"261'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1114","last_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_deep_scrub":"261'1114","last_deep_scrub_stamp":"2024-09-22T09:16:17.752078+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.752078+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":1100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:33:39.851809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5160,"num_read_kb":4572,"num_write":1524,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'345","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.909478+0000","last_change":"2024-09-22T09:16:10.909478+0000","last_active":"2024-09-22T09:16:10.909478+0000","last_peered":"2024-09-22T09:16:10.909478+0000","last_clean":"2024-09-22T09:16:10.909478+0000","last_became_active":"2024-09-22T08:17:38.312123+0000","last_became_peered":"2024-09-22T08:17:38.312123+0000","last_unstale":"2024-09-22T09:16:10.909478+0000","last_undegraded":"2024-09-22T09:16:10.909478+0000","last_fullsized":"2024-09-22T09:16:10.909478+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-22T09:16:10.909398+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.909398+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:48.269092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":10746,"num_write":1198,"num_write_kb":16031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.961164+0000","last_change":"2024-09-22T09:16:23.961164+0000","last_active":"2024-09-22T09:16:23.961164+0000","last_peered":"2024-09-22T09:16:23.961164+0000","last_clean":"2024-09-22T09:16:23.961164+0000","last_became_active":"2024-09-22T08:17:42.313312+0000","last_became_peered":"2024-09-22T08:17:42.313312+0000","last_unstale":"2024-09-22T09:16:23.961164+0000","last_undegraded":"2024-09-22T09:16:23.961164+0000","last_fullsized":"2024-09-22T09:16:23.961164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:23.961072+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.961072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:18.031550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'300","reported_seq":891,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.702560+0000","last_change":"2024-09-22T09:16:26.702560+0000","last_active":"2024-09-22T09:16:26.702560+0000","last_peered":"2024-09-22T09:16:26.702560+0000","last_clean":"2024-09-22T09:16:26.702560+0000","last_became_active":"2024-09-22T08:17:44.329665+0000","last_became_peered":"2024-09-22T08:17:44.329665+0000","last_unstale":"2024-09-22T09:16:26.702560+0000","last_undegraded":"2024-09-22T09:16:26.702560+0000","last_fullsized":"2024-09-22T09:16:26.702560+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-22T09:16:26.702460+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.702460+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:52:00.189471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51577,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1040,"num_write":388,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.193361+0000","last_change":"2024-09-22T09:16:32.193361+0000","last_active":"2024-09-22T09:16:32.193361+0000","last_peered":"2024-09-22T09:16:32.193361+0000","last_clean":"2024-09-22T09:16:32.193361+0000","last_became_active":"2024-09-22T08:17:46.356134+0000","last_became_peered":"2024-09-22T08:17:46.356134+0000","last_unstale":"2024-09-22T09:16:32.193361+0000","last_undegraded":"2024-09-22T09:16:32.193361+0000","last_fullsized":"2024-09-22T09:16:32.193361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:32.193280+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.193280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:23.876371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'112","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:56.015992+0000","last_change":"2024-09-22T09:16:56.015992+0000","last_active":"2024-09-22T09:16:56.015992+0000","last_peered":"2024-09-22T09:16:56.015992+0000","last_clean":"2024-09-22T09:16:56.015992+0000","last_became_active":"2024-09-22T08:17:48.367446+0000","last_became_peered":"2024-09-22T08:17:48.367446+0000","last_unstale":"2024-09-22T09:16:56.015992+0000","last_undegraded":"2024-09-22T09:16:56.015992+0000","last_fullsized":"2024-09-22T09:16:56.015992+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'112","last_scrub_stamp":"2024-09-22T09:16:56.015869+0000","last_deep_scrub":"261'112","last_deep_scrub_stamp":"2024-09-22T09:16:56.015869+0000","last_clean_scrub_stamp":"2024-09-22T09:16:56.015869+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:15.825355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":189,"num_write":273,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'673","reported_seq":2226,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.783102+0000","last_change":"2024-09-22T09:16:15.783102+0000","last_active":"2024-09-22T09:16:15.783102+0000","last_peered":"2024-09-22T09:16:15.783102+0000","last_clean":"2024-09-22T09:16:15.783102+0000","last_became_active":"2024-09-22T08:17:40.310416+0000","last_became_peered":"2024-09-22T08:17:40.310416+0000","last_unstale":"2024-09-22T09:16:15.783102+0000","last_undegraded":"2024-09-22T09:16:15.783102+0000","last_fullsized":"2024-09-22T09:16:15.783102+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'673","last_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_deep_scrub":"261'673","last_deep_scrub_stamp":"2024-09-22T09:16:15.783012+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.783012+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:05.838865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3355,"num_read_kb":2992,"num_write":929,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'398","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.720596+0000","last_change":"2024-09-22T09:16:15.720596+0000","last_active":"2024-09-22T09:16:15.720596+0000","last_peered":"2024-09-22T09:16:15.720596+0000","last_clean":"2024-09-22T09:16:15.720596+0000","last_became_active":"2024-09-22T08:17:38.310344+0000","last_became_peered":"2024-09-22T08:17:38.310344+0000","last_unstale":"2024-09-22T09:16:15.720596+0000","last_undegraded":"2024-09-22T09:16:15.720596+0000","last_fullsized":"2024-09-22T09:16:15.720596+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'398","last_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_deep_scrub":"261'398","last_deep_scrub_stamp":"2024-09-22T09:16:15.720482+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.720482+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:44:21.561411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":808,"num_read_kb":91878,"num_write":1336,"num_write_kb":27370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.056882+0000","last_change":"2024-09-22T09:16:37.056882+0000","last_active":"2024-09-22T09:16:37.056882+0000","last_peered":"2024-09-22T09:16:37.056882+0000","last_clean":"2024-09-22T09:16:37.056882+0000","last_became_active":"2024-09-22T08:17:42.314271+0000","last_became_peered":"2024-09-22T08:17:42.314271+0000","last_unstale":"2024-09-22T09:16:37.056882+0000","last_undegraded":"2024-09-22T09:16:37.056882+0000","last_fullsized":"2024-09-22T09:16:37.056882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:37.056786+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.056786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:18.010691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'291","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.628841+0000","last_change":"2024-09-22T09:16:28.628841+0000","last_active":"2024-09-22T09:16:28.628841+0000","last_peered":"2024-09-22T09:16:28.628841+0000","last_clean":"2024-09-22T09:16:28.628841+0000","last_became_active":"2024-09-22T08:17:44.333246+0000","last_became_peered":"2024-09-22T08:17:44.333246+0000","last_unstale":"2024-09-22T09:16:28.628841+0000","last_undegraded":"2024-09-22T09:16:28.628841+0000","last_fullsized":"2024-09-22T09:16:28.628841+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-22T09:16:28.628749+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.628749+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:39.456602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46656,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":494,"num_read_kb":1168,"num_write":408,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.722816+0000","last_change":"2024-09-22T09:16:30.722816+0000","last_active":"2024-09-22T09:16:30.722816+0000","last_peered":"2024-09-22T09:16:30.722816+0000","last_clean":"2024-09-22T09:16:30.722816+0000","last_became_active":"2024-09-22T08:17:46.352982+0000","last_became_peered":"2024-09-22T08:17:46.352982+0000","last_unstale":"2024-09-22T09:16:30.722816+0000","last_undegraded":"2024-09-22T09:16:30.722816+0000","last_fullsized":"2024-09-22T09:16:30.722816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:30.722700+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.722700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:21:40.178403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'815","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.228476+0000","last_change":"2024-09-22T09:16:30.228476+0000","last_active":"2024-09-22T09:16:30.228476+0000","last_peered":"2024-09-22T09:16:30.228476+0000","last_clean":"2024-09-22T09:16:30.228476+0000","last_became_active":"2024-09-22T08:17:40.320513+0000","last_became_peered":"2024-09-22T08:17:40.320513+0000","last_unstale":"2024-09-22T09:16:30.228476+0000","last_undegraded":"2024-09-22T09:16:30.228476+0000","last_fullsized":"2024-09-22T09:16:30.228476+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'815","last_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_deep_scrub":"261'815","last_deep_scrub_stamp":"2024-09-22T09:16:30.228380+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.228380+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:24.948927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3904,"num_read_kb":3552,"num_write":1054,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'342","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.809805+0000","last_change":"2024-09-22T09:16:11.809805+0000","last_active":"2024-09-22T09:16:11.809805+0000","last_peered":"2024-09-22T09:16:11.809805+0000","last_clean":"2024-09-22T09:16:11.809805+0000","last_became_active":"2024-09-22T08:17:38.311860+0000","last_became_peered":"2024-09-22T08:17:38.311860+0000","last_unstale":"2024-09-22T09:16:11.809805+0000","last_undegraded":"2024-09-22T09:16:11.809805+0000","last_fullsized":"2024-09-22T09:16:11.809805+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-22T09:16:11.809676+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.809676+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:44.292039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":11716,"num_write":1078,"num_write_kb":35181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.206946+0000","last_change":"2024-09-22T09:16:26.206946+0000","last_active":"2024-09-22T09:16:26.206946+0000","last_peered":"2024-09-22T09:16:26.206946+0000","last_clean":"2024-09-22T09:16:26.206946+0000","last_became_active":"2024-09-22T08:17:42.316724+0000","last_became_peered":"2024-09-22T08:17:42.316724+0000","last_unstale":"2024-09-22T09:16:26.206946+0000","last_undegraded":"2024-09-22T09:16:26.206946+0000","last_fullsized":"2024-09-22T09:16:26.206946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.206849+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.206849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:28.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'473","reported_seq":1098,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.253512+0000","last_change":"2024-09-22T09:16:32.253512+0000","last_active":"2024-09-22T09:16:32.253512+0000","last_peered":"2024-09-22T09:16:32.253512+0000","last_clean":"2024-09-22T09:16:32.253512+0000","last_became_active":"2024-09-22T08:17:44.328169+0000","last_became_peered":"2024-09-22T08:17:44.328169+0000","last_unstale":"2024-09-22T09:16:32.253512+0000","last_undegraded":"2024-09-22T09:16:32.253512+0000","last_fullsized":"2024-09-22T09:16:32.253512+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'473","last_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_deep_scrub":"261'473","last_deep_scrub_stamp":"2024-09-22T09:16:32.253410+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.253410+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:29.449772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91839,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":850,"num_read_kb":1972,"num_write":726,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.923928+0000","last_change":"2024-09-22T09:16:31.923928+0000","last_active":"2024-09-22T09:16:31.923928+0000","last_peered":"2024-09-22T09:16:31.923928+0000","last_clean":"2024-09-22T09:16:31.923928+0000","last_became_active":"2024-09-22T08:17:46.356796+0000","last_became_peered":"2024-09-22T08:17:46.356796+0000","last_unstale":"2024-09-22T09:16:31.923928+0000","last_undegraded":"2024-09-22T09:16:31.923928+0000","last_fullsized":"2024-09-22T09:16:31.923928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.923838+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.923838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:11.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'208","reported_seq":718,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.812336+0000","last_change":"2024-09-22T09:16:46.812336+0000","last_active":"2024-09-22T09:16:46.812336+0000","last_peered":"2024-09-22T09:16:46.812336+0000","last_clean":"2024-09-22T09:16:46.812336+0000","last_became_active":"2024-09-22T08:17:48.368049+0000","last_became_peered":"2024-09-22T08:17:48.368049+0000","last_unstale":"2024-09-22T09:16:46.812336+0000","last_undegraded":"2024-09-22T09:16:46.812336+0000","last_fullsized":"2024-09-22T09:16:46.812336+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'208","last_scrub_stamp":"2024-09-22T09:16:46.812252+0000","last_deep_scrub":"261'208","last_deep_scrub_stamp":"2024-09-22T09:16:46.812252+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.812252+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:29.531702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":308,"num_write":480,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'441","reported_seq":1964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.783099+0000","last_change":"2024-09-22T09:16:20.783099+0000","last_active":"2024-09-22T09:16:20.783099+0000","last_peered":"2024-09-22T09:16:20.783099+0000","last_clean":"2024-09-22T09:16:20.783099+0000","last_became_active":"2024-09-22T08:17:40.311942+0000","last_became_peered":"2024-09-22T08:17:40.311942+0000","last_unstale":"2024-09-22T09:16:20.783099+0000","last_undegraded":"2024-09-22T09:16:20.783099+0000","last_fullsized":"2024-09-22T09:16:20.783099+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'441","last_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_deep_scrub":"261'441","last_deep_scrub_stamp":"2024-09-22T09:16:20.783016+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.783016+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:04:03.329227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2340,"num_read_kb":2196,"num_write":543,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'392","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.796464+0000","last_change":"2024-09-22T09:16:13.796464+0000","last_active":"2024-09-22T09:16:13.796464+0000","last_peered":"2024-09-22T09:16:13.796464+0000","last_clean":"2024-09-22T09:16:13.796464+0000","last_became_active":"2024-09-22T08:17:38.308753+0000","last_became_peered":"2024-09-22T08:17:38.308753+0000","last_unstale":"2024-09-22T09:16:13.796464+0000","last_undegraded":"2024-09-22T09:16:13.796464+0000","last_fullsized":"2024-09-22T09:16:13.796464+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'392","last_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_deep_scrub":"261'392","last_deep_scrub_stamp":"2024-09-22T09:16:13.796344+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.796344+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:33.961247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":782,"num_read_kb":2508,"num_write":1241,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.007305+0000","last_change":"2024-09-22T09:16:29.007305+0000","last_active":"2024-09-22T09:16:29.007305+0000","last_peered":"2024-09-22T09:16:29.007305+0000","last_clean":"2024-09-22T09:16:29.007305+0000","last_became_active":"2024-09-22T08:17:42.318460+0000","last_became_peered":"2024-09-22T08:17:42.318460+0000","last_unstale":"2024-09-22T09:16:29.007305+0000","last_undegraded":"2024-09-22T09:16:29.007305+0000","last_fullsized":"2024-09-22T09:16:29.007305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:29.007163+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.007163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:12.241599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'308","reported_seq":895,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:45.123193+0000","last_change":"2024-09-22T09:16:45.123193+0000","last_active":"2024-09-22T09:16:45.123193+0000","last_peered":"2024-09-22T09:16:45.123193+0000","last_clean":"2024-09-22T09:16:45.123193+0000","last_became_active":"2024-09-22T08:17:44.336878+0000","last_became_peered":"2024-09-22T08:17:44.336878+0000","last_unstale":"2024-09-22T09:16:45.123193+0000","last_undegraded":"2024-09-22T09:16:45.123193+0000","last_fullsized":"2024-09-22T09:16:45.123193+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'308","last_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_deep_scrub":"261'308","last_deep_scrub_stamp":"2024-09-22T09:16:45.123088+0000","last_clean_scrub_stamp":"2024-09-22T09:16:45.123088+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:15.176307+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1052,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:40.813683+0000","last_change":"2024-09-22T09:16:40.813683+0000","last_active":"2024-09-22T09:16:40.813683+0000","last_peered":"2024-09-22T09:16:40.813683+0000","last_clean":"2024-09-22T09:16:40.813683+0000","last_became_active":"2024-09-22T08:17:46.350798+0000","last_became_peered":"2024-09-22T08:17:46.350798+0000","last_unstale":"2024-09-22T09:16:40.813683+0000","last_undegraded":"2024-09-22T09:16:40.813683+0000","last_fullsized":"2024-09-22T09:16:40.813683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:40.813564+0000","last_clean_scrub_stamp":"2024-09-22T09:16:40.813564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:49.900112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'206","reported_seq":716,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:53.994748+0000","last_change":"2024-09-22T09:16:53.994748+0000","last_active":"2024-09-22T09:16:53.994748+0000","last_peered":"2024-09-22T09:16:53.994748+0000","last_clean":"2024-09-22T09:16:53.994748+0000","last_became_active":"2024-09-22T08:17:48.373180+0000","last_became_peered":"2024-09-22T08:17:48.373180+0000","last_unstale":"2024-09-22T09:16:53.994748+0000","last_undegraded":"2024-09-22T09:16:53.994748+0000","last_fullsized":"2024-09-22T09:16:53.994748+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'206","last_scrub_stamp":"2024-09-22T09:16:53.994649+0000","last_deep_scrub":"261'206","last_deep_scrub_stamp":"2024-09-22T09:16:53.994649+0000","last_clean_scrub_stamp":"2024-09-22T09:16:53.994649+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:45.921961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":282,"num_write":574,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'1249","reported_seq":2882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.747497+0000","last_change":"2024-09-22T09:16:16.747497+0000","last_active":"2024-09-22T09:16:16.747497+0000","last_peered":"2024-09-22T09:16:16.747497+0000","last_clean":"2024-09-22T09:16:16.747497+0000","last_became_active":"2024-09-22T08:17:40.308200+0000","last_became_peered":"2024-09-22T08:17:40.308200+0000","last_unstale":"2024-09-22T09:16:16.747497+0000","last_undegraded":"2024-09-22T09:16:16.747497+0000","last_fullsized":"2024-09-22T09:16:16.747497+0000","mapping_epoch":27,"log_start":"261'1200","ondisk_log_start":"261'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1249","last_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_deep_scrub":"261'1249","last_deep_scrub_stamp":"2024-09-22T09:16:16.747413+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.747413+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:40.709656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5699,"num_read_kb":5032,"num_write":1717,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'364","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:10.160466+0000","last_change":"2024-09-22T09:16:10.160466+0000","last_active":"2024-09-22T09:16:10.160466+0000","last_peered":"2024-09-22T09:16:10.160466+0000","last_clean":"2024-09-22T09:16:10.160466+0000","last_became_active":"2024-09-22T08:17:38.301150+0000","last_became_peered":"2024-09-22T08:17:38.301150+0000","last_unstale":"2024-09-22T09:16:10.160466+0000","last_undegraded":"2024-09-22T09:16:10.160466+0000","last_fullsized":"2024-09-22T09:16:10.160466+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-22T09:16:10.160369+0000","last_clean_scrub_stamp":"2024-09-22T09:16:10.160369+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:26.305948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":701,"num_read_kb":11614,"num_write":1118,"num_write_kb":16306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.997725+0000","last_change":"2024-09-22T09:16:25.997725+0000","last_active":"2024-09-22T09:16:25.997725+0000","last_peered":"2024-09-22T09:16:25.997725+0000","last_clean":"2024-09-22T09:16:25.997725+0000","last_became_active":"2024-09-22T08:17:42.318828+0000","last_became_peered":"2024-09-22T08:17:42.318828+0000","last_unstale":"2024-09-22T09:16:25.997725+0000","last_undegraded":"2024-09-22T09:16:25.997725+0000","last_fullsized":"2024-09-22T09:16:25.997725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.997619+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:27.550802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'297","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.293457+0000","last_change":"2024-09-22T09:16:37.293457+0000","last_active":"2024-09-22T09:16:37.293457+0000","last_peered":"2024-09-22T09:16:37.293457+0000","last_clean":"2024-09-22T09:16:37.293457+0000","last_became_active":"2024-09-22T08:17:44.329370+0000","last_became_peered":"2024-09-22T08:17:44.329370+0000","last_unstale":"2024-09-22T09:16:37.293457+0000","last_undegraded":"2024-09-22T09:16:37.293457+0000","last_fullsized":"2024-09-22T09:16:37.293457+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-22T09:16:37.293351+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.293351+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:55:56.164258+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":1154,"num_write":408,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.767167+0000","last_change":"2024-09-22T09:16:31.767167+0000","last_active":"2024-09-22T09:16:31.767167+0000","last_peered":"2024-09-22T09:16:31.767167+0000","last_clean":"2024-09-22T09:16:31.767167+0000","last_became_active":"2024-09-22T08:17:46.356741+0000","last_became_peered":"2024-09-22T08:17:46.356741+0000","last_unstale":"2024-09-22T09:16:31.767167+0000","last_undegraded":"2024-09-22T09:16:31.767167+0000","last_fullsized":"2024-09-22T09:16:31.767167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.767068+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.767068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:32.629069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'157","reported_seq":653,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.984684+0000","last_change":"2024-09-22T09:16:51.984684+0000","last_active":"2024-09-22T09:16:51.984684+0000","last_peered":"2024-09-22T09:16:51.984684+0000","last_clean":"2024-09-22T09:16:51.984684+0000","last_became_active":"2024-09-22T08:17:48.365327+0000","last_became_peered":"2024-09-22T08:17:48.365327+0000","last_unstale":"2024-09-22T09:16:51.984684+0000","last_undegraded":"2024-09-22T09:16:51.984684+0000","last_fullsized":"2024-09-22T09:16:51.984684+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-22T09:16:51.984609+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-22T09:16:51.984609+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.984609+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:44.218370+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":218,"num_read_kb":206,"num_write":390,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'671","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.771617+0000","last_change":"2024-09-22T09:16:19.771617+0000","last_active":"2024-09-22T09:16:19.771617+0000","last_peered":"2024-09-22T09:16:19.771617+0000","last_clean":"2024-09-22T09:16:19.771617+0000","last_became_active":"2024-09-22T08:17:40.311746+0000","last_became_peered":"2024-09-22T08:17:40.311746+0000","last_unstale":"2024-09-22T09:16:19.771617+0000","last_undegraded":"2024-09-22T09:16:19.771617+0000","last_fullsized":"2024-09-22T09:16:19.771617+0000","mapping_epoch":27,"log_start":"261'600","ondisk_log_start":"261'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'671","last_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_deep_scrub":"261'671","last_deep_scrub_stamp":"2024-09-22T09:16:19.771511+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.771511+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:54.246211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3279,"num_read_kb":2987,"num_write":880,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'302","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.735731+0000","last_change":"2024-09-22T09:16:15.735731+0000","last_active":"2024-09-22T09:16:15.735731+0000","last_peered":"2024-09-22T09:16:15.735731+0000","last_clean":"2024-09-22T09:16:15.735731+0000","last_became_active":"2024-09-22T08:17:38.299978+0000","last_became_peered":"2024-09-22T08:17:38.299978+0000","last_unstale":"2024-09-22T09:16:15.735731+0000","last_undegraded":"2024-09-22T09:16:15.735731+0000","last_fullsized":"2024-09-22T09:16:15.735731+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'302","last_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_deep_scrub":"261'302","last_deep_scrub_stamp":"2024-09-22T09:16:15.735596+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.735596+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:46.178060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655841,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":50029,"num_write":1017,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.637101+0000","last_change":"2024-09-22T09:16:31.637101+0000","last_active":"2024-09-22T09:16:31.637101+0000","last_peered":"2024-09-22T09:16:31.637101+0000","last_clean":"2024-09-22T09:16:31.637101+0000","last_became_active":"2024-09-22T08:17:42.312422+0000","last_became_peered":"2024-09-22T08:17:42.312422+0000","last_unstale":"2024-09-22T09:16:31.637101+0000","last_undegraded":"2024-09-22T09:16:31.637101+0000","last_fullsized":"2024-09-22T09:16:31.637101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:31.637013+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.637013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:17.159451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'95","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:46.090331+0000","last_change":"2024-09-22T09:16:46.090331+0000","last_active":"2024-09-22T09:16:46.090331+0000","last_peered":"2024-09-22T09:16:46.090331+0000","last_clean":"2024-09-22T09:16:46.090331+0000","last_became_active":"2024-09-22T08:17:44.336592+0000","last_became_peered":"2024-09-22T08:17:44.336592+0000","last_unstale":"2024-09-22T09:16:46.090331+0000","last_undegraded":"2024-09-22T09:16:46.090331+0000","last_fullsized":"2024-09-22T09:16:46.090331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-22T09:16:46.090230+0000","last_clean_scrub_stamp":"2024-09-22T09:16:46.090230+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:28.048688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'780","reported_seq":2599,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.596983+0000","last_change":"2024-09-22T09:16:30.596983+0000","last_active":"2024-09-22T09:16:30.596983+0000","last_peered":"2024-09-22T09:16:30.596983+0000","last_clean":"2024-09-22T09:16:30.596983+0000","last_became_active":"2024-09-22T08:17:46.349221+0000","last_became_peered":"2024-09-22T08:17:46.349221+0000","last_unstale":"2024-09-22T09:16:30.596983+0000","last_undegraded":"2024-09-22T09:16:30.596983+0000","last_fullsized":"2024-09-22T09:16:30.596983+0000","mapping_epoch":33,"log_start":"261'700","ondisk_log_start":"261'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-22T09:16:30.596880+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.596880+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:46.027022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'168","reported_seq":690,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:52.963074+0000","last_change":"2024-09-22T09:16:52.963074+0000","last_active":"2024-09-22T09:16:52.963074+0000","last_peered":"2024-09-22T09:16:52.963074+0000","last_clean":"2024-09-22T09:16:52.963074+0000","last_became_active":"2024-09-22T08:17:48.370192+0000","last_became_peered":"2024-09-22T08:17:48.370192+0000","last_unstale":"2024-09-22T09:16:52.963074+0000","last_undegraded":"2024-09-22T09:16:52.963074+0000","last_fullsized":"2024-09-22T09:16:52.963074+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'168","last_scrub_stamp":"2024-09-22T09:16:52.962994+0000","last_deep_scrub":"261'168","last_deep_scrub_stamp":"2024-09-22T09:16:52.962994+0000","last_clean_scrub_stamp":"2024-09-22T09:16:52.962994+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:53.207528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":251,"num_write":334,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'509","reported_seq":2223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.919171+0000","last_change":"2024-09-22T09:16:21.919171+0000","last_active":"2024-09-22T09:16:21.919171+0000","last_peered":"2024-09-22T09:16:21.919171+0000","last_clean":"2024-09-22T09:16:21.919171+0000","last_became_active":"2024-09-22T08:17:40.320693+0000","last_became_peered":"2024-09-22T08:17:40.320693+0000","last_unstale":"2024-09-22T09:16:21.919171+0000","last_undegraded":"2024-09-22T09:16:21.919171+0000","last_fullsized":"2024-09-22T09:16:21.919171+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'509","last_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_deep_scrub":"261'509","last_deep_scrub_stamp":"2024-09-22T09:16:21.919066+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.919066+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:06.667960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2568,"num_write":592,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'372","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.163050+0000","last_change":"2024-09-22T09:16:11.163050+0000","last_active":"2024-09-22T09:16:11.163050+0000","last_peered":"2024-09-22T09:16:11.163050+0000","last_clean":"2024-09-22T09:16:11.163050+0000","last_became_active":"2024-09-22T08:17:38.297156+0000","last_became_peered":"2024-09-22T08:17:38.297156+0000","last_unstale":"2024-09-22T09:16:11.163050+0000","last_undegraded":"2024-09-22T09:16:11.163050+0000","last_fullsized":"2024-09-22T09:16:11.163050+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-22T09:16:11.162937+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.162937+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:59.374048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":33741,"num_write":1117,"num_write_kb":35710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:26.202193+0000","last_change":"2024-09-22T09:16:26.202193+0000","last_active":"2024-09-22T09:16:26.202193+0000","last_peered":"2024-09-22T09:16:26.202193+0000","last_clean":"2024-09-22T09:16:26.202193+0000","last_became_active":"2024-09-22T08:17:42.321155+0000","last_became_peered":"2024-09-22T08:17:42.321155+0000","last_unstale":"2024-09-22T09:16:26.202193+0000","last_undegraded":"2024-09-22T09:16:26.202193+0000","last_fullsized":"2024-09-22T09:16:26.202193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:26.202094+0000","last_clean_scrub_stamp":"2024-09-22T09:16:26.202094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:26.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.648190+0000","last_change":"2024-09-22T09:16:29.648190+0000","last_active":"2024-09-22T09:16:29.648190+0000","last_peered":"2024-09-22T09:16:29.648190+0000","last_clean":"2024-09-22T09:16:29.648190+0000","last_became_active":"2024-09-22T08:17:44.333732+0000","last_became_peered":"2024-09-22T08:17:44.333732+0000","last_unstale":"2024-09-22T09:16:29.648190+0000","last_undegraded":"2024-09-22T09:16:29.648190+0000","last_fullsized":"2024-09-22T09:16:29.648190+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-22T09:16:29.648057+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.648057+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:58.062115+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53474,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":1042,"num_write":392,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:41.575584+0000","last_change":"2024-09-22T09:16:41.575584+0000","last_active":"2024-09-22T09:16:41.575584+0000","last_peered":"2024-09-22T09:16:41.575584+0000","last_clean":"2024-09-22T09:16:41.575584+0000","last_became_active":"2024-09-22T08:17:46.356586+0000","last_became_peered":"2024-09-22T08:17:46.356586+0000","last_unstale":"2024-09-22T09:16:41.575584+0000","last_undegraded":"2024-09-22T09:16:41.575584+0000","last_fullsized":"2024-09-22T09:16:41.575584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:41.575466+0000","last_clean_scrub_stamp":"2024-09-22T09:16:41.575466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:56.385870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'134","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:38.214251+0000","last_change":"2024-09-22T09:16:38.214251+0000","last_active":"2024-09-22T09:16:38.214251+0000","last_peered":"2024-09-22T09:16:38.214251+0000","last_clean":"2024-09-22T09:16:38.214251+0000","last_became_active":"2024-09-22T08:17:48.365960+0000","last_became_peered":"2024-09-22T08:17:48.365960+0000","last_unstale":"2024-09-22T09:16:38.214251+0000","last_undegraded":"2024-09-22T09:16:38.214251+0000","last_fullsized":"2024-09-22T09:16:38.214251+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-22T09:16:38.214150+0000","last_clean_scrub_stamp":"2024-09-22T09:16:38.214150+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:26:12.089725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":195,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'1511","reported_seq":3232,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.894120+0000","last_change":"2024-09-22T09:16:20.894120+0000","last_active":"2024-09-22T09:16:20.894120+0000","last_peered":"2024-09-22T09:16:20.894120+0000","last_clean":"2024-09-22T09:16:20.894120+0000","last_became_active":"2024-09-22T08:17:40.310696+0000","last_became_peered":"2024-09-22T08:17:40.310696+0000","last_unstale":"2024-09-22T09:16:20.894120+0000","last_undegraded":"2024-09-22T09:16:20.894120+0000","last_fullsized":"2024-09-22T09:16:20.894120+0000","mapping_epoch":27,"log_start":"261'1500","ondisk_log_start":"261'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1511","last_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_deep_scrub":"261'1511","last_deep_scrub_stamp":"2024-09-22T09:16:20.894035+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.894035+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":1500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:28.749939+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6861,"num_read_kb":6053,"num_write":2095,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'336","reported_seq":1087,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:20.280118+0000","last_change":"2024-09-22T09:16:20.280118+0000","last_active":"2024-09-22T09:16:20.280118+0000","last_peered":"2024-09-22T09:16:20.280118+0000","last_clean":"2024-09-22T09:16:20.280118+0000","last_became_active":"2024-09-22T08:17:38.304584+0000","last_became_peered":"2024-09-22T08:17:38.304584+0000","last_unstale":"2024-09-22T09:16:20.280118+0000","last_undegraded":"2024-09-22T09:16:20.280118+0000","last_fullsized":"2024-09-22T09:16:20.280118+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-22T09:16:20.279952+0000","last_clean_scrub_stamp":"2024-09-22T09:16:20.279952+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:57.092613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":31338,"num_write":1035,"num_write_kb":39043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.006452+0000","last_change":"2024-09-22T09:16:25.006452+0000","last_active":"2024-09-22T09:16:25.006452+0000","last_peered":"2024-09-22T09:16:25.006452+0000","last_clean":"2024-09-22T09:16:25.006452+0000","last_became_active":"2024-09-22T08:17:42.317807+0000","last_became_peered":"2024-09-22T08:17:42.317807+0000","last_unstale":"2024-09-22T09:16:25.006452+0000","last_undegraded":"2024-09-22T09:16:25.006452+0000","last_fullsized":"2024-09-22T09:16:25.006452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.006360+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.006360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:22.141389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'314","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:37.622472+0000","last_change":"2024-09-22T09:16:37.622472+0000","last_active":"2024-09-22T09:16:37.622472+0000","last_peered":"2024-09-22T09:16:37.622472+0000","last_clean":"2024-09-22T09:16:37.622472+0000","last_became_active":"2024-09-22T08:17:44.332498+0000","last_became_peered":"2024-09-22T08:17:44.332498+0000","last_unstale":"2024-09-22T09:16:37.622472+0000","last_undegraded":"2024-09-22T09:16:37.622472+0000","last_fullsized":"2024-09-22T09:16:37.622472+0000","mapping_epoch":31,"log_start":"261'301","ondisk_log_start":"261'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-22T09:16:37.622379+0000","last_clean_scrub_stamp":"2024-09-22T09:16:37.622379+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:59.309829+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148291,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":1361,"num_write":420,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:49.058916+0000","last_change":"2024-09-22T09:16:49.058916+0000","last_active":"2024-09-22T09:16:49.058916+0000","last_peered":"2024-09-22T09:16:49.058916+0000","last_clean":"2024-09-22T09:16:49.058916+0000","last_became_active":"2024-09-22T08:17:46.349213+0000","last_became_peered":"2024-09-22T08:17:46.349213+0000","last_unstale":"2024-09-22T09:16:49.058916+0000","last_undegraded":"2024-09-22T09:16:49.058916+0000","last_fullsized":"2024-09-22T09:16:49.058916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:49.058805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:49.058805+0000","last_clean_scrub_stamp":"2024-09-22T09:16:49.058805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:24.017149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'132","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:47.811452+0000","last_change":"2024-09-22T09:16:47.811452+0000","last_active":"2024-09-22T09:16:47.811452+0000","last_peered":"2024-09-22T09:16:47.811452+0000","last_clean":"2024-09-22T09:16:47.811452+0000","last_became_active":"2024-09-22T08:17:48.369230+0000","last_became_peered":"2024-09-22T08:17:48.369230+0000","last_unstale":"2024-09-22T09:16:47.811452+0000","last_undegraded":"2024-09-22T09:16:47.811452+0000","last_fullsized":"2024-09-22T09:16:47.811452+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-22T09:16:47.811358+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-22T09:16:47.811358+0000","last_clean_scrub_stamp":"2024-09-22T09:16:47.811358+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:00.388141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'510","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.743151+0000","last_change":"2024-09-22T09:16:17.743151+0000","last_active":"2024-09-22T09:16:17.743151+0000","last_peered":"2024-09-22T09:16:17.743151+0000","last_clean":"2024-09-22T09:16:17.743151+0000","last_became_active":"2024-09-22T08:17:40.309790+0000","last_became_peered":"2024-09-22T08:17:40.309790+0000","last_unstale":"2024-09-22T09:16:17.743151+0000","last_undegraded":"2024-09-22T09:16:17.743151+0000","last_fullsized":"2024-09-22T09:16:17.743151+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'510","last_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_deep_scrub":"261'510","last_deep_scrub_stamp":"2024-09-22T09:16:17.743028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.743028+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:20:54.091402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2410,"num_write":629,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'380","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.809942+0000","last_change":"2024-09-22T09:16:12.809942+0000","last_active":"2024-09-22T09:16:12.809942+0000","last_peered":"2024-09-22T09:16:12.809942+0000","last_clean":"2024-09-22T09:16:12.809942+0000","last_became_active":"2024-09-22T08:17:38.307538+0000","last_became_peered":"2024-09-22T08:17:38.307538+0000","last_unstale":"2024-09-22T09:16:12.809942+0000","last_undegraded":"2024-09-22T09:16:12.809942+0000","last_fullsized":"2024-09-22T09:16:12.809942+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-22T09:16:12.809787+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.809787+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:23.365576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":50427,"num_write":1201,"num_write_kb":36018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.227143+0000","last_change":"2024-09-22T09:16:25.227143+0000","last_active":"2024-09-22T09:16:25.227143+0000","last_peered":"2024-09-22T09:16:25.227143+0000","last_clean":"2024-09-22T09:16:25.227143+0000","last_became_active":"2024-09-22T08:17:42.317803+0000","last_became_peered":"2024-09-22T08:17:42.317803+0000","last_unstale":"2024-09-22T09:16:25.227143+0000","last_undegraded":"2024-09-22T09:16:25.227143+0000","last_fullsized":"2024-09-22T09:16:25.227143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:25.227042+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.227042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:04.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'249","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.205123+0000","last_change":"2024-09-22T09:16:30.205123+0000","last_active":"2024-09-22T09:16:30.205123+0000","last_peered":"2024-09-22T09:16:30.205123+0000","last_clean":"2024-09-22T09:16:30.205123+0000","last_became_active":"2024-09-22T08:17:44.331813+0000","last_became_peered":"2024-09-22T08:17:44.331813+0000","last_unstale":"2024-09-22T09:16:30.205123+0000","last_undegraded":"2024-09-22T09:16:30.205123+0000","last_fullsized":"2024-09-22T09:16:30.205123+0000","mapping_epoch":31,"log_start":"261'200","ondisk_log_start":"261'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-22T09:16:30.205028+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.205028+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:12.680661+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43840,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":1016,"num_write":348,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:51.022708+0000","last_change":"2024-09-22T09:16:51.022708+0000","last_active":"2024-09-22T09:16:51.022708+0000","last_peered":"2024-09-22T09:16:51.022708+0000","last_clean":"2024-09-22T09:16:51.022708+0000","last_became_active":"2024-09-22T08:17:46.353331+0000","last_became_peered":"2024-09-22T08:17:46.353331+0000","last_unstale":"2024-09-22T09:16:51.022708+0000","last_undegraded":"2024-09-22T09:16:51.022708+0000","last_fullsized":"2024-09-22T09:16:51.022708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:51.022620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:51.022620+0000","last_clean_scrub_stamp":"2024-09-22T09:16:51.022620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:00:40.269124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'192","reported_seq":1652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:55.010457+0000","last_change":"2024-09-22T09:16:55.010457+0000","last_active":"2024-09-22T09:16:55.010457+0000","last_peered":"2024-09-22T09:16:55.010457+0000","last_clean":"2024-09-22T09:16:55.010457+0000","last_became_active":"2024-09-22T08:17:48.362820+0000","last_became_peered":"2024-09-22T08:17:48.362820+0000","last_unstale":"2024-09-22T09:16:55.010457+0000","last_undegraded":"2024-09-22T09:16:55.010457+0000","last_fullsized":"2024-09-22T09:16:55.010457+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-22T09:16:55.010356+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-22T09:16:55.010356+0000","last_clean_scrub_stamp":"2024-09-22T09:16:55.010356+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:04.923573+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1224,"num_read_kb":1219,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'431","reported_seq":2007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.853453+0000","last_change":"2024-09-22T09:16:19.853453+0000","last_active":"2024-09-22T09:16:19.853453+0000","last_peered":"2024-09-22T09:16:19.853453+0000","last_clean":"2024-09-22T09:16:19.853453+0000","last_became_active":"2024-09-22T08:17:40.314545+0000","last_became_peered":"2024-09-22T08:17:40.314545+0000","last_unstale":"2024-09-22T09:16:19.853453+0000","last_undegraded":"2024-09-22T09:16:19.853453+0000","last_fullsized":"2024-09-22T09:16:19.853453+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'431","last_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_deep_scrub":"261'431","last_deep_scrub_stamp":"2024-09-22T09:16:19.853368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.853368+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:53.654543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2165,"num_write":464,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'350","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.739492+0000","last_change":"2024-09-22T09:16:16.739492+0000","last_active":"2024-09-22T09:16:16.739492+0000","last_peered":"2024-09-22T09:16:16.739492+0000","last_clean":"2024-09-22T09:16:16.739492+0000","last_became_active":"2024-09-22T08:17:38.310981+0000","last_became_peered":"2024-09-22T08:17:38.310981+0000","last_unstale":"2024-09-22T09:16:16.739492+0000","last_undegraded":"2024-09-22T09:16:16.739492+0000","last_fullsized":"2024-09-22T09:16:16.739492+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'350","last_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_deep_scrub":"261'350","last_deep_scrub_stamp":"2024-09-22T09:16:16.739368+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.739368+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:59.971534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":43723,"num_write":1129,"num_write_kb":46673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":502,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:30.658377+0000","last_change":"2024-09-22T09:16:30.658377+0000","last_active":"2024-09-22T09:16:30.658377+0000","last_peered":"2024-09-22T09:16:30.658377+0000","last_clean":"2024-09-22T09:16:30.658377+0000","last_became_active":"2024-09-22T08:17:42.313559+0000","last_became_peered":"2024-09-22T08:17:42.313559+0000","last_unstale":"2024-09-22T09:16:30.658377+0000","last_undegraded":"2024-09-22T09:16:30.658377+0000","last_fullsized":"2024-09-22T09:16:30.658377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-22T09:16:30.658291+0000","last_clean_scrub_stamp":"2024-09-22T09:16:30.658291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:13.543896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'318","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:44.113220+0000","last_change":"2024-09-22T09:16:44.113220+0000","last_active":"2024-09-22T09:16:44.113220+0000","last_peered":"2024-09-22T09:16:44.113220+0000","last_clean":"2024-09-22T09:16:44.113220+0000","last_became_active":"2024-09-22T08:17:44.339132+0000","last_became_peered":"2024-09-22T08:17:44.339132+0000","last_unstale":"2024-09-22T09:16:44.113220+0000","last_undegraded":"2024-09-22T09:16:44.113220+0000","last_fullsized":"2024-09-22T09:16:44.113220+0000","mapping_epoch":31,"log_start":"261'300","ondisk_log_start":"261'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-22T09:16:44.113127+0000","last_clean_scrub_stamp":"2024-09-22T09:16:44.113127+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:18.587541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":1187,"num_write":420,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:42.621967+0000","last_change":"2024-09-22T09:16:42.621967+0000","last_active":"2024-09-22T09:16:42.621967+0000","last_peered":"2024-09-22T09:16:42.621967+0000","last_clean":"2024-09-22T09:16:42.621967+0000","last_became_active":"2024-09-22T08:17:46.354105+0000","last_became_peered":"2024-09-22T08:17:46.354105+0000","last_unstale":"2024-09-22T09:16:42.621967+0000","last_undegraded":"2024-09-22T09:16:42.621967+0000","last_fullsized":"2024-09-22T09:16:42.621967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:16:42.621829+0000","last_clean_scrub_stamp":"2024-09-22T09:16:42.621829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:16.010558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'142","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:32.574857+0000","last_change":"2024-09-22T09:16:32.574857+0000","last_active":"2024-09-22T09:16:32.574857+0000","last_peered":"2024-09-22T09:16:32.574857+0000","last_clean":"2024-09-22T09:16:32.574857+0000","last_became_active":"2024-09-22T08:17:48.371740+0000","last_became_peered":"2024-09-22T08:17:48.371740+0000","last_unstale":"2024-09-22T09:16:32.574857+0000","last_undegraded":"2024-09-22T09:16:32.574857+0000","last_fullsized":"2024-09-22T09:16:32.574857+0000","mapping_epoch":35,"log_start":"261'100","ondisk_log_start":"261'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-22T09:16:32.574766+0000","last_clean_scrub_stamp":"2024-09-22T09:16:32.574766+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:00:40.930130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":324,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'515","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.759180+0000","last_change":"2024-09-22T09:16:21.759180+0000","last_active":"2024-09-22T09:16:21.759180+0000","last_peered":"2024-09-22T09:16:21.759180+0000","last_clean":"2024-09-22T09:16:21.759180+0000","last_became_active":"2024-09-22T08:17:40.315406+0000","last_became_peered":"2024-09-22T08:17:40.315406+0000","last_unstale":"2024-09-22T09:16:21.759180+0000","last_undegraded":"2024-09-22T09:16:21.759180+0000","last_fullsized":"2024-09-22T09:16:21.759180+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'515","last_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_deep_scrub":"261'515","last_deep_scrub_stamp":"2024-09-22T09:16:21.759089+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.759089+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:02.438247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2561,"num_read_kb":2398,"num_write":596,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'327","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:11.872831+0000","last_change":"2024-09-22T09:16:11.872831+0000","last_active":"2024-09-22T09:16:11.872831+0000","last_peered":"2024-09-22T09:16:11.872831+0000","last_clean":"2024-09-22T09:16:11.872831+0000","last_became_active":"2024-09-22T08:17:38.306828+0000","last_became_peered":"2024-09-22T08:17:38.306828+0000","last_unstale":"2024-09-22T09:16:11.872831+0000","last_undegraded":"2024-09-22T09:16:11.872831+0000","last_fullsized":"2024-09-22T09:16:11.872831+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-22T09:16:11.872713+0000","last_clean_scrub_stamp":"2024-09-22T09:16:11.872713+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:43.753796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":538,"num_read_kb":33852,"num_write":961,"num_write_kb":34568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'420","reported_seq":1887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.764056+0000","last_change":"2024-09-22T09:16:19.764056+0000","last_active":"2024-09-22T09:16:19.764056+0000","last_peered":"2024-09-22T09:16:19.764056+0000","last_clean":"2024-09-22T09:16:19.764056+0000","last_became_active":"2024-09-22T08:17:40.312749+0000","last_became_peered":"2024-09-22T08:17:40.312749+0000","last_unstale":"2024-09-22T09:16:19.764056+0000","last_undegraded":"2024-09-22T09:16:19.764056+0000","last_fullsized":"2024-09-22T09:16:19.764056+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'420","last_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_deep_scrub":"261'420","last_deep_scrub_stamp":"2024-09-22T09:16:19.763959+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.763959+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:20.402662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2176,"num_read_kb":2049,"num_write":486,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'329","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.806176+0000","last_change":"2024-09-22T09:16:12.806176+0000","last_active":"2024-09-22T09:16:12.806176+0000","last_peered":"2024-09-22T09:16:12.806176+0000","last_clean":"2024-09-22T09:16:12.806176+0000","last_became_active":"2024-09-22T08:17:38.300015+0000","last_became_peered":"2024-09-22T08:17:38.300015+0000","last_unstale":"2024-09-22T09:16:12.806176+0000","last_undegraded":"2024-09-22T09:16:12.806176+0000","last_fullsized":"2024-09-22T09:16:12.806176+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-22T09:16:12.806058+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.806058+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:09:03.340195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":555,"num_read_kb":87971,"num_write":959,"num_write_kb":38061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'828","reported_seq":2483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:31.189423+0000","last_change":"2024-09-22T09:16:31.189423+0000","last_active":"2024-09-22T09:16:31.189423+0000","last_peered":"2024-09-22T09:16:31.189423+0000","last_clean":"2024-09-22T09:16:31.189423+0000","last_became_active":"2024-09-22T08:17:40.312420+0000","last_became_peered":"2024-09-22T08:17:40.312420+0000","last_unstale":"2024-09-22T09:16:31.189423+0000","last_undegraded":"2024-09-22T09:16:31.189423+0000","last_fullsized":"2024-09-22T09:16:31.189423+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'828","last_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_deep_scrub":"261'828","last_deep_scrub_stamp":"2024-09-22T09:16:31.189355+0000","last_clean_scrub_stamp":"2024-09-22T09:16:31.189355+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:13.809990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4154,"num_read_kb":3770,"num_write":1131,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'408","reported_seq":1113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.276787+0000","last_change":"2024-09-22T09:16:21.276787+0000","last_active":"2024-09-22T09:16:21.276787+0000","last_peered":"2024-09-22T09:16:21.276787+0000","last_clean":"2024-09-22T09:16:21.276787+0000","last_became_active":"2024-09-22T08:17:38.322693+0000","last_became_peered":"2024-09-22T08:17:38.322693+0000","last_unstale":"2024-09-22T09:16:21.276787+0000","last_undegraded":"2024-09-22T09:16:21.276787+0000","last_fullsized":"2024-09-22T09:16:21.276787+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-22T09:16:21.276682+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.276682+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:46:18.486550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":902,"num_read_kb":34719,"num_write":1272,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'749","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:28.677305+0000","last_change":"2024-09-22T09:16:28.677305+0000","last_active":"2024-09-22T09:16:28.677305+0000","last_peered":"2024-09-22T09:16:28.677305+0000","last_clean":"2024-09-22T09:16:28.677305+0000","last_became_active":"2024-09-22T08:17:40.312791+0000","last_became_peered":"2024-09-22T08:17:40.312791+0000","last_unstale":"2024-09-22T09:16:28.677305+0000","last_undegraded":"2024-09-22T09:16:28.677305+0000","last_fullsized":"2024-09-22T09:16:28.677305+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'749","last_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_deep_scrub":"261'749","last_deep_scrub_stamp":"2024-09-22T09:16:28.677182+0000","last_clean_scrub_stamp":"2024-09-22T09:16:28.677182+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:57.444450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3976,"num_read_kb":3605,"num_write":1080,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:14.763130+0000","last_change":"2024-09-22T09:16:14.763130+0000","last_active":"2024-09-22T09:16:14.763130+0000","last_peered":"2024-09-22T09:16:14.763130+0000","last_clean":"2024-09-22T09:16:14.763130+0000","last_became_active":"2024-09-22T08:17:38.309447+0000","last_became_peered":"2024-09-22T08:17:38.309447+0000","last_unstale":"2024-09-22T09:16:14.763130+0000","last_undegraded":"2024-09-22T09:16:14.763130+0000","last_fullsized":"2024-09-22T09:16:14.763130+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-22T09:16:14.762983+0000","last_clean_scrub_stamp":"2024-09-22T09:16:14.762983+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:22:17.416002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":20346,"num_write":1128,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'501","reported_seq":2082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:25.679439+0000","last_change":"2024-09-22T09:16:25.679439+0000","last_active":"2024-09-22T09:16:25.679439+0000","last_peered":"2024-09-22T09:16:25.679439+0000","last_clean":"2024-09-22T09:16:25.679439+0000","last_became_active":"2024-09-22T08:17:40.313426+0000","last_became_peered":"2024-09-22T08:17:40.313426+0000","last_unstale":"2024-09-22T09:16:25.679439+0000","last_undegraded":"2024-09-22T09:16:25.679439+0000","last_fullsized":"2024-09-22T09:16:25.679439+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'501","last_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_deep_scrub":"261'501","last_deep_scrub_stamp":"2024-09-22T09:16:25.679334+0000","last_clean_scrub_stamp":"2024-09-22T09:16:25.679334+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:06:59.317670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2534,"num_read_kb":2365,"num_write":576,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'326","reported_seq":949,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.224569+0000","last_change":"2024-09-22T09:16:13.224569+0000","last_active":"2024-09-22T09:16:13.224569+0000","last_peered":"2024-09-22T09:16:13.224569+0000","last_clean":"2024-09-22T09:16:13.224569+0000","last_became_active":"2024-09-22T08:17:38.311633+0000","last_became_peered":"2024-09-22T08:17:38.311633+0000","last_unstale":"2024-09-22T09:16:13.224569+0000","last_undegraded":"2024-09-22T09:16:13.224569+0000","last_fullsized":"2024-09-22T09:16:13.224569+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-22T09:16:13.224470+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.224470+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:14.022870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26435,"num_write":1053,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'719","reported_seq":2230,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.439057+0000","last_change":"2024-09-22T09:16:18.439057+0000","last_active":"2024-09-22T09:16:18.439057+0000","last_peered":"2024-09-22T09:16:18.439057+0000","last_clean":"2024-09-22T09:16:18.439057+0000","last_became_active":"2024-09-22T08:17:40.312269+0000","last_became_peered":"2024-09-22T08:17:40.312269+0000","last_unstale":"2024-09-22T09:16:18.439057+0000","last_undegraded":"2024-09-22T09:16:18.439057+0000","last_fullsized":"2024-09-22T09:16:18.439057+0000","mapping_epoch":27,"log_start":"261'700","ondisk_log_start":"261'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'719","last_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_deep_scrub":"261'719","last_deep_scrub_stamp":"2024-09-22T09:16:18.438942+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.438942+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:24.048331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3220,"num_write":949,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'356","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.218832+0000","last_change":"2024-09-22T09:16:12.218832+0000","last_active":"2024-09-22T09:16:12.218832+0000","last_peered":"2024-09-22T09:16:12.218832+0000","last_clean":"2024-09-22T09:16:12.218832+0000","last_became_active":"2024-09-22T08:17:38.307758+0000","last_became_peered":"2024-09-22T08:17:38.307758+0000","last_unstale":"2024-09-22T09:16:12.218832+0000","last_undegraded":"2024-09-22T09:16:12.218832+0000","last_fullsized":"2024-09-22T09:16:12.218832+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-22T09:16:12.218723+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.218723+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:55.208712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":780,"num_read_kb":911,"num_write":1065,"num_write_kb":47580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'463","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.152371+0000","last_change":"2024-09-22T09:16:23.152371+0000","last_active":"2024-09-22T09:16:23.152371+0000","last_peered":"2024-09-22T09:16:23.152371+0000","last_clean":"2024-09-22T09:16:23.152371+0000","last_became_active":"2024-09-22T08:17:40.319477+0000","last_became_peered":"2024-09-22T08:17:40.319477+0000","last_unstale":"2024-09-22T09:16:23.152371+0000","last_undegraded":"2024-09-22T09:16:23.152371+0000","last_fullsized":"2024-09-22T09:16:23.152371+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'463","last_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_deep_scrub":"261'463","last_deep_scrub_stamp":"2024-09-22T09:16:23.152260+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.152260+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:19.327801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2691,"num_read_kb":2545,"num_write":528,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'445","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.895888+0000","last_change":"2024-09-22T09:16:12.895888+0000","last_active":"2024-09-22T09:16:12.895888+0000","last_peered":"2024-09-22T09:16:12.895888+0000","last_clean":"2024-09-22T09:16:12.895888+0000","last_became_active":"2024-09-22T08:17:38.311798+0000","last_became_peered":"2024-09-22T08:17:38.311798+0000","last_unstale":"2024-09-22T09:16:12.895888+0000","last_undegraded":"2024-09-22T09:16:12.895888+0000","last_fullsized":"2024-09-22T09:16:12.895888+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-22T09:16:12.895757+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.895757+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:49.967455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":934,"num_read_kb":31165,"num_write":1662,"num_write_kb":57388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'491","reported_seq":2219,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:15.166984+0000","last_change":"2024-09-22T09:16:15.166984+0000","last_active":"2024-09-22T09:16:15.166984+0000","last_peered":"2024-09-22T09:16:15.166984+0000","last_clean":"2024-09-22T09:16:15.166984+0000","last_became_active":"2024-09-22T08:17:40.316360+0000","last_became_peered":"2024-09-22T08:17:40.316360+0000","last_unstale":"2024-09-22T09:16:15.166984+0000","last_undegraded":"2024-09-22T09:16:15.166984+0000","last_fullsized":"2024-09-22T09:16:15.166984+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'491","last_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_deep_scrub":"261'491","last_deep_scrub_stamp":"2024-09-22T09:16:15.166903+0000","last_clean_scrub_stamp":"2024-09-22T09:16:15.166903+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:58.210857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2682,"num_read_kb":2545,"num_write":528,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'323","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.737155+0000","last_change":"2024-09-22T09:16:19.737155+0000","last_active":"2024-09-22T09:16:19.737155+0000","last_peered":"2024-09-22T09:16:19.737155+0000","last_clean":"2024-09-22T09:16:19.737155+0000","last_became_active":"2024-09-22T08:17:38.306805+0000","last_became_peered":"2024-09-22T08:17:38.306805+0000","last_unstale":"2024-09-22T09:16:19.737155+0000","last_undegraded":"2024-09-22T09:16:19.737155+0000","last_fullsized":"2024-09-22T09:16:19.737155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-22T09:16:19.737050+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.737050+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:20.503931+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":8118,"num_write":1009,"num_write_kb":30960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'854","reported_seq":2603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.673418+0000","last_change":"2024-09-22T09:16:22.673418+0000","last_active":"2024-09-22T09:16:22.673418+0000","last_peered":"2024-09-22T09:16:22.673418+0000","last_clean":"2024-09-22T09:16:22.673418+0000","last_became_active":"2024-09-22T08:17:40.310458+0000","last_became_peered":"2024-09-22T08:17:40.310458+0000","last_unstale":"2024-09-22T09:16:22.673418+0000","last_undegraded":"2024-09-22T09:16:22.673418+0000","last_fullsized":"2024-09-22T09:16:22.673418+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'854","last_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_deep_scrub":"261'854","last_deep_scrub_stamp":"2024-09-22T09:16:22.673327+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.673327+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:44.554979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4288,"num_read_kb":3908,"num_write":1135,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'407","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.286192+0000","last_change":"2024-09-22T09:16:22.286115+0000","last_active":"2024-09-22T09:16:22.286192+0000","last_peered":"2024-09-22T09:16:22.286192+0000","last_clean":"2024-09-22T09:16:22.286192+0000","last_became_active":"2024-09-22T08:17:38.300661+0000","last_became_peered":"2024-09-22T08:17:38.300661+0000","last_unstale":"2024-09-22T09:16:22.286192+0000","last_undegraded":"2024-09-22T09:16:22.286192+0000","last_fullsized":"2024-09-22T09:16:22.286192+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'407","last_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_deep_scrub":"261'407","last_deep_scrub_stamp":"2024-09-22T09:16:22.285976+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.285976+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:01:50.371655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":773,"num_read_kb":152949,"num_write":1317,"num_write_kb":45742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'442","reported_seq":2080,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:19.482793+0000","last_change":"2024-09-22T09:16:19.482793+0000","last_active":"2024-09-22T09:16:19.482793+0000","last_peered":"2024-09-22T09:16:19.482793+0000","last_clean":"2024-09-22T09:16:19.482793+0000","last_became_active":"2024-09-22T08:17:40.307551+0000","last_became_peered":"2024-09-22T08:17:40.307551+0000","last_unstale":"2024-09-22T09:16:19.482793+0000","last_undegraded":"2024-09-22T09:16:19.482793+0000","last_fullsized":"2024-09-22T09:16:19.482793+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'442","last_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_deep_scrub":"261'442","last_deep_scrub_stamp":"2024-09-22T09:16:19.482692+0000","last_clean_scrub_stamp":"2024-09-22T09:16:19.482692+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:42.895660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2713,"num_read_kb":2568,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'344","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.751453+0000","last_change":"2024-09-22T09:16:17.751453+0000","last_active":"2024-09-22T09:16:17.751453+0000","last_peered":"2024-09-22T09:16:17.751453+0000","last_clean":"2024-09-22T09:16:17.751453+0000","last_became_active":"2024-09-22T08:17:38.309170+0000","last_became_peered":"2024-09-22T08:17:38.309170+0000","last_unstale":"2024-09-22T09:16:17.751453+0000","last_undegraded":"2024-09-22T09:16:17.751453+0000","last_fullsized":"2024-09-22T09:16:17.751453+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-22T09:16:17.751277+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.751277+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:30.489888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":609,"num_read_kb":9331,"num_write":1190,"num_write_kb":37894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'930","reported_seq":2517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:29.699494+0000","last_change":"2024-09-22T09:16:29.699494+0000","last_active":"2024-09-22T09:16:29.699494+0000","last_peered":"2024-09-22T09:16:29.699494+0000","last_clean":"2024-09-22T09:16:29.699494+0000","last_became_active":"2024-09-22T08:17:40.318261+0000","last_became_peered":"2024-09-22T08:17:40.318261+0000","last_unstale":"2024-09-22T09:16:29.699494+0000","last_undegraded":"2024-09-22T09:16:29.699494+0000","last_fullsized":"2024-09-22T09:16:29.699494+0000","mapping_epoch":27,"log_start":"261'900","ondisk_log_start":"261'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'930","last_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_deep_scrub":"261'930","last_deep_scrub_stamp":"2024-09-22T09:16:29.699399+0000","last_clean_scrub_stamp":"2024-09-22T09:16:29.699399+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:20.466619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4443,"num_read_kb":3978,"num_write":1279,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'357","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:12.200735+0000","last_change":"2024-09-22T09:16:12.200735+0000","last_active":"2024-09-22T09:16:12.200735+0000","last_peered":"2024-09-22T09:16:12.200735+0000","last_clean":"2024-09-22T09:16:12.200735+0000","last_became_active":"2024-09-22T08:17:38.300626+0000","last_became_peered":"2024-09-22T08:17:38.300626+0000","last_unstale":"2024-09-22T09:16:12.200735+0000","last_undegraded":"2024-09-22T09:16:12.200735+0000","last_fullsized":"2024-09-22T09:16:12.200735+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-22T09:16:12.200550+0000","last_clean_scrub_stamp":"2024-09-22T09:16:12.200550+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:39.553247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":484,"num_write":1192,"num_write_kb":40449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'831","reported_seq":2470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.203293+0000","last_change":"2024-09-22T09:16:18.203293+0000","last_active":"2024-09-22T09:16:18.203293+0000","last_peered":"2024-09-22T09:16:18.203293+0000","last_clean":"2024-09-22T09:16:18.203293+0000","last_became_active":"2024-09-22T08:17:40.315370+0000","last_became_peered":"2024-09-22T08:17:40.315370+0000","last_unstale":"2024-09-22T09:16:18.203293+0000","last_undegraded":"2024-09-22T09:16:18.203293+0000","last_fullsized":"2024-09-22T09:16:18.203293+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'831","last_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_deep_scrub":"261'831","last_deep_scrub_stamp":"2024-09-22T09:16:18.203194+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.203194+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:46.422305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3961,"num_read_kb":3589,"num_write":1078,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'455","reported_seq":1183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.719575+0000","last_change":"2024-09-22T09:16:16.719575+0000","last_active":"2024-09-22T09:16:16.719575+0000","last_peered":"2024-09-22T09:16:16.719575+0000","last_clean":"2024-09-22T09:16:16.719575+0000","last_became_active":"2024-09-22T08:17:38.310824+0000","last_became_peered":"2024-09-22T08:17:38.310824+0000","last_unstale":"2024-09-22T09:16:16.719575+0000","last_undegraded":"2024-09-22T09:16:16.719575+0000","last_fullsized":"2024-09-22T09:16:16.719575+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'455","last_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_deep_scrub":"261'455","last_deep_scrub_stamp":"2024-09-22T09:16:16.719441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.719441+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:51:32.637454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":882,"num_read_kb":67486,"num_write":1537,"num_write_kb":37547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'443","reported_seq":1866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:17.178525+0000","last_change":"2024-09-22T09:16:17.178525+0000","last_active":"2024-09-22T09:16:17.178525+0000","last_peered":"2024-09-22T09:16:17.178525+0000","last_clean":"2024-09-22T09:16:17.178525+0000","last_became_active":"2024-09-22T08:17:40.315962+0000","last_became_peered":"2024-09-22T08:17:40.315962+0000","last_unstale":"2024-09-22T09:16:17.178525+0000","last_undegraded":"2024-09-22T09:16:17.178525+0000","last_fullsized":"2024-09-22T09:16:17.178525+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'443","last_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_deep_scrub":"261'443","last_deep_scrub_stamp":"2024-09-22T09:16:17.178441+0000","last_clean_scrub_stamp":"2024-09-22T09:16:17.178441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:33.703833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2266,"num_read_kb":2096,"num_write":521,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'315","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:09.578353+0000","last_change":"2024-09-22T09:16:09.578353+0000","last_active":"2024-09-22T09:16:09.578353+0000","last_peered":"2024-09-22T09:16:09.578353+0000","last_clean":"2024-09-22T09:16:09.578353+0000","last_became_active":"2024-09-22T08:17:38.310158+0000","last_became_peered":"2024-09-22T08:17:38.310158+0000","last_unstale":"2024-09-22T09:16:09.578353+0000","last_undegraded":"2024-09-22T09:16:09.578353+0000","last_fullsized":"2024-09-22T09:16:09.578353+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:09.578247+0000","last_clean_scrub_stamp":"2024-09-22T09:16:09.578247+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:57.589765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":4113,"num_write":1035,"num_write_kb":6866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'1344","reported_seq":3021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:18.754474+0000","last_change":"2024-09-22T09:16:18.754474+0000","last_active":"2024-09-22T09:16:18.754474+0000","last_peered":"2024-09-22T09:16:18.754474+0000","last_clean":"2024-09-22T09:16:18.754474+0000","last_became_active":"2024-09-22T08:17:40.314129+0000","last_became_peered":"2024-09-22T08:17:40.314129+0000","last_unstale":"2024-09-22T09:16:18.754474+0000","last_undegraded":"2024-09-22T09:16:18.754474+0000","last_fullsized":"2024-09-22T09:16:18.754474+0000","mapping_epoch":27,"log_start":"261'1300","ondisk_log_start":"261'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1344","last_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_deep_scrub":"261'1344","last_deep_scrub_stamp":"2024-09-22T09:16:18.754381+0000","last_clean_scrub_stamp":"2024-09-22T09:16:18.754381+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":1300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:57.272268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6386,"num_read_kb":5670,"num_write":1932,"num_write_kb":814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'330","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.246155+0000","last_change":"2024-09-22T09:16:23.246155+0000","last_active":"2024-09-22T09:16:23.246155+0000","last_peered":"2024-09-22T09:16:23.246155+0000","last_clean":"2024-09-22T09:16:23.246155+0000","last_became_active":"2024-09-22T08:17:38.319990+0000","last_became_peered":"2024-09-22T08:17:38.319990+0000","last_unstale":"2024-09-22T09:16:23.246155+0000","last_undegraded":"2024-09-22T09:16:23.246155+0000","last_fullsized":"2024-09-22T09:16:23.246155+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-22T09:16:23.246014+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.246014+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:58.979313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515353,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":7532,"num_write":972,"num_write_kb":16072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'880","reported_seq":2372,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:22.746082+0000","last_change":"2024-09-22T09:16:22.746082+0000","last_active":"2024-09-22T09:16:22.746082+0000","last_peered":"2024-09-22T09:16:22.746082+0000","last_clean":"2024-09-22T09:16:22.746082+0000","last_became_active":"2024-09-22T08:17:40.320481+0000","last_became_peered":"2024-09-22T08:17:40.320481+0000","last_unstale":"2024-09-22T09:16:22.746082+0000","last_undegraded":"2024-09-22T09:16:22.746082+0000","last_fullsized":"2024-09-22T09:16:22.746082+0000","mapping_epoch":27,"log_start":"261'800","ondisk_log_start":"261'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'880","last_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_deep_scrub":"261'880","last_deep_scrub_stamp":"2024-09-22T09:16:22.745990+0000","last_clean_scrub_stamp":"2024-09-22T09:16:22.745990+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":800,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:18.063674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6179,"num_read_kb":5697,"num_write":1389,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'315","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:13.799122+0000","last_change":"2024-09-22T09:16:13.799122+0000","last_active":"2024-09-22T09:16:13.799122+0000","last_peered":"2024-09-22T09:16:13.799122+0000","last_clean":"2024-09-22T09:16:13.799122+0000","last_became_active":"2024-09-22T08:18:09.819245+0000","last_became_peered":"2024-09-22T08:18:09.819245+0000","last_unstale":"2024-09-22T09:16:13.799122+0000","last_undegraded":"2024-09-22T09:16:13.799122+0000","last_fullsized":"2024-09-22T09:16:13.799122+0000","mapping_epoch":38,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-22T09:16:13.799007+0000","last_clean_scrub_stamp":"2024-09-22T09:16:13.799007+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:31.530684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263494,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":814,"num_read_kb":1206,"num_write":1027,"num_write_kb":25452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'589","reported_seq":2176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:16.155968+0000","last_change":"2024-09-22T09:16:16.155915+0000","last_active":"2024-09-22T09:16:16.155968+0000","last_peered":"2024-09-22T09:16:16.155968+0000","last_clean":"2024-09-22T09:16:16.155968+0000","last_became_active":"2024-09-22T08:17:40.320441+0000","last_became_peered":"2024-09-22T08:17:40.320441+0000","last_unstale":"2024-09-22T09:16:16.155968+0000","last_undegraded":"2024-09-22T09:16:16.155968+0000","last_fullsized":"2024-09-22T09:16:16.155968+0000","mapping_epoch":27,"log_start":"261'500","ondisk_log_start":"261'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'589","last_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_deep_scrub":"261'589","last_deep_scrub_stamp":"2024-09-22T09:16:16.155810+0000","last_clean_scrub_stamp":"2024-09-22T09:16:16.155810+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:48:42.833807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3002,"num_read_kb":2747,"num_write":792,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'352","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:24.237090+0000","last_change":"2024-09-22T09:16:24.237090+0000","last_active":"2024-09-22T09:16:24.237090+0000","last_peered":"2024-09-22T09:16:24.237090+0000","last_clean":"2024-09-22T09:16:24.237090+0000","last_became_active":"2024-09-22T08:17:38.316286+0000","last_became_peered":"2024-09-22T08:17:38.316286+0000","last_unstale":"2024-09-22T09:16:24.237090+0000","last_undegraded":"2024-09-22T09:16:24.237090+0000","last_fullsized":"2024-09-22T09:16:24.237090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-22T09:16:24.236968+0000","last_clean_scrub_stamp":"2024-09-22T09:16:24.236968+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:37.139334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":65832,"num_write":1085,"num_write_kb":27405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:27.212752+0000","last_change":"2024-09-22T09:16:27.212752+0000","last_active":"2024-09-22T09:16:27.212752+0000","last_peered":"2024-09-22T09:16:27.212752+0000","last_clean":"2024-09-22T09:16:27.212752+0000","last_became_active":"2024-09-22T08:17:38.312107+0000","last_became_peered":"2024-09-22T08:17:38.312107+0000","last_unstale":"2024-09-22T09:16:27.212752+0000","last_undegraded":"2024-09-22T09:16:27.212752+0000","last_fullsized":"2024-09-22T09:16:27.212752+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-22T09:16:27.212631+0000","last_clean_scrub_stamp":"2024-09-22T09:16:27.212631+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:44.538803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":15571,"num_write":1043,"num_write_kb":35122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'504","reported_seq":2200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:23.792932+0000","last_change":"2024-09-22T09:16:23.792932+0000","last_active":"2024-09-22T09:16:23.792932+0000","last_peered":"2024-09-22T09:16:23.792932+0000","last_clean":"2024-09-22T09:16:23.792932+0000","last_became_active":"2024-09-22T08:17:40.321090+0000","last_became_peered":"2024-09-22T08:17:40.321090+0000","last_unstale":"2024-09-22T09:16:23.792932+0000","last_undegraded":"2024-09-22T09:16:23.792932+0000","last_fullsized":"2024-09-22T09:16:23.792932+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'504","last_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_deep_scrub":"261'504","last_deep_scrub_stamp":"2024-09-22T09:16:23.792820+0000","last_clean_scrub_stamp":"2024-09-22T09:16:23.792820+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:41.074747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2863,"num_read_kb":2703,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.712012+0000","last_change":"2024-09-22T09:16:21.712012+0000","last_active":"2024-09-22T09:16:21.712012+0000","last_peered":"2024-09-22T09:16:21.712012+0000","last_clean":"2024-09-22T09:16:21.712012+0000","last_became_active":"2024-09-22T08:17:38.303530+0000","last_became_peered":"2024-09-22T08:17:38.303530+0000","last_unstale":"2024-09-22T09:16:21.712012+0000","last_undegraded":"2024-09-22T09:16:21.712012+0000","last_fullsized":"2024-09-22T09:16:21.712012+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-22T09:16:21.711897+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.711897+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:26.256735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":80287,"num_write":1039,"num_write_kb":17615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'505","reported_seq":2183,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-22T09:16:21.178089+0000","last_change":"2024-09-22T09:16:21.178089+0000","last_active":"2024-09-22T09:16:21.178089+0000","last_peered":"2024-09-22T09:16:21.178089+0000","last_clean":"2024-09-22T09:16:21.178089+0000","last_became_active":"2024-09-22T08:17:40.312039+0000","last_became_peered":"2024-09-22T08:17:40.312039+0000","last_unstale":"2024-09-22T09:16:21.178089+0000","last_undegraded":"2024-09-22T09:16:21.178089+0000","last_fullsized":"2024-09-22T09:16:21.178089+0000","mapping_epoch":27,"log_start":"261'400","ondisk_log_start":"261'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'505","last_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_deep_scrub":"261'505","last_deep_scrub_stamp":"2024-09-22T09:16:21.177984+0000","last_clean_scrub_stamp":"2024-09-22T09:16:21.177984+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:26.746505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2832,"num_read_kb":2664,"num_write":627,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10822,"num_read_kb":8699,"num_write":3100,"num_write_kb":1002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1004,"ondisk_log_size":1004,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16435,"num_read_kb":16110,"num_write":17090,"num_write_kb":4996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637503,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":18076,"num_read_kb":37621,"num_write":15217,"num_write_kb":11954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714578,"num_omap_keys":1636,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2200,"ondisk_log_size":2200,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221195,"num_read_kb":202413,"num_write":56222,"num_write_kb":19284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36520,"num_omap_keys":148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4073,"ondisk_log_size":4073,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":51675961,"num_objects":284,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":44405,"num_read_kb":2189102,"num_write":73344,"num_write_kb":2164483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70811648,"data_stored":70811648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3860,"ondisk_log_size":3860,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":207543,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198277,"num_write":161,"num_write_kb":139901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424510165,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276108,"kb_used_data":15868,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94095732,"statfs":{"total":96636764160,"available":96354029568,"internally_reserved":0,"allocated":16248832,"data_stored":14279973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510165,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172824,"kb_used_data":15304,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":94199016,"statfs":{"total":96636764160,"available":96459792384,"internally_reserved":0,"allocated":15671296,"data_stored":13729926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510168,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333156,"kb_used_data":13204,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94038684,"statfs":{"total":96636764160,"available":96295612416,"internally_reserved":0,"allocated":13520896,"data_stored":11543840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510167,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142640,"kb_used_data":12896,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94229200,"statfs":{"total":96636764160,"available":96490700800,"internally_reserved":0,"allocated":13205504,"data_stored":11218915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542871,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253924,"kb_used_data":11796,"kb_used_omap":1,"kb_used_meta":242110,"kb_avail":94117916,"statfs":{"total":96636764160,"available":96376745984,"internally_reserved":0,"allocated":12079104,"data_stored":10115731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":247921098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542873,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116748,"kb_used_data":9212,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255092,"statfs":{"total":96636764160,"available":96517214208,"internally_reserved":0,"allocated":9433088,"data_stored":7445675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542872,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290332,"kb_used_data":12044,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":94081508,"statfs":{"total":96636764160,"available":96339464192,"internally_reserved":0,"allocated":12333056,"data_stored":10357434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284948933},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542870,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224148,"kb_used_data":12548,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147692,"statfs":{"total":96636764160,"available":96407236608,"internally_reserved":0,"allocated":12849152,"data_stored":10882684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8757248,"data_stored":8757248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":12083200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7569408,"data_stored":7569408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7917568,"data_stored":7917568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:17:32.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T09:17:32.493 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T09:17:32.493 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T09:17:32.493 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T09:17:32.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.536 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T09:17:32.537 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T09:17:32.537 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.586 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T09:17:32.587 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T09:17:32.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.633 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T09:17:32.633 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T09:17:32.633 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.686 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T09:17:32.687 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-22T09:17:32.687 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.732 INFO:tasks.ceph.osd.4:Stopped 2024-09-22T09:17:32.732 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-22T09:17:32.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.781 INFO:tasks.ceph.osd.5:Stopped 2024-09-22T09:17:32.781 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-22T09:17:32.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.823 INFO:tasks.ceph.osd.6:Stopped 2024-09-22T09:17:32.823 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-22T09:17:32.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.872 INFO:tasks.ceph.osd.7:Stopped 2024-09-22T09:17:32.872 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T09:17:32.872 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-22T09:17:32.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.900 INFO:tasks.ceph.mgr.y:Stopped 2024-09-22T09:17:32.901 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T09:17:32.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.929 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T09:17:32.929 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T09:17:32.929 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T09:17:32.929 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:32.957 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T09:17:32.958 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-22T09:17:32.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:33.011 INFO:tasks.ceph.mon.c:Stopped 2024-09-22T09:17:33.011 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-22T09:17:33.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:17:33.023 INFO:tasks.ceph.mon.b:Stopped 2024-09-22T09:17:33.023 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T09:17:33.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-22T09:17:33.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T09:17:33.093 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T09:17:33.396 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T09:17:33.397 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T09:17:33.497 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T09:17:33.497 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T09:17:33.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T09:17:33.571 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T09:17:33.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T09:17:33.652 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-22T09:17:33.791 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T09:17:33.792 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-22T09:17:33.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T09:17:33.912 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-22T09:17:33.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T09:17:33.985 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-22T09:17:34.056 INFO:tasks.ceph:Archiving mon data... 2024-09-22T09:17:34.057 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/data/mon.a.tgz 2024-09-22T09:17:34.058 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-22T09:17:34.088 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.HYSMjrl434 2024-09-22T09:17:34.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HYSMjrl434 2024-09-22T09:17:34.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.HYSMjrl434 2024-09-22T09:17:34.430 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.HYSMjrl434 is 461KB 2024-09-22T09:17:34.528 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.HYSMjrl434 2024-09-22T09:17:34.557 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/data/mon.c.tgz 2024-09-22T09:17:34.557 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-22T09:17:34.627 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.5GmamrRQDE 2024-09-22T09:17:34.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5GmamrRQDE 2024-09-22T09:17:34.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.5GmamrRQDE 2024-09-22T09:17:34.910 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.5GmamrRQDE is 469KB 2024-09-22T09:17:35.007 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.5GmamrRQDE 2024-09-22T09:17:35.035 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/data/mon.b.tgz 2024-09-22T09:17:35.035 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-22T09:17:35.070 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.jg4orFdSfa 2024-09-22T09:17:35.070 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jg4orFdSfa 2024-09-22T09:17:35.263 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.jg4orFdSfa 2024-09-22T09:17:35.373 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.jg4orFdSfa is 469KB 2024-09-22T09:17:35.471 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.jg4orFdSfa 2024-09-22T09:17:35.499 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T09:17:35.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T09:17:35.501 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T09:17:35.686 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T09:17:35.715 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T09:17:35.715 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T09:17:35.717 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi078/crash 2024-09-22T09:17:35.718 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T09:17:35.758 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi171/crash 2024-09-22T09:17:35.759 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T09:17:35.796 INFO:tasks.ceph:Compressing logs... 2024-09-22T09:17:35.796 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T09:17:35.802 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T09:17:35.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T09:17:35.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86870.log 2024-09-22T09:17:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113377.log 2024-09-22T09:17:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.86870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194702.log 2024-09-22T09:17:35.849 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86870.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65150.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.113377.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120447.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194702.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154610.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.65150.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.187926.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154610.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120447.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194287.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.187926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75602.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.187926.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194287.log.gz 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64661.log 2024-09-22T09:17:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.75602.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.154610.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178152.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.75602.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194333.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.64661.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.178152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194333.log: gzip -5 92.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.178152.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.40755.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194333.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174677.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190890.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122803.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56236.log 2024-09-22T09:17:35.851 INFO:teuthology.orchestra.run.smithi078.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.174677.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.190890.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122214.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.122803.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72022.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.56236.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170370.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159322.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122214.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.170370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136940.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.159322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177544.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.159322.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3%/var/log/ceph/ceph-client.admin.136940.log: -- replaced with /var/log/ceph/ceph-client.admin.72022.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177544.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.136940.log.gz 2024-09-22T09:17:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145775.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125749.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.145775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123981.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.145775.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.125749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151076.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.125749.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.123981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121036.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83925.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.177544.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.151076.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156966.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.170370.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121036.log: /var/log/ceph/ceph-client.admin.83925.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.121036.log.gz 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146953.log 2024-09-22T09:17:35.853 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.83925.log.gz 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172704.log 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156966.log.gz 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123981.log.gz 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51476.log 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.146953.log: /var/log/ceph/ceph-client.admin.172704.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146953.log.gz 2024-09-22T09:17:35.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32837.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32837.log.gz 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32617.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32617.log.gz 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32881.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T09:17:35.887 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32661.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32661.log.gz 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32749.log 2024-09-22T09:17:35.888 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32749.log.gz 2024-09-22T09:17:35.891 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T09:17:35.926 INFO:teuthology.orchestra.run.smithi171.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T09:17:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142241.log 2024-09-22T09:17:35.953 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172704.log.gz 2024-09-22T09:17:35.953 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167688.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.142241.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.193057.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106896.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.167688.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.193057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165284.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55647.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106896.log.gz 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.165284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162268.log 2024-09-22T09:17:35.954 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.165284.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95705.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.162268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85103.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.55647.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162268.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65022.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95705.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.85103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62198.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85103.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65022.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40068.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62198.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40068.log.gz 2024-09-22T09:17:35.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175285.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39885.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.133995.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.175285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115144.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175285.log.gz/var/log/ceph/ceph-client.admin.133995.log: 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139885.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133995.log.gz 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193873.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115144.log: /var/log/ceph/ceph-client.admin.139885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194838.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.115144.log.gz 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193873.log: 0.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139885.log.gz 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.193873.log.gz 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194471.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40344.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194838.log: gzip/var/log/ceph/ceph-client.admin.194471.log: -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.53856.log 2024-09-22T09:17:35.956 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194471.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194838.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40344.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102773.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159911.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53856.log: /var/log/ceph/ceph-client.admin.102773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105129.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53856.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.159911.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102773.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40711.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159911.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132817.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105129.log: /var/log/ceph/ceph-client.admin.40711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80980.log 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40711.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105129.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.132817.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132817.log.gz 2024-09-22T09:17:35.957 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99828.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103951.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.80980.log: /var/log/ceph/ceph-client.admin.99828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143419.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80980.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7%/var/log/ceph/ceph-client.admin.103951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107485.log 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103951.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99828.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71403.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.143419.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117501.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107485.log: /var/log/ceph/ceph-client.admin.71403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77966.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117501.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.107485.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117501.log.gz 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65684.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138118.log 2024-09-22T09:17:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65684.log: /var/log/ceph/ceph-client.admin.77966.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.77966.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.65684.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94527.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.71403.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42166.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94527.log: /var/log/ceph/ceph-client.admin.138118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193965.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0%/var/log/ceph/ceph-client.0.42166.log: -- replaced with /var/log/ceph/ceph-client.admin.94527.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138118.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.0.42166.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66449.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193965.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193965.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.194103.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65022.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184881.log 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194103.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194103.log.gz 2024-09-22T09:17:35.959 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.193827.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.184881.log: gzip -5 --verbose -- 80.0% -- replaced with /var/log/ceph/ceph-client.0.184881.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.166462.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193827.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190300.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0%/var/log/ceph/ceph-client.admin.39313.log: -- replaced with /var/log/ceph/ceph-client.admin.166462.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173312.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.admin.190300.log: --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.173312.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.190300.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181836.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173312.log.gz 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39310.log 2024-09-22T09:17:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz/var/log/ceph/ceph-client.0.181836.log: 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 83.8% -- replaced with /var/log/ceph/ceph-client.0.181836.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.0.44029.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39310.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142830.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.0.44029.log: --verbose -- /var/log/ceph/ceph-client.0.186099.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.44029.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44632.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142830.log.gz/var/log/ceph/ceph-client.0.186099.log: 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56825.log 84.0% -- replaced with /var/log/ceph/ceph-client.0.186099.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.44632.log: 43.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92760.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.0.44632.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91582.log 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92760.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.56825.log.gz 2024-09-22T09:17:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91582.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91582.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.78744.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 86.2% -- replaced with /var/log/ceph/ceph-client.admin.92760.log.gz 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.116322.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190912.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.78744.log: /var/log/ceph/ceph-client.admin.116322.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.78744.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88637.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.116322.log.gz 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99239.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190912.log.gz 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153432.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88637.log.gz 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.99239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72641.log 2024-09-22T09:17:35.962 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99239.log.gz/var/log/ceph/ceph-client.admin.153432.log: 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 86.7% -- replaced with /var/log/ceph/ceph-client.0.193057.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.153432.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39681.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173920.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39681.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39681.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.admin.173920.log: --verbose -- /var/log/ceph/ceph-client.admin.111021.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50839.log: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76784.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173920.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% 84.2% -- replaced with /var/log/ceph/ceph-client.admin.72641.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64298.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.76784.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146364.log 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111021.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.76784.log.gz 2024-09-22T09:17:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155788.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 59.1% -- replaced with /var/log/ceph/ceph-client.admin.64298.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.146364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.192364.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146364.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.155788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137529.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155788.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144597.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.192364.log: /var/log/ceph/ceph-client.admin.137529.log: gzip -5 80.6% -- replaced with /var/log/ceph/ceph-client.0.192364.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59794.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.66449.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.137529.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191620.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129283.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59794.log.gz 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47561.log 2024-09-22T09:17:35.964 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191620.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.129283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58003.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.144597.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.129283.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149898.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.47561.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178791.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.58003.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39315.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149898.log: /var/log/ceph/ceph-client.0.178791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116911.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.149898.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.0.178791.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58592.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39315.log.gz 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148131.log 2024-09-22T09:17:35.965 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.116911.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39678.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.58592.log.gz -5 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63400.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148131.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148131.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39678.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39678.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40414.log/var/log/ceph/ceph-client.admin.63400.log: 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.63400.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39306.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102184.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40414.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39306.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.39306.log.gz 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-22T09:17:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176501.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.102184.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38817.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194517.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2%/var/log/ceph/ceph-client.admin.38817.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.176501.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38817.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194517.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128105.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194517.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180618.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.128105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167075.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.180618.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.128105.log.gz -- 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.100417.log 2024-09-22T09:17:35.967 INFO:teuthology.orchestra.run.smithi078.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.180618.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152843.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167075.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155199.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100417.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.152843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55058.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.155199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59181.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.155199.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160500.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59181.log: gzip 84.1% -- replaced with /var/log/ceph/ceph-client.admin.55058.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67068.log 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.59181.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.160500.log: gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.152843.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- 80.7% -- replaced with /var/log/ceph/ceph-client.admin.160500.log.gz 2024-09-22T09:17:35.968 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.52065.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90404.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105718.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.67068.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose 85.3% -- /var/log/ceph/ceph-client.admin.64867.log -- replaced with /var/log/ceph/ceph-client.admin.52065.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90404.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90404.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139296.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105718.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64867.log: --verbose -- /var/log/ceph/ceph-client.admin.135173.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139296.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64867.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139296.log.gz 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.135173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162878.log 2024-09-22T09:17:35.969 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135173.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83336.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.162878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145186.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162878.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.83336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113966.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.145186.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.83336.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.193689.log 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145186.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45235.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0%/var/log/ceph/ceph-client.admin.193689.log: -- replaced with /var/log/ceph/ceph-client.admin.113966.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193689.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194609.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190960.log/var/log/ceph/ceph-client.0.45235.log: 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45235.log.gz 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75013.log 2024-09-22T09:17:35.970 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194609.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42775.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190960.log: /var/log/ceph/ceph-client.admin.75013.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.190960.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73925.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.75013.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.42775.log: 43.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112199.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.0.42775.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59770.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.73925.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.112199.log: /var/log/ceph/ceph-client.admin.119858.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59770.log: gzip -5 81.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.112199.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.39101.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59770.log.gz 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194057.log 2024-09-22T09:17:35.971 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119858.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86281.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194057.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.86281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194563.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.86281.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167051.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194563.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167051.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph-client.admin.53243.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.167051.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2024-09-22T09:17:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40843.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53243.log: /var/log/ceph/ceph-client.admin.48156.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53243.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39312.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2%/var/log/ceph/ceph-client.admin.40843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53832.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 0.0% 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40843.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96883.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39312.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53832.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87459.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.96883.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194149.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179400.log 2024-09-22T09:17:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.87459.log: /var/log/ceph/ceph-client.admin.194149.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87459.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114555.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194149.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.179400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70784.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114555.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.179400.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194241.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.114555.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158733.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194241.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194241.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.150487.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.158733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148720.log 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.158733.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150487.log: gzip -5 --verbose -- 81.4% -- replaced with /var/log/ceph/ceph-client.admin.150487.log.gz 2024-09-22T09:17:35.974 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.194195.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151665.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194195.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54469.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194195.log.gz 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189711.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54469.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.148720.log.gz 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.151665.log.gz 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.54469.log.gz 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39561.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.189711.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126338.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39561.log: gzip 82.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.189711.log.gz 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.158144.log 2024-09-22T09:17:35.975 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39561.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.126338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40619.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.158144.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.126338.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127516.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6%/var/log/ceph/ceph-client.admin.40619.log: -- replaced with /var/log/ceph/ceph-client.admin.158144.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59818.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40619.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81569.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.127516.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.127516.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.59818.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.81569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89815.log 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81569.log.gz/var/log/ceph/ceph-client.admin.39009.log: 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-09-22T09:17:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40799.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.89815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39305.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8%/var/log/ceph/ceph-client.admin.40799.log: -- replaced with /var/log/ceph/ceph-client.admin.89815.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62222.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40799.log.gz 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60407.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39305.log: /var/log/ceph/ceph-client.admin.62222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39305.log.gz 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 83.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.112788.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62222.log.gz 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52654.log/var/log/ceph/ceph-client.admin.60407.log: 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112788.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60407.log.gz 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191572.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112788.log.gz 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128694.log 2024-09-22T09:17:35.977 INFO:teuthology.orchestra.run.smithi078.stderr: 85.0%/var/log/ceph/ceph-client.admin.191572.log: -- replaced with /var/log/ceph/ceph-client.admin.52654.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73261.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191572.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.128694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108663.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128694.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73261.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108663.log: gzip -5 --verbose 81.8% -- /var/log/ceph/ceph-client.admin.39314.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108663.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.39314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39314.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147542.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79453.log 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.147542.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.147542.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 91.8% -- replaced with /var/log/ceph/ceph-client.admin.73261.log.gz 2024-09-22T09:17:35.978 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.191669.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.79453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126927.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.79453.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185490.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.191669.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.126927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109841.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.126927.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.185490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43420.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.185490.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109841.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109841.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45838.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.43420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163467.log 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.43420.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.45838.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45838.log.gz 2024-09-22T09:17:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50250.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.163467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191550.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6%/var/log/ceph/ceph-client.admin.50250.log: -- replaced with /var/log/ceph/ceph-client.admin.163467.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.50250.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89226.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175893.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.191550.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.89226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78135.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89226.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.175893.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175893.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.70784.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136351.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.78135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84514.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1%/var/log/ceph/ceph-client.admin.136351.log: -- replaced with /var/log/ceph/ceph-client.0.78135.log.gz 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181227.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2024-09-22T09:17:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.84514.log: /var/log/ceph/ceph-client.0.181227.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84514.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.181227.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40251.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.136351.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53880.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40353.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40251.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40251.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-osd.2.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40353.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90993.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130461.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38963.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90993.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.130461.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130461.log.gz 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152254.log 2024-09-22T09:17:35.981 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165260.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38963.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.152254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51428.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152254.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.165260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165260.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97472.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51428.log: -- /var/log/ceph/ceph-client.admin.67687.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51428.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.97472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40954.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67687.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97472.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.40954.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40954.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65088.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194794.log 2024-09-22T09:17:35.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65088.log: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.65088.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98061.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194794.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144008.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.98061.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.67687.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98061.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60996.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115733.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144008.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193781.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60996.log: /var/log/ceph/ceph-client.admin.115733.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60996.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165873.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8%/var/log/ceph/ceph-client.admin.193781.log: -- replaced with /var/log/ceph/ceph-client.admin.115733.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193781.log.gz 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140474.log 2024-09-22T09:17:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.165873.log: /var/log/ceph/ceph-mgr.y.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.165873.log.gz 2024-09-22T09:17:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2024-09-22T09:17:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140474.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140474.log.gz 2024-09-22T09:17:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88048.log 2024-09-22T09:17:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76194.log 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88048.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.88048.log.gz 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119268.log 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.76194.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76194.log.gz 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184272.log 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119268.log.gz 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124570.log 2024-09-22T09:17:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.184272.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.184272.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131639.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.124570.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.124570.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.131639.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131639.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104540.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154021.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104540.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.104540.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180009.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154021.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.154021.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132228.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.180009.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.180009.log.gz 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110430.log 2024-09-22T09:17:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.132228.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132228.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161089.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.110430.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.110430.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190936.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.161089.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.161089.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131050.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190936.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79506.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.131050.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.131050.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193919.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85692.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.79506.log: /var/log/ceph/ceph-client.admin.193919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193919.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191645.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.85692.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.85692.log.gz 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39683.log 2024-09-22T09:17:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191645.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98650.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39683.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40284.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.98650.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.79506.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98650.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40431.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40284.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156377.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161678.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156377.log: /var/log/ceph/ceph-client.admin.40431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40431.log.gz 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141652.log 2024-09-22T09:17:36.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.161678.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.161678.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164056.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.156377.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141652.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141652.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65748.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.164056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.164056.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165236.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38904.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.65748.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125160.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.165236.log: -- /var/log/ceph/ceph-client.admin.149309.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165236.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.125160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138707.log 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149309.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149309.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125160.log.gz 2024-09-22T09:17:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.138707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70165.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138707.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40106.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61585.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40106.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129872.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61585.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.61585.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70165.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39931.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118679.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.129872.log: /var/log/ceph/ceph-client.admin.39931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39931.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96294.log 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118679.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118679.log.gz 2024-09-22T09:17:36.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 85.9% -- replaced with /var/log/ceph/ceph-client.admin.129872.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.82158.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134584.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96294.log: /var/log/ceph/ceph-client.admin.82158.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.96294.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82158.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92171.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.134584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93349.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134584.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92171.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92171.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.41563.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93349.log: 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68307.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93349.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.41563.log: /var/log/ceph/ceph-client.admin.68307.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41563.log.gz 2024-09-22T09:17:36.023 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111610.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80115.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111610.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.111610.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167099.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.80115.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.80115.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.187317.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167099.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.167099.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39976.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.187317.log: 83.6% -- replaced with /var/log/ceph/ceph-client.0.187317.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.68307.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.183054.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101006.log 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39976.log: /var/log/ceph/ceph-client.0.183054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39976.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.183054.log.gz 2024-09-22T09:17:36.024 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93938.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69545.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.101006.log: /var/log/ceph/ceph-client.admin.93938.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93938.log.gz 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69545.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.101006.log.gz 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65860.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/rgw.ceph.client.0.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.69545.log.gz 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133406.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65860.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.65860.log.gz 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68926.log 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.133406.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.133406.log.gz 2024-09-22T09:17:36.025 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188535.log 2024-09-22T09:17:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68926.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.68926.log.gz 2024-09-22T09:17:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194379.log 2024-09-22T09:17:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.188535.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.188535.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121625.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194379.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101595.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121625.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.121625.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26674.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.101595.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101595.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183663.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.26674.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26674.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.183663.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.183663.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186708.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162289.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.186708.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.186708.log.gz 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157555.log 2024-09-22T09:17:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.162289.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.162289.log.gz 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39562.log 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.157555.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.157555.log.gz 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118090.log 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39562.log.gz 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62174.log 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118090.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118090.log.gz 2024-09-22T09:17:36.037 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170978.log 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62174.log.gz 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57414.log 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.170978.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170978.log.gz 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141063.log 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57414.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.57414.log.gz 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77375.log 2024-09-22T09:17:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141063.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141063.log.gz 2024-09-22T09:17:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64948.log 2024-09-22T09:17:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.77375.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.77375.log.gz 2024-09-22T09:17:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194656.log 2024-09-22T09:17:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64948.log.gz 2024-09-22T09:17:36.044 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95116.log 2024-09-22T09:17:36.044 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194656.log.gz 2024-09-22T09:17:36.044 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2024-09-22T09:17:36.045 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95116.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95116.log.gz 2024-09-22T09:17:36.045 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191596.log 2024-09-22T09:17:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2024-09-22T09:17:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82747.log 2024-09-22T09:17:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191596.log.gz 2024-09-22T09:17:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64551.log 2024-09-22T09:17:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.82747.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.82747.log.gz 2024-09-22T09:17:36.049 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38195.log 2024-09-22T09:17:36.050 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64551.log: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.64551.log.gz 2024-09-22T09:17:36.050 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62811.log 2024-09-22T09:17:36.050 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38195.log.gz 2024-09-22T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169721.log 2024-09-22T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62811.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.62811.log.gz 2024-09-22T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103362.log 2024-09-22T09:17:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.169721.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.169721.log.gz 2024-09-22T09:17:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106307.log 2024-09-22T09:17:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.103362.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103362.log.gz 2024-09-22T09:17:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T09:17:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106307.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106307.log.gz 2024-09-22T09:17:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108074.log 2024-09-22T09:17:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39930.log 2024-09-22T09:17:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108074.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.108074.log.gz 2024-09-22T09:17:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172096.log 2024-09-22T09:17:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39930.log.gz 2024-09-22T09:17:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109252.log 2024-09-22T09:17:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.172096.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.172096.log.gz 2024-09-22T09:17:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182445.log 2024-09-22T09:17:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109252.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.109252.log.gz 2024-09-22T09:17:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39563.log 2024-09-22T09:17:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.182445.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.182445.log.gz 2024-09-22T09:17:36.132 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193735.log 2024-09-22T09:17:36.132 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.39563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39563.log.gz 2024-09-22T09:17:36.143 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123392.log 2024-09-22T09:17:36.143 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193735.log.gz 2024-09-22T09:17:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194748.log 2024-09-22T09:17:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.123392.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123392.log.gz 2024-09-22T09:17:36.170 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194425.log 2024-09-22T09:17:36.171 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194748.log.gz 2024-09-22T09:17:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135762.log 2024-09-22T09:17:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194425.log.gz 2024-09-22T09:17:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194011.log 2024-09-22T09:17:36.192 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.135762.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135762.log.gz 2024-09-22T09:17:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168277.log 2024-09-22T09:17:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194011.log.gz 2024-09-22T09:17:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164645.log 2024-09-22T09:17:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168277.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.168277.log.gz 2024-09-22T09:17:36.227 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.164645.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.164645.log.gz 2024-09-22T09:17:36.526 INFO:teuthology.orchestra.run.smithi078.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-22T09:17:36.948 INFO:teuthology.orchestra.run.smithi171.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-22T09:17:37.104 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-22T09:17:38.864 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T09:17:40.299 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-22T09:17:46.252 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T09:17:46.382 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-22T09:17:46.464 INFO:teuthology.orchestra.run.smithi171.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-22T09:17:46.835 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T09:17:49.746 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T09:17:50.027 INFO:teuthology.orchestra.run.smithi171.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-22T09:17:56.997 INFO:teuthology.orchestra.run.smithi171.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-22T09:17:56.999 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-09-22T09:17:56.999 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m21.133s 2024-09-22T09:17:56.999 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m55.357s 2024-09-22T09:17:56.999 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m2.035s 2024-09-22T09:17:57.378 INFO:teuthology.orchestra.run.smithi078.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-22T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m21.551s 2024-09-22T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:user 1m3.463s 2024-09-22T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m2.542s 2024-09-22T09:17:57.380 INFO:tasks.ceph:Archiving logs... 2024-09-22T09:17:57.381 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi078/log 2024-09-22T09:17:57.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T09:18:05.616 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi171/log 2024-09-22T09:18:05.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T09:18:13.234 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T09:18:13.244 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T09:18:13.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T09:18:13.247 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T09:18:13.346 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T09:18:13.398 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T09:18:13.398 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T09:18:13.401 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T09:18:13.428 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-22T09:18:13.430 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-22T09:18:13.432 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T09:18:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-22T09:18:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +216us[ +221us] +/- 53ms 2024-09-22T09:18:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 -368us[ -363us] +/- 54ms 2024-09-22T09:18:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +253us[ +258us] +/- 84ms 2024-09-22T09:18:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +210us[ +211us] +/- 53ms 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -375us[ -374us] +/- 54ms 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +217us[ +218us] +/- 84ms 2024-09-22T09:18:13.435 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T09:18:13.436 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T09:18:13.445 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T09:18:13.445 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T09:18:13.454 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T09:18:13.556 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T09:18:13.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T09:18:13.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:18:13.672 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T09:18:13.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:18:13.714 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T09:18:13.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T09:18:13.747 INFO:teuthology.task.internal:Duration was 4078.476820 seconds 2024-09-22T09:18:13.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T09:18:13.758 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T09:18:13.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T09:18:13.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T09:18:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T09:18:13.813 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T09:18:14.161 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T09:18:14.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-22T09:18:14.162 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T09:18:14.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-09-22T09:18:14.195 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T09:18:14.244 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T09:18:14.244 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T09:18:14.246 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T09:18:14.286 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T09:18:14.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T09:18:14.327 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T09:18:14.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T09:18:14.462 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T09:18:14.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T09:18:14.501 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T09:18:14.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T09:18:14.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:18:14.552 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:18:14.586 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-22T09:18:14.615 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-09-22T09:18:14.631 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:18:14.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:18:14.668 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:18:14.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:18:14.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T09:18:14.710 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T09:18:14.710 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi078 2024-09-22T09:18:14.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T09:18:14.760 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915043/remote/smithi171 2024-09-22T09:18:14.760 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T09:18:14.805 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T09:18:14.805 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T09:18:14.808 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T09:18:14.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T09:18:14.881 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T09:18:14.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T09:18:14.892 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T09:18:14.892 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T09:18:14.894 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T09:18:14.920 INFO:teuthology.orchestra.run.smithi078.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 09:18 /home/ubuntu/cephtest 2024-09-22T09:18:14.938 INFO:teuthology.orchestra.run.smithi171.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 09:18 /home/ubuntu/cephtest 2024-09-22T09:18:14.939 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T09:18:14.951 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T09:18:14.976 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4078.476819753647 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-09-22T09:18:14.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T09:18:15.082 INFO:teuthology.run:pass